Is there any pre-trained RETRO model released yet?

[paraschopra]

I don't have resources to train a large model myself, but I'm wondering if anyone has used this repo to release a model that I can play with.

Thanks!

[mtkociuba]

+1

[loretoparisi]

+1 for pre-trained model, even if I assume this is something it should be done by the community
#14

[paraschopra]

@lucidrains if there's a pretrained model (even the encoder part), please let us know?

[Ag2S1]

@lucidrains if there's a pretrained model (even the encoder part), please let us know?

My team is trying to do this, so if you are interested, check out this project : https://github.com/Langboat/mengzi-retrieval-lm