New models posted by TheBloke, 7B to 65B, something for everyone!
Info from creators:
A stunning arrival! The fully upgraded Robin Series V2 language model is ready and eagerly awaiting your exploration.
This is not just a model upgrade, but the crystallization of wisdom from our research and development team. In the new version, Robin Series V2 has performed excellently among various open-source models, defeating well-known models such as Falcon, LLaMA, StableLM, RedPajama, MPT.
Specifically, we have carried out in-depth fine-tuning based on the entire LLaMA series, including 7b, 13b, 33b, 65b, all of which have achieved pleasing results. Robin-7b scored 51.7 in the OpenLLM standard test, and Robin-13b even reached as high as 59.1, ranking sixth, surpassing many 33b models. The achievements of Robin-33b and Robin-65b are even more surprising, with scores of 64.1 and 65.2 respectively, firmly securing the top positions.
This is not just a model upgrade, but the crystallization of wisdom from our research and development team.
So much marketing and no basic information like what dataset was used.
Lmao right? Wish the devs provided way more info… I feel like things are just moving too fast for any documentation (which is equal parts sad and scary)
More information here: https://github.com/OptimalScale/LMFlow