@[email protected] to [email protected]English • 2 months agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square40fedilinkarrow-up1214arrow-down117cross-posted to: [email protected]
arrow-up1197arrow-down1external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.com@[email protected] to [email protected]English • 2 months agomessage-square40fedilinkcross-posted to: [email protected]
minus-square@[email protected]linkfedilinkEnglish16•2 months agoYo this is big. In both that it is momentous, and holy shit that’s a lot of parameters. How many GB is this model?? I’d be able to run it if I had an few extra $10k bills lying around to buy the required hardware.
minus-square@2001zhaozhaolinkEnglish1•2 months agoTime to buy a thread ripper and 800gb of ram so that I can run this model at 1 token per hour.
Yo this is big. In both that it is momentous, and holy shit that’s a lot of parameters. How many GB is this model?? I’d be able to run it if I had an few extra $10k bills lying around to buy the required hardware.
its around 800gb
God damn.
That’s some thick model
Time to buy a thread ripper and 800gb of ram so that I can run this model at 1 token per hour.