sabreW4K3@lazysoci.al to Tech@programming.dev · 3 months agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square9fedilinkarrow-up166arrow-down14cross-posted to: [email protected]
arrow-up162arrow-down1external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comsabreW4K3@lazysoci.al to Tech@programming.dev · 3 months agomessage-square9fedilinkcross-posted to: [email protected]
minus-squarexionzuilinkfedilinkarrow-up9·edit-23 months agoYou can get usable performance on a CPU with good memory bandwidth. Apple studios are the best way to get that right now, but a good Epyc with 256GB of RAM works too. Of course, you could also just run 5 GPUs
You can get usable performance on a CPU with good memory bandwidth. Apple studios are the best way to get that right now, but a good Epyc with 256GB of RAM works too.
Of course, you could also just run 5 GPUs