🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.ee to LocalLLaMAEnglish · 1 day agoHow much gpu do i need to run a 90b modelmessage-squaremessage-square14fedilinkarrow-up112arrow-down11file-text
arrow-up111arrow-down1message-squareHow much gpu do i need to run a 90b model🇦🇺𝕄𝕦𝕟𝕥𝕖𝕕𝕔𝕣𝕠𝕔𝕕𝕚𝕝𝕖@lemm.ee to LocalLLaMAEnglish · 1 day agomessage-square14fedilinkfile-text
minus-squareGladaed@feddit.orglinkfedilinkEnglisharrow-up2·1 day agoRound about that much vram. I.e. 90 GB
Round about that much vram. I.e. 90 GB