ThorrJo@lemmy.sdf.org to LocalLLaMAEnglish · 8 天前Microsoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUswww.tomshardware.comexternal-linkmessage-square10fedilinkarrow-up140arrow-down11
arrow-up139arrow-down1external-linkMicrosoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUswww.tomshardware.comThorrJo@lemmy.sdf.org to LocalLLaMAEnglish · 8 天前message-square10fedilink
minus-squareweker01linkfedilinkEnglisharrow-up2·6 天前For a second, I was thinking about why you need 300 instances of CAD software and if 128GB isn’t a bit too small for that ludicrous amount of computer aided design.
For a second, I was thinking about why you need 300 instances of CAD software and if 128GB isn’t a bit too small for that ludicrous amount of computer aided design.