Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 1 year agoSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comexternal-linkmessage-square25linkfedilinkarrow-up1294arrow-down115
arrow-up1279arrow-down1external-linkSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 1 year agomessage-square25linkfedilink
minus-squareFlumpkin@slrpnk.netlinkfedilinkEnglisharrow-up1arrow-down1·1 year agoHow fast are they with a good GPU?
minus-squareDarkThoughts@fedia.ioBannedlinkfedilinkarrow-up1arrow-down1·edit-26 months agoRemoved by mod
minus-squareFlumpkin@slrpnk.netlinkfedilinkEnglisharrow-up1·1 year agoSorry, I’m just curious in general how fast these local LLMs are. Maybe someone else can give some rough info.
Removed by mod
How fast are they with a good GPU?
Removed by mod
Sorry, I’m just curious in general how fast these local LLMs are. Maybe someone else can give some rough info.