Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 11 months agoSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comexternal-linkmessage-square25fedilinkarrow-up1294arrow-down115
arrow-up1279arrow-down1external-linkSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 11 months agomessage-square25fedilink
minus-squareFlumpkin@slrpnk.netlinkfedilinkEnglisharrow-up1arrow-down1·11 months agoHow fast are they with a good GPU?
minus-squareDarkThoughts@fedia.iocakelinkfedilinkarrow-up1arrow-down1·edit-218 days agoRemoved by mod
minus-squareFlumpkin@slrpnk.netlinkfedilinkEnglisharrow-up1·11 months agoSorry, I’m just curious in general how fast these local LLMs are. Maybe someone else can give some rough info.
How fast are they with a good GPU?
Removed by mod
Sorry, I’m just curious in general how fast these local LLMs are. Maybe someone else can give some rough info.