Flying Squid@lemmy.world to Technology@lemmy.worldEnglish · 1 year agoYour AI Girlfriend Is a Data-Harvesting Horror Showgizmodo.comexternal-linkmessage-square88fedilinkarrow-up1494arrow-down113cross-posted to: [email protected]
arrow-up1481arrow-down1external-linkYour AI Girlfriend Is a Data-Harvesting Horror Showgizmodo.comFlying Squid@lemmy.world to Technology@lemmy.worldEnglish · 1 year agomessage-square88fedilinkcross-posted to: [email protected]
minus-squarePennomi@lemmy.worldlinkfedilinkEnglisharrow-up11·1 year agoPretty easy to roll your own with Kobold.cpp and various open model weights found on HuggingFace.
minus-squareTipRing@lemmy.worldlinkfedilinkEnglisharrow-up8·1 year agoAlso for an interface, I’d recommend KoboldLite for writing or assistant and SillyTavern for chat/RP.
minus-squareexu@feditown.comlinkfedilinkEnglisharrow-up4·1 year agoYou’ll want to use a quantised model on your GPU. You could also use the CPU and offload some parts to the GPU with llama.cpp (an option in oobabooga). Llama.cpp models are in the GGUF format.
Pretty easy to roll your own with Kobold.cpp and various open model weights found on HuggingFace.
Also for an interface, I’d recommend KoboldLite for writing or assistant and SillyTavern for chat/RP.
Removed by mod
You’ll want to use a quantised model on your GPU. You could also use the CPU and offload some parts to the GPU with llama.cpp (an option in oobabooga). Llama.cpp models are in the GGUF format.