I’m sure there’s an instance for that
I’m sure there’s an instance for that
It makes every comment like yours all the more valuable :)
Wow oil and now this. Good for Norway
Yea it’s called Text Generation web UI. If you check out the Ooba Booga git, it goes into good details. From what I can tell it’s based on the automatic1111 UI for stable diffusion.
GPTQ-for-llama with ooba booga works pretty well. I’m not sure to what extent it uses CPU, but my GPU is at 100% during inference so it seems to be mainly that.
Someone said you can format links so that login is not required to subscribe. I still don’t totally understand how all this works. The example they gave was /c/[email protected]
Ha, where do you find such talents⸮