EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S
Some people are energised by that kind of thing. However if you don’t want to reveal things to humans, you can use (if you are more technical) llama.cpp
EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S
Some people are energised by that kind of thing. However if you don’t want to reveal things to humans, you can use (if you are more technical) llama.cpp
Thanks for the links. So I don’t need to worry about downloading the model from meta eh?
Edit: oh you mean download this one instead?
I tried and the app crashes after submitting a prompt but this is a good starting point. I’ll take a look into it further later.