• FractalsInfinite
    link
    fedilink
    arrow-up
    3
    ·
    edit-2
    9 months ago

    EDIT: It seems the app sherpa has what you need. Just use one of the models found here, preferably 7b-chat Q4_K_S

    Some people are energised by that kind of thing. However if you don’t want to reveal things to humans, you can use (if you are more technical) llama.cpp

    • can
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      9 months ago

      Thanks for the links. So I don’t need to worry about downloading the model from meta eh?

      Edit: oh you mean download this one instead?

      I tried and the app crashes after submitting a prompt but this is a good starting point. I’ll take a look into it further later.