Thx in advice.

  • kata1yst
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    5 months ago

    KobaldCPP or LocalAI will probably be the easiest way out of the box that has both image generation and LLMs.

    I personally use vllm and HuggingChat, mostly because of vllm’s efficiency and speed increase.