I’m interested in really leveraging the full capabilities of local ai, for code generation and everything else. let me know what you people are using.

  • MacN'Cheezus@lemmy.today
    link
    fedilink
    English
    arrow-up
    2
    ·
    22 hours ago

    I like Witsy, as it offers a lot of system integration that isn’t possible with web apps, such as a quick prompt feature and the ability to select text in any app and have the AI act on it. Oh and it’s also FOSS.

  • xektop@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    22 hours ago

    Openwebui has a lot of functionality like custom plugins, filters, pipelines and whatnot.

    What are you looking to enhance and what do you feel like you are missing there?

    • 🍪CRUMBGRABBER🍪@lemm.eeOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      8 hours ago

      I used lm studio when it first came out for a little bit but then I got attracted to all the shiny objects of The AI companies that are making things a little more like an IDE but then if you’re going to go that route vs code with an extension just seems to be a natural better choice. anyway I’m happy with open web ui so far, it just isn’t intuitive the way that you can expand it. but I have to learn more about programming there’s just no excuse. The ability to add functions and have that based stuff like python code is there in open web ui.

  • 🍪CRUMBGRABBER🍪@lemm.eeOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    21 hours ago

    Good old vs code with llm extensions is pretty awesome. I am testing out roo code right now and there are a bunch of other promising ones.

  • 🍪CRUMBGRABBER🍪@lemm.eeOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    21 hours ago

    I’m just coming to grips with MCP and N8N, which along with things like zapier, make.com and activepieces allow llms to reach into the real world. Openwebui looks like you can add some of these functionalities if you can program a little bit. But the idea is to integrate llms into a workflow so that we can create the idea and then have a lot of things actually executed. Right now i am spending a lot of time in a chat window and then moving around copying, pasting, saving, reformatting.

  • Russ@bitforged.space
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 day ago

    LLM Studio is pretty popular, and as for code generation I know IntelliJ (so I would guess all JetBrains IDEs) has support for it with their AI tooling that’s built in now. I assume there’s a similar VS Code plug-in as well if that’s your editor of choice.