Just wondering if anyone has any suggestions to keep things moving and growing, was thinking of doing a daily quantized models post just for keeping up with the bloke, thoughts?

  • rufus@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    1 year ago

    Please don’t make this a place that is just spammed by automatic re-posts of something inconsequential. If i want to know what TheBloke recently published, I can simply go to huggingface and have a look myself. That way i can even filter by ggml/gptq llama1 or 2 and if I’m even interested at all.

    That said, if you found a (new) model you like and you have any additional information or your story to offer… Please go ahead. That’s someting i very much like to read.

    I personally like to read / discuss:

    • Groundbreaking AI news
    • Questions from intermediate/pro users (not things you can simply look up in the README file)
    • Personal experience / lessons learned by other people
    • Other people’s use cases for the Llama. Your perspectives on LLMs.
    • Prompt engineering (especially that. 95% of information on the internet is about ChatGPT. We need info for Llama)
    • Current issues / technical problems and brand new features of frequently used software like Oobabooga’s or SillyTavern / whatever
    • free software projects that do different things than the usual roleplaying chatbot
    • Tools and software i don’t know yet.
    • Developer talk: Experience with frameworks like langchain / ms guidance / LMQL
    • Language Processing (NLP) tasks like sentiment analysis, extraction of whatever to make information usable for a ‘normal’ computer program, summarization, translation, document analysis and things like that, done with free and open tools
    • Role play / text adventures / fantasy and/or ERP
    • Storytelling tips and tricks
    • AI in game development
    • Philosophical questions, politics, the future of/with AI, the singularity and/or your personal opinion about the upcoming robot apocalypse
    • Benchmarks / word of mouth about which models excel at which tasks

    Maybe guides / tutorials / a wiki or megathread with useful information.

    For me, Lemmy is kind of a mix between several things. I like the link-aggregator aspect and like to read news, have blog posts recommended to me. And I (even more) like the forum aspect. Discussing/debating things in the comments and have a community to talk about nerdy stuff. The second thing is why I’m here.

    And of course related to LocalLLaMA. As i understand we’re mainly discussing DIY things here, not just what OpenAI offers.

    • noneabove1182OPM
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      I don’t think there’s harm in a sticky that contains the latest model releases, I agree that it shouldn’t devolve into spamming automated posts, maybe weekly is more appropriate or every X days

      I agree overall with your list, the question is just about how do we foster that, and I’m wondering if discussion threads will be a good middle ground until we have a reasonable flow of new posts

      Either way I want to keep an eye on it and find a way to help the community grow organically

      • rufus@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        1 year ago

        maybe weekly is more appropriate

        Well, a summary of recent news / developments is always useful. What about something like aicg on 4chan or just a few lines like ggerganov does with the “Hot topics” on llama.cpp’s github page? Of course there’s also hundreds of other wikis and maintained pages on rentry.org I’ll let someone else suggest a useful format for that.

        find a way to help the community grow organically

        I don’t know how this community came into existence. I believe we’re currently mostly expats from r/LocalLlama?? I don’t know if people over there know there is this alternative community? Also there is [email protected] which might have substantial overlap with us.

        Edit: I hope i don’t sound too negative here. I think you/we should just try a few things and see what’s good for this community. Maybe have a semi-regular feedback poll or a stickied (monthly) post so people can complain. At this point I’m not sure what’s best. If it’s too many automated news posts with zero interaction, i can also complain after the fact.

        And I appreciate what you’re doing here.

        • noneabove1182OPM
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          Yeah no for sure didn’t sound too negative, your concerns are definitely valid

          As for whether people on Reddit know about this one, it’s likely several don’t cut also not sure how well the mods there would take to advertising an alternative, probably best bet is to have some high value posts here that get posted on Reddit for awareness and maybe some people will feel like joining :D