Surprised pikachu face

        • utopiah@lemmy.world
          link
          fedilink
          English
          arrow-up
          10
          ·
          3 months ago

          I like Ollama, and recommend it to tinker, but I admit this “LLM Explorer” is quite neat thanks to sections like “LLMs Fit 16GB VRAM”

          Ollama just works but it doesn’t help to pick which model best fits your needs.

          • Knock_Knock_Lemmy_In@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            3 months ago

            pick which model best fits your needs.

            What is the need I have to put the effort in to install all this locally. Websites win in terms of convenience.

            • utopiah@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              ·
              3 months ago

              I don’t think I understand your point, are you saying there is no benefit in running locally and that Websites or APIs are more convenient?

              • Knock_Knock_Lemmy_In@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                3 months ago

                I already have stable diffusion on a local machine. I was trying to find motivation to install a LLM locally. You answered my question in a different response

                use cases where customization helps while quality does matter much due to scale, i.e spam, then LLMs and related tools are amazing.

            • morriscox@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              ·
              3 months ago

              I want to work on my stuff in peace and in private without worrying about a company grabbing my stuff and using it for themselves and to give/sell it to other outfits, including the government. “If you have nothing to hide…” is bullshit and needs to die.

    • T156@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      1
      ·
      3 months ago

      At the same time, the trouble with local LLMs is that they’re very resource heavy. Your average household computer isn’t going to be able to run one with much usability or speed.

      • floquant@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        23
        arrow-down
        1
        ·
        3 months ago

        Which, you know, is fine. Maybe if people had an idea of how much power is required to run them, they would think twice before using a gigawatt to output a poem about farts, and perhaps even wonder how OpenAI can offer that for free. Btw, a 7b model should run ok on any PC with at least 16GB of RAM and a modern processor/GPU.

      • RmDebArc_5OP
        link
        fedilink
        English
        arrow-up
        3
        ·
        3 months ago

        Phi 3 can run on pretty low specs (requires 4gb RAM) and has relatively good output

      • TriflingToad@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 months ago

        it’s a lot slower that chatgpt but on my integrated graphics i7 laptop it ran decent, def enough to be useable. Also there’s different models to play around with, some are faster but worse and some are smarter but slower

    • finitebanjo@lemmy.world
      link
      fedilink
      English
      arrow-up
      16
      arrow-down
      23
      ·
      edit-2
      3 months ago

      Okay but what problem does that solve? Is the solution setting up our own spambots to fill forums with arguments counter to their bullshit spambots? I don’t see how an LLM improves literally anything ever in any circumstance.

      • trainsaresexy@lemmy.world
        link
        fedilink
        English
        arrow-up
        21
        arrow-down
        5
        ·
        3 months ago

        You seem unnecessarily hostile about this. If you don’t like LLM just move on.

        This is exactly why this sub about technology is better off without business news. You’re just reacting to something you hate and directing that at others.

        • finitebanjo@lemmy.world
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          4
          ·
          3 months ago

          But answer the question maybe

          Also, my “hate” was very clearly directed towards LLMs and not a “person”.

      • utopiah@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        edit-2
        3 months ago

        FWIW I did try a lot (LLMs, code, generative AI for images, 3D models) in a lot of ways (CLI, Web based, chat bot) both locally and using APIs.

        I don’t use any on a daily basis. I find it exciting that we can theoretically do a lot “more” automatically but… so far the results have not been worth the efforts. Sadly some of the best use cases are exactly what you highlighted, i.e low effort engagement for spam. Overall I find that either working with a professional (script writer, 3D modeler, dev, designer, etc) is a lot more rewarding but also more efficient which itself makes it cheaper.

        For use cases where customization helps while quality does matter much due to scale, i.e spam, then LLMs and related tools are amazing.

        PS: I’d love to hear the opinion of a spammer actually, maybe they also think it’s not that efficient either.

        • T156@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          3 months ago

          I have personally found generative-text LLMs quite good for creating titles. As an example, I have a few hundred tweets that I’m trying to put into a file, and I’ll use an LLM to create a human-readable name for them. It’s much better than a lot of the other summarisation mechanisms (like BERT) I’ve tried with it, but it’s still not perfect, because the model tends to output the same thing in slightly different words each time, so repeat runs will often result in the same thing with a different title.

          But, that is also a fairly limited use case.

        • finitebanjo@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          2
          ·
          edit-2
          3 months ago

          From all the studies available, LLMs increased the rate at which low skilled workers complete tasks. They also lower accuracy, so expect some of the tasks to be done incorrectly.

          If your metric for “improves” is being a better low skill drone forever then yes I’m sure it’s helping you. Here is a novel idea, maybe learn the language from a reliable source instead of taking the word of a bullshit generator at face value?

          • DavidDoesLemmy@lemmynsfw.com
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            3
            ·
            3 months ago

            Here’s an idea, maybe start with curiosity about how someone is getting value out of it? It’s possible you don’t know everything about other people’s experiences.

            • finitebanjo@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              2
              ·
              edit-2
              3 months ago

              It’s something being shoved down our throats every second of every day and I’ve seen enough to know I don’t like it. Curiosity was satiated a long ass time ago. It’s just a bigger power draw than Cryptocurrency but somehow magically even less value.

        • utopiah@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          2
          ·
          3 months ago

          improves my experience coding in unfamiliar languages

          Alan Perlis said “A programming language that doesn’t change the way you think is not worth learning.”

          So… if you code in another language without actually “getting it”, solely having a usable result, what is actually the point of changing languages?

          • DavidDoesLemmy@lemmynsfw.com
            link
            fedilink
            English
            arrow-up
            4
            ·
            3 months ago

            I have a job to do. And I understand the other language conceptually, I am just rusty on the syntax.

            Also the chat feature is invaluable. I can highlight a piece of code and ask what it does, and copilot explains it.

          • sugar_in_your_tea
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 months ago

            Exactly. I see AI as a tool to automate the boring parts, if you try to automate the hard parts, you’re going to have a bad time.

            Take the time to learn the tools you use thoroughly, and then you can turn to AI to make your use of those tools more efficient. If I’m learning woodworking, for example, I’m going to learn to use hand tools first before using power tools, but there’s no way I’m sticking to hand tools when producing a lot of things. Programming isn’t any different, I’ll learn the language and its idioms as deeply as I can, and only then will I turn to things like AI to spit out boilerplate to work from.

              • sugar_in_your_tea
                link
                fedilink
                English
                arrow-up
                1
                ·
                3 months ago

                I’m not sure how to succinctly do that.

                When I learn a new language, I:

                1. go through whatever tutorial is provided by the language developers - for Rust, that’s The Rust Programming Language, for Go, it’s Tour of Go and Effective Go
                2. build something - for Go, this was a website, and for Rust it was a Tauri app (basically a website); it should be substantial enough to exercise the things I would normally do with the language, but not so big that I won’t finish
                3. read through substantial portions of the standard library - if this is minimal (e.g. in Rust), read through some high profile projects
                4. repeat 2 & 3 until I feel confident I understand the idioms of the language

                I generally avoid setting up editor tooling until I’ve at least run through step 3, because things like code completion can distract from the learning process IMO.

                Some books I’ve really enjoyed (i.e. where 1 doesn’t exist):

                • The C Programming Language - by Brian Kernighan and Dennis Richie
                • Programming in Lua - by Roberto Ierusalimschy
                • Learn You a Haskell for Great Good - by Miran Lipovača (available free online)

                But regardless of the form it takes, I appreciate a really thorough introduction to the language, followed by some experimentation, and then topped off with some solid, practical code examples. I generally allow myself about 2 weeks before expecting to write anything resembling production code.

                These days, I feel confident in a dozen or so programming languages (I really like learning new languages), and I find that thoroughly learning each has made me a better programmer.

                • utopiah@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  3 months ago

                  Thanks for that, was quite interesting and I agree that completion too early (even… in general) can be distracting.

                  I did mean about AI though, how you manage to integrate it in your workflow to “automate the boring parts” as I’m curious which parts are “boring” for you and which tools you actual use, and how, to solve the problem. How in particular you are able to estimate if it can be automated with AI, how long it might take, how often you are correct about that bet, how you store and possibly share past attempts to automate, etc.

  • BZ 🇨🇦@lemm.ee
    link
    fedilink
    English
    arrow-up
    118
    arrow-down
    1
    ·
    3 months ago

    Almost like Sam Altman is just another run of the mill tech bro scam guy.

    • just_an_average_joe@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      18
      ·
      3 months ago

      I don’t think he is a “tech bro scam guy”, i think he is worse like he is smart and has a documented track record of lying. Unlike other tech bros, he actually knows the capability /limits of his products and he still lies and makes it out to be something it’s not.

  • Avid Amoeba@lemmy.ca
    link
    fedilink
    English
    arrow-up
    107
    arrow-down
    1
    ·
    edit-2
    3 months ago

    I hope OpenAI is going to serve as a radicalizing example to all the engineers, who fell for the “ethical guy/company” rhetoric, that the minority-controlled corporate structures they’re used to cannot withstand the push for profit. I hope this will make more of them choose majority-controlled structures for their startups and demand unions in existing corpos.

    • gravitas_deficiency
      link
      fedilink
      English
      arrow-up
      51
      ·
      3 months ago

      I mean, I was already radicalized in that respect, but it’s definitely reaffirming that radicalization.

      But also: I fuckin told you so. This progression was so blindingly obvious from the get-go.

      • CountVon
        link
        fedilink
        English
        arrow-up
        31
        ·
        3 months ago

        OpenAI on that enshittification speedrun any% no-glitch!

        Honestly though, they’re skipping right past the “be good to users to get them to lock in” step. They can’t even use the platform capitalism playbook because it costs too much to run AI platforms. Shit is egregiously expensive and doesn’t deliver sufficient return to justify the cost. At this point I’m ~80% certain that AI is going to be a dead tech fad by the end of this decade because the economics just don’t work now that the free money era has ended.

  • Jordan117@lemmy.world
    link
    fedilink
    English
    arrow-up
    76
    arrow-down
    1
    ·
    edit-2
    3 months ago

    The fact that Silicon Valley interests effortlessly shrugged off the non-profit board’s attempt to hit the kill switch last year, and now are preparing to take the company commercial despite the deliberate design otherwise, becomes much more interesting when you consider the theory that corporations are a form of artificial superintelligence.

    If the AI idealists can’t stand up to basic forces of capitalism, how do they expect to control an actually dangerous AGI?

    • finitebanjo@lemmy.world
      link
      fedilink
      English
      arrow-up
      31
      ·
      3 months ago

      You give them far too much credit to assume this specific company will ever achieve anything even close to AGI.

        • ShepherdPie@midwest.social
          link
          fedilink
          English
          arrow-up
          5
          ·
          3 months ago

          If they had something better, don’t you think they’d be putting it out front and center? This is akin to all those conspiracy theorists claiming they have proof to back their claims but they just can’t show it to you right now but it’s definitely coming at some indeterminate time in the future.

    • irreticent@lemmy.world
      link
      fedilink
      English
      arrow-up
      18
      ·
      3 months ago

      If the AI idealists can’t stand up to basic forces of capitalism, how do they expect to control an actually dangerous AGI?

      My guess is they don’t expect to. I guess that that is one of the reasons they seem to not care about out of control climate change; burn it all down before it all literally burns down.

      • Krauerking@lemy.lol
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        2
        ·
        3 months ago

        Yeah, the people leading the “AGI will save us” are the same as super church pastors.
        They don’t believe it, they just want their bank account limitless before they go into oblivion.

    • lemto@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      3 months ago

      I kinda liked the text you linked. Here’s a quote.

      There are also structural changes that can be made to corporations to realign their values system with human welfare. Corporate charters can be amended to optimize for a triple bottom line of social, environmental, and financial outcomes (the so-called “triple Ps” of people, planet, and profit.)

      This reminds me of what we are trying to do where I live. The hard thing is this requires a lot of work and it doesn’t just go against the corporate agenda; it goes against the normal lifestyle most everyone around us lives. It has made me want to quit sometimes.

      But then again, true life is in true living among real people and real things, not in daydreaming of better days.

  • DragonTypeWyvern@midwest.social
    link
    fedilink
    English
    arrow-up
    76
    arrow-down
    5
    ·
    3 months ago

    Hey, remember when you guys lined up to suck his dick when the board tried to keep OpenAI working for the good of humanity instead of the oligarchy?

      • s3p5r@lemm.ee
        link
        fedilink
        English
        arrow-up
        25
        arrow-down
        3
        ·
        3 months ago

        People have grown up reading comic books and watching movies about generous billionaire superhero saviors. They want to believe that exists because it’s what they’ve been taught justice looks like.

          • s3p5r@lemm.ee
            link
            fedilink
            English
            arrow-up
            3
            ·
            3 months ago

            I feel like Luthor was a better counterexample for this before the model for his billionaire redesign was elected President of the USA.

            Even so, Luthor hasn’t had quite the same volume of appearances as Iron Man, Batman, Captain America and the other rich superhero tropes.

          • DragonTypeWyvern@midwest.social
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            3 months ago

            And yet the problem was never that he was a billionaire, and Lexcorp was never portrayed as anything but an industrial powerhouse whose existence was ultimately good.

            • UnderpantsWeevil@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              edit-2
              3 months ago

              Lexcorp was never portrayed as anything but an industrial powerhouse whose existence was ultimately good.

              The largest international arms dealing firm that did Captain Planet Villain tier pollution, corruption, and financial scams was “ultimately good”?

              Didn’t Lexcorp literally clone an army of Doomsdays?

              • DragonTypeWyvern@midwest.social
                link
                fedilink
                English
                arrow-up
                2
                ·
                edit-2
                3 months ago

                Obviously it’s going to be the “villain” as Lex’s plaything but it’s also on that “job creator” cope.

                https://dc.fandom.com/wiki/LexCorp

                Employs literally 2/3 of Metropolis’s population lol. Lex even handed it over Superman at one point and made him the CEO because he was on a “Earth needs Superman” arc while obviously CEOs are the real heroes and such, and what are you going to do, Superman? Unemploy a supermajority of Metropolis? It NEEDS Lexcorp, etc etc.

                • UnderpantsWeevil@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  1
                  ·
                  3 months ago

                  “How will we get by without all our financialized monopolies?!”

                  Idk, bro. Just keep doing what you’re doing, minus the extraordinary rents to your bloated bourgeois landlords, maybe?

        • Alex@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          3 months ago

          They do exist they just prefer to be anonymous in their altruism so nobody hears about them.

            • morriscox@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              3 months ago

              Actually, this is part of Jewish society. Essentially, one is not supposed to do it for glory. I suspect that part of that is to avoid getting letters pleading for more money from those who they have helped or who knows that they helped someone. A lot of charities share/sell donor lists.

    • Wrufieotnak@feddit.org
      link
      fedilink
      English
      arrow-up
      31
      arrow-down
      1
      ·
      3 months ago

      Yeah, that was a strange moment. Those in the company being for Altman, I can understand. They expected big returns of investment from keeping him around. But the outsiders on the internet cheering him on? Felt like Elon Musk in the beginning again. And yes I also fell for his engineer persona in the beginning. But I learned from that.

        • Ragnarok314159@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          9
          ·
          edit-2
          3 months ago

          Musk the Fuck doesn’t even have an engineering degree and was never accepted into any PhD program. Lying piece of shit copies some code out of an early 80’s magazine and thinks he is a programmer and got his degree after a donation from daddy.

          I repeatedly see loser here, and other places online, defend his dipshit ass. People keep falling for rich tech bro bullshit and still do.

          • Ilandar@aussie.zone
            link
            fedilink
            English
            arrow-up
            6
            ·
            3 months ago

            I guess that’s just the reality of living in a world where money is equated with success and success is equated with talent.

      • jacksilver@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        3 months ago

        What was so obvious in that instance was the board members trying to push him out were calling out the lack of openness OpenAI was trending towards. They were literally calling him out for not upholding the vision of why the company was founded.

        All the engineers clearly saw their payday slipping away and revolted for that reason. Can’t say I blame them, but it was a scenario where the board was actually doing the right thing and everyone turned on them for profit.

    • UnderpantsWeevil@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      3 months ago

      I don’t remember this at all.

      AI has looked like a scam since the Metaverse days when Facebook realized it couldn’t push those shitty headsets on people and decided to pivot.

  • exanime@lemmy.world
    link
    fedilink
    English
    arrow-up
    58
    ·
    edit-2
    3 months ago

    … To the surprise of <checks notes> absolutely nobody

    Actually I have a question and I admit knowing nothing of the legal framework here but…

    Isn’t it absolutely ridiculous that a not-for-profit entity can exists solely for the purpose of developing a closed-source piece of software, demand to train it for free off copyrighted material, just to switch to a for-profit entity??

    Sound 100% like tax avoidance. Like me registering a charity so I can throw a mega concert/party privately, secure preferencial treatment on supplies, get discounts on artists or even free performance and then switch to for profit as I start selling tickets

    • jacksilver@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      1
      ·
      3 months ago

      Originally all their work was supposed to be published and shared with the world, hence the “open” in OpenAI. However somewhere along the way they made a for-profit break off of the original company and started pulling everything in that direction.

  • BilboBargains@lemmy.world
    link
    fedilink
    English
    arrow-up
    59
    arrow-down
    2
    ·
    3 months ago

    Step 1. Make an AI that hoovers up content.

    Step 2. When owners of content complain about privacy violations and copyright infringement, allay their fears. This AI is for the Good of Humanity.

    Step 3. ???

    Step 4. Profit.

    • ShepherdPie@midwest.social
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      2
      ·
      3 months ago

      Yet another example of doing crime at a big enough scale that you get rewarded for it. That’s what this country was built on.

  • Etterra@lemmy.world
    link
    fedilink
    English
    arrow-up
    57
    arrow-down
    1
    ·
    edit-2
    3 months ago

    OpenAI: It’s not fair to charge us to use copywriten works.

    Also OpenAI: Also you have to pay us for using them.

    • buttfarts@lemy.lol
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 months ago

      That’s why all human creative works done online need to be bean related. To fuck up the data stream and make it unintelligible for AIs and marketing algorithms.

  • webghost0101@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    37
    ·
    edit-2
    3 months ago

    How exactly does one “outgrow” “AGI for the benefit of all humanity?

    OpenAI Charter https://openai.com/charter

    Our primary fiduciary duty is to humanity. We anticipate needing to marshal substantial resources to fulfill our mission, but will always diligently act to minimize conflicts of interest among our employees and stakeholders that could compromise broad benefit.

  • socialmedia@lemmy.world
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    1
    ·
    3 months ago

    Just want to point out that it absolutely is possible to train an AI that will keep track of its sources for inspiration and can attribute those when it makes a response.

    Meaning creators could be compensated for their parts of AI generated stuff, if anyone wanted to.

    • blorp@feddit.uk
      link
      fedilink
      English
      arrow-up
      9
      ·
      3 months ago

      Doesn’t Phind do this already? I haven’t used it much but I remember it showing its sources for answers of code-related stuff

      • bluewing@lemm.ee
        link
        fedilink
        English
        arrow-up
        6
        ·
        3 months ago

        I use Phind solving computer problems. It does cite the sources it uses. At least for distro and general Linux issues. So far, it’s been a very good resource when I’ve needed it.

      • UnderpantsWeevil@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        4
        ·
        3 months ago

        The entire training set isn’t used in each permutation. Your keywords are building the samples based on metadata tags tied back to the original images.

        If you ask for “Iron Man in a cowboy hat”, the toolset will reach for some catalog of Iron Man images and some catalog of cowboy hat images and some catalog of person-in-cowboy-hat images, when looking for a basis of comparison as it renders the image.

        These would be the images attributed to the output.

        • Trantarius@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          2
          ·
          3 months ago

          Do you have a source for this? This sounds like fine-tuning a model, which doesn’t prevent data from the original training set from influencing the output. The method you described would only work if the AI is trained from scratch on only images of iron man and cowboy hats. And I don’t think that’s how any of these models work.

    • mm_maybe
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 months ago

      I think that there are some people working on this, and a few groups that have claimed to do it, but I’m not aware of any that actually meet the description you gave. Can you cite a paper or give a link of some sort?