• DumbAceDragon
    link
    fedilink
    English
    arrow-up
    46
    ·
    edit-2
    5 months ago

    What these people don’t realize is you’re never gonna get AGI by just feeding a machine an infinite amount of raw data.

      • David Gerard@awful.systemsM
        link
        fedilink
        English
        arrow-up
        25
        ·
        5 months ago

        There might actually be nothing bad about the Torment Nexus, and the classic sci-fi novel “Don’t Create The Torment Nexus” was nonsense. We shouldn’t be making policy decisions based off of that.

        wild

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        20
        ·
        5 months ago

        Yes, we know (there are papers about it) that for LLMs every increase of capabilities we need exponentially more data to train it. But don’t worry, we only consumed half the worlds data to train LLMs, still a lot of places to go ;).

        • FaceDeer@fedia.io
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          5 months ago

          That doesn’t appear to actually be the case, though. LLMs have been improving greatly through the use of a smaller amount of higher-quality data, some of it synthetic data that’s been generated in part by other LLMs. Turns out simply dumping giant piles of random nonsense from the Internet on a neural net doesn’t produce the best results. Do you have references to any of those papers you mention?

          Necro-edit: NVIDIA just released an LLM that’s specifically designed to generate training data for other LLMs, as a concrete example of what I’m talking about.

    • Naz
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      21
      ·
      5 months ago

      Interesting. I recall a phenomenon by which inorganic matter was given a series of criterion and it adapted based on changes from said environment, eventually forming data which it then learned from over a period of millions of years.

      It then used that information to build the world wide web in the lifetime of a single organism and cast doubt on others trying to emulate it.

      But I see your point.

        • swlabr@awful.systems
          link
          fedilink
          English
          arrow-up
          30
          ·
          5 months ago

          Not me dawg, I am highly non linear (pls donate to my gofundme for spinal correction)

          • zbyte64@awful.systems
            link
            fedilink
            English
            arrow-up
            15
            ·
            edit-2
            5 months ago

            My dog does linear algebra everytime he pees on a fire hydrant so that he only pees for the exact amount of time needed. Similarly, when I drain my bath tub, it acts as a linear algebra machine that calculates how long it takes for the water to drain through a small hole.

            Is this a fun way to look at the world that allows us to more readily build computational devices from our environment? Definitely. Is it useful for determining what is intelligence? Not at all.

              • froztbyte@awful.systems
                link
                fedilink
                English
                arrow-up
                12
                ·
                5 months ago

                Where the fuck was the insult? Wild

                You’re the one making incoherent illogical driveby comments, clown

              • Soyweiser@awful.systems
                link
                fedilink
                English
                arrow-up
                10
                ·
                edit-2
                5 months ago

                Yes, and that was a stupid argument unrelated to the point made that evolution used this raw data to do things, thus raw data in LLMs will lead to AGI. You just wanted debate points for ‘see somewhere there is data in the process of things being alive’. Which is dumb gotcha logic which drags all of us down and makes it harder to have normal conversations about things. My reply was an attempt to make you see this and hope you would do better.

                I didn’t call you stupid, I called the argument stupid, but if the shoe fits.

                E: the argument from the person before you ‘evolution was created us with a lot of data and then we created the internet’ is also silly of course, as if you just go ‘well raw data created evolution’ then no matter how we would get AGI (say it is build out of post quantum computers in 2376) this line of reasoning would say it comes from raw data, so the whole conversation devolves into saying nothing.

                • froztbyte@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  11
                  ·
                  5 months ago

                  No no see, since everything is information this argument totally holds up. That one would need to categorize and order it for it to be data is such a silly notion, utterly ridiculous and unnecessary! Just throw some information in the pool and stir, it’ll evolve soon enough!

                  • mountainriver@awful.systems
                    link
                    fedilink
                    English
                    arrow-up
                    7
                    ·
                    5 months ago

                    The number of rocks in my garden is information. Yet, despite counting them all, I have not found AGI. So I must need more information than that.

                    Clearly, counting all the rocks in Wales should do it. So much counting.

          • Clent@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            5 months ago

            The sensory inputs are a continuous stream of environmental data.