• kromem@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    8 months ago

    it’s a tech product that runs a series of complicated loops against a large series of texts and returns the closest comparison, as it stands it’s never going to be dangerous in and of itself.

    That’s not how it works. I really don’t get what’s with people these days being so willing to be confidently incorrect. It’s like after the pandemic people just decided that if everyone else was spewing BS from their “gut feelings,” well gosh darnit they could too!

    It uses gradient descent on a large series of texts to build a neural network capable of predicting those texts as accurately as possible.

    How that network actually operates ends up a black box, especially for larger models.

    But research over the past year and a half in simpler toy models has found that there’s a rather extensive degree of abstraction. For example, a small GPT trained only on legal Othello or Chess moves ends up building a virtual representation of the board and tracks “my pieces” and “opponent pieces” on it, despite never being fed anything that directly describes the board or the concept of ‘mine’ vs ‘other’. In fact, in the Chess model, the research found there was even a single vector in the neural network that could be flipped to have the model play well or play like shit regardless of the surrounding moves fed in.

    It’s fairly different from what you seem to think it is. Though I suspect that’s not going to matter to you in the least, as I’ve come to find that explaining transformers to people spouting misinformation about them online has about the same result as a few years ago explaining vaccine research to people spouting misinformation about that.

    • funkless_eck
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      edit-2
      8 months ago

      I dont know if saying “it’s not a loop! it’s an iterative process using a series of steps!” is that much of a burn.

      my dude, that’s a loop.

      • Chakravanti
        link
        fedilink
        English
        arrow-up
        2
        ·
        8 months ago

        Well He That Remains came by just to show that everything we experience is always part of a bigger loop. You can fucking kill him and even slam the break; crash to his design of the the highest number of alternate dimensions and then some and it won’t stop the loop. 99.99% of the time he’ll be back. We only need to consciously accept the concept of no more than the notion to summon his return. Even if we were to successfully crack the time management mech and undo his manipulation, he’ll be back when we track him down to build another one.

        The Loop is more nature than matter to energy combined. When everything in all of reality would expand infinitely far apart, the whole shebang goes lateral mirror again with a whole new dimension. There is no end to any aspect of reality. Anywhere it would be, turns out it’s “just” “another” Loop Mirror.