• abruptly8951@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    4
    ·
    7 months ago

    It’s definitely not indexed, we use RAG architectures to add indexing to data stores that we want the model to have direct access to, the relevant information is injected directly in the context (prompt). This can somewhat be equated to short term memory

    The rest of the information is approximated in the weights of the neural network which gives the model general knowledge and intuition…akin to long term memory

    • self@awful.systems
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      2
      ·
      7 months ago

      or it can be equated to a shitty database and lossy compression (with artifacts in the form of “hallucinations”), but that doesn’t make the tech sound particularly smart, does it?

      but half the posts in your history are in this thread and that’s too many already

      • Deceptichum
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        7 months ago

        They 11 posts in total and 2 are in this thread. 2 is not half of 11.

        How bad is your maths?

    • Deceptichum
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      9
      ·
      7 months ago

      People have such crazy misconceptions about AI. Glad to see someone else knows how it works at least.

        • froztbyte@awful.systems
          link
          fedilink
          English
          arrow-up
          10
          arrow-down
          2
          ·
          7 months ago

          awww, I just got another bowl of popcorn!

          but rofl holy shit at “glad to see someone else knows how they work” given the … depth of understanding, shall we say? that was demonstrated in this thread

        • Deceptichum
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          7 months ago

          No you fuck off mate. You’re in here peddling misinformation like your name was ChatGPT.