I think AI is neat.

  • Kecessa
    link
    fedilink
    arrow-up
    3
    ·
    11 months ago

    How come all LLMs keep inventing facts and telling false information then?

    • Meowoem
      link
      fedilink
      arrow-up
      1
      arrow-down
      1
      ·
      11 months ago

      People do that too, actually we do it a lot more than we realise. Studies of memory for example have shown we create details that we expect to be there to fill in blanks and that we convince ourselves we remember them even when presented with evidence that refutes it.

      A lot of the newer implementations use more complex methods of fact verification, it’s not easy to explain but essentially it comes down to the weight you give different layers. GPT 5 is already training and likely to be out around October but even before that we’re seeing pipelines using LLM to code task based processes - an LLM is bad at chess but could easily install stockfish in a VM and beat you every time.