• conciselyverbose
    link
    fedilink
    arrow-up
    6
    arrow-down
    4
    ·
    4 months ago

    LLMs are absolutely not in their infancy.

    They’re already many orders of magnitude past diminishing returns and don’t scale up for shit.

    • vrighter@discuss.tchncs.de
      link
      fedilink
      arrow-up
      4
      arrow-down
      3
      ·
      4 months ago

      there is literally a loaded die at the end of all generators. It is not part of the llm. It comes later down the pipeline. So not only diminishing returns, but the hallucinations are literally impossible to fix