• mindbleach
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 months ago

        Jevon’s paradox says that efficiency will increase use. Microsoft is buying a nuclear power plant for AI shit. If they can train a trillion-parameter model for one-thousandth the cost… they will instead train a quadrillion-parameter model.

        Or I guess if they’re smart they’ll train a trillion-parameter model longer. Or iterate like crazy, when training takes hours instead of months.

      • Saleh@feddit.org
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 months ago

        So will the return of the flag conclude the adventures of ressource usage in computers?

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      5 months ago

      What star said, but what it also does is turn hard matrix multiplication into simple addition.

      Basically, AI will be hilariously easy to run compared to now once ASICs start coming out, thought it will run on CPUs/GPUs just fine.