Coffeezilla asks: “Is the LAM a Scam? Down the rabbit hole we go.”

  • gh0stcassette@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    33
    ·
    7 months ago

    This is because dedicated consumer AI hardware is a dumb idea. If it’s powerful enough to run a model locally, you should be able to use it for other things (like, say, as a phone or PC) and if it’s sending all its API requests to the cloud, then it has no business being anything but a smartphone app or website.

    • KairuByte@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      4
      ·
      7 months ago

      I can’t agree with that. ASICs can specialize to do one thing at lightning speeds, and fail to do even the most basic of anything else. It’s like claiming your GPU is super powerful so it should be able to run your PC without a CPU.

      • gh0stcassette@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        7 months ago

        That’s fair, dedicated ASICs for AI acceleration are totally a valid consumer product, but I meant more along the lines of independent devices (like Rabbit R1 and the AI Pin), not components you can add to an existing device. I should have been more clear.