Is there any computer program with AI capabilities (the generative ones seen in ChatGPT; onlineText-to-Picture generators, etc.) that is actually standalone? i.e. able to run in a fully offline environment.

As far as I understand, the most popular AI technology rn consists of a bunch of matrix algebra, convolutions and parallel processing of many low-precision floating-point numbers, which works because statistics and absurdly huge datasets. So if any such program existed, how would it even have a reasonable storage size if it needs the dataset?

  • @CaptDust
    link
    12 months ago

    Agreed, especially true with Llama3 their 7b model is extremely competitive.

    • FaceDeer
      link
      fedilink
      42 months ago

      Makes it all the more amusing how OpenAI staff were fretting about how GPT-2 was “too dangerous to release” back in the day. Nowadays that class of LLM is a mere toy.

      • Lung
        link
        fedilink
        22 months ago

        Whenever these corps talk up the danger of AI, all I think is “nice marketing dept bro”