Is there any computer program with AI capabilities (the generative ones seen in ChatGPT; onlineText-to-Picture generators, etc.) that is actually standalone? i.e. able to run in a fully offline environment.

As far as I understand, the most popular AI technology rn consists of a bunch of matrix algebra, convolutions and parallel processing of many low-precision floating-point numbers, which works because statistics and absurdly huge datasets. So if any such program existed, how would it even have a reasonable storage size if it needs the dataset?

  • CaptDust
    link
    fedilink
    arrow-up
    1
    ·
    4 months ago

    Agreed, especially true with Llama3 their 7b model is extremely competitive.

    • FaceDeer@fedia.io
      link
      fedilink
      arrow-up
      4
      ·
      4 months ago

      Makes it all the more amusing how OpenAI staff were fretting about how GPT-2 was “too dangerous to release” back in the day. Nowadays that class of LLM is a mere toy.