• PsychedSy
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    Are the cards really powerful enough for so much fuss?

    • Socsa
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      1 year ago

      Definitely. An A100 system is around $10k which is expensive, but definitely in reach, and you need two of them to run a 70B parameter model. Possibly one if you are clever about it.

      And you can still do plenty of damage with a $1000 consumer grade GPU. Most deepfake videos are trained on these platforms.