• @[email protected]
    link
    fedilink
    English
    523 days ago

    that first L stands for large. sanitizing something of this size is not hard, it’s functionally impossible.

    • Ekky
      link
      fedilink
      English
      423 days ago

      You don’t have to sanitize the weights, you have to sanitize the data you use to get the weights. Two very different things, and while I agree that sanitizing a LLM after training is close to impossible, sanitizing the data you give it is much, much easier.