A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

  • Treczoks@lemm.ee
    link
    fedilink
    arrow-up
    25
    arrow-down
    3
    ·
    11 months ago

    The problem is how to actually prevent this. What could one do? Make AI systems illegal? Make graphics tools illegal? Make the Internet illegal? Make computers illegal?

      • Treczoks@lemm.ee
        link
        fedilink
        arrow-up
        18
        arrow-down
        3
        ·
        11 months ago

        Isn’t it already? Has it provided any sort of protection? Many things in this world are illegal, and nobody cares.

        • Jimmyeatsausage@lemmy.world
          link
          fedilink
          arrow-up
          9
          arrow-down
          8
          ·
          11 months ago

          Yes, I would argue that if CSAM was legal, there would be more of it…meaning it being illegal provides a level of protection.

          • yamanii@lemmy.world
            link
            fedilink
            arrow-up
            6
            arrow-down
            2
            ·
            11 months ago

            I wonder why are you being downvoted, something being illegal puts fear in most people to not do it.

            • 31337
              link
              fedilink
              arrow-up
              1
              ·
              11 months ago

              I’ve been wondering about this lately, but I’m not sure how much of an effect this has. There are millions of people in prison, and many of those will go on to offend again. Making things illegal can be seen as an agreement to a social contract (in a democracy), drive the activity underground (probably good thing in many cases), and prevent businesses (legal entities) from engaging in the activity; but I’m not sure how well it works on an individual level of deterrence. Like, if there were no laws, I can not really think of a law I would break that I wouldn’t already break regardless. I guess I’d just be more open about it.

              Though, people who cause harm to others should be removed from society, and ideally, quickly rehabilitated, and released back into society as a productive member.

      • CAVOK@lemmy.world
        link
        fedilink
        arrow-up
        10
        arrow-down
        3
        ·
        edit-2
        11 months ago

        It is where I’m at. Draw Lisa Simpson nude and you get a visit from the law. Dunno what the punishment is though. A fine? Jail? Can’t say.

        Edit: Apparently I was wrong, it has to be a realistic drawing. See here: 2010/0064/COD doc.nr 10335/1/10 REV 1

        • Rodeo@lemmy.ca
          link
          fedilink
          arrow-up
          8
          arrow-down
          5
          ·
          11 months ago

          What about making depictions of other crimes? Should depictions of theft be illegal? Depictions of murder?

          Why should depictions of one crime be made illegal, but depictions of other heinous crimes remain legal?

          • Jimmyeatsausage@lemmy.world
            link
            fedilink
            arrow-up
            9
            arrow-down
            4
            ·
            11 months ago

            Because a picture of someone robbing my house doesn’t revictimize me. Even if it’s simulated, every time they run into some rando who recognizes them or every time a potential employer runs a background/social media check, it impacts the victim again

            • Fal@yiffit.net
              link
              fedilink
              English
              arrow-up
              11
              arrow-down
              5
              ·
              11 months ago

              A picture of a cartoon child having sex doesn’t victimize you either, the same way a drawing of a robbery doesn’t victimize you

              • Ataraxia
                link
                fedilink
                arrow-up
                4
                arrow-down
                4
                ·
                11 months ago

                You mean being raped. What it does is let pedos feel like it’s OK to be pedos.

                • Fal@yiffit.net
                  link
                  fedilink
                  English
                  arrow-up
                  7
                  arrow-down
                  2
                  ·
                  11 months ago

                  Lol just like violent video games makes people think it’s ok to be violent in real life?

            • Rodeo@lemmy.ca
              link
              fedilink
              arrow-up
              4
              arrow-down
              3
              ·
              edit-2
              11 months ago

              Who is being victimized with a drawing of Lisa Simpson?

      • Llewellyn@lemm.ee
        link
        fedilink
        arrow-up
        8
        arrow-down
        1
        ·
        11 months ago

        Severity of punishment works poorly. Inevitability, on the other hand…

        • ParsnipWitch@feddit.de
          link
          fedilink
          arrow-up
          3
          ·
          11 months ago

          I think in this case less mild punishment would send the appropriate signal that this isn’t just a little joke or a small misdemeanor.

          There are still way too many people who believe sexual harassment etc. aren’t that huge of a deal. And I believe the fact that perpetrators so easily get away with it plays into this.

          (I am not sure how it is in the US, in my country the consequence of crimes against bodily autonomy are laughable.)

    • afraid_of_zombies@lemmy.world
      link
      fedilink
      arrow-up
      11
      arrow-down
      13
      ·
      11 months ago

      Require consent to take a person’s picture and hold them liable for whatever comes from them putting it on a computer.

      • jimbo@lemmy.world
        link
        fedilink
        arrow-up
        7
        arrow-down
        3
        ·
        11 months ago

        That’s a whole fucking can of worms we don’t need to open. Just make faking porn a crime similar to publishing revenge porn.

        • afraid_of_zombies@lemmy.world
          link
          fedilink
          arrow-up
          4
          arrow-down
          1
          ·
          11 months ago

          Nah. Use my image and pay me what I want. If I can’t make a Mickey Mouse movie they shouldn’t be able to make a porn staring me. Does a corporatation have more rights to an image than I have to my image?

          • jimbo@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            edit-2
            11 months ago

            That really depends on what you consider “using my image”. Are you going to demand that people pay you because you were wandering around in the background of their family photo or their YouTube video? Will you ask to be compensated when people post group photos that include you on their social media? Does mom owe you money for all those pictures she took of you as a kid?

      • Treczoks@lemm.ee
        link
        fedilink
        arrow-up
        8
        arrow-down
        21
        ·
        11 months ago

        You already need consent to take a persons picture. Did it help in this case? I don’t think so.

          • JonEFive@midwest.social
            link
            fedilink
            arrow-up
            13
            arrow-down
            2
            ·
            11 months ago

            *in the US.

            In the US, the thought is that if you are in a public place, you have no presumption of privacy. If you’re walking down the street, or shopping in a grocery store or whatever else, anyone can snap a picture of you.

            Other countries have different values and laws such that you may need a person’s permission to photograph them even if they are in a public place.

            • afraid_of_zombies@lemmy.world
              link
              fedilink
              arrow-up
              1
              arrow-down
              2
              ·
              11 months ago

              That thought is a pile of bull crap. If you really think you have zero presumption of privacy then I have the right to follow right behind you with a sign that says “idiot ahead”. Laws like this are so written for the drug war and for big media not for us.

              • JonEFive@midwest.social
                link
                fedilink
                arrow-up
                3
                ·
                11 months ago

                Not saying I agree with it, that’s just the way the laws are written.

                A good example of how crappy this law works out is paparazzi. They harass celebrities just to get any halfway decent photo. Then they can sell the photo, the celebrity has no say in the matter. And to make things even worse, if the celebrity happens to use the photo of themselves in any way, the photographer can demand payment because they own the copyright.

                  • JonEFive@midwest.social
                    link
                    fedilink
                    arrow-up
                    1
                    ·
                    11 months ago

                    That much I can agree with. If someone takes a picture of me, I should have some say in how that image is used, even if the default assumption is that a person in public is plainly visible to everyone including photographers.

                    But there’s a lot of nuance here. Maybe a celebrity, or any person really, doesn’t want an unflattering image used. Fair enough I suppose, but to what extent is that actually enforceable?

                    Or maybe the subject wants to use the image of themselves for their own purposes. Does the photographer deserve compensation for their role in creating the image?

                    What about unflattering images of politicians or government employees? What about criminals? There’s a line to be walked here as well. We already have this sort of concept in slander laws. Public figures have a higher bar to prove damages resulting from statements that might otherwise be considered slanderous or libelous. There are also free speech and freedom of the press issues associated with government entities.

                    Yes, you should have a right to decide how your image is used, and yes, you should probably have some shared ownership of images of yourself unless you agree otherwise. But the reality isn’t so clear cut.

                    Admittedly, I haven’t looked into how other parts of the world that don’t default to lack of privacy in public handle this. Some of these questions must have already been hashed out.

          • Treczoks@lemm.ee
            link
            fedilink
            arrow-up
            5
            arrow-down
            4
            ·
            11 months ago

            Sorry, I forgot that the US is decades behind the rest of the world in privacy laws.

            Well, maybe you could start with this aspect.

        • afraid_of_zombies@lemmy.world
          link
          fedilink
          arrow-up
          5
          arrow-down
          9
          ·
          11 months ago

          Really? Please show me the signed and notarized letter with the girl’s name on it that says they agree to have their image used for AI porn. Also since she is a minor her legal guardians.

          • CommanderCloon@lemmy.ml
            link
            fedilink
            arrow-up
            7
            arrow-down
            1
            ·
            11 months ago

            How would you possibly enforce that, or prevent people from just copying publicly available pictures for nefarious usage

            • afraid_of_zombies@lemmy.world
              link
              fedilink
              arrow-up
              2
              arrow-down
              4
              ·
              11 months ago

              It would have to be enforced after getting caught. As an add on charge. Like if an area has a rule against picking locks to commit a crime. You can never be charged with it alone but you can add that on to existing charges.