Warning: this is really awful.
Really hope the parents see jail time for this. The AI didn’t put a gun in their house.
It sounds like the parents weren’t even aware. They said he was spending his snack money on it. He probably bought gift cards or something.
The time of reckless software really has to end. They will bemoan that it “stifles” innovation, but so much damage has resulted from irresponsible software just in the last couple of decades.
We humans used to be technologically limited by how fast we could innovate. Not enough RAM or CPU or a sensor didnt exist. There is no technological throttle anymore, we need to govern one.
tragic case. Character.ai is full of depravity, and it seems that is also unmoderated; every user can publish a bot of their own liking/design, then the gullible nature of kids (or even adults) and a non safely stored gun. I hope there will be consequences for every involved party (so character.ai and the “parents”), perhaps even stricter policies in regards to LLMs.
The fuck were they supposed to do, besides exclude minors?
It’s a chatbot. It’s spicy autocomplete. If ‘the robot shouldn’t do [blank]!’ was easy, we’d all be living an Isaac Asimov story. But this isn’t Google recommending glue when people asked for pizza toppings - it’s a site specifically for roleplaying with fictional characters. Some characters are gonna say wild shit. Fiction is supposed to be a safe place to step beyond the boundaries of everyday life.
This was a chatbot aping a character from Game Of Thrones. That’s an amoral hyperviolent setting I know some of y’all enjoyed watching. Is generating conversations based on that supposed to be worse than showing it on television? Does the inclusion of second-person pronouns make getting eaten by dragons an actionable threat?
Of fucking course a cheap knockoff of a Targaryen said some fucked-up things. That’s how you know it’s working! If it did not do that, it would not be mimicking a Targaryen. Is a single person on Lemmy going to get equally mad at George RR Martin for inventing these characters from whole cloth?
If some video game - even some fourth-wall-bending dating sim, like Doki Doki Literature Club - had been at the center of this, would anyone here even think to blame the creator?
Here’s the real implications of this event.
One, having guns in your house is a risk to your own family. Probably moreso than to anyone else in the world.
Two, the adult users who had all their logs erased by a panicking company deserve control over the software they use.
