How much glue should you put in your pizza?
Seriously. Eating Reddit means some truly strange shit is going to emerge. We all know the pattern of fun replies on Reddit, but the AI does not. Hence the glue thing.
I don’t think that’s an impossible problem. Existing models can reliability distinguish between, for example, different languages. Most of their training data is presumably in English but while this may make them better at generating English text, it doesn’t make them randomly switch from other languages to English. A sufficiently advanced model would likewise distinguish between descriptions of reality and shit-posts because the content of shit-posts would not be useful for predicting descriptions of reality. Some fine tuning would teach it to produce just the descriptions of reality.
Or look at it this way: the folks developing these LLMs aren’t ignorant of the fact that Reddit content is often false and meant to be funny. They’re not going to make the sort of silly mistake that someone who isn’t an expert can still easily predict and they’re not going to train their LLMs on that content if it makes the LLMs worse, although we’re still going to see some glue on pizza while the technology continues to develop.
It can cross check a language with tons of other words and examples of that language already in its data set. There is no such data for whether or not something confirms with reality. That simply doesn’t exist and really won’t ever exist. They are not similar problems. One is immensely more challenging to solve than the other.
Glue is still a more valid pizza topping than PINEAPPLE!!!
Pineapple and bacon is the best toppings for pizza to ever exist
Pineapple and jalapeno together on pizza is pretty dope as well.
Bring back anchovies.
Found Zoidberg!
Jokes on them they paid for my drunk shitposts.
Exactly. I think about 90% of what I posted was Grade A sarcastic bullshit.
Removed by mod
You’re forgetting the enormous amounts of shitposts
Plus rants.
If they hadn’t made it impossible to use a functional app to browse their site, I probably wouldn’t care.
But the fact that they blocked 100 apps that would, if you merged the absolute worst of all of them, still blow the actual Reddit app out of the water? Nope. Fuck 'em.
I mean whatever I posted there I posted for public use. Whatever it can learn from my few ancient Stack Overflow posts, it’s welcome to it.
They are using your knowledge and talents to profit immensely by selling or using it. Selling it right back to you and everyone else. I have a problem with that.
It would be fine if it was free.
I can’t wait to become a chess master with the help of AI powered by the smart folks at r/anarchychess ([email protected] is the Lemmy equivalent)
That is exactly the sort of community I wish I was smart enough to be a part of because it looks awesome.
On my side, I joined Chess Club in middle school and lost my first game in two moves. Because I suck that much at chess.
Think three moves ahead? I can’t even think three moves behind.
Consider the source of the Reddit comments, Stack Overflow questions and FB photos: a substantial number of them are poorly written, irrelevant, re-posts and were already churned out by AI. So the ouroboros is the master of and source of its own fate. GIGO.
So fill yer boots, AI, it’s your own shit you’re eating.
Hence Google’s AI giving supposedly real advice based on Reddit joke posts.
Does it matter if I’m okay with it? If I use those websites, it’s going to happen. And honestly, it’s probably happening with Lemmy too since any company can scrape it for free. That’s just the sad state of the internet at this point. If you write something anywhere public, it’s probably being used to train AI.
They don’t even need to scrape it. Set up an ActivityPub endpoint and suck it all in nice and json’d.
No, that’s why I deleted my fucking account of 17 years.
Did you delete your regular account as well?
It was all soft deletes.
Dunno, I used one of those overwrite services before I did.
Yes.
What? You were expecting me to give a shit about what happens to my comments on a public forum?
Yep. I knew it was a public when I posted it. The thing I have a problem with is when my non-public content is used by people I didn’t intend.
According to gdpr it is not allowed to use people’s data for purposes other than the ones they agreed to. I had an e-mail discussion with them and I filed a complaint with my countries gdpr enforcement agency. They take a while to investigate and react, but hopefully if enough people complain they will take it seriously.
Exactly, but it’s far more easier to spread panic with generalizations than it is to speak about the specifics.
I don’t use any of them, but it sucks for the people that do.
I’ve said so many wrong and stupid things on reddit over the years both purposely and not. I wouldn’t trust anything trained on reddit. And facebook shouldn’t even be thought if as a training source as its mainly bots, idiots and propaganda.
Stack overflow, I’ve never used but seems to be mostly smart people.
An AI using what I say to train it will only make AI more like me. As far as I’m concerned, that’s an improvement that may help others while not affecting my life one iota. It’s not like it remembers who said what, it all just tweaks the algorithm.
Advertisers have been recording and storing what you say word for word to build a profile specific to you, containing your deepest, darkest truths so they can trick you into giving them more of your money. Who cares about AI training on publicly posted comments, it’s just taking energy away from the real privacy issues.
Exactly!!! All this fear about AI being trained as if our data hasn’t been being vacuumed for years and years now. Tracking profiles, fingerprinting, etc. There are legitimate things to get energized and concerned over, no need to make up fear-based narratives
In 2022 I was among the 1% of most karma awarded on reddit. Hadn’t been banned anywhere.
Then in 2024 their IPO went public. A week later it was said that AI bots were now scrubbing the site to sell your data to google.
Within 3 weeks I was permanently banned, for 3 posts that had nothing wrong with them. One of them I understand how an AI would flag if its just using keywords. In context of the conversation nothing was wrong.
The other 2 didn’t even have keywords which an AI would pick up on.
So my assumption is the AI scrubbed my data, started acting like me, which is to say an absurdist, and google didn’t like the results of my data. So reddit banned me.
In my opinion stack overflow has vague answers 80% of the time. If AI helps filtering all the bullshit, I’m ok with that. And I don’t know how Reddit or Facebook bot comments are a good source of information.
