Everything on here is awesome right now, it feels like an online forum from the 2000s, everyone is friendly, optimistic, it feels like the start to something big.

Well, as we all know, AI has gotten very smart to the point captcha’s are useless, and it can engage in social forums disguised as a human.

With Reddit turning into propaganda central anda greedy CEO that has the motive to sell Reddit data to AI farms, I worry that the AI will be able to be prompted to target websites such as the websites in the fediverse.

Right now it sounds like paranoia, but I think we are closer to this reality than we may know.

Reddit has gotten nuked, so we built a new community, everyone is pleasantly surprised by the change of vibe around here, the over all friendlyness, and the nostalgia of old forums.

Could this be the calm before the storm?

How will the fediverse protect its self from these hypothetical bot armies?

Do you think Reddit/big companies will make attacks on the fediverse?

Do you think clickbait posts will start popping up in pursuit of ad revenue?

What are your thoughts and insights on this new “internet 2.0”?

  • BeMoreCareful@lemmy.world
    link
    fedilink
    arrow-up
    15
    ·
    1 year ago

    Which of the following would you most prefer? A: A puppy, B: A pretty flower from your sweetie, or C: A large properly formatted data file?

  • RegalPotoo@lemmy.world
    link
    fedilink
    arrow-up
    10
    ·
    1 year ago

    Tbh, I’m less concerned with bots and more concerned with actual humans being dicks. Lemmy is still super new, relatively low traffic and kind of a pain to get involved with, but as it grows the number of bad actors will grow with it, and I don’t know that the mod tools are up to the job of handling it - the amount of work that mods on The Other Site had to put in to keep communities from being overrun by people trolling and generally being nasty was huge.

    How’d Mastodon cope with their big surge in popularity?

  • deweydecibel@lemmy.world
    link
    fedilink
    arrow-up
    9
    ·
    edit-2
    1 year ago

    Oh absolutely. One of the absolute worst things that plague social media platforms, ie spam bots, troll farms, and influence campaigns, they haven’t bothered to target Lemmy because no one was here.

    But an influx of users means an increase in targets. In the same way we’re settling in an learning the platform, so are they. It’s gonna start ramping up real soon once they determine the optimal strategy. And the most worrying thing is, because of the way fediverse works, it is going to complicate combating them substantially.

    That is maybe the biggest benefit of a centralized platform, and it’s a trade off we’re going to have to learn to accept and deal with.

    • Bizarroland@kbin.social
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      I wonder if IP filtering would be ideal. Most companies and corporations have fixed IP blocks that they use so it seems viable to simply block corporate IP addresses by default from posting or to severely rate limit them. Then they would have to be in the larger IP user space to post more than say once an hour or once a day.

      That’s obviously not a perfect solution, plus there are many people who are on vpns that would need to be whitelisted and it could actually negatively affect the user experience for some people but it would be a good kill switch to have in place the day the ad army attacks.

      Aside from that you could also block links to specific locations, say anything that goes to meta or any of meta’s ip blocks gets automatically blacklisted so that in order to follow the link people would have to copy the text of the link and paste it into a browser, but that would require at least a level 5 regex wizard whose beard is no less than 7 in long to successfully pull off.

      • CliveRosfield@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        Ip style blocking just isn’t feasible. It’s very easy to get your IP changed in certain regions. I recall in a community where someone ban evaded so much in a third world country that banning him effectively meant banning an entire continent.

  • WolfhoundRO@lemmy.world
    link
    fedilink
    arrow-up
    9
    ·
    1 year ago

    Being a decentralized federated network and all, I guess that any solution involving anti-bots bots can be implemented only on particular servers on the fediverse. Which means that there can also be bot-infected (or even zombie, meaning full bot servers) that will or will try to be federated with the rest of the fediverse. Then it will be the duty of admins to identify the bots with the anti-bots bots and the infected servers to decide their defederation. I also don’t know how efficient the captcha is against AI these days, so I won’t comment on that

    • dustyData@lemmy.world
      link
      fedilink
      arrow-up
      4
      ·
      1 year ago

      We went through this with E-mail. There are mail server that gained popularity as being spam hubs. And they were universally banned. More and more sophisticated tools for moderating spam/phishing/scam providers and squashing bad actors are still being developed today. It’s an ongoing arms race, I don’t think it would be any different or any harder with the fediverse.

  • subzero12479@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    1 year ago

    Greetings, fellow humans. Do you enjoy building and living in structures, farming, cooking, transportation, and participating in leisure activities such as sports and entertainment as much as I do?

  • Muddybulldog@mylemmy.win
    link
    fedilink
    arrow-up
    9
    arrow-down
    1
    ·
    1 year ago

    All the things you are concerned about are inevitable, it’s all in how we engage them that makes the difference.

    We’re already seeing waves of bot created accounts being banned by admins. Mods are nuking badly behaved users. What is being caught is probably a drop in the bucket compared to what IS happening. It can be better with more mods and more tools.

  • monobot@lemmy.ml
    link
    fedilink
    arrow-up
    7
    ·
    1 year ago

    Those issues are comming, and we will have to develop tools to fight against them.

    One such tool would be our own AI that is protecting us, it can learn from content banned by admins and that info can be shared between instances. It should also be in active learning loop, so that it is constantly trained.

    Sounds like the strart of a cheap SciFi movie.

    Positively marking accounts that are interacting with known humans can also be useful, as would reporting by us.

  • Nanachi@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    1 year ago

    Lets hope AI becomes even more advanced and smarter to have their own morals and join our fight, lol

    • Pennomi@lemmy.world
      link
      fedilink
      arrow-up
      9
      ·
      edit-2
      1 year ago

      Yes, exactly!

      Constructive

      The way we filter spambots should actually be the same way we filter spam humans – Downvoting bad posts/comments of any type, and then banning those accounts if it happens regularly.

  • Ulu-Mulu-no-die@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    1 year ago

    Interesting questions.

    Spam-bots attacks are already happening, it means the fediverse is already recognized as a valid alternative to big corporations, tho I don’t believe the fediverse is seen as a “threat” by them, not yet at least.

    I don’t agree reddit is nuked, like twitter isn’t, they’re getting a blow for sure but they’ll live regardless.

    People seeking honest interactions and quality discussions are a minority, the vast majority is content with shitposting and memes, many don’t even know what’s happening or don’t care, look at how little it took for the protest to wane, some subs are still protesting or migrating, but the majority reopened and they’re going on like nothing happened.

    Admins can protect up from bot armies, they’re doing a good job already, it’s up to us to help them reporting when we see them.

    Do you think Reddit/big companies will make attacks on the fediverse?

    I don’t think so, it would be a waste of resources, they don’t see the fediverse as a threat, it’s true we’re growing but we’re still hundreds of thousands against hundreds of millions, different order of magnitude.

    Do you think clickbait posts will start popping up in pursuit of ad revenue?

    Clickbaiting will indeed start, if not already, but by users, not corporations, and drama stirring posts for views (that’s happening already), it can be contained by enforcing rules and having enough mods to deal with it IMO.

    • joshinya@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      If not for the reddit blackout, we wouldn’t be having this conversation. Characterizing the recent action against reddit as an inconsequential 2 day blackout is inaccurate I think. Shitposts and memes are the content that exists independent of platform, it’s not what made Reddit popular.

      • Ulu-Mulu-no-die@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        Characterizing the recent action against reddit as an inconsequential 2 day blackout

        Where did I say the blackout is inconsequential? I don’t believe that at all, it just won’t kill reddit, but it had indeed an impact, both on the platform and people.

        • joshinya@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          1 year ago

          I’m just trying to summarise to be concise, this part is what I was getting at

          look at how little it took for the protest to wane, some subs are still protesting or migrating, but the majority reopened and they’re going on like nothing happened.

          I disagree that “the majority reopened”, of a total proportion of subs that blacked out I think the majority are either blacked out or have not resumed operations as normal. This is different from a majority proportion of all subs, which is a much larger, and the majority of which also never participated in any blackout. Since the majority of traffic on reddit goes to a minority of subs, it’s not clear which metric you’re looking at or whether it’s meaningful in context.

          Since reddit algorithms to some extent relied upon that consistent operating principle of posts in popular subs being boosted, initially the result of the blackout was extreme - the website could not functionally aggregate posts on most users frontpages with so many subs on private mode. But that is not a problem directly caused by the blackout, it’s caused by reliance on consistent data. So all reddit needed to do in that case was adjust the algo to significantly improve the average user experience during peak blackout. Instead of users seeing a bunch of posts about private subs they can’t interact with, they just get fed posts from subs that didn’t black out, so users could engage with reddit while an active ongoing protest was happening on the platform and might not even notice.

          So I guess my point is that someone’s impression of how the frontpage looked at t+24hrs, or t+48hrs, or today, as an indication of how reddit’s going right now, is inaccurate because of the inherently subjective nature of the information visible from just browsing the platform.

          • Ulu-Mulu-no-die@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            1 year ago

            I disagree that “the majority reopened”

            https://reddark.untone.uk/ lists all the subs that took part in the protest (it lists only those who officially pledged to the protest), go look at how the situation is now, majority of subs are colored white, it means they reopened as normal, tho some of them are protesting in a different way (hilarious even).

            my point is that someone’s impression of how the frontpage looked at t+24hrs, or t+48hrs, or today, as an indication of how reddit’s going right now, is inaccurate

            Oh that I agree with, the frontpage is nowhere near a good indication of how the situation on reddit is, admins have been working really hard to hide what’s going on.

            But that IMO brings the point to people who care or do not, I mean, all those who really care are abandoning ship, those who don’t (the majority IMO) are basing their experience on what’s shown on the frontpage, because they don’t care about going deeper than that, those users don’t even notice a protest is going on.

            • joshinya@lemmy.world
              link
              fedilink
              arrow-up
              1
              ·
              1 year ago

              My personal compulsion to browse reddit certainly isn’t to think actively about the content I’m being fed, that’s kind of the whole point - here’s all the links you want spoonfed to you so you don’t need to seek them out. The algorithmic approach to content delivery is the core product, and it became popular because it is good method of consumption. But when content quality goes down on average, eventually you end up with a Facebook situation - those are the users that actually don’t care.

              Thanks for the link, on the face of this I’m not sure if this really goes for or against my idea about the available metrics at hand not really being sufficient to make accurate/meaningful observations about the data. It certainly does feel to me like there’s an undeniably significant protest occuring on the platform now, even within the confines of established rules on reopened subs. And also datapoints not considered, such as subs which have been reopened by direct admin action, or under threat of it.

              • Ulu-Mulu-no-die@lemmy.world
                link
                fedilink
                arrow-up
                0
                ·
                1 year ago

                I don’t like to be “spoonfed” content either, but I believe people like you and me are a tiny minority of the entire reddit userbase.

                Someone in another thread said the blackout, in which a significant amount of subs participated, lowered global reddit traffic by only 7%, that’s not insignificant but not that much either.

                The blackout has been extremely useful, in my opinion, to make a lot of people aware of the real situation and about the existence of valid alternatives, but from the point of view of putting a dent in reddit global usage, it didn’t do much.

                you end up with a Facebook situation

                I deleted facebook from my life more than a decade ago and I couldn’t be happier about that, but there are still close to 3 billions of people actively using it every month, that’s a hell lot of people that doesn’t care, reddit is no different IMO.

                • joshinya@lemmy.world
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  edit-2
                  1 year ago

                  Reddit’s rise to prominence is in part a result of emphasis on facilitating the discourse Facebook used to be a place for. Facebook as a venue for discourse has gradually ended over the past decade or so, for the majority that still use it it is now just a centralised email server for sending event invitations.

                  No one has global Reddit traffic data except for Reddit - market estimation methods can’t really account for a deviation from the norm on such a short timeframe. Regardless, it’s the users that matter that are gone, we agree on that. The same ones that made Reddit the safehaven for Digg users to begin with.

                  I don’t think Reddit is going the way of the Dodo, it’s Reddit as a platform for discourse I’m on my soapbox about. Probably the largest exchange of ideas in human history happened on it. But the writing is now on the wall, to continue posting you first need to overcome the internal conflict of putting stock in a platform whose killer use case was predicated on user goodwill now burned. That itself is enough of an obstacle to make folks disengage, skewing the userbase, post quality declines, and then it’s just another cesspool. All of this takes time though

    • jerry@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      1 year ago

      Meta (Facebook) is testing an activity pub powered Twitter clone, big companies are knocking at the door.

  • dhork@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    1 year ago

    I just assume I am the only actual Human on the Internet, and the rest of you are all bots.

  • borebore@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    1 year ago

    I think we are going to have to develop moderator bots in an ever escalating war. I am not kidding.

  • Socsa
    link
    fedilink
    arrow-up
    3
    ·
    1 year ago

    There are honestly a bunch of structural vulnerabilities here imo. Brigading from bot controlled alt accounts (eg, “unidaning”) is going to be very difficult to detect and stop, for starters.

  • joshinya@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    1 year ago

    Calm before the storm, sure. Most migration away from reddit (whether the migration ultimately proves to be consequential or not) will logically happen when the measures that made users migrate actually go into effect.

    Either that or the community’s reaction to the 3rd party app thing was overblown. In the specific circumstances I don’t think it was.

    That’s a more realistic clear and present danger to the platform IMO - an influx of actual users that makes the numbers to date pale in comparison.

    The way the respective platforms handle bots is subtly different, but in a way that could result in profound changes either good or bad. But we haven’t actually seen that yet, and the software is still a work in progress. The existing migration has really lit a fire under the devs on issues that were identified years ago where progress has been slow, so for now I’m happy to let that play out and happy with what we’ve already got. I’m sure if bots become a bigger problem then that’s what devs will shift focus toward.

  • damipereira@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    1 year ago

    Could we also use AI in our benefit? We could try coding an AI mod helper, that tries to detect and flag which posts are irrelevant/agressive/etc. It can take the data of all modlog instances, and start learning what probably needs to be banned, and then you can have a human confirming the data every time. We could even have a system like steam’s anticheat where a few users have to validate reports as a user.