• FeelThePower@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    2
    ·
    6 months ago

    The only thing we reasonably have is security through obscurity. We are something bigger than a forum but smaller than Reddit, in terms of active user size. If such a thing were to happen here, mods could handle it more easily probably (like when we had the spammer of the Japanese text back then), but if it were to happen on a larger scale than what we have it would be harder to deal with.

    • BarbecueCowboy@kbin.social
      link
      fedilink
      arrow-up
      15
      ·
      6 months ago

      mods could handle it more easily probably

      I kind of feel like the opposite, for a lot of instances, ‘mods’ are just a few guys who check in sporadically whereas larger companies can mobilize full teams in times of crisis, it might take them a bit of time to spin things up, but there are existing processes to handle it.

      I think spam might be what kills this.

      • deweydecibel@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        6 months ago

        If a community is so small that the mod team can be so inactive, there’s no incentive for the company to put any effort into spamming it like you’re suggesting.

        And if they do end up getting a shit ton of spam in there, and it sits around for a bit until a moderator checks in, so what? They’ll just clean it up and keep going.

        I’m not sure why people are so worried about this. It’s been possible for bad actors to overrun small communities with automated junk for a very long time, across many different platforms, some that predate Reddit. It just gets cleaned up and things keep going.

        It’s not like if they get some AI produced garbage into your community, it infects it like a virus that cannot be expelled.

    • old_machine_breaking_apart@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      1
      ·
      6 months ago

      There’s one advantage on the fediverse. We don’t have the corporations like reddit manipulating our feeds, censoring what they dislike, and promoting shit. This alone makes using the fediverse worth for me.

      When it comes to problems involving the users themselves, things aren’t that different, and we don’t have much to do.

      • MinFapper@lemmy.world
        link
        fedilink
        English
        arrow-up
        23
        ·
        6 months ago

        We don’t have corporations manipulating our feeds

        yet. Once we have enough users that it’s worth their effort to target, the bullshit will absolutely come.

        • old_machine_breaking_apart@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          9
          ·
          6 months ago

          they can perhaps create instances, pay malicious users, try some embrace, extend, extinguish approach or something, but they can’t manipulate the code running on the instances we use, so they can’t have direct power over it. Or am I missing something? I’m new to the fediverse.

          • BarbecueCowboy@kbin.social
            link
            fedilink
            arrow-up
            5
            ·
            6 months ago

            There’s very little to prevent them just pretending to be average users and very little preventing someone from just signing up a bunch of separate accounts to a bunch of separate instances.

            No great automated way to tell whether someone is here legitimately.

            • bitfucker@programming.dev
              link
              fedilink
              English
              arrow-up
              1
              ·
              6 months ago

              Yeah, and that is true for a lot of service. Sybil attack is indeed quite hard to prevent since malicious users can blend with legitimate ones.

        • bitfucker@programming.dev
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          6 months ago

          Federation means if you are federated then sure you get some BS. Otherwise, business as usual. Now, making sure there is no paid user or corporate bot is another matter entirely since it relies on instance moderators.

      • deweydecibel@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 months ago

        We don’t have the corporations like reddit manipulating our feeds, censoring what they dislike, and promoting shit.

        Corporations aren’t the only ones with incentives to do that. Reddit was very hands off for a good long while, but don’t expect that same neutral mentality from fediverse admins.

    • linearchaos@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      6 months ago

      I think the real danger here is subtlety. What happens when somebody asks for recommendations on a printer, or complains about their printer being bad, and all of a sudden some long established account recommends a product they’ve been happy with for years. And it turns out it’s just an AI bot shilling for brother.

      • deweydecibel@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        6 months ago

        For one, well established brands have less incentives to engage in this.

        Second, in this example, the account in question being a “long established user” would seem to indicate you think these spam companies are going to be playing a long game. They won’t. That’s too much effort and too expensive. They will do all of this on the cheap, and it will be very obvious.

        This is not some sophisticated infiltration operation with cutting edge AI. This is just auto generated spam in a new upgraded form. We will learn to catch it, like we’ve learned to catch it before.

        • linearchaos@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          6 months ago

          I mean, it doesn’t have to be expensive. And also doesn’t have to be particularly cutting edge. Start throwing some credits into an LLM API, haven’t randomly read and help people out in different groups. Once it reaches some amount of reputation have it quietly shill for them. Pull out posts that contain keywords. Have the AI consume the posts and figure out if they have to do with what they sound like they do. Have it subtly do product placement. None of this is particularly difficult or groundbreaking. But it could help shape our buying habits.