An update:

  • fmhy.ml is gone, due to the ongoing fiasco with mali government taking all their .ml domains back
  • As such, lemmy.fmhy.ml is also gone, we are currently exploring ways to refederate (or somehow restart federation entirely) without breaking anything substantial
  • We have backups, so don’t worry about data loss (you can view them on other instances anyway)

Currently, we have fmhy.net and are exploring options to somehow migrate, thank you for your patience.

  • AZmaybe9
    link
    fedilink
    English
    14810 months ago

    Man this is all so interesting to see so many unique situations testing the Fediverse to see how it holds up.

    • PupBiru
      link
      fedilink
      4310 months ago

      let’s hope they’re interesting because it’s novel and the problems were there with other solutions just solved ages ago rather than the alternative: “so many unique situations” because there are a litany of “oops didn’t think of that” moments that will continue to crop up

    • Corgana
      link
      fedilink
      English
      610 months ago

      IMO the real takeaway is that a big instance disappeared overnight and yet here we all are on the fediverse talking about it.

  • Square Singer
    link
    fedilink
    English
    71
    edit-2
    10 months ago

    WIll this also affect all other .ml domains? Or is this some anti-piracy thing? (I don’t know fmhy, but from the name I guess it’s about piracy.)

    • sab
      link
      fedilink
      7110 months ago

      It seems to be Mali just wanting their domains back, in which case it’s uncertain times for all .ml domains.

        • sab
          link
          fedilink
          7210 months ago

          Good thing join-lemmy is safely tucked away in a .org domain.

          This is extremely bad timing for Lemmy (if it ends up happening), but also a good example of how federation makes the entire social media landscape more robust. Had this happened to a centralized service it would be devastating.

          • @[email protected]
            link
            fedilink
            2810 months ago

            Not really. Most centralized services are accessible via multiple domains, e.g. for different countries. This would just disable one of them, but users could still use another to log into their accounts. For the Fediverse it “disables” an entire instance, locks out users and cuts it off from federation.

            Lets not put a positive spin on a situation that exposes a weakness of the current system. The federation protocol needs to be able to handle these things gracefully, like propagating domain changes and migrating accounts between instances!

            • @[email protected]
              link
              fedilink
              710 months ago

              I’m now wondering what happens if the Mali government (or someone else) begins using those domains with their own lemmy instance, potentially with malicious content.

              Would the instances they’ve federated with begin ingesting and serving that content automatically? Or would that be blocked due to key mismatch?

              • ඞmir
                link
                fedilink
                610 months ago

                I think they need the private key for the https certificate to do that

              • @[email protected]
                link
                fedilink
                410 months ago

                Afaik it is all connected to the domain name, so they could definitely start to impersonate any .ml instance. Other instances could detect that the signing key for federation messages changed, but that’s about it. Their admins would probably have to block/defederate them manually.

          • @[email protected]
            link
            fedilink
            1110 months ago

            If it was always going to happen, now isn’t really a bad time. Sure, a month ago would have been better, but people still haven’t been here that long. If I wind up needing to migrate, and lose my current account, oh well. No big loss. I imagine others feel similar.

            • @[email protected]
              link
              fedilink
              610 months ago

              I was frustrated with the outage yesterday and created a new account on a different instance so I could still browse. Couple hours later I had all my subscriptions filled out and the experience is almost identical to my first account.

        • @[email protected]
          link
          fedilink
          English
          910 months ago

          lemmy.ml is still up as of right now. Possibly they contracted a subscription to the domain name to keep it up. They had to do something to retain it otherwise the site would be unreachable. If lemmy.ml does have to change names it will be a hassle since I’ve got a good number of community subscriptions there.

          This wouldn’t happen to an instance with a regularly subscribed domain name. Problem is the .ml domains were free and the associated country decided to claim them back. The risk of using a free top level domain is something that should have been considered. I don’t think it’s worth the risk versus the cost savings considering how difficult it is to migrate a Lemmy instance.

          • @[email protected]
            link
            fedilink
            English
            31
            edit-2
            10 months ago

            The instance is known by its domain name in the federation network. If that domain name changes, it’s like starting a new instance from scratch.

            Sounds like a complicated project to migrate communities and posts and users to a new instance without breaking something.

          • lazynooblet
            link
            fedilink
            English
            3010 months ago

            Federation connections are by domain name, so … it is a big deal

            • RxBrad
              link
              fedilink
              English
              710 months ago

              Right. This will basically make nearly every /c live in .world as all of the .ml /c’s go defunct. That, or Beehaw, which is walled off from everyone else.

              (Side note… my work’s firewalls block everything *.ml – and that’s the only thing that saved me from creating my account there)

            • Tekakutli
              link
              fedilink
              English
              2
              edit-2
              10 months ago

              deploying the fediverse instances-instance communication on top of a mesh-net like yggdrasil, using their addresses as domain names, may be a quick fix without having to change the paradigm

            • @[email protected]
              link
              fedilink
              English
              210 months ago

              From that point of view, yes. That’d mess things up, you’re right. But from my understanding, they won’t lose any data, accounts will remain, as well as subscriptions that lemmy.ml users have. Or am I wrong?

              • @[email protected]
                link
                fedilink
                English
                1110 months ago

                The problem is, if they don’t have access to their original .ml domain, their accounts are still tied to it. That means if they try to interact, such as subscribing to a community, when the data for that action tries to be sent back (such as updates) it’ll go to the .ml domain, which they wouldn’t receive.

                Lemmy doesn’t have a built in way to just change the domain name, or really any of the ActivityPub services AFAIK. You’d have to either really do some hacky stuff to get around it (which could result in unknown issues down the line) or reset everything.

                • @[email protected]
                  link
                  fedilink
                  English
                  710 months ago

                  Most of the hacky ways around it involve retaining ownership of the old domain and leaving it up indefinitely as a pointer to the new location. If your domain is taken from you though there is not much you can do.

                  Seriously dumb to have used this TLD considering there are a ton of choices these days.

          • redcalcium
            link
            fedilink
            English
            22
            edit-2
            10 months ago

            Currently, activitypub identity is tied to domain name. Mastodon support migration as long as the old domain is still up during the migration process, but AFAIK Lemmy doesn’t even have a process to migrate an instance to a new domain yet.

            Someone should tell Lemmy devs and send them a crate of coffee because it’ll be a race to implement domain migration before all .ml domains got shut down.

        • sab
          link
          fedilink
          20
          edit-2
          10 months ago

          Never hurts. Could be a good opportunity to look around the threadiverse and see if you find anything interesting.

          However, as it only affects the domain, I expect the Lemmy developers will manage to migrate user data to the new domain should lemmy.ml go down. So your account won’t just disappear, but it might go down for a while. It might also affect communities hosted on .ml domains, as followers from other instances will not have the correct path any more.

          • Square Singer
            link
            fedilink
            810 months ago

            Yeah, they are actively working on functionality to migrate user accounts and other data between instances, so that they can use that functionality to migrate everything on an instance to another instance.

            Since migrating data affects all the replicated data on other instances as well, I guess when they migrate lemmy.ml somewhere else, all of Lemmy will be down for a day or two, being just overloaded with all the migration stuff.

        • Dalë
          link
          fedilink
          310 months ago

          I’ve migrated from fmhy to feddit.uk, luckily my subscriptions were on a cached web page soon was able to manually re-subscribe.

          • redcalcium
            link
            fedilink
            11
            edit-2
            10 months ago

            Unfortunately, no.

            Currently, activitypub identity is tied to domain name. While mastodon support migration as long as the old domain is still up during the migration process, AFAIK Lemmy doesn’t even have a process to migrate an instance to a new domain yet.

            So basically, if you switch your instance domain, you’ll mess up all your federation network, unless Lemmy devs implement a solution soon.

            • Ahri Boy
              link
              fedilink
              210 months ago

              Calckey.social will be transferring all data to new firefish.social, first in the Fediverse.

    • @[email protected]
      link
      fedilink
      English
      25
      edit-2
      10 months ago

      I understand it as the Mali government is taking back all the domains after a subletting contract ran out. A lot of sensitive emails that should go to .mil (US military) has been typo-sent to .ml-addresses instead. Here’s some more reading.

      (I am very tired here and might have misunderstood everything, please correct me if I am wrong)

      • @[email protected]
        link
        fedilink
        English
        1510 months ago

        Perhaps the military should have a system in place to not allow emails to be sent outside of very specific TLDs if it’s that sensitive? And perhaps have an automated contact book, instead of relying on someone typing out the to: address manually to be able to make that mistake in the first place?

        Seems like some very basic security measures for something so serious.

        • @darkdemize
          link
          English
          310 months ago

          For most situations, there is a global address list that members can use. There are instances where emails need to be sent outside of the .mil domain though, such as to other government agencies that use a .gov, or to contractors on commercial domains, as well as to partner nations that will be on their own countries’ domains.

        • Tywele
          link
          fedilink
          English
          310 months ago

          Internally they do block that but the problem are people outside the network sending something to a .mil address and mistyping.

        • @[email protected]
          link
          fedilink
          English
          110 months ago

          Yeah that’s super easy to integrate. I used to work in cyber security for a bank and even I was only allowed to send to internal domains initially. I had to file for exceptions for contractors and vendors and stuff.

  • Nix
    link
    fedilink
    English
    5010 months ago

    Lemmy has had such a crazy month and a half. Insane growth, XSS injections, DDOS attacks, admin takeover, domain name seizures. What a wild ride

  • @BlazeOP
    link
    English
    4210 months ago

    Posting here for visibility as I guess most people on Lemmy are not on Firefish/Mastodon

    • @BlazeOP
      link
      English
      1810 months ago

      Yes, that’s reassuring. Also, nice to see their main website, I never actually noticed it existed

    • @[email protected]
      link
      fedilink
      English
      910 months ago

      Damn, lemmy.zip, eh? If that instance is public, I don’t see that being a good thing.

      Tons of businesses, people, etc, are all banning .zip and .mov TLDs for security purposes. I’ve personally banned all those domains from my network as well.

      Bold move.

        • @[email protected]
          link
          fedilink
          English
          1610 months ago

          See https://youtu.be/GCVJsz7EODA and https://youtu.be/V82lHNsSPww

          There are a few problems, but I believe the biggest issue is that .zip and .mov are valid and common file extensions, and it’s common for people to write something like ‘example dot zip’ or ‘attachment dot mov’ in emails, tweets, etc. Things like email clients have features where they automatically convert text that looks like a web address into clickable links. So now, retroactively, all those emails etc suddenly have a link, where they used to just have text, and the domains that are equivalent to those previously benign file names are being purchased by nefarious actors to exploit people unaware of the issue.

          • @[email protected]
            link
            fedilink
            English
            1
            edit-2
            10 months ago

            But there’s only an issue if the software you’re using auto linkifies the domain. They often don’t and won’t. This seems like a hypothetical problem that probably doesn’t exist for most major software. I certainly know no email software is gonna auto linkify this.

            If you’re curious, you can see if whatever software you’re viewing this post in auto linkifies (neither are for me): hshshssu.zip iwuf8aowk.mov

            (And if we’re manually linkifying, then you don’t need to use the new TLD. Eg, not-a-virus.zip.)

            • @[email protected]
              link
              fedilink
              English
              310 months ago

              At 1:30 in that second video, he shows that YouTube already converts dot zip domains, even in old comments that predate the domain’s existence. At 3:19, he shows/mentions Twitter, Reddit, Facebook, and LinkedIn. I would consider those major platforms. And keep in mind, it only takes one person downloading one file to cause major damage - the LMG hack was due to someone downloading and trying to open a fake PDF that was sent via email: https://youtu.be/yGXaAWbzl5A.

              So yes, not everything does or will auto convert the links, but I think you are underestimating the potential for issues here.

        • @[email protected]
          link
          fedilink
          English
          410 months ago

          https://www.trendmicro.com/en_us/research/23/e/future-exploitation-vector-file-extensions-as-top-level-domains.html

          Actually really huge security threats. It’s a very good idea to block them. I especially did because my girlfriend works for the government and does some secret stuff that can’t really get out, and she deals with a ton of real .zip files. I think everyone regardless of who they are should make sure to block them.

      • @[email protected]
        link
        fedilink
        English
        110 months ago

        i don’t doubt there have been a lot of cases of those tlds used for scams but i haven’t been negatively effected by this instances domain name.

        feel free to read the discussion about it here though

    • @[email protected]
      link
      fedilink
      English
      1910 months ago

      I’m sorry but for the good of all instances I’m afraid you will need to become a lurker 😔

      • redcalcium
        link
        fedilink
        English
        410 months ago

        .ee is owned by Estonia. Just pray Estonia wouldn’t do the same shenanigan and cause your instance to go down.

        • AChiTenshi
          link
          English
          210 months ago

          The instance up and disappeared right after it’s admin said they were going g to defederate with another instance. There was no warning it was just gone the next day.

          There is lots of speculation around it, but I think the admin got scared of the implication that their servers still held content from the other instance that was illegal in their country.

    • redcalcium
      link
      fedilink
      English
      910 months ago

      Are you using the free domain deal, or are you paying for your .ml domain? I suspect they only revoking those unpaid .ml domains.

        • redcalcium
          link
          fedilink
          English
          5
          edit-2
          10 months ago

          You might still buy your old .ml domain once Mali government open up registration again, assuming domain squatters doesn’t grab it first.

          • @[email protected]
            link
            fedilink
            English
            110 months ago

            I only used that domain because it’s free. Now I’m buying an actual domain, I’m not going back to that one.

    • @BlazeOP
      link
      English
      410 months ago

      Crap, sorry to hear that

    • @[email protected]
      link
      fedilink
      English
      210 months ago

      Lost mine too, had an .ml domain for testing servers. Was baffled why the DNS won’t resolve, then I see this.

  • Nix
    link
    fedilink
    English
    2110 months ago

    I’ve been seeing posts from users on lemmy.ml though? How’s that possible

  • @[email protected]
    link
    fedilink
    English
    1910 months ago

    I posted this on another thread about this, but I’ll repost it here:

    I have made a tool that can backup / copy your account settings, subscriptions, and blocks to a new account: https://github.com/CMahaff/lasim

    There are others out there as well if you look.

    Obviously the loss of .ml communities would still be catastrophic to Lemmy, but at least your new account won’t start from ground-zero, and you can be less effected by downtime by having 2 accounts with the same subscriptions.

    • Ghoelian
      link
      fedilink
      English
      22
      edit-2
      10 months ago

      I think in theory yes, since the .ml tld is now managed by the Mali government instead of some guy that had an agreement with them.

  • r00ty
    link
    fedilink
    1810 months ago

    Re-federation is probably possible. BUT! You’re going to always have problems with older content. Case in point my federation error messages is at 2300. About half are failed requests on fmhy.ml.

    So for re-federation what’s needed:

    1: Remote instances should unsubscribe all users from any fmhy groups. They’re dead now. They can only announce that and hope they do. I reckon when their errors start ramping up (as I saw yesterday) they will be looking into why. Probably to help de-federate from the old URL
    2: The fmhy instance should unsubscribe all users from all remote groups but keep a note of the groups while identifying as fmhy.ml. Then once on a configuration for the new domain re-subscribe to each one. The first step should hopefully stop them trying (and failing) to federate new events to the old URL. The second step should trigger federation with the new one.
    3: They could be able to keep the DB. But I am not sure in what places the old domain might be stored in the DB and what would need fixing there. Also not sure if they’d need to regenerate keys. Not sure if they’ll see the key was attached to the old domain and refuse to talk to the instance.

    Now what’s going to be a problem? Well ALL the existing content out there has references to users on the old domain. It’s VERY hard to fix that. Like every instance would need to fix their database. Not worth it. But, whenever someone likes/unlikes or comments or whatever a post made from fmhy.ml then there’s a good chance a remote instance will queue up a retrieval of:

    1: User info about the poster/commentor/liker
    2: Missing comments/posts for a like/comment event

    And those will fail and error log. I don’t think there’s a way around that aside from editing the whole database on every instance. Again, IMO not worth it.

    Would be a nice federation feature if, provided you could identify with the correct private key, announce a domain change which would automatically trigger the above in federated instances, or at the very least some kind of internal redirect for outgoing messages.

    • @[email protected]
      link
      fedilink
      1310 months ago

      If I’m running lemmy.world, I wouldn’t unsubscribe my people. I’d wait for that instance to move to a new domain and just find/replace in the database.

      Not every instance needs to migrate fmhy. Some can just leave that stuff broken. If the biggest half dozen instances migrate manually, fmhy would be able to keep most of their subscribers.

      I do wonder how often instances will keep looking for fmhy without intervention. Seems like tooling to migrate or discontinue an instance wouldn’t be too difficult to build. At least it wouldn’t if they didn’t have a million other things on their plate.

      We could use a few less third party clients and more work on Lemmy itself. Unless you’re going to bring over your userbase like RiF and Apollo can.

      • r00ty
        link
        fedilink
        410 months ago

        Yes, although you might need to fudge keys if they’re properly enforced. Looking at kbin I can see requests are at least signed with the private key. Not sure if the public key is stored somewhere in database, or is pulled from the instance using DNS as a security guarantor (I guess) every time.

        I don’t have any subscriptions to them, but I have those 1000+ errors just from posts their users were involved in.

    • redcalcium
      link
      fedilink
      3
      edit-2
      10 months ago

      Afaik mastodon has a way for instances to migrate to a new domain, but the old domain must be up during the migration process. Lemmy on the other hand don’t even have any domain migration procedure yet. People will probably go nuts about this on their GitHub issues portal.

      • r00ty
        link
        fedilink
        510 months ago

        Possibly. I think mastadon has been around a bit longer though? Not sure why the old domain must be up. Unless they don’t store public keys of known instances and they rely on DNS for the security.

        e.g. Instance A signs a request, Instance B queries Instance A via DNS lookup (as is normal) and checks public key confirms signature and allows it.

        • redcalcium
          link
          fedilink
          110 months ago

          I got curious so I start digging into how mastodon do it. It’s more like a hack, really. Mastodon uses WebFinger to resolve user account, so when you change domain, you can leave the old domain up so your federated servers can still resolve your users and realized the domain has been changed and update their federation data. But it turns out you can’t exactly retire the old domain either because it’s still tied to user account internally. So if you lose control of your old domain, you’re probably as screwed as fmhy.ml.

          • r00ty
            link
            fedilink
            110 months ago

            Yeah, which is why I think storing remote user and instance public keys might be better. Then that can be used to authenticate the migration request (it’d probably need to be an extension to the activitypub standard).

            The biggest problem I see is that an instance doesn’t know about all the instances that have data pointing to them. So how does it communicate the changes to everyone? The mastadon way is probably the sensible way to do it, despite not supporting the loss of control of domain scenario.

  • FlashPossum
    link
    fedilink
    1710 months ago

    Is Mali gov just removing all DNS records without warning?
    No respect for existing contracts, or at least some heads up a couple of months earlier.

    • 001100 010010
      link
      fedilink
      English
      2010 months ago

      Governments just love doing stuff whenever they can, because what are you gonna do? This is a country under a military junta, there is no legal process to get back the domain.

      • sab
        link
        fedilink
        1510 months ago

        They just handed off the management of .ml domains to a third party on a ten-year contract, and the contract is now ending.

        So I guess Mali is honouring its contracts, and I doubt the third party provided anyone with contracts going beyond the ten year period they could guarantee for. I doubt the third party provided contracts at all to be honest.

        • @[email protected]
          link
          fedilink
          310 months ago

          Freenom (the third party in question) has been pretty shady for years. I got burned with their free .tk names a few times back in the day.