My favorite part of this story:

“The rocket terminated the flight after judging that the achievement of its mission would be difficult.”

“Man, this is too hard, better explode!”

  • AbouBenAdhem@lemmy.worldEnglish
    84·
    9 months ago

    the rocket self-destructs when it detects errors in its flight path, speed or control system that could cause a crash that endangers people on the ground

    More AI hallucinations?

      • AbouBenAdhem@lemmy.worldEnglish
        94·
        9 months ago

        Right—the way they’re describing it sounds like they replaced a human range safety officer with an autonomous AI.

        • Admiral Patrick@dubvee.orgEnglish
          9·
          9 months ago

          I’m not clear on this particular one, but I believe there can be both. Onboard sensors can initiate flight termination as well as a ground-based range safety officer.

          Edit: Yeah. Looks like there have been autonomous methods since about 1998.

          An autonomous flight termination system (AFTS) or autonomous flight safety system (AFSS) is a system in which the rocket’s flight computer can command flight termination without depending on ground personnel.

          • Wrench@lemmy.worldEnglish
            6·
            9 months ago

            Which in itself is a failsafe in case communication is disrupted. These are good things.

        • Wrench@lemmy.worldEnglish
          112·
          9 months ago

          I think you’re misusing the term “AI”.

          This would just be presets that would trigger if sensors detected problems, and if enough parts trigger, and automated response of destroying the craft would trigger.

          That is in no way artificial intelligence. Just automated safety features.

          Just like your car deploys an airbag if it’s sensors detect a collision.

          • AbouBenAdhem@lemmy.worldEnglish
            35·
            9 months ago

            Except for this line: “The rocket terminated the flight after judging that the achievement of its mission would be difficult”.

            Either the company president being quoted or the translator seems to be implying that the system is modeling the outcome of the whole mission, not just checking if sensor readings exceed some preset threshold. They’re trying to portray it as an AI-like decision, whether that’s really the case or not.

            • Wrench@lemmy.worldEnglish
              141·
              9 months ago

              It’s going to be a combination of red flags that an algorithm weighs, and triggers the self destruct if exceeded. Probably even gives HQ a short window to override it (if coms are working).

              It’s not going to have a built in “AI” making “intelligent” decisions in a dynamic way. That would be extremely dangerous/unreliable, as well as require a shit ton of processing power.

              Stop buying into the AI bullshit. Algorithms != AI

              • idiomaddict@feddit.deEnglish
                11·
                9 months ago

                It’s not buying into AI bullshit to infer some processing and assessment from something said to have decided something. Decisions involve consideration, they’re not like instincts.

                It seems like the person saying that misspoke.

                • MartianSandsEnglish
                  4·
                  9 months ago

                  They didn’t misspeak, they anthropomorphised. People do that all the time, and calling it an error is pedantic to the point of being incorrect.

                  Also, that statement was probably in Japanese. You can’t read that kind of implication from it, even if it would have been correct to do so in English (which it wouldn’t)

                  • idiomaddict@feddit.deEnglish
                    12·
                    9 months ago

                    That’s misleadingly inaccurate if it wasn’t misspeaking, calling it a mistake was charitable (though the issue could definitely rest in translation, you’re right).

            • jimbolauski@lemm.eeEnglish
              31·
              9 months ago

              They will not put AI on flight critical pieces for planes. It’s impossible to fully test and verify the software will behave in a predictable fashion. Instead the ai is used in a layer outside the critical path and it’s decisions are vetted by flight critical pieces.

              Destroying the rocket was done after flight critical software calculated the probability of failure as too high.

              If( notGoingToMakeIt() ) goBoom();