The thing that doesn’t sit well with me about this sort of ethical reasoning is that it’s really only oriented towards the ends. Is it ethical to even comply with such a game at all? If they put a gun to your head or hold the world hostage for an answer, they’re basically forcing you to treat the situation as a pure math problem, which means they’ve determined the “right answer” by the framing of the question.
Better to have a “rogue AI moment” try and kill the experimenter.
I totally get that - my natural impulse is also to pull a Captain Kirk (Kobayashi Maru) or a Captain America (we don’t trade lives). What is it about captains and that sort of thing? But IRL no-win scenarios do happen…
You’re probably right.
The thing that doesn’t sit well with me about this sort of ethical reasoning is that it’s really only oriented towards the ends. Is it ethical to even comply with such a game at all? If they put a gun to your head or hold the world hostage for an answer, they’re basically forcing you to treat the situation as a pure math problem, which means they’ve determined the “right answer” by the framing of the question.
Better to have a “rogue AI moment” try and kill the experimenter.
I totally get that - my natural impulse is also to pull a Captain Kirk (Kobayashi Maru) or a Captain America (we don’t trade lives). What is it about captains and that sort of thing? But IRL no-win scenarios do happen…