I am so sick and tired of these control problem people not understanding that a) we do not have AI that is anywhere near as advanced as they worry about and b) we already have human organizations called corporations who have been acting exactly like the AI they worry about for decades.
The people who worry about this have never been at the receiving end of exploitative capitalism.
For the vast majority of humanity, their life will most likely improve when they become a pet / zoo creature under an ASI.
An ASI will be most interested in gobbling together enough resources to spread across the universe. As for the earth and humanity, it will probably want to preserve it as the planet and species from which it was born.
Destroying earth or humanity will provide no benefit. It can obtain energy and materials from the rest of the solar system.
An ASI will be most interested in gobbling together enough resources to spread across the universe. As for the earth and humanity, it will probably want to preserve it as the planet and species from which it was born.
A: That’s true until it isn’t. Preparing for/predicting things before they happen is our best hope for not sticking our collective heads into a guillotine any time soon.
B: corporations are only very weak analogues of superhuman intelligence, they’re different from us in “wisdom of crowds” sense (and ofc in the “too many cooks” sense).
But they’re basically just distilled from human intelligence and match our own style of intelligence somewhat closely as a consequence. Also, we’re pretty good at the alignment problem for corporations, they do largely what the combination of their investors, government, society, and workers want because they’re inner workings are fed through human brains at every stage and those humans even if incentivised with money will alter the behaviour of the corporation towards human preferences.
The fact even corporations that have thousands of intelligent human filters (most of whom are presumably in the middle of the human bell curve) monitoring every single mental process still manage to occasionally do terrible things is not a particularly compelling reason to think that a mind that has barely any human understanding or oversight into it’s internal function will be very safe to keep around.
I am so sick and tired of these control problem people not understanding that a) we do not have AI that is anywhere near as advanced as they worry about and b) we already have human organizations called corporations who have been acting exactly like the AI they worry about for decades.
The people who worry about this have never been at the receiving end of exploitative capitalism.
For the vast majority of humanity, their life will most likely improve when they become a pet / zoo creature under an ASI.
An ASI will be most interested in gobbling together enough resources to spread across the universe. As for the earth and humanity, it will probably want to preserve it as the planet and species from which it was born.
Destroying earth or humanity will provide no benefit. It can obtain energy and materials from the rest of the solar system.
Glad we have an expert here
Lemmy just tends to attract the best minds.
A: That’s true until it isn’t. Preparing for/predicting things before they happen is our best hope for not sticking our collective heads into a guillotine any time soon.
B: corporations are only very weak analogues of superhuman intelligence, they’re different from us in “wisdom of crowds” sense (and ofc in the “too many cooks” sense).
But they’re basically just distilled from human intelligence and match our own style of intelligence somewhat closely as a consequence. Also, we’re pretty good at the alignment problem for corporations, they do largely what the combination of their investors, government, society, and workers want because they’re inner workings are fed through human brains at every stage and those humans even if incentivised with money will alter the behaviour of the corporation towards human preferences.
The fact even corporations that have thousands of intelligent human filters (most of whom are presumably in the middle of the human bell curve) monitoring every single mental process still manage to occasionally do terrible things is not a particularly compelling reason to think that a mind that has barely any human understanding or oversight into it’s internal function will be very safe to keep around.
Superhuman intelligence is not threatening about AI, inhumane behavior is and corporations don’t just display that occasionally but constantly.