Imagine an AGI (Artificial General Intelligence) that could perform any task a human can do on a computer, but at a much faster pace. This AGI could create an operating system, produce a movie better than anything you’ve ever seen, and much more, all while being limited to SFW (Safe For Work) content. What are the first things you would ask it to do?
If that exists, it’s curtains for humanity. Not because of the AGI itself killing us all, necessarily, but because that means human labor is forever obsolete and the vast majority of humans, including me, will soon starve to death on the street or be imprisoned for vagrancy.
So, I wouldn’t ask it anything, except maybe to recommend a suicide method.
Hopefully there are some people more positive than that, willing to change society so AGI doesn’t make most humans starve to death or be imprisoned.
Look around you. Look at all the uprisings that haven’t happened as a result of the latest round of extreme price gouging and resulting public impoverishment. Look at all the homeless people everywhere, sitting quietly in their tents and dying of starvation, instead of standing up and marching and demanding the employment and housing opportunities that they’ve thus far been denied.
No, society will not change to coexist harmoniously with AGI. The events of the last few years have made this abundantly clear. The whole point of creating AGI is to replace human labor and dispose of the vast majority of humans, and those humans are going to let it happen.