My guess is that they didn’t answer your question because they had strict instructions not to stray from the script on this topic. Saying the wrong thing could lead to a big PR problem, so I don’t expect that people working in this field would be willing to have a candid public discussion even about topics to which they have given a lot of thought. I do expect that they have given the ability of AI to obey orders accurately a lot of thought at least due to practical (if not ethical) concerns.
I mean, I am currently willing to say “the AIs will almost definitely kill civilians but we should build them anyway” because I don’t work in defense. However, even I’m a little nervous saying that because one day I might want to. My friends who do work in defense have told me that the people who gave them clearance did investigate their online presence. (My background is in computational biochemistry but I look at what’s going on in AI and I feel like nothing else is important in comparison.)
As for cold comfort: I think autonomous weapons are inevitable in the same way that the atom bomb was inevitable. Even if no one wants to see it used, everyone wants to have it because enemies will. However, I don’t see a present need for strategic (as opposed to tactical) automation. A computer would have an advantage in battlefield control but strategy takes hours or days or years and so a human’s more reliable ability to reason would be more important in that domain.
Once a computer can reason better than a human can, that’s the end of the world as we know it. It’s also inevitable like the atom bomb.
My guess is that they didn’t answer your question because they had strict instructions not to stray from the script on this topic. Saying the wrong thing could lead to a big PR problem, so I don’t expect that people working in this field would be willing to have a candid public discussion even about topics to which they have given a lot of thought. I do expect that they have given the ability of AI to obey orders accurately a lot of thought at least due to practical (if not ethical) concerns.
I mean, I am currently willing to say “the AIs will almost definitely kill civilians but we should build them anyway” because I don’t work in defense. However, even I’m a little nervous saying that because one day I might want to. My friends who do work in defense have told me that the people who gave them clearance did investigate their online presence. (My background is in computational biochemistry but I look at what’s going on in AI and I feel like nothing else is important in comparison.)
As for cold comfort: I think autonomous weapons are inevitable in the same way that the atom bomb was inevitable. Even if no one wants to see it used, everyone wants to have it because enemies will. However, I don’t see a present need for strategic (as opposed to tactical) automation. A computer would have an advantage in battlefield control but strategy takes hours or days or years and so a human’s more reliable ability to reason would be more important in that domain.
Once a computer can reason better than a human can, that’s the end of the world as we know it. It’s also inevitable like the atom bomb.