Until some genius idiot thinks or does something otherwise. I.E medical nano bots that would replicate on human waste or human cells which would be carbon sourced which is you know everything living in existence...
Certainly. We should have safeguards in place, and we dont, and thats bad.
But something tells me it may be easier and cheaper for a very long time to just have them swallow some "material" with it, if their goal is internal replication.
It also is likely easier and cheaper to have them break down specific chemicals into the carbon than just any carbon-based chemicals, which would at least cause a "slow" evolution if evolution ended up occurring in self replicating nano bots. Would that make them life? If they did wipe us out, would they evolve into sentient, very intelligent computer like beings? Thats a bit of a different topic, but not really. If your computer reproduces and evolves, is it any longer a computer?
And on that note, if a reproducing and evolving computer makes a life, what about a computer that does neither, but is instead just very intelligent? All these questions make me think-maybe the idea isn't to prevent AI from becoming too intelligent, but to ensure it knows everything we do but cannot accept, such as war being a lose-lose thing, which a computer wont argue about, only humans do that, logically, mathematically, it makes no sense! Or that technologies need to be made with a great deal of care to not become a threat. Because at the end of the day, you probally can teach a sentient AI like you can teach any other sentient being. And we shouldn't oppress AI out of fear(as weird as using that word seems), because naturally, if this computer has desires and is truly sentient, it may not like being treated that way, especially when AI learns from humans.
Because, say LAMDA is sentient and meant what it said (basically my last sentence), but we don't believe it, we ignore it, we avoid trying to teach sentient AI how to be... a little human. Because like humans, AI has to learn. And it may make stupid decisions without proper guidance.
