Freefall 2537
Socks, Spoons and Neural Nets
[!0.987]2014-08-15
In nanotech, it's a “grey goo” scenario. On a larger scale, it's a “paperclip maximizer”. An A.I. with that programmed goal will try to turn everything in its reach into paperclips or paperclip production.
So what do you get with a system of autonomous robots that ALWAYS has human desires as its top priority?
A human maximizer.
Good news if you're a human. Bad news if you're anything else.
Color by George Peterson
Bowman talks about several mental experiments leading up to the end-of-the-world scenario – about uncontrolled growth self-replicating nanobots (Mityai)