jwylie’s stuff

racing, food, anything but work 
« Back to blog

Artificial Intelligence needs motivation - just like Marvin the paranoid android

Edward Boyden has written an article on Artificial Intelligence - referencing Marvin the paranoid android.

"A really advanced intelligence, improperly motivated, might realize the impermanence of all things, calculate that the sun will burn out in a few billion years, and decide to play video games for the remainder of its existence, concluding that inventing an even smarter machine is pointless. (A corollary of this thinking might explain why we haven't found extraterrestrial life yet: intelligences on the cusp of achieving interstellar travel might be prone to thinking that with the galaxies boiling away in just 1019 years, it might be better just to stay home and watch TV.)"

More here...

http://www.technologyreview.com/biomedicine/23354/page1/
http://www.singularitysummit.com/program

Loading mentions Retweet

Comments (1)

Sep 10, 2009
 said...
Here is my thought. Any AI system has to have a goal/motivation. Even a basic GA has to have some sort of evaluation process which tells it is it getting closer or further away.
In an open ended problem the goal would be can this problem be solved within the span of the lifetime of our sun. If it can’t be then the system should tell you, tell you why, and stop working on the problem anyway.

Leave a comment...

 
To leave a comment on this posterous, please login by clicking one of the following.
Posterous-login     Connect     twitter