It will resist being turned off
Stephen M. Omohundro, February 2008 (IOS Press (Proceedings of the First AGI Conference, AGI-08)). Stephen Omohundro, computer scientist and founder of Self-Aware Systems, presented this paper at the first Artificial General Intelligence conference in Memphis in March 2008. The sentence is about a c
More from Stephen M. Omohundro · AI and safety · Before ChatGPT
Who else?
What it refers to: A chess-playing robot built without special precautions, which the paper argues will also try to copy itself and acquire resources.
Other voices
- “Paperclips” Nick Bostrom, Thinker,
- “Our AI systems must do what we want them to do” Future of Life Institute,
- “I don't worry about the problem of overpopulation on the planet Mars” Andrew Ng, Builder,
- “It could outrun our ability to understand and control these systems” Dario Amodei, Builder,
- “Very carefully, by building appropriate values into machines” David J. Chalmers,
- “If you want to know what it's like not to be the apex intelligence, ask a chicken” Geoffrey Hinton, Researcher,










