Unpredictability of AI: On the Impossibility of Accurately Predicting All Actions of a Smarter Agent
Roman V. Yampolskiy
Abstract
The young field of AI Safety is still in the process of identifying its challenges and limitations. In this paper, we formally describe one such impossibility result, namely Unpredictability of AI. We prove that it is impossible to precisely and consistently predict what specific actions a smarter-than-human intelligent system will take to achieve its objectives, even if we know the terminal goals of the system. In conclusion, the impact of Unpredictability on AI Safety is discussed.
Topics & Concepts
ImpossibilityProcess (computing)Computer scienceField (mathematics)Risk analysis (engineering)Artificial intelligenceComputer securityData scienceBusinessPolitical scienceMathematicsLawOperating systemPure mathematicsComputability, Logic, AI AlgorithmsReinforcement Learning in RoboticsBayesian Modeling and Causal Inference