The Archimedean trap: Why traditional reinforcement learning will probably not yield AGI
Not on the map. Why?
Abstract (arXiv)
After generalizing the Archimedean property of real numbers in such a way as to make it adaptable to non-numeric structures, we demonstrate that the real numbers cannot be used to accurately measure non-Archimedean structures. We argue that, since an agent with Artificial General Intelligence (AGI) should have no problem engaging in tasks that inherently involve non-Archimedean rewards, and since traditional reinforcement learning rewards are real numbers, therefore traditional reinforcement learning probably will not lead to AGI. We indicate two possible ways traditional reinforcement learning could be altered to remove this roadblock.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 1.
6 papers.
- 2022A Survey on Reinforcement Learning Methods in Character Animationcited by 12
- 2022Computable Artificial General Intelligencecited by 6
- 2023On the Computation of Meaning, Language Models and Incomprehensible Horrorscited by 5
- 2021Measuring Intelligence and Growth Rate: Variations on Hibbard's Intelligence Measurecited by 3
- 2021Reward-Punishment Symmetric Universal Intelligencecited by 3
- 2021Representation and Invariance in Reinforcement Learningcited by 0
- 2023On the Computation of Meaning, Language Models and Incomprehensible Horrors25 Apr 2023
- 2022Computable Artificial General Intelligence21 May 2022
- 2022A Survey on Reinforcement Learning Methods in Character Animation7 Mar 2022
- 2021Representation and Invariance in Reinforcement Learning14 Dec 2021
- 2021Reward-Punishment Symmetric Universal Intelligence6 Oct 2021
- 2021Measuring Intelligence and Growth Rate: Variations on Hibbard's Intelligence Measure25 Jan 2021