Nociception as a Control Primitive: Afferent Channels and Nociceptive Memory for Agents Deployed in One Body
Not on the map. Why?
Abstract (arXiv)
An agent deployed in a single body cannot learn how fast that body wears, because every trial that would reveal its wear resistance wears the body it would protect. We study this epoch-one setting, in which the parameters of a fixed-weight policy are set before the body is drawn and never updated in life. The agent carries a load-gated nociceptive channel and a memory that retains what was felt. We prove that felt cost moves the allocation to the best-paid work not yet felt rather than the gentlest, that an agent without retention never sees the felt-cost constraint bind, and that the channel pays only where the threat is individually unpredictable, cheap to avoid and expensive to ignore. We measure per body, setting the agent with channel and memory against the same individual without them, where neither carries a schedule learned across lives. On 2,000 simulated floor-layer knees, with wear anchored to published loss rates, feeling, retaining and substituting extends the working life from age 55.2 to 59.6 and raises career output from 33.7 to 36.1. 69.3% of bodies gain and none lose. A body that feels but retains nothing past the day gains one of the +4.4 years, and retention carries the rest. A population-trained agent gains +0.65 years from the same channel at -0.54 output. The difference is what a species prior already supplies, and a single body has none. The two are related by an identity, the ablation mean reporting (1-chi) of the per-body value with chi the share a blind schedule already captures, so we report both. Where the regime map predicts value, a care robot sextuples its certified service life and a field-anchored fleet writes off 0.15 of its machines instead of 0.55. Where it predicts none, a rover gains little over blind caution, so the map holds in both directions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 83 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
29 of 83 references.
References · 29
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2017Constrained Policy Optimizationcited by 928
- 2016RL2: Fast Reinforcement Learning via Slow Reinforcement Learningcited by 490
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2017Safe Reinforcement Learning via Shieldingcited by 427
- 2019Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variablescited by 372
- 2019Control Barrier Functions: Theory and Applicationscited by 332
- 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 268
- 2014Robots that can adapt like animalscited by 203
- 2022In-context Reinforcement Learning with Algorithm Distillationcited by 186
- 2015Risk-Sensitive and Robust Decision-Making: a CVaR Optimization Approachcited by 162
17 more
- 2017Neural Episodic Controlcited by 148
- 2020Exploration-Exploitation in Constrained MDPscited by 146
- 2023Supervised Pretraining Can Learn In-Context Reinforcement Learningcited by 137
- 2023Human-Timescale Adaptation in an Open-Ended Task Spacecited by 136
- 2020Safe Reinforcement Learning in Constrained Markov Decision Processescited by 109
- 2016Model-Free Episodic Controlcited by 100
- 2014Optimizing the CVaR via Samplingcited by 98
- 2021Learning Policies with Zero or Bounded Constraint Violation for Constrained MDPscited by 78
- 2016Safe Exploration in Finite Markov Decision Processes with Gaussian Processescited by 72
- 2020Approximate information state for approximate planning and reinforcement learning in partially observed systemscited by 67
- 2016Conservative Banditscited by 58
- 2016Conservative Contextual Linear Banditscited by 56
- 2019Conservative Agency via Attainable Utility Preservationcited by 35
- 2021DOPE: Doubly Optimistic and Pessimistic Exploration for Safe Reinforcement Learningcited by 34
- 2018Managing engineering systems with large state and action spaces through deep reinforcement learningcited by 32
- 2022You Only Live Once: Single-Life Reinforcement Learningcited by 23
- 2021There Is No Turning Back: A Self-Supervised Approach for Reversibility-Aware Reinforcement Learningcited by 17
Built on by
Not cited yet.