Emotion-Inspired Learning Signals (EILS): A Homeostatic Framework for Adaptive Autonomous Agents
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
The ruling method in modern Artificial Intelligence spanning from Deep Reinforcement Learning (DRL) to Large Language Models (LLMs) relies on a surge of static, externally defined reward functions. While this "extrinsic maximization" approach has rendered superhuman performance in closed, stationary fields, it produces agents that are fragile in open-ended, real-world environments. Standard agents lack internal autonomy: they struggle to explore without dense feedback, fail to adapt to distribution shifts (non-stationarity), and require extensive manual tuning of static hyperparameters. This paper proposes that the unaddressed factor in robust autonomy is a functional analog to biological emotion, serving as a high-level homeostatic control mechanism. We introduce Emotion-Inspired Learning Signals (EILS), a unified framework that replaces scattered optimization heuristics with a coherent, bio-inspired internal feedback engine. Unlike traditional methods that treat emotions as semantic labels, EILS models them as continuous, homeostatic appraisal signals such as Curiosity, Stress, and Confidence. We formalize these signals as vector-valued internal states derived from interaction history. These states dynamically modulate the agent's optimization landscape in real time: curiosity regulates entropy to prevent mode collapse, stress modulates plasticity to overcome inactivity, and confidence adapts trust regions to stabilize convergence. We hypothesize that this closed-loop homeostatic regulation can enable EILS agents to outperform standard baselines in terms of sample efficiency and non-stationary adaptation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 16 of its 32 references that are in the map. First posted on arXiv 20 Dec 2025.
Builds on
16 of 32 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2016Concrete Problems in AI Safetycited by 1,642
- 2018World Modelscited by 1,513
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,150
- 2018Exploration by Random Network Distillationcited by 993
4 more
- 2017Population Based Training of Neural Networkscited by 367
- 2018Reward learning from human preferences and demonstrations in Ataricited by 316
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
- 2024Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Resetcited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022Teaching Drones on the Fly: Can Emotional Feedback Serve as Learning Signal for Training Artificial Agents?
- 2026Emotion2Skill: Model-Internal Emotion Signals for Adaptive Skill Selection and Evolution
- 2026A Mathematical Model of Motivated Emotional Mind - Cognitive Embodied System
- 2026Dual-Loop Self-Evolution via Verifiable Emotion Feedback for Multi-Turn Empathetic Dialogue
- 2025Emotion-Gradient Metacognitive RSI (Part I): Theoretical Foundations and Single-Agent Architecture
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems
- 2026Intrinsic Motivation in Reinforcement Learning: A Research Agenda for Adaptive Self-Organisation
- 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agents