mlsanityData to 14 Oct 2026

Reward Valuation in Large Language Models: Causal Induction of Anhedonia

arXiv 2607.06626 ↗First posted 7 Jul 2026cs.LG q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent frontier models mimic complex aspects of human cognition. Here we ask whether this alignment extends into reward valuation, which we assess in a mechanistic framework. Specifically, we use clinical tests that were developed to evaluate anhedonia in human subjects with major depressive disorders. Mechanistically, anhedonia is frequently associated with dysregulation in the Nucleus Accumbens (NAc) and the broader dopaminergic reward system. While neuroimaging has localized these deficits, establishing a causal link between NAc activity and specific behavioral symptoms remains a challenge. We use these ideas from neuroscience to functionally identify reward-anticipatory units in state-of-the-art AI models, and evaluate their causal involvement via targeted perturbations. We find that not only are such model units predictive of NAc brain recordings, their perturbation also induces behavioral effects mirroring human anhedonia: the model opts for low-effort, low-reward tasks in effort-based decision-making paradigms. Crucially, our results demonstrate that this represents a specific deficit in self-centered reward valuation and anticipation--rather than a loss of task capability, reward calculation, or effort avoidance. This induced vulnerability aligns with clinical measures of anhedonia and motivation in humans, such as DARS and MAP-SR, instruments that contain no reward-related vocabulary, ruling out a purely lexical account of the perturbation effect. Taken together, our results suggest reward valuation circuits in AI models that functionally mimic those in humans.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 84 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

24 of 84 references.

References · 24

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2016Pointer Sentinel Mixture Modelscited by 3,096
  6. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  8. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  9. 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
  10. 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 318
  11. 2019Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain)cited by 128
  12. 2022The neuroconnectionist research programmecited by 48
12 more
  1. 2023Instruction-tuning Aligns LLMs to the Human Braincited by 40
  2. 2024The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Unitscited by 34
  3. 2025From Language to Cognition: How LLMs Outgrow the Human Language Networkcited by 30
  4. 2024Human-like object concept representations emerge naturally in multimodal large language modelscited by 25
  5. 2024Depression Diagnosis Dialogue Simulation: Self-improving Psychiatrist with Tertiary Memorycited by 14
  6. 2024Scaling Laws for Task-Optimized Models of the Primate Visual Ventral Streamcited by 13
  7. 2024TopoLM: brain-like spatio-functional organization in a topographic language modelcited by 12
  8. 2025Contour Integration Underlies Human-Like Visioncited by 6
  9. 2025Do Large Language Models Think Like the Brain? Sentence-Level Evidences from Layer-Wise Embeddings and fMRIcited by 6
  10. 2024PsychAdapter: Adapting LLM Transformers to Reflect Traits, Personality and Mental Healthcited by 5
  11. 2025Alignment between Brains and AI: Evidence for Convergent Evolution across Modalities, Scales and Training Trajectoriescited by 5
  12. 2025Inducing Dyslexia in Vision Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024HMM for Discovering Decision-Making Dynamics Using Reinforcement Learning Experiments
  2. 2026Sparse Reward Subsystem in Large Language Models
  3. 2026Debiasing Reward Models via Causally Motivated Inference-Time Intervention
  4. 2025Reward Model Interpretability via Optimal and Pessimal Tokens
  5. 2026How's it going? Reinforcement learning in language models recruits a functional welfare axis
  6. 2026BioLLMAgent: A Hybrid Framework with Enhanced Structural Interpretability for Simulating Human Decision-Making in Computational Psychiatry
  7. 2026A Transdiagnostic Space of Disorder Like Phenotypes in Reinforcement Learning Agents
  8. 2025Joint modeling for learning decision-making dynamics in behavioral experiments