mlsanityData to 7 Oct 2026

EMPA: Evaluating Persona-Aligned Empathy as a Process

arXiv 2603.00552 ↗First posted 28 Feb 2026cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Evaluating persona-aligned empathy in LLM-based dialogue agents remains challenging. User states are latent, feedback is sparse and difficult to verify in situ, and seemingly supportive turns can still accumulate into trajectories that drift from persona-specific needs. We introduce EMPA, a process-oriented framework that evaluates persona-aligned support as sustained intervention rather than isolated replies. EMPA distills real interactions into controllable, psychologically grounded scenarios, couples them with an open-ended multi-agent sandbox that exposes strategic adaptation and failure modes, and scores trajectories in a latent psychological space by directional alignment, cumulative impact, and stability. The resulting signals and metrics support reproducible comparison and optimization of long-horizon empathic behavior, and they extend to other agent settings shaped by latent dynamics and weak, hard-to-verify feedback.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 17 of its 41 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

17 of 41 references.

References · 17

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  4. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  5. 2023Large Language Modelscited by 774
  6. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  7. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
  8. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 288
  9. 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
  10. 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Modelscited by 161
  11. 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agentscited by 66
  12. 2024Explaining Length Bias in LLM-Based Preference Evaluationscited by 48
5 more
  1. 2026Alternating Reinforcement Learning for Rubric-Based Reward Modeling in Non-Verifiable LLM Post-Trainingcited by 45
  2. 2025Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Modelscited by 21
  3. 2023An In-depth Investigation of User Response Simulation for Conversational Searchcited by 20
  4. 2025Goal Alignment in LLM-Based User Simulators for Conversational AIcited by 19
  5. 2024Automated test generation to evaluate tool-augmented LLMs as conversational AI agentscited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Measurement to Expertise: Empathetic Expert Adapters for Context-Based Empathy in Conversational AI Agents
  2. 2026ComPASS: Towards Personalized Agentic Social Support via Tool-Augmented Companionship
  3. 2026From Triggers to Emotions: A CPM-Grounded Appraisal Multi-Agent for Dynamic Emotional Evolution in Persona-Based Dialogue
  4. 2026From Empathy to Personalized Empathy: Adapting Empathetic Strategies to Individual Users
  5. 2025Following the TRACE: A Structured Path to Empathetic Response Generation with Multi-Agent Models
  6. 2025PEER: Unified Process-Outcome Reinforcement Learning for Structured Empathetic Reasoning
  7. 2026Behavior-Adaptive Conversational Agents: Toward a Fluid Personality Framework
  8. 2025Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learning