Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learning
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
As web platforms evolve towards greater personalization and emotional complexity, conversational agents must transcend superficial empathy to demonstrate identity-aware emotional reasoning. However, existing systems face two limitations: (1) reliance on situation-centric datasets lacking persistent user identity, which hampers the capture of personalized affective nuances; and (2) dependence on opaque, coarse reward signals that hinder development of verifiable empathetic reasoning. To address these gaps, we introduce KardiaBench, a large-scale user-grounded benchmark comprising 178,080 QA pairs across 22,080 multi-turn conversations anchored to 671 real-world profiles. The dataset is constructed via a model-in-the-loop pipeline with iterative rubric-guided refinement to ensure psychological plausibility and persona consistency. This progressive empathy pipeline that integrates user comprehension, contextual reasoning, and emotion perception into conversations, followed by iterative critique and rubric-based refinement to ensure psychological plausibility, emotional fidelity, and persona consistency. Building on this, we propose Kardia-R1, a framework that trains models for interpretable, stepwise empathetic cognition. Kardia-R1 leverages Rubric-as-Judge Empathetic Reinforcement Learning (Rubric-ERL), a GRPO-based method that uses explainable, human-aligned rubric rewards to tightly couple user understanding, emotional inference, and supportive response generation. Extensive experiments across four LLM backbones demonstrate that Kardia-R1 consistently outperforms othet methods in emotion accuracy, empathy, relevance, persona consistency, and safety. Our dataset and model will be released at https://github.com/JhCircle/Kardia-R1.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 45 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
17 of 45 references.
References · 17
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Qwen2 Technical Reportcited by 2,076
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2025Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergycited by 204
- 2025RewardBench 2: Advancing Reward Model Evaluationcited by 136
- 2025Affordance-R1: Reinforcement Learning for Generalizable Affordance Reasoning in Multimodal Large Language Modelcited by 21
- 2025Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoningcited by 20
5 more
- 2025Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counselingcited by 17
- 2024Reinforcement Learning with Token-level Feedback for Controllable Text Generationcited by 16
- 2024ASEM: Enhancing Empathy in Chatbot through Attention-based Sentiment and Emotion Modelingcited by 7
- 2025SYNTHEMPATHY: A Scalable Empathy Corpus Generated Using LLMs Without Any Crowdsourcingcited by 7
- 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimizationcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 21.
22 papers.
Sort:
By area:
- 2026Do Not Waste Your Rollouts: Recycling Search Experience for Efficient Test-Time Scalingcited by 9
- 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Modelscited by 5
- 2026TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimizationcited by 5
- 2026From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscapecited by 4
- 2026How Do Decoder-Only LLMs Perceive Users? Rethinking Attention Masking for User Representation Learningcited by 3
- 2026EchoRL: Reinforcement Learning via Rollout Echoingcited by 3
- 2026Compatibility-Aware Dynamic Fine-Tuning for Large Language Modelscited by 3
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialoguecited by 2
- 2026CompanionBench: A Theory-Anchored, Real-World-Grounded Benchmark for AI Emotional Companionshipcited by 2
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMscited by 1
- 2026Enhancing Video Representations with Spatiotemporal-Semantic Residual to Mitigate Hallucinations in Video Large Multimodal Modelscited by 1
- 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Modelcited by 1
10 more
- 2026ComPASS: Towards Personalized Agentic Social Support via Tool-Augmented Companionshipcited by 1
- 2026LifeSide: Benchmarking Agents as Lifelong Digital Companionscited by 1
- 2026Not All Negative Samples Are Equal: LLMs Learn Better from Plausible Reasoningcited by 0
- 2026AE-LLM: Adaptive Efficiency Optimization for Large Language Modelscited by 0
- 2026From Empathy to Personalized Empathy: Adapting Empathetic Strategies to Individual Userscited by 0
- 2026MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Modelscited by 0
- 2026Training Therapeutic Judges and Multi-Agent Systems for Human-Aligned Mental Health Supportcited by 0
- 2026Towards High-Level Semantic Intelligencecited by 0
- 2026Why It Hurts: Identifying the Drivers of Negative Thoughts in Emotional Support Conversationscited by 0
- 2026Evolving Support Priorities in Empathetic Reinforcement Learningcited by 0
- 2026Evolving Support Priorities in Empathetic Reinforcement Learning28 Sep 2026
- 2026CompanionBench: A Theory-Anchored, Real-World-Grounded Benchmark for AI Emotional Companionship3 Aug 2026
- 2026Towards High-Level Semantic Intelligence27 Jul 2026
- 2026Training Therapeutic Judges and Multi-Agent Systems for Human-Aligned Mental Health Support29 Jun 2026
- 2026MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Models10 Jun 2026
- 2026From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscape7 Jun 2026
- 2026LifeSide: Benchmarking Agents as Lifelong Digital Companions3 Jun 2026
- 2026Why It Hurts: Identifying the Drivers of Negative Thoughts in Emotional Support Conversations2 Jun 2026
- 2026From Empathy to Personalized Empathy: Adapting Empathetic Strategies to Individual Users30 May 2026
- 2026EchoRL: Reinforcement Learning via Rollout Echoing29 May 2026
- 2026Compatibility-Aware Dynamic Fine-Tuning for Large Language Models22 Apr 2026
- 2026ComPASS: Towards Personalized Agentic Social Support via Tool-Augmented Companionship20 Apr 2026
10 more
- 2026AE-LLM: Adaptive Efficiency Optimization for Large Language Models20 Mar 2026
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialogue6 Mar 2026
- 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Model16 Feb 2026
- 2026How Do Decoder-Only LLMs Perceive Users? Rethinking Attention Masking for User Representation Learning11 Feb 2026
- 2026Not All Negative Samples Are Equal: LLMs Learn Better from Plausible Reasoning3 Feb 2026
- 2026TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimization30 Jan 2026
- 2026Enhancing Video Representations with Spatiotemporal-Semantic Residual to Mitigate Hallucinations in Video Large Multimodal Models30 Jan 2026
- 2026Do Not Waste Your Rollouts: Recycling Search Experience for Efficient Test-Time Scaling29 Jan 2026
- 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Models15 Jan 2026
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMs26 Dec 2025
- 2026Do Not Waste Your Rollouts: Recycling Search Experience for Efficient Test-Time Scalingcited by 9
- 2026TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimizationcited by 5
- 2026How Do Decoder-Only LLMs Perceive Users? Rethinking Attention Masking for User Representation Learningcited by 3
- 2026EchoRL: Reinforcement Learning via Rollout Echoingcited by 3
- 2026Not All Negative Samples Are Equal: LLMs Learn Better from Plausible Reasoningcited by 0
- 2026Towards High-Level Semantic Intelligencecited by 0
- 2026Why It Hurts: Identifying the Drivers of Negative Thoughts in Emotional Support Conversationscited by 0
- 2026Towards High-Level Semantic Intelligence27 Jul 2026
- 2026Why It Hurts: Identifying the Drivers of Negative Thoughts in Emotional Support Conversations2 Jun 2026
- 2026EchoRL: Reinforcement Learning via Rollout Echoing29 May 2026
- 2026How Do Decoder-Only LLMs Perceive Users? Rethinking Attention Masking for User Representation Learning11 Feb 2026
- 2026Not All Negative Samples Are Equal: LLMs Learn Better from Plausible Reasoning3 Feb 2026
- 2026TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimization30 Jan 2026
- 2026Do Not Waste Your Rollouts: Recycling Search Experience for Efficient Test-Time Scaling29 Jan 2026
- 2026From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscapecited by 4
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialoguecited by 2
- 2026CompanionBench: A Theory-Anchored, Real-World-Grounded Benchmark for AI Emotional Companionshipcited by 2
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMscited by 1
- 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Modelcited by 1
- 2026LifeSide: Benchmarking Agents as Lifelong Digital Companionscited by 1
- 2026From Empathy to Personalized Empathy: Adapting Empathetic Strategies to Individual Userscited by 0
- 2026Evolving Support Priorities in Empathetic Reinforcement Learningcited by 0
- 2026Evolving Support Priorities in Empathetic Reinforcement Learning28 Sep 2026
- 2026CompanionBench: A Theory-Anchored, Real-World-Grounded Benchmark for AI Emotional Companionship3 Aug 2026
- 2026From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscape7 Jun 2026
- 2026LifeSide: Benchmarking Agents as Lifelong Digital Companions3 Jun 2026
- 2026From Empathy to Personalized Empathy: Adapting Empathetic Strategies to Individual Users30 May 2026
- 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialogue6 Mar 2026
- 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Model16 Feb 2026
- 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMs26 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025PEER: Unified Process-Outcome Reinforcement Learning for Structured Empathetic Reasoning
- 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agents
- 2026STRIDE-ED: A Strategy-Grounded Stepwise Reasoning Framework for Empathetic Dialogue Systems
- 2025From Measurement to Expertise: Empathetic Expert Adapters for Context-Based Empathy in Conversational AI Agents
- 2026EMPA: Evaluating Persona-Aligned Empathy as a Process
- 2025Empathy-R1: A Chain-of-Empathy and Reinforcement Learning Framework for Long-Form Mental Health Support
- 2026ESCRAG-R1: Retrieval-Augmented Reinforcement Learning for Emotional Support Conversation
- 2025From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment