mlsanityData to 7 Oct 2026

Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learning

arXiv 2512.01282 ↗First posted 1 Dec 2025cs.CL cs.AIcited by 22

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

As web platforms evolve towards greater personalization and emotional complexity, conversational agents must transcend superficial empathy to demonstrate identity-aware emotional reasoning. However, existing systems face two limitations: (1) reliance on situation-centric datasets lacking persistent user identity, which hampers the capture of personalized affective nuances; and (2) dependence on opaque, coarse reward signals that hinder development of verifiable empathetic reasoning. To address these gaps, we introduce KardiaBench, a large-scale user-grounded benchmark comprising 178,080 QA pairs across 22,080 multi-turn conversations anchored to 671 real-world profiles. The dataset is constructed via a model-in-the-loop pipeline with iterative rubric-guided refinement to ensure psychological plausibility and persona consistency. This progressive empathy pipeline that integrates user comprehension, contextual reasoning, and emotion perception into conversations, followed by iterative critique and rubric-based refinement to ensure psychological plausibility, emotional fidelity, and persona consistency. Building on this, we propose Kardia-R1, a framework that trains models for interpretable, stepwise empathetic cognition. Kardia-R1 leverages Rubric-as-Judge Empathetic Reinforcement Learning (Rubric-ERL), a GRPO-based method that uses explainable, human-aligned rubric rewards to tightly couple user understanding, emotional inference, and supportive response generation. Extensive experiments across four LLM backbones demonstrate that Kardia-R1 consistently outperforms othet methods in emotion accuracy, empathy, relevance, persona consistency, and safety. Our dataset and model will be released at https://github.com/JhCircle/Kardia-R1.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 45 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

17 of 45 references.

References · 17

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2024Qwen2 Technical Reportcited by 2,076
  6. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  7. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
  8. 2024DeepSeek-V3 Technical Reportcited by 724
  9. 2025Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergycited by 204
  10. 2025RewardBench 2: Advancing Reward Model Evaluationcited by 136
  11. 2025Affordance-R1: Reinforcement Learning for Generalizable Affordance Reasoning in Multimodal Large Language Modelcited by 21
  12. 2025Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoningcited by 20
5 more
  1. 2025Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counselingcited by 17
  2. 2024Reinforcement Learning with Token-level Feedback for Controllable Text Generationcited by 16
  3. 2024ASEM: Enhancing Empathy in Chatbot through Attention-based Sentiment and Emotion Modelingcited by 7
  4. 2025SYNTHEMPATHY: A Scalable Empathy Corpus Generated Using LLMs Without Any Crowdsourcingcited by 7
  5. 2024EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimizationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 21.

22 papers.

Sort:

By area:

  1. 2026Do Not Waste Your Rollouts: Recycling Search Experience for Efficient Test-Time Scalingcited by 9
  2. 2026PERM: Psychology-grounded Empathetic Reward Modeling for Large Language Modelscited by 5
  3. 2026TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimizationcited by 5
  4. 2026From Holistic Evaluation to Structured Criteria: Rubrics Across the Evolving LLM Landscapecited by 4
  5. 2026How Do Decoder-Only LLMs Perceive Users? Rethinking Attention Masking for User Representation Learningcited by 3
  6. 2026EchoRL: Reinforcement Learning via Rollout Echoingcited by 3
  7. 2026Compatibility-Aware Dynamic Fine-Tuning for Large Language Modelscited by 3
  8. 2026MICA: Multi-granularity Intertemporal Credit Assignment for Long-Horizon Emotional Support Dialoguecited by 2
  9. 2026CompanionBench: A Theory-Anchored, Real-World-Grounded Benchmark for AI Emotional Companionshipcited by 2
  10. 2025HeartBench: Probing Core Dimensions of Anthropomorphic Intelligence in LLMscited by 1
  11. 2026Enhancing Video Representations with Spatiotemporal-Semantic Residual to Mitigate Hallucinations in Video Large Multimodal Modelscited by 1
  12. 2026Query as Anchor: Scenario-Adaptive User Representation via Large Language Modelcited by 1
10 more
  1. 2026ComPASS: Towards Personalized Agentic Social Support via Tool-Augmented Companionshipcited by 1
  2. 2026LifeSide: Benchmarking Agents as Lifelong Digital Companionscited by 1
  3. 2026Not All Negative Samples Are Equal: LLMs Learn Better from Plausible Reasoningcited by 0
  4. 2026AE-LLM: Adaptive Efficiency Optimization for Large Language Modelscited by 0
  5. 2026From Empathy to Personalized Empathy: Adapting Empathetic Strategies to Individual Userscited by 0
  6. 2026MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Modelscited by 0
  7. 2026Training Therapeutic Judges and Multi-Agent Systems for Human-Aligned Mental Health Supportcited by 0
  8. 2026Towards High-Level Semantic Intelligencecited by 0
  9. 2026Why It Hurts: Identifying the Drivers of Negative Thoughts in Emotional Support Conversationscited by 0
  10. 2026Evolving Support Priorities in Empathetic Reinforcement Learningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025PEER: Unified Process-Outcome Reinforcement Learning for Structured Empathetic Reasoning
  2. 2025RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agents
  3. 2026STRIDE-ED: A Strategy-Grounded Stepwise Reasoning Framework for Empathetic Dialogue Systems
  4. 2025From Measurement to Expertise: Empathetic Expert Adapters for Context-Based Empathy in Conversational AI Agents
  5. 2026EMPA: Evaluating Persona-Aligned Empathy as a Process
  6. 2025Empathy-R1: A Chain-of-Empathy and Reinforcement Learning Framework for Long-Form Mental Health Support
  7. 2026ESCRAG-R1: Retrieval-Augmented Reinforcement Learning for Emotional Support Conversation
  8. 2025From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment