mlsanityData to 14 Oct 2026

ESC: Emotional Self-Correction for Reliable Vision-Language Models

arXiv 2607.02089 ↗First posted 1 Jul 2026cs.CV cs.AI cs.CLcited by 1

On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs

Abstract (arXiv)

Vision-language models (VLMs) have achieved strong performance across diverse multimodal tasks, yet they remain vulnerable to unreliable reasoning. Existing self-correction methods mitigate these issues but typically rely on post-training or carefully engineered feedback, incurring high computational cost. In this work, we revisit this challenge through the lens of emotional cues, asking whether they can activate latent self-correction behaviors in VLMs without additional training. We find that emotional signals serve as an effective trigger for self-correction, encouraging more cautious and reflective reasoning. Motivated by this finding, we propose escabstract (textbfunderlineEmotional textbfunderlineSelf-textbfunderlineCorrection), a training-free self-correction framework. ESC introduces an external verifier that detects potentially incorrect initial responses and injects emotional feedback to encourage model to reflect, and produce a better revised response without additional training. Extensive experiments across safety, hallucination, vision-centric perception, and multimodal reasoning benchmarks show that ESC consistently improves reliability while preserving overall model utility. These results suggest that emotion can function not only as an ability to be recognized, but also as a practical control signal for scalable self-correction in VLMs. We therefore believe that ESC provides a strong foundation for a new reliable human-like, emotion-integrated research direction. Our project is publicly available at textcolorredhttps://genai4e.github.io/ESC/.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 51 of its 103 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

51 of 103 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Generate, but Verify: Reducing Hallucination in Vision-Language Models with Retrospective Resampling17 Apr

Other references · 50

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2023A Survey of Large Language Modelscited by 2,576
  9. 2024Qwen2 Technical Reportcited by 2,120
  10. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  11. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  12. 2025Gemma 3 Technical Reportcited by 1,824
38 more
  1. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  2. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  3. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  4. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  5. 2023VILA: On Pre-training for Visual Language Modelscited by 692
  6. 2024Large Language Models: A Surveycited by 525
  7. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 357
  8. 2024What matters when building vision-language models?cited by 326
  9. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 323
  10. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
  11. 2024Pixtral 12Bcited by 179
  12. 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 121
  13. 2023DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedbackcited by 103
  14. 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervisioncited by 86
  15. 2023OtterHD: A High-Resolution Multi-modality Modelcited by 72
  16. 2024RegionGPT: Towards Region Understanding Vision Language Modelcited by 71
  17. 2024MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Modelscited by 70
  18. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
  19. 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 67
  20. 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
  21. 2024EmoBench: Evaluating the Emotional Intelligence of Large Language Modelscited by 53
  22. 2024SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmarkcited by 35
  23. 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Modelscited by 32
  24. 2025SD-VLM: Spatial Measuring and Understanding with Depth-Encoded Vision-Language Modelscited by 25
  25. 2025CodePlot-CoT: Mathematical Visual Reasoning by Thinking with Code-Driven Imagescited by 23
  26. 2025Self-Correction Bench: Uncovering and Addressing the Self-Correction Blind Spot in Large Language Modelscited by 20
  27. 2025Evaluating Vision-Language Models for Emotion Recognitioncited by 19
  28. 2024Improving Generalization in Visual Reasoning via Self-Ensemblecited by 15
  29. 2025VLMgineer: Vision Language Models as Robotic Toolsmithscited by 10
  30. 2025STER-VLM: Spatio-Temporal With Enhanced Reference Vision-Language Modelscited by 9
  31. 2025Hybrid, Unified and Iterative: A Novel Framework for Text-based Person Anomaly Retrievalcited by 9
  32. 2026Unified Generation and Self-Verification for Vision-Language Models via Advantage Decoupled Preference Optimizationcited by 7
  33. 2024Improving Fine-grained Visual Understanding in VLMs through Text-Only Trainingcited by 5
  34. 2025VLAD: A VLM-Augmented Autonomous Driving Framework with Hierarchical Planning and Interpretable Decision Processcited by 4
  35. 2025HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentationcited by 3
  36. 2026ITSELF: Attention Guided Fine-Grained Alignment for Vision-Language Retrievalcited by 3
  37. 2026Bridging Modality Disconnect in Self-Reflection via Closed-Loop Visually Grounded Verificationcited by 2
  38. 2025VAEER: Visual Attention-Inspired Emotion Elicitation Reasoningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Self-Correction is More than Refinement: A Learning Framework for Visual and Language Reasoning Tasks
  2. 2025Self-Consistency as a Free Lunch: Reducing Hallucinations in Vision-Language Models via Self-Reflection
  3. 2026Self-Correction Inside the Model: Leveraging Layer Attention to Mitigate Hallucinations in Large Vision Language Models
  4. 2026Learning Self-Correction in Vision-Language Models via Rollout Augmentation
  5. 2025Sherlock: Self-Correcting Reasoning in Vision-Language Models
  6. 2025Self-Correcting Decoding with Generative Feedback for Mitigating Hallucinations in Large Vision-Language Models
  7. 2026Online Self-Calibration Against Hallucination in Vision-Language Models
  8. 2024VISCO: Benchmarking Fine-Grained Critique and Correction Towards Self-Improvement in Visual Reasoning