mlsanityData to 7 Oct 2026

The Failure Is in the Readout: Fine-Grained Emotion Recognition Benchmarks Measure Elicitation, Not Perception

arXiv 2610.08162 ↗First posted 6 Oct 2026cs.CV cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Fine-grained emotion recognition supports therapy tools and social robots, but it needs facial data, which raises privacy and data-protection concerns. EmoNet-Face-HQ answers that with generated portraits, expert-rated over a 40-category taxonomy far finer than the usual six to eight basic emotions. Under the protocol it ships with, vision-language models (VLMs) score poorly on that taxonomy, and the benchmark concludes that a dedicated fine-tuned model is necessary: Empathic-Insight-Face (EIF; Small/Large). We show that off-the-shelf VLMs match or beat that fine-tuned model when the answer is not generated but read from the logits, as one binary query per category. We keep the benchmark's images, taxonomy and ratings, and change only how the answer is read. Experts agree at kappaw = 0.468 on the five categories they measure most reliably. Generatively, no interval among eleven open-weight VLMs lies entirely above that anchor (kappaw=0.268-0.486). Under verification all eleven clear it, each of them significantly better at kappaw=0.507-0.586. Three also significantly beat EIF sitting at kappaw = 0.551 (Small; 0.534 Large). The gain comes from the graded probability and not from asking a yes/no question: as a control, thresholding those same probabilities to yes/no costs 142% of the average gains and drops binarization below generative elicitation to kappaw=0.254-0.423. A replication on real photographs (FACES) is weaker and mixed: of the ten models that pass a validity gate, six gain, three are neutral to positive and one is negative, so the effect is not confined to synthetic data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 6 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EmoNet-Face: An Expert-Annotated Benchmark for Synthetic Emotion Recognition
  2. 2025EEmo-Bench: A Benchmark for Multi-modal Large Language Models on Image Evoked Emotion Assessment
  3. 2024E-ICL: Enhancing Fine-Grained Emotion Recognition through the Lens of Prototype Theory
  4. 2025Evaluating Vision-Language Models for Emotion Recognition
  5. 2025Fine-Grained Emotion Recognition via In-Context Learning
  6. 2026E3mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment
  7. 2025Reading Smiles: Proxy Bias in Foundation Models for Facial Emotion Recognition
  8. 2026Why Do Vision Language Models Struggle To Recognize Human Emotions?