mlsanityData to 7 Oct 2026

LaCoVL-FER: Landmark-Guided Contrastive Learning Network with Vision-Language Enhancement for Facial Expression Recognition

arXiv 2605.19821 ↗First posted 19 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Facial Expression Recognition (FER) in the wild requires models to identify subtle expression cues under large variations in pose, occlusion, illumination, and identity. Recent FER methods improve robustness by introducing visual attention, facial landmarks, or vision-language models as auxiliary priors. However, these priors are typically integrated in a static manner, failing to capture instance-specific facial variations, thereby resulting in severe attention redundancy and representation instability. To address this issue, we propose LaCoVL-FER, a landmark-guided contrastive learning network with vision-language enhancement for FER, which shifts FER from static prior injection to sample-adaptive prior refinement. Specifically, a Landmark-Guided Adaptive Encoder (LGAE) calibrates regional appearance features with landmark geometry through Bi-branch Gated Cross Attention (BGCA), suppressing noisy responses and producing expression-relevant representations. In parallel, a Vision-Language Enhancement Strategy (VLES) refines the generalizable visual features from a frozen CLIP image encoder into expression-specific visual representations. Based on them, an Expression-Conditioned Prompting (ECP) mechanism adapts fixed class-level textual prompts from the frozen CLIP text encoder into instance-aware textual representations. The resulting visual-textual representations are aligned as adaptive semantic priors to enhance robustness and generalization. Quantitative and qualitative experiments show that LaCoVL-FER outperforms state-of-the-art methods on RAF-DB, FERPlus, and AffectNet. The code is available at https://github.com/ylin06804/LaCoVL-FER.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 62 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

23 of 62 references.

References · 23

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  5. 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
  6. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 490
  7. 2013Challenges in Representation Learning: A report on three machine learning contestscited by 301
  8. 2016Training Deep Networks for Facial Expression Recognition with Crowd-Sourced Label Distributioncited by 158
  9. 2020Suppressing Uncertainties for Large-Scale Facial Expression Recognitioncited by 157
  10. 2019Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognitioncited by 127
  11. 2021Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognitioncited by 89
  12. 2021TransFER: Learning Relation-aware Facial Expression Representations with Transformerscited by 85
11 more
  1. 2022Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognitioncited by 67
  2. 2021Facial Expression Recognition with Visual Transformers and Attentional Selective Fusioncited by 49
  3. 2022POSTER: A Pyramid Cross-Fusion Transformer Network for Facial Expression Recognitioncited by 49
  4. 2018A Compact Embedding for Facial Expression Similaritycited by 41
  5. 2017Island Loss for Learning Discriminative Features in Facial Expression Recognitioncited by 35
  6. 2022Vision Transformer with Attentive Pooling for Robust Facial Expression Recognitioncited by 35
  7. 2018Personalized Machine Learning for Robot Perception of Affect and Engagement in Autism Therapycited by 29
  8. 2023CLIPER: A Unified Vision-Language Framework for In-the-Wild Facial Expression Recognitioncited by 27
  9. 2023LA-Net: Landmark-Aware Learning for Reliable Facial Expression Recognition under Label Noisecited by 17
  10. 2024ExpLLM: Towards Chain of Thought for Facial Expression Recognitioncited by 15
  11. 2024QCS: Feature Refining from Quadruplet Cross Similarity for Facial Expression Recognitioncited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Zero-Shot Facial Expression Recognition by LLM Knowledge Transfer
  2. 2024Knowledge-Enhanced Facial Expression Recognition with Emotional-to-Neutral Transformation
  3. 2025Rethinking Facial Expression Recognition in the Era of Multimodal Large Language Models: Benchmark, Datasets, and Beyond
  4. 2024FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space
  5. 2025An Evaluation of a Visual Question Answering Strategy for Zero-shot Facial Expression Recognition in Still Images
  6. 2025Multimodal Prompt Alignment for Facial Expression Recognition
  7. 2025Self-Supervised Multi-View Representation Learning using Vision-Language Model for 3D/4D Facial Expression Recognition
  8. 2023EmoCLIP: A Vision-Language Method for Zero-Shot Video Facial Expression Recognition