ARGen: Affect-Reinforced Generative Augmentation towards Vision-based Dynamic Emotion Perception
Not on the map. Why?
Abstract (arXiv)
Dynamic facial expression recognition in the wild remains challenging due to data scarcity and long-tail distributions, which hinder models from effectively learning the temporal dynamics of scarce emotions. To address these limitations, we propose ARGen, an Affect-Reinforced Generative Augmentation Framework that enables data-adaptive dynamic expression generation for robust emotion perception. ARGen operates in two stages: Affective Semantic Injection (ASI) and Adaptive Reinforcement Diffusion (ARD). The ASI stage establishes affective knowledge alignment through facial Action Units and employs a retrieval-augmented prompt generation strategy to synthesize consistent and fine-grained affective descriptions via large-scale visual-language models, thereby injecting interpretable emotional priors into the generation process. The ARD stage integrates text-conditioned image-to-video diffusion with reinforcement learning, introducing inter-frame conditional guidance and a multi-objective reward function to jointly optimize expression naturalness, facial integrity, and generative efficiency. Extensive experiments on both generation and recognition tasks verify that ARGen substantially enhances synthesis fidelity and improves recognition performance, establishing an interpretable and generalizable generative augmentation paradigm for vision-based affective computing.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 49 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
33 of 49 references.
References · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
- 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 310
21 more
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2018Deep Facial Expression Recognition: A Surveycited by 269
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2022Diffusion Models for Video Prediction and Infillingcited by 134
- 2020DFEW: A Large-Scale Database for Recognizing Dynamic Facial Expressions in the Wildcited by 128
- 2024Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuningcited by 117
- 2023End-to-End Diffusion Latent Optimization Improves Classifier Guidancecited by 107
- 2022FERV39k: A Large-Scale Multi-Scene Dataset for Facial Expression Recognition in Videoscited by 69
- 2018Pose Guided Human Video Generationcited by 67
- 2021VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognitioncited by 65
- 2021Understanding Object Dynamics for Interactive Image-to-Video Synthesiscited by 38
- 2024LTGC: Long-tail Recognition via Leveraging LLMs-driven Generated Contentcited by 33
- 2024Towards Localized Fine-Grained Control for Facial Expression Generationcited by 12
- 2024Static for Dynamic: Towards a Deeper Understanding of Dynamic Facial Expressions Using Static Expression Datacited by 9
- 2024EMOdiffhead: Continuously Emotional Control in Talking Head Generation via Diffusioncited by 6
- 2024D2SP: Dynamic Dual-Stage Purification Framework for Dual Noise Mitigation in Vision-based Affective Recognitioncited by 3
- 2024FacEnhance: Facial Expression Enhancing with Recurrent DDPMscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Personalized Emotional Intelligence in Generative AI through Symbolic Affective Reasoning
- 2026Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring
- 2025Text-guided Weakly Supervised Framework for Dynamic Facial Expression Recognition
- 2026AffectFuse: Cross-Task Feature Fusion with Temporal Modeling for Multi-Task Affective Behavior Analysis
- 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimization
- 2026AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional Rectified Flow
- 2026EmoScene: A Dual-space Dataset for Controllable Affective Image Generation
- 2025EmoFeedback2: Reinforcement of Continuous Emotional Image Generation via LVLM-based Reward and Textual Feedback