Barycentric Guidance: Turning Foundation Image Editors into Continuous Affective Controllers
Not on the map. Why?
Abstract (arXiv)
Emotions are expressed on a continuum and are naturally described in the valence-arousal (VA) space. Existing VA-based image editors are typically training-based and domain-specific, limiting them to VA regions seen during training and making them brittle across datasets and domains. Meanwhile, despite producing high-quality edits, state-of-the-art foundation image editors are not continuous affective controllers: non-linear emotion representations in text encoders makes prompt interpolation poorly calibrated, so accurate and continuous VA control remains unreliable. To fill this gap, we introduce Barycentric Guidance, a training-free framework that turns pretrained foundation image editors into continuous affective controllers over VA, requiring no finetuning, extra data, or model changes. Our method maps any target VA point to simplex-based guidance weights, enabling VA controllability in three aspects: (i) accurate targeting of VA states, (ii) broad coverage across the VA plane, and (iii) continuous control. Across three face datasets, we improve VA target accuracy by 25-29%, expand VA-plane coverage by 28-50%, and increase expression diversity by 29-49%, over the strongest baseline. Unlike prior domain-specific methods, our training-free approach exploits the foundation model's inherent versatility, enabling generalization beyond human faces to animals, artworks, and complex scenes within a single framework. Code is available at https://github.com/harveymannering/BarycentricGuidance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 65 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
46 of 65 references.
References · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
34 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2016Improved Techniques for Training GANscited by 2,970
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2025DINOv3cited by 1,414
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
- 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
- 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 161
- 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
- 2023DiffusionRig: Learning Personalized Priors for Facial Appearance Editingcited by 75
- 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
- 2024EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Modelscited by 37
- 2025WAFT: Warping-Alone Field Transforms for Optical Flowcited by 34
- 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 30
- 2024FluxSpace: Disentangled Semantic Editing in Rectified Flow Transformerscited by 27
- 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Modelcited by 26
- 2024FindingEmo: An Image Dataset for Emotion Recognition in the Wildcited by 22
- 2025Kontinuous Kontext: Continuous Strength Control for Instruction-based Image Editingcited by 18
- 2024Make Me Happier: Evoking Emotions Through Image Diffusion Modelscited by 16
- 2024Towards Localized Fine-Grained Control for Facial Expression Generationcited by 13
- 2025Affective Image Editing: Shaping Emotional Factors via Text Descriptionscited by 12
- 2024A Unified and Interpretable Emotion Representation and Expression Generationcited by 11
- 2025EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generationcited by 11
- 2025HiFi-Portrait: Zero-shot Identity-preserved Portrait Generation with High-fidelity Multi-face Fusioncited by 5
- 2025FaceCrafter: Identity-Conditional Diffusion with Disentangled Control over Facial Pose, Expression, and Emotioncited by 4
- 2025EmoStyle: Emotion-Driven Image Stylizationcited by 3
- 2026PixelSmile: Toward Fine-Grained Facial Expression Editingcited by 1
Built on by
Not cited yet.