mlsanityData to 14 Oct 2026

Barycentric Guidance: Turning Foundation Image Editors into Continuous Affective Controllers

arXiv 2610.16892 ↗First posted 12 Oct 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Emotions are expressed on a continuum and are naturally described in the valence-arousal (VA) space. Existing VA-based image editors are typically training-based and domain-specific, limiting them to VA regions seen during training and making them brittle across datasets and domains. Meanwhile, despite producing high-quality edits, state-of-the-art foundation image editors are not continuous affective controllers: non-linear emotion representations in text encoders makes prompt interpolation poorly calibrated, so accurate and continuous VA control remains unreliable. To fill this gap, we introduce Barycentric Guidance, a training-free framework that turns pretrained foundation image editors into continuous affective controllers over VA, requiring no finetuning, extra data, or model changes. Our method maps any target VA point to simplex-based guidance weights, enabling VA controllability in three aspects: (i) accurate targeting of VA states, (ii) broad coverage across the VA plane, and (iii) continuous control. Across three face datasets, we improve VA target accuracy by 25-29%, expand VA-plane coverage by 28-50%, and increase expression diversity by 29-49%, over the strongest baseline. Unlike prior domain-specific methods, our training-free approach exploits the foundation model's inherent versatility, enabling generalization beyond human faces to animals, artworks, and complex scenes within a single framework. Code is available at https://github.com/harveymannering/BarycentricGuidance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 65 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

46 of 65 references.

References · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  10. 2022Classifier-Free Diffusion Guidancecited by 5,847
  11. 2022Flow Matching for Generative Modelingcited by 5,702
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
34 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  2. 2016Improved Techniques for Training GANscited by 2,970
  3. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  7. 2025DINOv3cited by 1,414
  8. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
  9. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  10. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  11. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  12. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  13. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
  14. 2017AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wildcited by 492
  15. 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 161
  16. 2023EmoSet: A Large-scale Visual Emotion Dataset with Rich Attributescited by 82
  17. 2023DiffusionRig: Learning Personalized Priors for Facial Appearance Editingcited by 75
  18. 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 67
  19. 2024EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Modelscited by 37
  20. 2025WAFT: Warping-Alone Field Transforms for Optical Flowcited by 34
  21. 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 30
  22. 2024FluxSpace: Disentangled Semantic Editing in Rectified Flow Transformerscited by 27
  23. 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Modelcited by 26
  24. 2024FindingEmo: An Image Dataset for Emotion Recognition in the Wildcited by 22
  25. 2025Kontinuous Kontext: Continuous Strength Control for Instruction-based Image Editingcited by 18
  26. 2024Make Me Happier: Evoking Emotions Through Image Diffusion Modelscited by 16
  27. 2024Towards Localized Fine-Grained Control for Facial Expression Generationcited by 13
  28. 2025Affective Image Editing: Shaping Emotional Factors via Text Descriptionscited by 12
  29. 2024A Unified and Interpretable Emotion Representation and Expression Generationcited by 11
  30. 2025EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generationcited by 11
  31. 2025HiFi-Portrait: Zero-shot Identity-preserved Portrait Generation with High-fidelity Multi-face Fusioncited by 5
  32. 2025FaceCrafter: Identity-Conditional Diffusion with Disentangled Control over Facial Pose, Expression, and Emotioncited by 4
  33. 2025EmoStyle: Emotion-Driven Image Stylizationcited by 3
  34. 2026PixelSmile: Toward Fine-Grained Facial Expression Editingcited by 1

Built on by

Not cited yet.