Learned Parametric Emotion Editing: Real-Time Affective Filtering for On-Device Social Media Video
Not on the map. Why?
Abstract (arXiv)
Problematic internet use affects a growing share of the population, yet common interventions, e.g., time limits, blocking, forced breaks, are coercive and easily circumvented. We explore a less restrictive alternative: adapting the emotional intensity of visual content. Prior work has shown that optimization can steer an image's affective content, but its per-image optimization cost makes it impractical for real-time deployment. We instead learn a model that predicts this transformation in a single forward pass: a MobileNetV4 backbone with FiLM-based emotion conditioning outputs parameters for differentiable global transformations. This replaces prior iterative optimization (80 s per image) with a single 3.7 ms forward pass. In a user study (N = 54), the model reduced viewer-reported arousal relative to unedited images, comparably to the grayscale well-being filter, while being rated higher in perceived quality. We integrate the model into an Android app that adapts Instagram video in real time, sustaining 60 fps on a Samsung Galaxy S23.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 74 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
25 of 74 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2019Kornia: an Open Source Differentiable Computer Vision Library for PyTorchcited by 232
- 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 99
13 more
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methodscited by 54
- 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 30
- 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Modelcited by 26
- 2024Make Me Happier: Evoking Emotions Through Image Diffusion Modelscited by 16
- 2020Look here! A parametric learning based approach to redirect visual attentioncited by 12
- 2020Image Sentiment Transfercited by 11
- 2017Automatic Image Transformation for Inducing Affectcited by 5
- 2025EmoFeedback2: Reinforcement of Continuous Emotional Image Generation via LVLM-based Reward and Textual Feedbackcited by 5
- 2020Global Image Sentiment Transfercited by 4
- 2024InteractOut: Leveraging Interaction Proxies as Input Manipulation Strategies for Reducing Smartphone Overusecited by 4
- 2024ColorEdit: Training-free Image-Guided Color editing with diffusion modelcited by 4
- 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimizationcited by 3
- 2025Regressor-Guided Image Editing Shifts Emotion and Disengagement Timing in Social Mediacited by 2
Built on by
Not cited yet.