FreeSliders: Training-Free, Modality-Agnostic Concept Sliders for Fine-Grained Diffusion Control in Images, Audio, and Video
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion models have become state-of-the-art generative models for images, audio, and video, yet enabling fine-grained controllable generation, i.e., continuously steering specific concepts without disturbing unrelated content, remains challenging. Concept Sliders (CS) offer a promising direction by discovering semantic directions through textual contrasts, but they require per-concept training and architecture-specific fine-tuning (e.g., LoRA), limiting scalability to new modalities. In this work we introduce FreeSliders, a simple yet effective approach that is fully training-free and modality-agnostic, achieved by partially estimating the CS formula during inference. To support modality-agnostic evaluation, we extend the CS benchmark to include both video and audio, establishing the first suite for fine-grained concept generation control with multiple modalities. We further propose three evaluation properties along with new metrics to improve evaluation quality. Finally, we identify an open problem of scale selection and non-linear traversals and introduce a two-stage procedure that automatically detects saturation points and reparameterizes traversal for perceptually uniform, semantically meaningful edits. Extensive experiments demonstrate that our method enables plug-and-play, training-free concept control across modalities, improves over existing baselines, and establishes new tools for principled controllable generation. An interactive presentation of our benchmark and method is available at: https://azencot-group.github.io/FreeSliders/
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 52 of its 58 references that are in the map. First posted on arXiv 30 Oct 2025.
Builds on
52 of 58 references.
Closest ancestors · 6
Same direction, newest first
- 2024Prompt Sliders for Fine-Grained Control, Editing and Erasing of Concepts in Diffusion Models25 Sep
- 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models20 Nov
- 2023Text-to-image Diffusion Models in Generative AI: A Survey14 Mar
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
Other references · 46
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022Video Diffusion Modelscited by 2,280
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
34 more
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2018Disentangling by Factorisingcited by 614
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 307
- 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generationcited by 256
- 2019On the "steerability" of generative adversarial networkscited by 247
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2024Stable Audio Opencited by 192
- 2022HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detectioncited by 174
- 2021Taming Visually Guided Sound Generationcited by 136
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
- 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 58
- 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 46
- 2024Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Seriescited by 42
- 2021Contrastively Disentangled Sequential Variational Autoencodercited by 34
- 2023DisDiff: Unsupervised Disentanglement of Diffusion Probabilistic Modelscited by 30
- 2023Multifactor Sequential Disentanglement via Structured Koopman Autoencoderscited by 23
- 2025CASteer: Cross-Attention Steering for Controllable Concept Erasurecited by 14
- 2023Sample and Predict Your Latent: Modality-free Sequential Disentanglement via Contrastive Estimationcited by 10
- 2023Audio Editing with Non-Rigid Text Promptscited by 8
- 2024Sequential Disentanglement by Extracting Static Information From A Single Sequence Elementcited by 7
- 2024Reviving Life on the Edge: Joint Score-Based Graph Generation of Rich Edge Attributescited by 6
- 2025DiffSDA: Unsupervised Diffusion Sequential Disentanglement Across Modalitiescited by 2
- 2025Disentanglement Beyond Static vs. Dynamic: A Benchmark and Evaluation Framework for Multi-Factor Sequential Representationscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Text Slider: Efficient and Plug-and-Play Continuous Concept Control for Image/Video Synthesis via LoRA Adapters
- 2025SliderSpace: Decomposing the Visual Capabilities of Diffusion Models
- 2026Semantic Steering for Controllable Generation: Tuning-Free Concept Erasure in Multimodal Diffusion Transformers
- 2024Scaling Concept With Text-Guided Diffusion Models
- 2025Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spaces
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey
- 2025Prompt-aware classifier free guidance for diffusion models
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidance