mlsanityData to 7 Oct 2026

The Unreasonable Effectiveness of Text Embedding Interpolation for Continuous Image Steering

arXiv 2603.17998 ↗First posted 18 Mar 2026cs.CVcited by 4

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

We present a training-free framework for continuous and controllable image editing at test time for text-conditioned generative models. In contrast to prior approaches that rely on additional training or manual user intervention, we find that a simple steering in the text-embedding space is sufficient to produce smooth edit control. Given a target concept (e.g., enhancing photorealism or changing facial expression), we use a large language model to automatically construct a small set of debiased contrastive prompt pairs, from which we compute a steering vector in the generator's text-encoder space. We then add this vector directly to the input prompt representation to control generation along the desired semantic axis. To obtain a continuous control, we propose an elastic range search procedure that automatically identifies an effective interval of steering magnitudes, avoiding both under-steering (no-edit) and over-steering (changing other attributes). Adding the scaled versions of the same vector within this interval yields smooth and continuous edits. Since our method modifies only textual representations, it naturally generalizes across text-conditioned modalities, including image and video generation. To quantify the steering continuity, we introduce a new evaluation metric that measures the uniformity of semantic change across edit strengths. We compare the continuous editing behavior across methods and find that, despite its simplicity and lightweight design, our approach is comparable to training-based alternatives, outperforming other training-free methods.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 44 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

39 of 44 references.

References · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2025Qwen3-VL Technical Reportcited by 2,534
  12. 2022Video Diffusion Modelscited by 2,280
27 more
  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  2. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  3. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
  4. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  5. 2025Qwen-Image Technical Reportcited by 973
  6. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  7. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  8. 2023Steering Language Models With Activation Engineeringcited by 824
  9. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
  10. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  11. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
  12. 2025VACE: All-in-One Video Creation and Editingcited by 467
  13. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  14. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  15. 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Modelscited by 148
  16. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
  17. 2024CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusioncited by 72
  18. 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
  19. 2024Spectral Editing of Activations for Large Language Model Alignmentcited by 54
  20. 2025Angular Steering: Behavior Control via Rotation in Activation Spacecited by 45
  21. 2024Continuous, Subject-Specific Attribute Control in T2I Models by Identifying Semantic Directionscited by 39
  22. 2024Interpreting the Weight Space of Customized Diffusion Modelscited by 35
  23. 2024Controlling Large Language Model Agents with Entropic Activation Steeringcited by 29
  24. 2024FluxSpace: Disentangled Semantic Editing in Rectified Flow Transformerscited by 25
  25. 2025Kontinuous Kontext: Continuous Strength Control for Instruction-based Image Editingcited by 15
  26. 2025SliderEdit: Continuous Image Editing with Fine-Grained Instruction Controlcited by 12
  27. 2025SAEdit: Token-level control for continuous image editing via Sparse AutoEncodercited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Prompt-Softbox-Prompt: A Free-Text Embedding Control for Image Editing
  2. 2024Learn Once, Edit Anywhere: Visual Direction Transfer for Diffusion Models
  3. 2026Language-Free Generative Editing from One Visual Example
  4. 2023AdapEdit: Spatio-Temporal Guided Adaptive Editing Algorithm for Text-Based Continuity-Sensitive Image Editing
  5. 2023iEdit: Localised Text-guided Image Editing with Weak Supervision
  6. 2025EditInfinity: Image Editing with Binary-Quantized Generative Models
  7. 2023Manipulating Embeddings of Stable Diffusion Prompts
  8. 2025Controllable-Continuous Color Editing in Diffusion Model via Color Mapping