mlsanityData to 14 Oct 2026

AcFlow: Controlling Text-to-Image Diffusion Transformers via Learned Conditional Activation Flow

arXiv 2609.10723 ↗First posted 9 Sep 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-image diffusion transformers (DiTs) are powerful generators, yet direct prompting provides limited control interface for style intensity and can fail to suppress unwanted concepts. To enable these controls, we introduce AcFlow, an inference-time controller that transports intermediate layer image-token activations through a learned concept-conditioned velocity field while keeping the base DiT frozen. A textual concept description specifies the desired intervention, while the integration horizon provides a continuous control parameter. The field produces token-varying, activation-dependent updates. With parameters shared across concepts within each task family, one field covers over 15,000 style descriptions or over 1,000 suppression concepts, and generalizes to concepts unseen during training without per-concept fitting. On style control, AcFlow achieves the best style--content trade-off among the evaluated baselines in the high-style-alignment regime. At a fixed operating point, AcFlow attains style--content alignment of 0.5365/0.2860, compared with 0.4397/0.2684 for the baseline with the highest style alignment. On concept suppression, AcFlow reduces the fraction of images showing the concept from 95.3%/82.1% to 41.6%/40.5% on held-in/held-out concepts, including cases where deleting them from the prompt fails to remove them. Our analyses support the learned velocity field as an adaptive control mechanism, with update directions varying across tokens and depending on their activation states. Our code is available at https://github.com/Nove1yst/AcFlow.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 48 of its 51 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

48 of 51 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026SHIFT: Steering Hidden Intermediates in Flow Transformers10 Apr
  2. 2026Attention, May I Have Your Decision? Localizing Generative Choices in Diffusion Models29 Mar
  3. 2025Text Slider: Efficient and Plug-and-Play Continuous Concept Control for Image/Video Synthesis via LoRA Adapters23 Sep
  4. 2024FluxSpace: Disentangled Semantic Editing in Rectified Flow Transformers12 Dec
  5. 2024Continuous, Subject-Specific Attribute Control in T2I Models by Identifying Semantic Directions25 Mar
  6. 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models20 Nov
  7. 2023Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA12 Apr
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov

Other references · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2025Qwen3 Technical Reportcited by 8,820
  8. 2023Segment Anythingcited by 8,234
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  10. 2022Scalable Diffusion Models with Transformerscited by 6,054
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2022Flow Matching for Generative Modelingcited by 5,702
28 more
  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  3. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  4. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  5. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  6. 2023Erasing Concepts from Diffusion Modelscited by 539
  7. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
  8. 2023Unified Concept Editing in Diffusion Modelscited by 388
  9. 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 317
  10. 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 307
  11. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  12. 2023Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models?cited by 250
  13. 2023To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Nowcited by 210
  14. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  15. 2023One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applicationscited by 169
  16. 2024EraseAnything: Enabling Concept Erasure in Rectified Flow Transformerscited by 95
  17. 2024Controlling Language and Diffusion Models by Transporting Activationscited by 68
  18. 2024Holistic Unlearning Benchmark: A Multi-Faceted Evaluation for Text-to-Image Diffusion Model Unlearningcited by 21
  19. 2025CASteer: Cross-Attention Steering for Controllable Concept Erasurecited by 16
  20. 2025Activation Steering with a Feedback Controllercited by 15
  21. 2024Six-CD: Benchmarking Concept Removals for Benign Text-to-image Diffusion Modelscited by 9
  22. 2025Dynamically Scaled Activation Steeringcited by 8
  23. 2026Beyond Steering Vector: Flow-based Activation Steering for Inference-Time Interventioncited by 6
  24. 2025SplitFlux: Learning to Decouple Content and Style from a Single Imagecited by 5
  25. 2026MegaStyle: Constructing Diverse and Scalable Style Dataset via Consistent Text-to-Image Style Mappingcited by 5
  26. 2026Conditioned Activation Transport for T2I Safety Steeringcited by 3
  27. 2026SteeringDiffusion: A Bottlenecked Activation Control Interface for Diffusion Modelscited by 1
  28. 2026Semantic Steering for Controllable Generation: Tuning-Free Concept Erasure in Multimodal Diffusion Transformerscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference
  2. 2026Concept Guidance: Precise, Training-Free Latent Control for Text-to-Image Generation
  3. 2026Images Talk Back: Guiding MMDiTs by Suppressing Image-to-Text Feedback
  4. 2025CritiFusion: Semantic Critique and Spectral Alignment for Faithful Text-to-Image Generation
  5. 2026PokeFusion Attention: A Lightweight Cross-Attention Mechanism for Style-Conditioned Image Generation
  6. 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models
  7. 2025Local Prompt Adaptation for Style-Consistent Multi-Object Generation in Diffusion Models
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Models