mlsanityData to 14 Oct 2026

Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing

arXiv 2609.21268 ↗First posted 18 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-guided video editing modifies target content while preserving the appearance and temporal coherence of unedited regions. Training-based approaches provide strong control but demand substantial data and computation. Training-free methods fall into inversion-free and inversion-based paradigms. Inversion-free approaches avoid trajectory recovery, but their source-preserving guidance can limit editing strength and leave semantic changes incomplete. Inversion-based approaches recover a latent trajectory before regeneration, where approximation errors can accumulate and cause source-content drift and temporal inconsistency. We introduce Edit-VAR, the first training-free and inversion-free framework for text-guided video editing with a pretrained visual autoregressive video model. Edit-VAR directly encodes the source video into multi-scale discrete tokens and performs probability-guided conditional token replacement for source preservation. Attention-guided token-wise and scale-aware modulation selectively relaxes source constraints over edit-relevant positions and generation stages. Scale-Decoupled Generation, implemented as late-scale constraint release, regenerates motion-consistent details and reduces texture fragmentation. Residual-guided token pruning further exploits redundancy at the final two high-resolution scales to reduce inference cost. Extensive experiments and a blind user study demonstrate that Edit-VAR outperforms existing training-free video editing methods overall in editing fidelity, source preservation, temporal coherence, and inference efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 52 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

49 of 52 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  4. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  6. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  7. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
  8. 2025VACE: All-in-One Video Creation and Editingcited by 479
  9. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  10. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  11. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  12. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
37 more
  1. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
  2. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
  3. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  4. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  5. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  6. 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
  7. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
  8. 2025Controllable Video Generation: A Surveycited by 98
  9. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  10. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
  11. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
  12. 2024ControlVAR: Exploring Controllable Visual Autoregressive Modelingcited by 58
  13. 2025UNIC: Unified In-Context Video Editingcited by 55
  14. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
  15. 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 49
  16. 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 45
  17. 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 45
  18. 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
  19. 2025FastVAR: Linear Visual Autoregressive Modeling via Cached Token Pruningcited by 34
  20. 2025DAG: A Dual Correlation Network for Time Series Forecasting with Exogenous Variablescited by 33
  21. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  22. 2025FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editingcited by 26
  23. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  24. 2025Training-Free Text-Guided Image Editing with Visual Autoregressive Modelcited by 21
  25. 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 16
  26. 2025Head-Aware KV Cache Compression for Efficient Visual Autoregressive Modelingcited by 15
  27. 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
  28. 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generatorscited by 14
  29. 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
  30. 2025Anchor Token Matching: Implicit Structure Locking for Training-free AR Image Editingcited by 10
  31. 2026StreamingEffect: Real-Time Human-Centric Video Effect Generationcited by 8
  32. 2026VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformerscited by 8
  33. 2026PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motioncited by 8
  34. 2025FADE: Frequency-Aware Diffusion Model Factorization for Video Editingcited by 7
  35. 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
  36. 2026ToProVAR: Efficient Visual Autoregressive Modeling via Tri-Dimensional Entropy-Aware Semantic Analysis and Sparsity Optimizationcited by 5
  37. 2026FastSTAR: Spatiotemporal Token Pruning for Efficient Autoregressive Video Synthesiscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking Structure Preservation in Text-Guided Image Editing with Visual Autoregressive Models
  2. 2025Visual Autoregressive Modeling for Instruction-Guided Image Editing
  3. 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
  4. 2024VideoDirector: Precise Video Editing via Text-to-Video Models
  5. 2024FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing
  6. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistency
  7. 2023ControlVideo: Conditional Control for One-shot Text-driven Video Editing and Beyond
  8. 2026OSVE: One Step Video Editing with One Step Diffusion Models