Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing
Not on the map. Why?
Abstract (arXiv)
Text-guided video editing modifies target content while preserving the appearance and temporal coherence of unedited regions. Training-based approaches provide strong control but demand substantial data and computation. Training-free methods fall into inversion-free and inversion-based paradigms. Inversion-free approaches avoid trajectory recovery, but their source-preserving guidance can limit editing strength and leave semantic changes incomplete. Inversion-based approaches recover a latent trajectory before regeneration, where approximation errors can accumulate and cause source-content drift and temporal inconsistency. We introduce Edit-VAR, the first training-free and inversion-free framework for text-guided video editing with a pretrained visual autoregressive video model. Edit-VAR directly encodes the source video into multi-scale discrete tokens and performs probability-guided conditional token replacement for source preservation. Attention-guided token-wise and scale-aware modulation selectively relaxes source constraints over edit-relevant positions and generation stages. Scale-Decoupled Generation, implemented as late-scale constraint release, regenerates motion-consistent details and reduces texture fragmentation. Residual-guided token pruning further exploits redundancy at the final two high-resolution scales to reduce inference cost. Extensive experiments and a blind user study demonstrate that Edit-VAR outperforms existing training-free video editing methods overall in editing fidelity, source preservation, temporal coherence, and inference efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 52 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
49 of 52 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
37 more
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
- 2025Controllable Video Generation: A Surveycited by 98
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editingcited by 59
- 2024ControlVAR: Exploring Controllable Visual Autoregressive Modelingcited by 58
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
- 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 49
- 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 45
- 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 45
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
- 2025FastVAR: Linear Visual Autoregressive Modeling via Cached Token Pruningcited by 34
- 2025DAG: A Dual Correlation Network for Time Series Forecasting with Exogenous Variablescited by 33
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
- 2025FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editingcited by 26
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2025Training-Free Text-Guided Image Editing with Visual Autoregressive Modelcited by 21
- 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 16
- 2025Head-Aware KV Cache Compression for Efficient Visual Autoregressive Modelingcited by 15
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generatorscited by 14
- 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
- 2025Anchor Token Matching: Implicit Structure Locking for Training-free AR Image Editingcited by 10
- 2026StreamingEffect: Real-Time Human-Centric Video Effect Generationcited by 8
- 2026VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformerscited by 8
- 2026PAI-Studio: Cinematic Video Background Replacement with Camera-Aware Motioncited by 8
- 2025FADE: Frequency-Aware Diffusion Model Factorization for Video Editingcited by 7
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
- 2026ToProVAR: Efficient Visual Autoregressive Modeling via Tri-Dimensional Entropy-Aware Semantic Analysis and Sparsity Optimizationcited by 5
- 2026FastSTAR: Spatiotemporal Token Pruning for Efficient Autoregressive Video Synthesiscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking Structure Preservation in Text-Guided Image Editing with Visual Autoregressive Models
- 2025Visual Autoregressive Modeling for Instruction-Guided Image Editing
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
- 2024VideoDirector: Precise Video Editing via Text-to-Video Models
- 2024FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing
- 2023Edit-A-Video: Single Video Editing with Object-Aware Consistency
- 2023ControlVideo: Conditional Control for One-shot Text-driven Video Editing and Beyond
- 2026OSVE: One Step Video Editing with One Step Diffusion Models