ASTRA: Let Arbitrary Subjects Transform in Video Editing
Not on the map. Why?
Abstract (arXiv)
While existing video editing methods excel with single subjects, they struggle in dense, multi-subject scenes, frequently suffering from attention dilution and mask boundary entanglement that cause attribute leakage and temporal instability. To address this, we propose ASTRA, a training-free framework for seamless, arbitrary-subject video editing. Without requiring model fine-tuning, ASTRA precisely manipulates multiple designated subjects while strictly preserving non-target regions. It achieves this via two core components: a prompt-guided multimodal alignment module that generates robust conditions to mitigate attention dilution, and a prior-based mask retargeting module that produces temporally coherent mask sequences to resolve boundary entanglement. Functioning as a versatile plug-and-play module, ASTRA seamlessly integrates with diverse mask-driven video generators. Extensive experiments on our newly constructed benchmark, MSVBench, demonstrate that ASTRA consistently outperforms state-of-the-art methods. Code, models, and data are available at https://github.com/XWH-A/ASTRA.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 54 of its 57 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
54 of 57 references.
References · 54
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
38 more
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2024Depth Anything V2cited by 1,385
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2016Adversarial Feature Learningcited by 350
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 165
- 2017Video Generation From Textcited by 153
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
- 2016Fully Convolutional Instance-aware Semantic Segmentationcited by 122
- 2018To Create What You Tell: Generating Videos from Captionscited by 84
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 60
- 2023CVPR 2023 Text Guided Video Editing Competitioncited by 54
- 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domaincited by 53
- 2025VideoGrain: Modulating Space-Time Attention for Multi-grained Video Editingcited by 50
- 2016Sync-DRAW: Automatic Video Generation using Deep Recurrent Attentive Architecturescited by 44
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Interpretable Logical Anomaly Classification via Constraint Decomposition and Instruction Fine-Tuningcited by 0
- 2026RMK RetinaNet: Rotated Multi-Kernel RetinaNet for Robust Oriented Object Detection in Remote Sensing Imagerycited by 0
- 2026Multi-Period Texture Contrast Enhancement for Low-Contrast Wafer Defect Detection and Segmentationcited by 0
- 2026SARES-DEIM: Sparse Mixture-of-Experts Meets DETR for Robust SAR Ship Detectioncited by 0
- 2026Beyond Reconstruction: Reconstruction-to-Vector Diffusion for Hyperspectral Anomaly Detectioncited by 0
- 2026MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editingcited by 0
- 2026MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing15 Sep 2026
- 2026Beyond Reconstruction: Reconstruction-to-Vector Diffusion for Hyperspectral Anomaly Detection13 Apr 2026
- 2026SARES-DEIM: Sparse Mixture-of-Experts Meets DETR for Robust SAR Ship Detection5 Apr 2026
- 2026Multi-Period Texture Contrast Enhancement for Low-Contrast Wafer Defect Detection and Segmentation15 Mar 2026
- 2026RMK RetinaNet: Rotated Multi-Kernel RetinaNet for Robust Oriented Object Detection in Remote Sensing Imagery5 Mar 2026
- 2026Interpretable Logical Anomaly Classification via Constraint Decomposition and Instruction Fine-Tuning3 Feb 2026