CVPR 2023 Text Guided Video Editing Competition
Not on the map. Why?
Cited by 26 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Humans watch more than a billion hours of video per day. Most of this video was edited manually, which is a tedious process. However, AI-enabled video-generation and video-editing is on the rise. Building on text-to-image models like Stable Diffusion and Imagen, generative AI has improved dramatically on video tasks. But it's hard to evaluate progress in these video tasks because there is no standard benchmark. So, we propose a new dataset for text-guided video editing (TGVE), and we run a competition at CVPR to evaluate models on our TGVE dataset. In this paper we present a retrospective on the competition and describe the winning method. The competition dataset is available at https://sites.google.com/view/loveucvpr23/track4.
Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). Builds on 32 of its 37 references that are in the map. First posted on arXiv 24 Oct 2023.
Builds on
32 of 37 references.
References · 32
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022Video Diffusion Modelscited by 2,305
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
20 more
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2019Few-shot Video-to-Video Synthesiscited by 197
- 2023Dreamix: Video Diffusion Models are General Video Editorscited by 191
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
- 2023Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Modelscited by 137
- 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 67
- 2023Make-A-Protagonist: Generic Video Editing with An Ensemble of Expertscited by 34
- 2023DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editingcited by 17
Built on by
Citing papers per year: 2023: 7; 2024: 20; 2025: 21; 2026: 7.
55 papers.
Sort:
By area:
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
- 2024Towards A Better Metric for Text-to-Video Generationcited by 51
- 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
- 2024Diffusion Model-Based Video Editing: A Surveycited by 44
- 2024Video Editing via Factorized Diffusion Distillationcited by 41
- 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slicescited by 40
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 40
38 more
- 2023Drag-A-Video: Non-rigid Video Editing with Point-based Interactioncited by 22
- 2023BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Modelscited by 20
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Modelscited by 19
- 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferencescited by 16
- 2024On Efficient Variants of Segment Anything Model: A Surveycited by 16
- 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfercited by 16
- 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 16
- 2024FRAG: Frequency Adapting Group for Diffusion Video Editingcited by 15
- 2024DNI: Dilutional Noise Initialization for Diffusion Video Editingcited by 12
- 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
- 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessmentcited by 11
- 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMscited by 11
- 2024FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editingcited by 9
- 2025FlowDrag: 3D-aware Drag-based Image Editing with Mesh-guided Deformation Vector Flow Fieldscited by 8
- 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
- 2025Understanding Attention Mechanism in Video Diffusion Modelscited by 7
- 2025Neurons: Emulating the Human Visual Cortex Improves Fidelity and Interpretability in fMRI-to-Video Reconstructioncited by 6
- 2025ASTRA: Let Arbitrary Subjects Transform in Video Editingcited by 6
- 2024Segment Anything for Videos: A Systematic Surveycited by 5
- 2024Re-Attentional Controllable Video Diffusion Editingcited by 5
- 2025Separate Motion from Appearance: Customizing Motion via Customizing Text-to-Video Diffusion Modelscited by 4
- 2025Evaluating SAM2 for Video Semantic Segmentationcited by 4
- 2025A Cognitive Process-Inspired Architecture for Subject-Agnostic Brain Visual Decodingcited by 3
- 2023Neutral Editing Framework for Diffusion-based Video Editingcited by 2
- 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splattingcited by 2
- 2025When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generatorscited by 2
- 2025ViDiC: Video Difference Captioningcited by 2
- 2025FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editingcited by 2
- 2025Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Modelcited by 1
- 2025RO-Bench: Large-scale robustness evaluation of MLLMs with text-driven counterfactual videoscited by 1
- 2026RFDM: Residual Flow Diffusion Model for Efficient Causal Video Editingcited by 1
- 2026PropFly: Learning to Propagate via On-the-Fly Supervision from Pre-trained Video Diffusion Modelscited by 1
- 2023SmoothVideo: Smooth Video Synthesis with Noise Constraints on Diffusion Models for One-shot Video Tuningcited by 0
- 2024PRIMEdit: Probability Redistribution for Instance-Aware Multi-Object Video Editing With a New Benchmark Datasetcited by 0
- 2025STR-Match: Matching SpatioTemporal Relevance Score for Training-Free Video Editingcited by 0
- 2025Audio-Guided Visual Editing with Complex Multi-Modal Promptscited by 0
- 2025Point-to-Point: Sparse Motion Guidance for Controllable Video Editingcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Neurons++: A Unified Visual-Stream Framework for Image and Video Reconstruction from fMRI with Neural-to-Visual Interpretability9 Oct 2026
- 2026ChordVideo: One-Step, Training-Free, Temporally Consistent Video Editing via Low-Energy Transport1 Aug 2026
- 2026Consistent and Editable: A Balanced Framework for Text-Guided Video Editing6 Jul 2026
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs17 Apr 2026
- 2026PropFly: Learning to Propagate via On-the-Fly Supervision from Pre-trained Video Diffusion Models24 Feb 2026
- 2026RFDM: Residual Flow Diffusion Model for Efficient Causal Video Editing6 Feb 2026
- 2026Beyond Rigid: Benchmarking Non-Rigid Video Editing26 Jan 2026
- 2025FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editing24 Dec 2025
- 2025VideoCoF: Unified Video Editing with Temporal Reasoner8 Dec 2025
- 2025ViDiC: Video Difference Captioning3 Dec 2025
- 2025Evaluating SAM2 for Video Semantic Segmentation1 Dec 2025
- 2025Point-to-Point: Sparse Motion Guidance for Controllable Video Editing23 Nov 2025
38 more
- 2025A Cognitive Process-Inspired Architecture for Subject-Agnostic Brain Visual Decoding4 Nov 2025
- 2025RO-Bench: Large-scale robustness evaluation of MLLMs with text-driven counterfactual videos10 Oct 2025
- 2025ASTRA: Let Arbitrary Subjects Transform in Video Editing1 Oct 2025
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learning24 Sep 2025
- 2025Audio-Guided Visual Editing with Complex Multi-Modal Prompts28 Aug 2025
- 2025FlowDrag: 3D-aware Drag-based Image Editing with Mesh-guided Deformation Vector Flow Fields11 Jul 2025
- 2025STR-Match: Matching SpatioTemporal Relevance Score for Training-Free Video Editing28 Jun 2025
- 2025When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generators24 Jun 2025
- 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMs26 May 2025
- 2025Understanding Attention Mechanism in Video Diffusion Models16 Apr 2025
- 2025Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model8 Apr 2025
- 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfer3 Apr 2025
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation18 Mar 2025
- 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models17 Mar 2025
- 2025Neurons: Emulating the Human Visual Cortex Improves Fidelity and Interpretability in fMRI-to-Video Reconstruction14 Mar 2025
- 2025Separate Motion from Appearance: Customizing Motion via Customizing Text-to-Video Diffusion Models28 Jan 2025
- 2024PRIMEdit: Probability Redistribution for Instance-Aware Multi-Object Video Editing With a New Benchmark Dataset17 Dec 2024
- 2024Re-Attentional Controllable Video Diffusion Editing16 Dec 2024
- 2024DIVE: Taming DINO for Subject-Driven Video Editing4 Dec 2024
- 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfer26 Oct 2024
- 2024On Efficient Variants of Segment Anything Model: A Survey7 Oct 2024
- 2024DNI: Dilutional Noise Initialization for Diffusion Video Editing19 Sep 2024
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferences26 Aug 2024
- 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessment21 Aug 2024
- 2024Segment Anything for Videos: A Systematic Survey31 Jul 2024
- 2024Diffusion Model-Based Video Editing: A Survey26 Jun 2024
- 2024FRAG: Frequency Adapting Group for Diffusion Video Editing10 Jun 2024
- 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting4 Jun 2024
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models26 May 2024
- 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slices20 May 2024
- 2024Video Editing via Factorized Diffusion Distillation14 Mar 2024
- 2024FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing10 Mar 2024
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Models22 Feb 2024
- 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing20 Feb 2024
- 2024Magic-Me: Identity-Specific Video Customized Diffusion14 Feb 2024
- 2024Towards A Better Metric for Text-to-Video Generation15 Jan 2024
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editing17 Dec 2023
- 2023Neutral Editing Framework for Diffusion-based Video Editing10 Dec 2023
50 newest of 55 All 55 (JSON)
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 113
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2024Diffusion Model-Based Video Editing: A Surveycited by 44
- 2024Video Editing via Factorized Diffusion Distillationcited by 41
- 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slicescited by 40
- 2023BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Modelscited by 20
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Modelscited by 19
- 2024DIVE: Taming DINO for Subject-Driven Video Editingcited by 17
- 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfercited by 16
- 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 16
12 most cited of 25 All 25 (JSON)
- 2026Consistent and Editable: A Balanced Framework for Text-Guided Video Editing6 Jul 2026
- 2026PropFly: Learning to Propagate via On-the-Fly Supervision from Pre-trained Video Diffusion Models24 Feb 2026
- 2026RFDM: Residual Flow Diffusion Model for Efficient Causal Video Editing6 Feb 2026
- 2025FluencyVE: Marrying Temporal-Aware Mamba with Bypass Attention for Video Editing24 Dec 2025
- 2025Audio-Guided Visual Editing with Complex Multi-Modal Prompts28 Aug 2025
- 2025Understanding Attention Mechanism in Video Diffusion Models16 Apr 2025
- 2025Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model8 Apr 2025
- 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models17 Mar 2025
- 2025Separate Motion from Appearance: Customizing Motion via Customizing Text-to-Video Diffusion Models28 Jan 2025
- 2024Re-Attentional Controllable Video Diffusion Editing16 Dec 2024
- 2024DIVE: Taming DINO for Subject-Driven Video Editing4 Dec 2024
- 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfer26 Oct 2024
12 newest of 25 All 25 (JSON)
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
- 2024Towards A Better Metric for Text-to-Video Generationcited by 51
- 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
- 2023Drag-A-Video: Non-rigid Video Editing with Point-based Interactioncited by 22
- 2024K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferencescited by 16
- 2024On Efficient Variants of Segment Anything Model: A Surveycited by 16
- 2024FRAG: Frequency Adapting Group for Diffusion Video Editingcited by 15
- 2024DNI: Dilutional Noise Initialization for Diffusion Video Editingcited by 12
- 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
- 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMscited by 11
- 2025FlowDrag: 3D-aware Drag-based Image Editing with Mesh-guided Deformation Vector Flow Fieldscited by 8
12 most cited of 26 All 26 (JSON)
- 2026Neurons++: A Unified Visual-Stream Framework for Image and Video Reconstruction from fMRI with Neural-to-Visual Interpretability9 Oct 2026
- 2026ChordVideo: One-Step, Training-Free, Temporally Consistent Video Editing via Low-Energy Transport1 Aug 2026
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs17 Apr 2026
- 2026Beyond Rigid: Benchmarking Non-Rigid Video Editing26 Jan 2026
- 2025ViDiC: Video Difference Captioning3 Dec 2025
- 2025Evaluating SAM2 for Video Semantic Segmentation1 Dec 2025
- 2025Point-to-Point: Sparse Motion Guidance for Controllable Video Editing23 Nov 2025
- 2025A Cognitive Process-Inspired Architecture for Subject-Agnostic Brain Visual Decoding4 Nov 2025
- 2025ASTRA: Let Arbitrary Subjects Transform in Video Editing1 Oct 2025
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learning24 Sep 2025
- 2025FlowDrag: 3D-aware Drag-based Image Editing with Mesh-guided Deformation Vector Flow Fields11 Jul 2025
- 2025STR-Match: Matching SpatioTemporal Relevance Score for Training-Free Video Editing28 Jun 2025
12 newest of 26 All 26 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Models
- 2023VidEdit: Zero-Shot and Spatially Aware Text-Driven Video Editing
- 2023Edit Temporal-Consistent Videos with Image Diffusion Model
- 2025Video Text Preservation with Synthetic Text-Rich Videos
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising
- 2024VideoGuide: Improving Video Diffusion Models without Training Through a Teacher's Guide
- 2024Kandinsky 3: Text-to-Image Synthesis for Multifunctional Generative Framework
- 2024AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction