Geometry-Instructed Video Editing
Not on the map. Why?
Abstract (arXiv)
Object-level geometric edits, including translating, rotating, scaling, duplicating, or removing an object, are routine operations in digital content creation (DCC) workflows, yet they remain unreliable in generative video editing. The key challenge lies in specifying the target object's 3D state change unambiguously across viewpoint and time, while consistently updating geometry-dependent secondary effects such as shadows and reflections. We introduce GIVE, a geometry-instructed video editing framework that represents edits through a unified object-state formulation. Two video-aligned geometry streams describe the target object before and after editing: a depth-box encoding coarse 3D placement and extent, and an orientation-box providing an appearance-agnostic orientation cue. Together, these streams provide a compact pre/post geometric specification for object-state transitions. To provide paired supervision for learning these edits, we build a scalable graphics-engine pipeline that executes object-level edit programs and renders controlled before/after pairs, isolating the intended geometric edit while keeping secondary effects consistent with the transformation. Experimental results demonstrate that GIVE produces faithful geometric edits with temporal coherence and consistent secondary effects across operators in a unified framework, and shows promising transfer to in-the-wild videos. Project page: https://geometry-instructed-video-editing.github.io/give/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 43 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
29 of 43 references.
References · 29
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generationcited by 91
17 more
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 63
- 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
- 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 61
- 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3Dcited by 59
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
- 2024LeviTor: 3D Trajectory Oriented Image-to-Video Synthesiscited by 39
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 30
- 2025Perception-as-Control: Fine-grained Controllable Image Animation with 3D-aware Motion Representationcited by 23
- 2025VideoHandles: Editing 3D Object Compositions in Videos Using Video Generative Priorscited by 14
- 2025MTV-Inpaint: Multi-Task Long Video Inpaintingcited by 14
- 20253D-Fixup: Advancing Photo Editing with 3D Priorscited by 12
- 2025Shape-for-Motion: Precise and Consistent Video Editing with 3D Proxycited by 9
Built on by
Not cited yet.