ScaleVid: Geometry-Aware Video Object Scaling with Mesh-Free Inference
Not on the map. Why?
Abstract (arXiv)
Geometry-aware video object scaling aims to anisotropically resize the object along object-centric axes while preserving geometric plausibility, temporal coherence, and background consistency. Existing text-guided methods mainly operate in the 2D image plane, while depth-guided approaches provide coarse control and mesh-based methods require costly 3D reconstruction. We present a progressive two-stage training framework that decouples geometry-aware foreground transformation from background preservation and realistic video composition, without mesh-pixel alignment and explicit 3D reconstruction at inference. In both stages, geometrically perturbed pseudo-sources are constructed from real videos, while the original complete videos are retained as reconstruction targets. The first stage uses planar transformations to learn robust foreground-background composition, whereas the second introduces object-centric 3D deformation guidance for geometry-aware scaling. This pseudo-source reconstruction formulation enables real-video synthesis without paired real-world scaling targets. We construct complementary paired-geometry and real-background benchmarks and further evaluate on in-the-wild videos. Extensive experiments demonstrate superior geometric consistency, foreground fidelity, and background preservation, together with faster and more practical inference than methods requiring explicit 3D reconstruction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 68 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
54 of 68 references.
References · 54
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2025VACE: All-in-One Video Creation and Editingcited by 467
38 more
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
- 2018Learning Blind Video Temporal Consistencycited by 247
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
- 2019Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Researchcited by 98
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 79
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 69
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 62
- 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
- 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3Dcited by 59
- 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 49
- 2024Image Sculpting: Precise Object Editing with 3D Geometry Controlcited by 45
- 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
- 2023StyleAdapter: A Unified Stylized Image Generation Modelcited by 39
- 2024GeoDiffuser: Geometry-Based Image Editing with Diffusion Modelscited by 34
- 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32
- 2025RORem: Training a Robust Object Remover with Human-in-the-Loopcited by 23
- 2025Generative Video Motion Editing with 3D Point Trackscited by 21
- 2024ObjCtrl-2.5D: Training-free Object Control with Camera Posescited by 18
- 2024PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preferencecited by 17
- 2025TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpaintingcited by 15
- 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusioncited by 15
- 2025VideoHandles: Editing 3D Object Compositions in Videos Using Video Generative Priorscited by 14
- 2025MTV-Inpaint: Multi-Task Long Video Inpaintingcited by 14
- 2025Training-free Geometric Image Editing on Diffusion Modelscited by 13
- 2025O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editingcited by 10
- 2025Shape-for-Motion: Precise and Consistent Video Editing with 3D Proxycited by 8
- 2025BlenderFusion: 3D-Grounded Visual Editing and Generative Compositingcited by 7
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.