mlsanityData to 7 Oct 2026

ScaleVid: Geometry-Aware Video Object Scaling with Mesh-Free Inference

arXiv 2608.12232 ↗First posted 12 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Geometry-aware video object scaling aims to anisotropically resize the object along object-centric axes while preserving geometric plausibility, temporal coherence, and background consistency. Existing text-guided methods mainly operate in the 2D image plane, while depth-guided approaches provide coarse control and mesh-based methods require costly 3D reconstruction. We present a progressive two-stage training framework that decouples geometry-aware foreground transformation from background preservation and realistic video composition, without mesh-pixel alignment and explicit 3D reconstruction at inference. In both stages, geometrically perturbed pseudo-sources are constructed from real videos, while the original complete videos are retained as reconstruction targets. The first stage uses planar transformations to learn robust foreground-background composition, whereas the second introduces object-centric 3D deformation guidance for geometry-aware scaling. This pseudo-source reconstruction formulation enables real-video synthesis without paired real-world scaling targets. We construct complementary paired-geometry and real-background benchmarks and further evaluate on in-the-wild videos. Extensive experiments demonstrate superior geometric consistency, foreground fidelity, and background preservation, together with faster and more practical inference than methods requiring explicit 3D reconstruction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 68 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

54 of 68 references.

References · 54

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  9. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  10. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  11. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  12. 2025VACE: All-in-One Video Creation and Editingcited by 467
38 more
  1. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
  2. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  3. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  4. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  5. 2018Learning Blind Video Temporal Consistencycited by 247
  6. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  7. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
  8. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  9. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
  10. 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
  11. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
  12. 2019Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Researchcited by 98
  13. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
  14. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
  15. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 79
  16. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
  17. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 69
  18. 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 62
  19. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  20. 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3Dcited by 59
  21. 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 49
  22. 2024Image Sculpting: Precise Object Editing with 3D Geometry Controlcited by 45
  23. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 42
  24. 2023StyleAdapter: A Unified Stylized Image Generation Modelcited by 39
  25. 2024GeoDiffuser: Geometry-Based Image Editing with Diffusion Modelscited by 34
  26. 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32
  27. 2025RORem: Training a Robust Object Remover with Human-in-the-Loopcited by 23
  28. 2025Generative Video Motion Editing with 3D Point Trackscited by 21
  29. 2024ObjCtrl-2.5D: Training-free Object Control with Camera Posescited by 18
  30. 2024PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preferencecited by 17
  31. 2025TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpaintingcited by 15
  32. 2026ActionMesh: Animated 3D Mesh Generation with Temporal 3D Diffusioncited by 15
  33. 2025VideoHandles: Editing 3D Object Compositions in Videos Using Video Generative Priorscited by 14
  34. 2025MTV-Inpaint: Multi-Task Long Video Inpaintingcited by 14
  35. 2025Training-free Geometric Image Editing on Diffusion Modelscited by 13
  36. 2025O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editingcited by 10
  37. 2025Shape-for-Motion: Precise and Consistent Video Editing with 3D Proxycited by 8
  38. 2025BlenderFusion: 3D-Grounded Visual Editing and Generative Compositingcited by 7

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.