mlsanityData to 7 Oct 2026

Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generation

arXiv 2512.05044 ↗First posted 4 Dec 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Generating interactive and dynamic 4D scenes from a single static image remains a core challenge. Most existing generate-then-reconstruct and reconstruct-then-generate methods decouple geometry from motion, causing spatiotemporal inconsistencies and poor generalization. To address these, we present MoGe4D (Motion and Geometry-Aware image-to-4D Synthesis), a geometry-conditioned framework for single-image 4D synthesis that models a scene as dense 4D point trajectories. Instead of treating geometry and dynamics as two disconnected stages, our method starts from an initial geometric prior inferred from the input image and predicts future time-varying trajectories in a diffusion process, improving spatiotemporal coherence while preserving structural stability. To support this task, we first introduce TrajScene-60K, a large-scale dataset of 60,000 video samples with dense 4D point trajectories, addressing the scarcity of high-quality training data for scene-level 4D generation. Built on this, our diffusion-based 4D Scene Trajectory Generator (4D-STraG) predicts geometry-consistent and motion-plausible trajectory fields conditioned on the input image, with a depth-guided motion normalization strategy to reduce scale ambiguity and a Motion Perception Module (MPM) to inject motion-aware priors. We further propose a 4D View Synthesis Module (4D-ViSM) to render the generated 4D representation into videos under arbitrary camera trajectories. Experiments show that MoGe4D produces high-quality 4D scenes with strong temporal coherence, favorable geometry-aware consistency, and compelling novel-view synthesis from a single image. Code: https://github.com/Zhangyr2022/MoGe4D.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 77 of its 92 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

77 of 92 references.

References · 77

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2017Neural Discrete Representation Learningcited by 4,650
  7. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  9. 2022Video Diffusion Modelscited by 2,280
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  11. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  12. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
38 more
  1. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  2. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  3. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  4. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  5. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  6. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
  7. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  8. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  9. 2023CoTracker: It is Better to Track Togethercited by 516
  10. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  11. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  12. 2016Generating Videos with Scene Dynamicscited by 376
  13. 2022Kubric: A scalable dataset generatorcited by 373
  14. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  15. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  16. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  17. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  18. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
  19. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  20. 2018Stochastic Video Generation with a Learned Priorcited by 244
  21. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 214
  22. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  23. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  24. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  25. 2024Autoregressive Video Generation without Vector Quantizationcited by 180
  26. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
  27. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
  28. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  29. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  30. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
  31. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  32. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  33. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
  34. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 139
  35. 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
  36. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  37. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
  38. 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122

50 most cited of 77 All 77 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.