Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generation
Not on the map. Why?
Abstract (arXiv)
Generating interactive and dynamic 4D scenes from a single static image remains a core challenge. Most existing generate-then-reconstruct and reconstruct-then-generate methods decouple geometry from motion, causing spatiotemporal inconsistencies and poor generalization. To address these, we present MoGe4D (Motion and Geometry-Aware image-to-4D Synthesis), a geometry-conditioned framework for single-image 4D synthesis that models a scene as dense 4D point trajectories. Instead of treating geometry and dynamics as two disconnected stages, our method starts from an initial geometric prior inferred from the input image and predicts future time-varying trajectories in a diffusion process, improving spatiotemporal coherence while preserving structural stability. To support this task, we first introduce TrajScene-60K, a large-scale dataset of 60,000 video samples with dense 4D point trajectories, addressing the scarcity of high-quality training data for scene-level 4D generation. Built on this, our diffusion-based 4D Scene Trajectory Generator (4D-STraG) predicts geometry-consistent and motion-plausible trajectory fields conditioned on the input image, with a depth-guided motion normalization strategy to reduce scale ambiguity and a Motion Perception Module (MPM) to inject motion-aware priors. We further propose a 4D View Synthesis Module (4D-ViSM) to render the generated 4D representation into videos under arbitrary camera trajectories. Experiments show that MoGe4D produces high-quality 4D scenes with strong temporal coherence, favorable geometry-aware consistency, and compelling novel-view synthesis from a single image. Code: https://github.com/Zhangyr2022/MoGe4D.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 77 of its 92 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
77 of 92 references.
References · 77
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2017Neural Discrete Representation Learningcited by 4,650
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Video Diffusion Modelscited by 2,280
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
38 more
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 666
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2016Generating Videos with Scene Dynamicscited by 376
- 2022Kubric: A scalable dataset generatorcited by 373
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2018Stochastic Video Generation with a Learned Priorcited by 244
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 214
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
- 2024Autoregressive Video Generation without Vector Quantizationcited by 180
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 139
- 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 139
- 2023Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decompositioncited by 134
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122
50 most cited of 77 All 77 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.