SirenPose: Dynamic Scene Reconstruction via Geometric Supervision
Not on the map. Why?
Abstract (arXiv)
We introduce SirenPose, a geometry-aware loss formulation that integrates the periodic activation properties of sinusoidal representation networks with keypoint-based geometric supervision, enabling accurate and temporally consistent reconstruction of dynamic 3D scenes from monocular videos. Existing approaches often struggle with motion fidelity and spatiotemporal coherence in challenging settings involving fast motion, multi-object interaction, occlusion, and rapid scene changes. SirenPose incorporates physics inspired constraints to enforce coherent keypoint predictions across both spatial and temporal dimensions, while leveraging high frequency signal modeling to capture fine grained geometric details. We further expand the UniKPT dataset to 600,000 annotated instances and integrate graph neural networks to model keypoint relationships and structural correlations. Extensive experiments on benchmarks including Sintel, Bonn, and DAVIS demonstrate that SirenPose consistently outperforms state-of-the-art methods. On DAVIS, SirenPose achieves a 17.8 percent reduction in FVD, a 28.7 percent reduction in FID, and a 6.0 percent improvement in LPIPS compared to MoSCA. It also improves temporal consistency, geometric accuracy, user score, and motion smoothness. In pose estimation, SirenPose outperforms Monst3R with lower absolute trajectory error as well as reduced translational and rotational relative pose error, highlighting its effectiveness in handling rapid motion, complex dynamics, and physically plausible reconstruction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 55 of its 64 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
55 of 64 references.
References · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
38 more
- 2023Text-To-4D Dynamic Scene Generationcited by 205
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 2022Deep Patch Visual Odometrycited by 190
- 2020Robust Consistent Video Depth Estimationcited by 188
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 100
- 2025Controllable Video Generation: A Surveycited by 98
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2020Monocular Real-Time Volumetric Performance Capturecited by 74
- 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
- 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 59
- 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 58
- 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
- 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 37
- 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 35
- 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 34
- 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Modelscited by 34
- 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaborationcited by 30
- 2018Asymptotic Soft Filter Pruning for Deep Convolutional Neural Networkscited by 27
- 2020TENet: Triple Excitation Network for Video Salient Object Detectioncited by 26
- 2023X-Pose: Detecting Any Keypointscited by 21
- 2025Failure-Driven Workflow Refinementcited by 20
- 2025Hybrid Token Compression for Vision-Language Modelscited by 20
- 2024Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpsescited by 17
- 2025Learning Dynamics of VLM Finetuningcited by 17
- 2025Top-Down Semantic Refinement for Image Captioningcited by 16
- 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correctioncited by 15
- 2023FlowIBR: Leveraging Pre-Training for Efficient Neural Image-Based Rendering of Dynamic Scenescited by 14
- 2025RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliabilitycited by 14
- 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interactioncited by 14
- 20251000+ FPS 4D Gaussian Splatting for Dynamic Scene Renderingcited by 13
- 2017Why Do Neural Dialog Systems Generate Short and Meaningless Replies? A Comparison between Dialog and Translationcited by 12
- 20253DAlign-DAER: Dynamic Attention Policy and Efficient Retrieval Strategy for Fine-grained 3D-Text Alignment at Scalecited by 12
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.