mlsanityData to 14 Oct 2026

SirenPose: Dynamic Scene Reconstruction via Geometric Supervision

arXiv 2512.20531 ↗First posted 23 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce SirenPose, a geometry-aware loss formulation that integrates the periodic activation properties of sinusoidal representation networks with keypoint-based geometric supervision, enabling accurate and temporally consistent reconstruction of dynamic 3D scenes from monocular videos. Existing approaches often struggle with motion fidelity and spatiotemporal coherence in challenging settings involving fast motion, multi-object interaction, occlusion, and rapid scene changes. SirenPose incorporates physics inspired constraints to enforce coherent keypoint predictions across both spatial and temporal dimensions, while leveraging high frequency signal modeling to capture fine grained geometric details. We further expand the UniKPT dataset to 600,000 annotated instances and integrate graph neural networks to model keypoint relationships and structural correlations. Extensive experiments on benchmarks including Sintel, Bonn, and DAVIS demonstrate that SirenPose consistently outperforms state-of-the-art methods. On DAVIS, SirenPose achieves a 17.8 percent reduction in FVD, a 28.7 percent reduction in FID, and a 6.0 percent improvement in LPIPS compared to MoSCA. It also improves temporal consistency, geometric accuracy, user score, and motion smoothness. In pose estimation, SirenPose outperforms Monst3R with lower absolute trajectory error as well as reduced translational and rotational relative pose error, highlighting its effectiveness in handling rapid motion, complex dynamics, and physically plausible reconstruction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 55 of its 64 references that are in the map. First posted on arXiv 23 Dec 2025.

Builds on

55 of 64 references.

References · 55

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  3. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  5. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  7. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  8. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  9. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  10. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  11. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  12. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
38 more
  1. 2023Text-To-4D Dynamic Scene Generationcited by 205
  2. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  3. 2022Deep Patch Visual Odometrycited by 190
  4. 2020Robust Consistent Video Depth Estimationcited by 188
  5. 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
  6. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
  7. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
  8. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
  9. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  10. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 100
  11. 2025Controllable Video Generation: A Surveycited by 98
  12. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  13. 2020Monocular Real-Time Volumetric Performance Capturecited by 74
  14. 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
  15. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
  16. 2025CF-VLM:CounterFactual Vision-Language Fine-tuningcited by 59
  17. 2025GAM-Agent: Game-Theoretic and Uncertainty-Aware Collaboration for Complex Visual Reasoningcited by 58
  18. 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 43
  19. 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 37
  20. 2025MAT-Agent: Adaptive Multi-Agent Training Optimizationcited by 35
  21. 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 34
  22. 2025MM-CoT:A Benchmark for Probing Visual Chain-of-Thought Reasoning in Multimodal Modelscited by 34
  23. 2025OSC: Cognitive Orchestration through Dynamic Knowledge Alignment in Multi-Agent LLM Collaborationcited by 30
  24. 2018Asymptotic Soft Filter Pruning for Deep Convolutional Neural Networkscited by 27
  25. 2020TENet: Triple Excitation Network for Video Salient Object Detectioncited by 26
  26. 2023X-Pose: Detecting Any Keypointscited by 21
  27. 2025Failure-Driven Workflow Refinementcited by 20
  28. 2025Hybrid Token Compression for Vision-Language Modelscited by 20
  29. 2024Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpsescited by 17
  30. 2025Learning Dynamics of VLM Finetuningcited by 17
  31. 2025Top-Down Semantic Refinement for Image Captioningcited by 16
  32. 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correctioncited by 15
  33. 2023FlowIBR: Leveraging Pre-Training for Efficient Neural Image-Based Rendering of Dynamic Scenescited by 14
  34. 2025RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliabilitycited by 14
  35. 2025Cost-Effective Communication: An Auction-based Method for Language Agent Interactioncited by 14
  36. 20251000+ FPS 4D Gaussian Splatting for Dynamic Scene Renderingcited by 13
  37. 2017Why Do Neural Dialog Systems Generate Short and Meaningless Replies? A Comparison between Dialog and Translationcited by 12
  38. 20253DAlign-DAER: Dynamic Attention Policy and Efficient Retrieval Strategy for Fine-grained 3D-Text Alignment at Scalecited by 12

50 most cited of 55 All 55 (JSON)

Built on by

Not cited yet.