AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
Reconstructing dynamic 3D scenes from monocular videos requires simultaneously capturing high-frequency appearance details and temporally continuous motion. Existing methods using single Gaussian primitives are limited by their low-pass filtering nature, while standard Gabor functions introduce energy instability. Moreover, lack of temporal continuity constraints often leads to motion artifacts during interpolation. We propose AdaGaR, a unified framework addressing both frequency adaptivity and temporal continuity in explicit dynamic scene modeling. We introduce Adaptive Gabor Representation, extending Gaussians through learnable frequency weights and adaptive energy compensation to balance detail capture and stability. For temporal continuity, we employ Cubic Hermite Splines with Temporal Curvature Regularization to ensure smooth motion evolution. An Adaptive Initialization mechanism combining depth estimation, point tracking, and foreground masks establishes stable point cloud distributions in early training. Experiments on Tap-Vid DAVIS demonstrate state-of-the-art performance (PSNR 35.49, SSIM 0.9433, LPIPS 0.0723) and strong generalization across frame interpolation, depth consistency, video editing, and stereo view synthesis. Project page: https://jiewenchan.github.io/AdaGaR/
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 91 of its 105 references that are in the map. First posted on arXiv 2 Jan 2026.
Builds on
91 of 105 references.
References · 91
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
38 more
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2021NeRV: Neural Representations for Videoscited by 255
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 2023Robust Dynamic Radiance Fieldscited by 193
- 2023Tracking Everything Everywhere All at Oncecited by 190
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2023HUGS: Human Gaussian Splatscited by 154
- 2022FILM: Frame Interpolation for Large Motioncited by 149
- 2021Layered Neural Atlases for Consistent Video Editingcited by 137
- 2023Multi-Scale 3D Gaussian Splatting for Anti-Aliased Renderingcited by 137
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 115
- 2024Neural Video Compression with Feature Modulationcited by 115
- 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
- 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
- 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
- 2023HNeRV: A Hybrid Neural Representation for Videoscited by 100
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
- 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generationcited by 90
- 2024MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereocited by 86
- 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
- 2024Local All-Pair Correspondence for Point Trackingcited by 77
50 most cited of 91 All 91 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 15
- 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Predictioncited by 3
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understandingcited by 3
- 2026Gabor Fields: Orientation-Selective Level-of-Detail for Volume Renderingcited by 2
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inferencecited by 0
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verificationcited by 0
- 2026MOSAIC: Orchestrating Collaborative Knowledge Tracing with Hierarchical Semantic Alignmentcited by 0
- 2026OuroWorld: Bringing Any 3D World Alive as Diverse, Endlessly Looping 3D Cinemagraphscited by 0
- 2026OuroWorld: Bringing Any 3D World Alive as Diverse, Endlessly Looping 3D Cinemagraphs8 Oct 2026
- 2026MOSAIC: Orchestrating Collaborative Knowledge Tracing with Hierarchical Semantic Alignment27 Jun 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference31 May 2026
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding7 May 2026
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrieval22 Apr 2026
- 2026FAST: A Synergistic Framework of Attention and State-space Models for Spatiotemporal Traffic Prediction15 Apr 2026
- 2026Gabor Fields: Orientation-Selective Level-of-Detail for Volume Rendering4 Feb 2026