Occlusion-Aware Temporally Consistent Amodal Completion for 3D Human-Object Interaction Reconstruction
Not on the map. Why?
Abstract (arXiv)
We introduce a novel framework for reconstructing dynamic human-object interactions from monocular video that overcomes challenges associated with occlusions and temporal inconsistencies. Traditional 3D reconstruction methods typically assume static objects or full visibility of dynamic subjects, leading to degraded performance when these assumptions are violated-particularly in scenarios where mutual occlusions occur. To address this, our framework leverages amodal completion to infer the complete structure of partially obscured regions. Unlike conventional approaches that operate on individual frames, our method integrates temporal context, enforcing coherence across video sequences to incrementally refine and stabilize reconstructions. This template-free strategy adapts to varying conditions without relying on predefined models, significantly enhancing the recovery of intricate details in dynamic scenes. We validate our approach using 3D Gaussian Splatting on challenging monocular videos, demonstrating superior precision in handling occlusions and maintaining temporal stability compared to existing techniques.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 10 Jul 2025.
Builds on
26 of 51 references.
References · 26
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2018Learning Blind Video Temporal Consistencycited by 253
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
14 more
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
- 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 93
- 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 82
- 2024GaussianObject: High-Quality 3D Object Reconstruction from Four Views with Gaussian Splattingcited by 59
- 2024THOR: Text to Human-Object Interaction Diffusion via Relation Interventioncited by 46
- 2023Amodal Completion via Progressive Mixed Context Diffusioncited by 38
- 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Modelscited by 24
- 2024Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpsescited by 17
- 2024OccFusion: Rendering Occluded Humans with Generative Diffusion Priorscited by 8
- 2024AIM 2024 Sparse Neural Rendering Challenge: Dataset and Benchmarkcited by 6
Built on by
Citing papers per year: 2025: 1.
1 paper.