SwitchSplat: Learning Discrete Object States from Casually Captured Scenes
On the map: 3D reconstruction and neural rendering → Dynamic scene reconstruction also fits: Semantic 3D scene understanding and robotics
Abstract (arXiv)
3D Gaussian Splatting has made high-fidelity 3D reconstruction fast and accessible, yet existing representations assume a static world. This assumption breaks down in casual captures, where a user naturally interacts with the environment -- opening doors, toggling switches, or moving objects -- introducing discrete state changes that no current framework can model. Time-conditioned dynamic methods such as 4DGS conflate when a state was observed with what state the scene is in, limiting them to replaying seen sequences rather than composing arbitrary object configurations. We present SwitchSplat, the first 3DGS representation to address this gap via a base+slot decomposition: a shared static base captures the invariant scene, while each slot independently holds the two binary states (on/off) of one interactable object. Because the assignment of Gaussians to slots is fully differentiable, the model discovers the geometry of each state directly from video, without manual annotation. At inference, the user can freely combine slot states and render the resulting scene from any viewpoint. We validate SwitchSplat on a new casual-capture dataset and show that it outperforms static and dynamic baselines in novel-view synthesis quality, while uniquely supporting rendering of state combinations never seen during capture. Project page: https://switchsplat.github.io
Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Dynamic scene reconstruction, one of 15 directions in 3D reconstruction and neural rendering. First posted on arXiv 17 Oct 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given
- 2026GlobalSplat: Efficient Feed-Forward 3D Gaussian Splatting via Global Scene Tokens
- 2026ZipSplat: Fewer Gaussians, Better Splats
- 2024DynSUP: Dynamic Gaussian Splatting from An Unposed Image Pair
- 2025DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstruction
- 2026StereoSplat+: Feed-Forward Stereo Gaussian Splatting with Diffusion-Assisted Progressive Inference
- 2025IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenes
- 2026No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videos