SeqAffordSplat: Scene-level Sequential Affordance Reasoning on 3D Gaussian Splatting
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
3D affordance reasoning, the task of associating human instructions with the functional regions of 3D objects, is a critical capability for embodied agents. Current methods based on 3D Gaussian Splatting (3DGS) are fundamentally limited to single-object, single-step interactions, a paradigm that falls short of addressing the long-horizon, multi-object tasks required for complex real-world applications. To bridge this gap, we introduce the novel task of Sequential 3D Gaussian Affordance Reasoning and establish SeqAffordSplat, a large-scale benchmark featuring 1800+ scenes to support research on long-horizon affordance understanding in complex 3DGS environments. We then propose SeqSplatNet, an end-to-end framework that directly maps an instruction to a sequence of 3D affordance masks. SeqSplatNet employs a large language model that autoregressively generates text interleaved with special segmentation tokens, guiding a conditional decoder to produce the corresponding 3D mask. To handle complex scene geometry, we introduce a pre-training strategy, Conditional Geometric Reconstruction, where the model learns to reconstruct complete affordance region masks from known geometric observations, thereby building a robust geometric prior. Furthermore, to resolve semantic ambiguities, we design a feature injection mechanism that lifts rich semantic features from 2D Vision Foundation Models (VFM) and fuses them into the 3D decoder at multiple scales. Extensive experiments demonstrate that our method sets a new state-of-the-art on our challenging benchmark, effectively advancing affordance reasoning from single-step interactions to complex, sequential tasks at the scene level.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 35 references that are in the map. First posted on arXiv 31 Jul 2025.
Builds on
10 of 35 references.
References · 10
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2023GPT-4 Technical Reportcited by 18,132
- 2025Qwen3 Technical Reportcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20243D Gaussian Splatting in Robotics: A Surveycited by 44
- 2024Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splattingcited by 37
- 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 36
- 2022PartAfford: Part-level Affordance Discovery from 3D Objectscited by 35
- 20233DSGrasp: 3D Shape-Completion for Robotic Graspcited by 13
- 20253DAffordSplat: Efficient Affordance Reasoning with 3D Gaussianscited by 9
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026VideoAfford: Grounding 3D Affordance from Human-Object-Interaction Videos via Multimodal Large Language Modelcited by 2
- 2026CompassAD: Intent-Driven 3D Affordance Grounding in Functionally Competing Objectscited by 1
- 2026A3R: Agentic Affordance Reasoning via Cross-Dimensional Evidence in 3D Gaussian Scenescited by 0
- 2026CompassAD: Intent-Driven 3D Affordance Grounding in Functionally Competing Objects2 Apr 2026
- 2026A3R: Agentic Affordance Reasoning via Cross-Dimensional Evidence in 3D Gaussian Scenes2 Apr 2026
- 2026VideoAfford: Grounding 3D Affordance from Human-Object-Interaction Videos via Multimodal Large Language Model10 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2024SeqAfford: Sequential 3D Affordance Reasoning via Multimodal Large Language Model
- 2026CausalSplat: Towards Comprehensive Hierarchical Reasoning in 3D Gaussian Splatting
- 2026ThinkAfford: Affordance-Centric Reasoning for Fine-Grained 3D Grounding in Cluttered Scenes
- 2026SplatReasoner: Enhancing Embodied Reasoning and Grounding by Novel View Synthesis
- 2025AffordBot: 3D Fine-grained Embodied Reasoning via Multimodal Large Language Models
- 20253D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worlds
- 2025Task-Aware 3D Affordance Segmentation via 2D Guidance and Geometric Refinement
- 2025GaussianVLM: Scene-centric 3D Vision-Language Models using Language-aligned Gaussian Splats for Embodied Reasoning and Beyond