MoMa-Kitchen: A 100K+ Benchmark for Affordance-Grounded Last-Mile Navigation in Mobile Manipulation
Not on the map. Why?
Abstract (arXiv)
In mobile manipulation, navigation and manipulation are often treated as separate problems, resulting in a significant gap between merely approaching an object and engaging with it effectively. Many navigation approaches primarily define success by proximity to the target, often overlooking the necessity for optimal positioning that facilitates subsequent manipulation. To address this, we introduce MoMa-Kitchen, a benchmark dataset comprising over 100k samples that provide training data for models to learn optimal final navigation positions for seamless transition to manipulation. Our dataset includes affordance-grounded floor labels collected from diverse kitchen environments, in which robotic mobile manipulators of different models attempt to grasp target objects amidst clutter. Using a fully automated pipeline, we simulate diverse real-world scenarios and generate affordance labels for optimal manipulation positions. Visual data are collected from RGB-D inputs captured by a first-person view camera mounted on the robotic arm, ensuring consistency in viewpoint during data collection. We also develop a lightweight baseline model, NavAff, for navigation affordance grounding that demonstrates promising performance on the MoMa-Kitchen benchmark. Our approach enables models to learn affordance-based final positioning that accommodates different arm types and platform heights, thereby paving the way for more robust and generalizable integration of navigation and manipulation in embodied AI. Project page: hrefhttps://momakitchen.github.io/https://momakitchen.github.io/.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 78 of its 97 references that are in the map. First posted on arXiv 14 Mar 2025.
Builds on
78 of 97 references.
References · 78
- 2017Attention Is All You Needcited by 60,361
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2024Depth Anything V2cited by 1,422
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
38 more
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 405
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2017Embodied Question Answeringcited by 336
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 316
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
- 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 204
- 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 183
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
- 2023Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisitioncited by 159
- 2020Rearrangement: A Challenge for Embodied AIcited by 155
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 148
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 137
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 131
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 125
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 124
- 2023Language Models Meet World Models: Embodied Experiences Enhance Language Modelscited by 124
- 2020H3DNet: 3D Object Detection Using Hybrid Geometric Primitivescited by 123
- 2022Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotioncited by 121
- 2023UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learningcited by 107
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 106
- 2019Embodied Question Answering in Photorealistic Environments with Point Cloud Perceptioncited by 103
- 2021Visual Room Rearrangementcited by 102
- 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 98
- 2019Interactive Gibson Benchmark (iGibson 0.5): A Benchmark for Interactive Navigation in Cluttered Environmentscited by 90
- 2024AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agentscited by 87
50 most cited of 78 All 78 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 6.
12 papers.
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Modelcited by 56
- 2025Evaluating and Steering Modality Preferences in Multimodal Large Language Modelcited by 33
- 2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigationcited by 17
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulationcited by 15
- 2025Bridge the Gap: From Weak to Full Supervision for Temporal Action Localization with PseudoFormercited by 6
- 2026Instruction Anchor: Dissecting the Mechanistic Dynamics of Modality Arbitrationcited by 6
- 2026Closed-Loop Action Chunks with Dynamic Corrections for Training-Free Diffusion Policycited by 3
- 2026From Instruction to Event: Sound-Triggered Mobile Manipulationcited by 2
- 2026VAGNet: Grounding 3D Affordance from Human-Object Interactions in Videoscited by 1
- 2025Affordance-Guided Coarse-to-Fine Exploration for Base Placement in Open-Vocabulary Mobile Manipulationcited by 0
- 2026Devils in Question Relay: Source-Conditioned Relay Steering to Mitigate Hallucinations in Audio-visual Large Language Modelscited by 0
- 2026UniWAM Technical Report: Unified Mobile Manipulation via Mixed-Stream World-Action Modeling and Manipulation Anchor Pose Supervisioncited by 0
- 2026UniWAM Technical Report: Unified Mobile Manipulation via Mixed-Stream World-Action Modeling and Manipulation Anchor Pose Supervision30 Sep 2026
- 2026Devils in Question Relay: Source-Conditioned Relay Steering to Mitigate Hallucinations in Audio-visual Large Language Models29 Sep 2026
- 2026Closed-Loop Action Chunks with Dynamic Corrections for Training-Free Diffusion Policy2 Mar 2026
- 2026VAGNet: Grounding 3D Affordance from Human-Object Interactions in Videos24 Feb 2026
- 2026Instruction Anchor: Dissecting the Mechanistic Dynamics of Modality Arbitration3 Feb 2026
- 2026From Instruction to Event: Sound-Triggered Mobile Manipulation29 Jan 2026
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation22 Nov 2025
- 2025Affordance-Guided Coarse-to-Fine Exploration for Base Placement in Open-Vocabulary Mobile Manipulation9 Nov 2025
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Model27 May 2025
- 2025Evaluating and Steering Modality Preferences in Multimodal Large Language Model27 May 2025
- 2025Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigation27 May 2025
- 2025Bridge the Gap: From Weak to Full Supervision for Temporal Action Localization with PseudoFormer21 Apr 2025