MobileOcc: A Human-Aware Semantic Occupancy Dataset for Mobile Robots
Not on the map. Why?
Abstract (arXiv)
Dense 3D semantic occupancy perception is critical for mobile robots operating in pedestrian-rich environments, yet it remains underexplored compared to its application in autonomous driving. To address this gap, we present MobileOcc, a semantic occupancy dataset for mobile robots operating in crowded human environments. Our dataset is built using an annotation pipeline that incorporates static object occupancy annotations and a novel mesh optimization framework explicitly designed for human occupancy modeling. It reconstructs deformable human geometry from 2D images, then refines and optimizes it using associated LiDAR point data. Using MobileOcc, we establish benchmarks for two tasks: i) Occupancy prediction and ii) Pedestrian velocity prediction, using different methods, including monocular, stereo, and panoptic occupancy, with metrics and baseline implementations for reproducible comparison. Beyond occupancy prediction, we further assess our annotation method on 3D human pose estimation datasets. Results demonstrate that our method exhibits robust performance across different datasets. Our code and dataset are released at https://autonomousrobots.nl/paper_websites/mobileocc
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 49 of its 60 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
49 of 60 references.
References · 49
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
37 more
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2020I2L-MeshNet: Image-to-Lixel Prediction Network for Accurate 3D Human Pose and Mesh Estimation from a Single RGB Imagecited by 274
- 2021Mesh Graphormercited by 264
- 2020Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Posecited by 248
- 2022CLIFF: Carrying Location Information in Full Frames into Human Pose and Shape Estimationcited by 237
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
- 2020Monocular, One-stage, Regression of Multiple 3D Peoplecited by 216
- 2023Scene as Occupancycited by 208
- 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 200
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
- 2020RELLIS-3D Dataset: Data, Benchmarks and Analysiscited by 118
- 2019Seamless Scene Segmentationcited by 112
- 2017V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Mapcited by 102
- 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101
- 2023TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environmentscited by 89
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 85
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2021S3: Neural Shape, Skeleton, and Skinning Fields for 3D Human Modelingcited by 59
- 2023SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environmentscited by 47
- 2023Towards Robust Robot 3D Perception in Urban Environments: The UT Campus Object Datasetcited by 28
- 2021Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptationcited by 24
- 2021VoteHMR: Occlusion-Aware Voting Network for Robust 3D Human Mesh Recovery from Partial Point Cloudscited by 18
- 2022PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body Estimationcited by 18
- 2024Panoptic-FlashOcc: An Efficient Baseline to Marry Semantic Occupancy with Panoptic via Instance Centercited by 14
- 2023LiDAR-HMR: 3D Human Mesh Recovery from LiDARcited by 12
- 2022Multi-Person 3D Pose and Shape Estimation via Inverse Kinematics and Refinementcited by 11
- 2023Human-M3: A Multi-view Multi-modal Dataset for 3D Human Pose Estimation in Outdoor Scenescited by 11
- 2024WildOcc: A Benchmark for Off-Road 3D Semantic Occupancy Predictioncited by 9
- 2024Particle-based Instance-aware Semantic Occupancy Mapping in Dynamic Environmentscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.