mlsanityData to 7 Oct 2026

Multi-View Pedestrian Occupancy Prediction with a Novel Synthetic Dataset

arXiv 2412.13569 ↗First posted 18 Dec 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

We address an advanced challenge of predicting pedestrian occupancy as an extension of multi-view pedestrian detection in urban traffic. To support this, we have created a new synthetic dataset called MVP-Occ, designed for dense pedestrian scenarios in large-scale scenes. Our dataset provides detailed representations of pedestrians using voxel structures, accompanied by rich semantic scene understanding labels, facilitating visual navigation and insights into pedestrian spatial information. Furthermore, we present a robust baseline model, termed OmniOcc, capable of predicting both the voxel occupancy state and panoptic labels for the entire scene from multi-view images. Through in-depth analysis, we identify and evaluate the key elements of our proposed model, highlighting their specific contributions and importance.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 31 of its 50 references that are in the map. First posted on arXiv 18 Dec 2024.

Builds on

31 of 50 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  5. 2018Panoptic Segmentationcited by 796
  6. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  7. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  8. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  9. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  10. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  11. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  12. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
19 more
  1. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
  2. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
  3. 2022SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptationcited by 146
  4. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  5. 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
  6. 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 126
  7. 20203D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Priorcited by 124
  8. 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88
  9. 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 85
  10. 2020Multiview Detection with Feature Perspective Transformationcited by 70
  11. 2021Direct Multi-view Multi-person 3D Pose Estimationcited by 64
  12. 2021Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereocited by 38
  13. 2022Cross-View Cross-Scene Multi-View Crowd Countingcited by 28
  14. 2020SCFusion: Real-time Incremental Scene Reconstruction with Semantic Completioncited by 25
  15. 2021Not All Voxels Are Equal: Semantic Scene Completion from the Point-Voxel Perspectivecited by 22
  16. 20223D Random Occlusion and Multi-Layer Projection for Deep Multi-Camera Pedestrian Localizationcited by 22
  17. 2022Graph Neural Networks for Cross-Camera Data Associationcited by 13
  18. 2023Human-M3: A Multi-view Multi-modal Dataset for 3D Human Pose Estimation in Outdoor Scenescited by 11
  19. 2024CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecastingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

  1. 2025CueBench: Advancing Unified Understanding of Context-Aware Video Anomalies in Real-Worldcited by 3
  2. 2025MSMVD: Exploiting Multi-scale Image Features via Multi-scale BEV Features for Multi-view Pedestrian Detectioncited by 1
  3. 2026PaperFit: Vision-in-the-Loop Typesetting Optimization for Scientific Documentscited by 1
  4. 2025Active View Selection for Scene-level Multi-view Crowd Counting and Localization with Limited Labeling Budgetcited by 0
  5. 2026MV2GF: Multi-view Pedestrian Detection with a Visual Geometric Foundation Modelcited by 0