PMOF: A Dataset and Benchmark for Passenger Monitoring Using Overhead Fisheye Cameras
Not on the map. Why?
Abstract (arXiv)
Autonomous staff-free public transport requires reliable in-vehicle passenger monitoring. However, perception inside moving vehicles is challenged by confined spaces, variable illumination, motion-induced background variation, occlusion, and limited viewpoints. To mitigate these spatial constraints, ceiling-mounted fisheye cameras provide full-scene coverage from a single viewpoint. Yet existing public overhead fisheye datasets are recorded in static environments and do not capture the domain shift introduced by vehicle motion. To fill this gap, we introduce PMOF, Passenger Monitoring using Overhead Fisheye cameras, the first public dataset of top-view fisheye imagery captured inside a moving vehicle, comprising over 19k manually annotated frames. PMOF provides rotated bounding boxes, tracking identifiers, and action labels, supporting object detection, tracking, and action recognition. We benchmark PMOF using YOLO26m-obb models fine-tuned under multiple dataset configurations that combine PMOF with existing overhead fisheye datasets. Cross-domain fine-tuning with custom rotation-aware augmentation achieves 94.8% AP50 on PMOF and 96.5% AP50 on an unseen overhead fisheye dataset from a different domain. Our results highlight the domain gap between static and moving environments and show that incorporating PMOF improves detection performance and advances generalization beyond passenger monitoring to broader fisheye-based person detection tasks. The dataset and code are available at https://swermuth.github.io/pmof/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 27 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
10 of 27 references.
References · 10
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2019WoodScape: A multi-task, multi-camera fisheye dataset for autonomous drivingcited by 144
- 2020Generalized Object Detection on Fisheye Cameras for Autonomous Driving: Dataset, Representations and Baselinecited by 42
- 2020RAPiD: Rotation-Aware People Detection in Overhead Fisheye Imagescited by 17
- 2023Large-Scale Person Detection and Localization using Overhead Fisheye Camerascited by 12
- 2018Improved Person Detection on Omnidirectional Images with Non-maxima Suppressioncited by 6
- 2023Applications of Deep Learning for Top-View Omnidirectional Imaging: A Surveycited by 3
- 2022ARPD: Anchor-free Rotation-aware People Detection using Topview Fisheye Cameracited by 2
- 2024NToP: NeRF-Powered Large-scale Dataset Generation for 2D and 3D Human Pose Estimation in Top-View Fisheye Imagescited by 2
Built on by
Not cited yet.