SynWoodScape: Synthetic Surround-view Fisheye Camera Dataset for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Surround-view cameras are a primary sensor for automated driving, used for near-field perception. It is one of the most commonly used sensors in commercial vehicles primarily used for parking visualization and automated parking. Four fisheye cameras with a 190deg field of view cover the 360deg around the vehicle. Due to its high radial distortion, the standard algorithms do not extend easily. Previously, we released the first public fisheye surround-view dataset named WoodScape. In this work, we release a synthetic version of the surround-view dataset, covering many of its weaknesses and extending it. Firstly, it is not possible to obtain ground truth for pixel-wise optical flow and depth. Secondly, WoodScape did not have all four cameras annotated simultaneously in order to sample diverse frames. However, this means that multi-camera algorithms cannot be designed to obtain a unified output in birds-eye space, which is enabled in the new dataset. We implemented surround-view fisheye geometric projections in CARLA Simulator matching WoodScape's configuration and created SynWoodScape. We release 80k images from the synthetic dataset with annotations for 10+ tasks. We also release the baseline code and supporting scripts.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 22 of its 46 references that are in the map. First posted on arXiv 9 Mar 2022.
Builds on
22 of 46 references.
References · 22
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2016Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?cited by 194
- 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 188
- 2017Playing for Benchmarkscited by 169
- 2019WoodScape: A multi-task, multi-camera fisheye dataset for autonomous drivingcited by 142
- 2021OmniDet: Surround View Cameras based Multi-task Visual Perception Network for Autonomous Drivingcited by 57
- 2020SynDistNet: Self-Supervised Monocular Fisheye Camera Distance Estimation Synergized with Semantic Segmentation for Autonomous Drivingcited by 48
- 2020Generalized Object Detection on Fisheye Cameras for Autonomous Driving: Dataset, Representations and Baselinecited by 41
- 2019FisheyeDistanceNet: Self-Supervised Scale-Aware Distance Estimation using Monocular Fisheye Camera for Autonomous Drivingcited by 36
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2020UnRectDepthNet: Self-Supervised Monocular Depth Estimation using a Generic Framework for Handling Common Camera Distortion Modelscited by 33
10 more
- 2021SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround View Fisheye Camerascited by 25
- 2021Near-field Perception for Low-Speed Vehicle Automation using Surround-view Fisheye Camerascited by 24
- 2021Weather and Light Level Classification for Autonomous Driving: Dataset, Baseline and Active Learningcited by 20
- 2018Monocular Fisheye Camera Depth Estimation Using Sparse LiDAR Supervisioncited by 19
- 2019FisheyeMODNet: Moving Object detection on Surround-view Cameras for Autonomous Drivingcited by 18
- 2020TiledSoilingNet: Tile-level Soiling Detection on Automotive Surround-view Cameras Using Coverage Metriccited by 17
- 2021Adversarial Attacks on Multi-task Visual Perception for Autonomous Drivingcited by 14
- 2021An Online Learning System for Wireless Charging Alignment using Surround-view Fisheye Camerascited by 9
- 2021A Hybrid Sparse-Dense Monocular SLAM System for Autonomous Drivingcited by 8
- 2019Capsule Neural Network based Height Classification using Low-Cost Automotive Ultrasonic Sensorscited by 5
Built on by
Citing papers per year: 2022: 7; 2023: 9; 2024: 7; 2025: 6; 2026: 3.
32 papers.
Sort:
By area:
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
- 2022Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challengescited by 33
- 2022SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpointscited by 22
- 2023HEAL-SWIN: A Vision Transformer On The Spherecited by 18
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 13
- 2023F2BEV: Bird's Eye View Generation from Surround-View Fisheye Camera Images for Automated Drivingcited by 12
- 2023Optical Flow for Autonomous Driving: Applications, Challenges and Improvementscited by 9
- 20253DGEER: 3D Gaussian Rendering Made Exact and Efficient for Generic Camerascited by 8
- 2024Deformable Mamba for Wide Field of View Segmentationcited by 7
- 2025Dur360BEV: A Real-world 360-degree Single Camera Dataset and Benchmark for Bird-Eye View Mapping in Autonomous Drivingcited by 5
20 more
- 2023ADD: An Automatic Desensitization Fisheye Dataset for Autonomous Drivingcited by 4
- 2022IBISCape: A Simulated Benchmark for multi-modal SLAM Systems Evaluation in Large-scale Dynamic Environmentscited by 3
- 2023Applications of Deep Learning for Top-View Omnidirectional Imaging: A Surveycited by 3
- 2024Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challengescited by 3
- 2025RealDriveSim: A Realistic Multi-Modal Multi-Task Synthetic Dataset for Autonomous Drivingcited by 3
- 2025FishBEV: Distortion-Resilient Bird's Eye View Segmentation with Surround-View Fisheye Camerascited by 3
- 2026Rethinking Camera Choice: An Empirical Study on Fisheye Camera Properties in Robotic Manipulationcited by 3
- 2022Surround-View Cameras based Holistic Visual Perception for Automated Drivingcited by 2
- 2022Woodscape Fisheye Object Detection for Autonomous Driving -- CVPR 2022 OmniCV Workshop Challengecited by 2
- 2023Sector Patch Embedding: An Embedding Module Conforming to The Distortion Pattern of Fisheye Imagecited by 2
- 2024DaF-BEVSeg: Distortion-aware Fisheye Camera based Bird's Eye View Segmentation with Occlusion Reasoningcited by 2
- 2025FlyAwareV2: A Multimodal Cross-Domain UAV Dataset for Urban Scene Understandingcited by 2
- 2026Benchmarking Multi-View BEV Object Detection with Mixed Pinhole and Fisheye Camerascited by 2
- 2022SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Drivingcited by 1
- 2024Measuring Natural Scenes SFR of Automotive Fisheye Camerascited by 1
- 2024Deformable Convolution Based Road Scene Semantic Segmentation of Fisheye Images in Autonomous Drivingcited by 1
- 2025Training for X-Ray Vision: Amodal Segmentation, Amodal Content Completion, and View-Invariant Object Representation from Multi-Camera Videocited by 1
- 2026WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimationcited by 1
- 2023WoodScape Motion Segmentation for Autonomous Driving -- CVPR 2023 OmniCV Workshop Challengecited by 0
- 2024Neural Rendering based Urban Scene Reconstruction for Autonomous Drivingcited by 0
- 2026WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation22 May 2026
- 2026Benchmarking Multi-View BEV Object Detection with Mixed Pinhole and Fisheye Cameras29 Mar 2026
- 2026Rethinking Camera Choice: An Empirical Study on Fisheye Camera Properties in Robotic Manipulation2 Mar 2026
- 2025FlyAwareV2: A Multimodal Cross-Domain UAV Dataset for Urban Scene Understanding15 Oct 2025
- 2025FishBEV: Distortion-Resilient Bird's Eye View Segmentation with Surround-View Fisheye Cameras17 Sep 2025
- 2025Training for X-Ray Vision: Amodal Segmentation, Amodal Content Completion, and View-Invariant Object Representation from Multi-Camera Video1 Jul 2025
- 2025RealDriveSim: A Realistic Multi-Modal Multi-Task Synthetic Dataset for Autonomous Driving19 Jun 2025
- 20253DGEER: 3D Gaussian Rendering Made Exact and Efficient for Generic Cameras29 May 2025
- 2025Dur360BEV: A Real-world 360-degree Single Camera Dataset and Benchmark for Bird-Eye View Mapping in Autonomous Driving2 Mar 2025
- 2024Deformable Mamba for Wide Field of View Segmentation25 Nov 2024
- 2024Deformable Convolution Based Road Scene Semantic Segmentation of Fisheye Images in Autonomous Driving23 Jul 2024
- 2024DaF-BEVSeg: Distortion-aware Fisheye Camera based Bird's Eye View Segmentation with Occlusion Reasoning9 Apr 2024
20 more
- 2024Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challenges19 Feb 2024
- 2024Neural Rendering based Urban Scene Reconstruction for Autonomous Driving9 Feb 2024
- 2024Measuring Natural Scenes SFR of Automotive Fisheye Cameras10 Jan 2024
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlook2 Jan 2024
- 2023WoodScape Motion Segmentation for Autonomous Driving -- CVPR 2023 OmniCV Workshop Challenge31 Dec 2023
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Driving12 Sep 2023
- 2023ADD: An Automatic Desensitization Fisheye Dataset for Autonomous Driving15 Aug 2023
- 2023HEAL-SWIN: A Vision Transformer On The Sphere14 Jul 2023
- 2023Applications of Deep Learning for Top-View Omnidirectional Imaging: A Survey17 Apr 2023
- 2023Sector Patch Embedding: An Embedding Module Conforming to The Distortion Pattern of Fisheye Image26 Mar 2023
- 2023F2BEV: Bird's Eye View Generation from Surround-View Fisheye Camera Images for Automated Driving7 Mar 2023
- 2023Delivering Arbitrary-Modal Semantic Segmentation2 Mar 2023
- 2023Optical Flow for Autonomous Driving: Applications, Challenges and Improvements11 Jan 2023
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentation25 Jul 2022
- 2022IBISCape: A Simulated Benchmark for multi-modal SLAM Systems Evaluation in Large-scale Dynamic Environments27 Jun 2022
- 2022Woodscape Fisheye Object Detection for Autonomous Driving -- CVPR 2022 OmniCV Workshop Challenge26 Jun 2022
- 2022Surround-View Cameras based Holistic Visual Perception for Automated Driving11 Jun 2022
- 2022SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Driving6 Jun 2022
- 2022Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challenges26 May 2022
- 2022SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpoints20 Apr 2022
- 2024Deformable Mamba for Wide Field of View Segmentationcited by 7
- 2024Deformable Mamba for Wide Field of View Segmentation25 Nov 2024
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 115
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
- 2022Surround-view Fisheye Camera Perception for Automated Driving: Overview, Survey and Challengescited by 33
- 2022SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpointscited by 22
- 2023HEAL-SWIN: A Vision Transformer On The Spherecited by 18
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 13
- 2023F2BEV: Bird's Eye View Generation from Surround-View Fisheye Camera Images for Automated Drivingcited by 12
- 2023Optical Flow for Autonomous Driving: Applications, Challenges and Improvementscited by 9
- 20253DGEER: 3D Gaussian Rendering Made Exact and Efficient for Generic Camerascited by 8
- 2025Dur360BEV: A Real-world 360-degree Single Camera Dataset and Benchmark for Bird-Eye View Mapping in Autonomous Drivingcited by 5
- 2023ADD: An Automatic Desensitization Fisheye Dataset for Autonomous Drivingcited by 4
12 most cited of 31 All 31 (JSON)
- 2026WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation22 May 2026
- 2026Benchmarking Multi-View BEV Object Detection with Mixed Pinhole and Fisheye Cameras29 Mar 2026
- 2026Rethinking Camera Choice: An Empirical Study on Fisheye Camera Properties in Robotic Manipulation2 Mar 2026
- 2025FlyAwareV2: A Multimodal Cross-Domain UAV Dataset for Urban Scene Understanding15 Oct 2025
- 2025FishBEV: Distortion-Resilient Bird's Eye View Segmentation with Surround-View Fisheye Cameras17 Sep 2025
- 2025Training for X-Ray Vision: Amodal Segmentation, Amodal Content Completion, and View-Invariant Object Representation from Multi-Camera Video1 Jul 2025
- 2025RealDriveSim: A Realistic Multi-Modal Multi-Task Synthetic Dataset for Autonomous Driving19 Jun 2025
- 20253DGEER: 3D Gaussian Rendering Made Exact and Efficient for Generic Cameras29 May 2025
- 2025Dur360BEV: A Real-world 360-degree Single Camera Dataset and Benchmark for Bird-Eye View Mapping in Autonomous Driving2 Mar 2025
- 2024Deformable Convolution Based Road Scene Semantic Segmentation of Fisheye Images in Autonomous Driving23 Jul 2024
- 2024DaF-BEVSeg: Distortion-aware Fisheye Camera based Bird's Eye View Segmentation with Occlusion Reasoning9 Apr 2024
- 2024Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challenges19 Feb 2024
12 newest of 31 All 31 (JSON)