mlsanityData to 7 Oct 2026

InfraParis: A multi-modal and multi-task autonomous driving dataset

arXiv 2309.15751 ↗First posted 27 Sep 2023cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Current deep neural networks (DNNs) for autonomous driving computer vision are typically trained on specific datasets that only involve a single type of data and urban scenes. Consequently, these models struggle to handle new objects, noise, nighttime conditions, and diverse scenarios, which is essential for safety-critical applications. Despite ongoing efforts to enhance the resilience of computer vision DNNs, progress has been sluggish, partly due to the absence of benchmarks featuring multiple modalities. We introduce a novel and versatile dataset named InfraParis that supports multiple tasks across three modalities: RGB, depth, and infrared. We assess various state-of-the-art baseline techniques, encompassing models for the tasks of semantic segmentation, object detection, and depth estimation. More visualizations and the download link for InfraParis are available at hrefhttps://ensta-u2is.github.io/infraParis/https://ensta-u2is.github.io/infraParis/.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 34 of its 51 references that are in the map. First posted on arXiv 27 Sep 2023.

Builds on

34 of 51 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  6. 2017Mask R-CNNcited by 7,259
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  8. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  10. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  11. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  12. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
22 more
  1. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  2. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  3. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  4. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
  5. 2017Semantic Foggy Scene Understanding with Synthetic Datacited by 401
  6. 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
  7. 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
  8. 2018IDD: A Dataset for Exploring Problems of Autonomous Navigation in Unconstrained Environmentscited by 163
  9. 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
  10. 2022SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptationcited by 146
  11. 2018Dark Model Adaptation: Semantic Image Segmentation from Daytime to Nighttimecited by 122
  12. 2016Lost and Found: Detecting Small Road Hazards for Self-Driving Vehiclescited by 117
  13. 2018Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoningcited by 102
  14. 2020Rain rendering for evaluating and improving robustness to bad weathercited by 56
  15. 2020HeatNet: Bridging the Day-Night Domain Gap in Semantic Segmentation with Thermal Imagescited by 41
  16. 2019Curriculum Model Adaptation with Synthetic and Real Data for Semantic Foggy Scene Understandingcited by 40
  17. 2019Segmenting Objects in Day and Night:Edge-Conditioned CNN for Thermal Image Semantic Segmentationcited by 36
  18. 2018PTB-TIR: A Thermal Infrared Pedestrian Tracking Benchmarkcited by 34
  19. 2022MUAD: Multiple Uncertainties for Autonomous Driving, a benchmark for multiple uncertainty types and taskscited by 24
  20. 2019Brno Urban Dataset -- The New Data for Self-Driving Agents and Mapping Taskscited by 19
  21. 2022Robust Environment Perception for Automated Driving: A Unified Learning Pipeline for Visual-Infrared Object Detectioncited by 4
  22. 2021Investigating Outdoor Recognition Performance of Infrared Beacons for Infrastructure-based Localizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 4; 2026: 4.

12 papers.

  1. 2024MUSES: The Multi-Sensor Semantic Perception Dataset for Driving under Uncertaintycited by 32
  2. 2024Dataset and Benchmark: Novel Sensors for Autonomous Vehicle Perceptioncited by 14
  3. 2024Modality-Incremental Learning with Disjoint Relevance Mapping Networks for Image-based Semantic Segmentationcited by 6
  4. 2025SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systemscited by 4
  5. 2025RASMD: RGB And SWIR Multispectral Driving Dataset for Robust Perception in Adverse Conditionscited by 3
  6. 2025Learning to Match Unpaired Data with Minimum Entropy Couplingcited by 2
  7. 2024IndraEye: Infrared Electro-Optical UAV-based Perception Dataset for Robust Downstream Taskscited by 1
  8. 2025Depth-Sensitive Soft Suppression with RGB-D Inter-Modal Stylization Flow for Domain Generalization Semantic Segmentationcited by 0
  9. 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistencycited by 0
  10. 2026Unified Restoration-Perception Learning: Maritime Infrared-Visible Image Fusion and Segmentationcited by 0
  11. 2026Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmarkcited by 0
  12. 2026Descriptor: LYNRED Mobility Dataset Multimodal Detection Subset (LYNRED-MDS)cited by 0