SODA10M: A Large-Scale 2D Self/Semi-Supervised Object Detection Dataset for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Aiming at facilitating a real-world, ever-evolving and scalable autonomous driving system, we present a large-scale dataset for standardizing the evaluation of different self-supervised and semi-supervised approaches by learning from raw data, which is the first and largest dataset to date. Existing autonomous driving systems heavily rely on `perfect' visual perception models (i.e., detection) trained using extensive annotated data to ensure safety. However, it is unrealistic to elaborately label instances of all scenarios and circumstances (i.e., night, extreme weather, cities) when deploying a robust autonomous driving system. Motivated by recent advances of self-supervised and semi-supervised learning, a promising direction is to learn a robust detection model by collaboratively exploiting large-scale unlabeled data and few labeled data. Existing datasets either provide only a small amount of data or covers limited domains with full annotation, hindering the exploration of large-scale pre-trained models. Here, we release a Large-Scale 2D Self/semi-supervised Object Detection dataset for Autonomous driving, named as SODA10M, containing 10 million unlabeled images and 20K images labeled with 6 representative object categories. To improve diversity, the images are collected within 27833 driving hours under different weather conditions, periods and location scenes of 32 different cities. We provide extensive experiments and deep analyses of existing popular self/semi-supervised approaches, and give some interesting findings in autonomous driving scope. Experiments show that SODA10M can serve as a promising pre-training dataset for different self-supervised learning methods, which gives superior performance when fine-tuning with different downstream tasks (i.e., detection, semantic/instance segmentation) in autonomous driving domain. More information can refer to https://soda-2d.github.io.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 52 of its 74 references that are in the map. First posted on arXiv 21 Jun 2021.
Builds on
52 of 74 references.
References · 52
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
38 more
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2016Colorful Image Colorizationcited by 1,113
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
- 2017Large Batch Training of Convolutional Networkscited by 529
- 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
- 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2021Unbiased Teacher for Semi-Supervised Object Detectioncited by 305
- 2014Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networkscited by 299
- 2020A Simple Semi-Supervised Learning Framework for Object Detectioncited by 282
- 2019Billion-scale semi-supervised learning for image classificationcited by 232
- 2017Unsupervised Representation Learning by Sorting Sequencescited by 219
- 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
- 2017CityPersons: A Diverse Dataset for Pedestrian Detectioncited by 171
- 2018MixUp as Locally Linear Out-Of-Manifold Regularizationcited by 158
- 2018Self-Supervised Video Representation Learning with Space-Time Cubic Puzzlescited by 149
- 2018Deep Co-Training for Semi-Supervised Image Recognitioncited by 145
- 2021Self-Supervised Learning with Swin Transformerscited by 121
- 2021When Does Contrastive Visual Representation Learning Work?cited by 92
- 2021Divide and Contrast: Self-supervised Learning from Uncurated Datacited by 85
- 2020SeCo: Exploring Sequence Supervision for Unsupervised Representation Learningcited by 65
- 2020Watching the World Go By: Representation Learning from Unlabeled Videoscited by 59
- 2020FeatMatch: Feature-Based Augmentation for Semi-Supervised Learningcited by 57
- 2018NOTE-RCNN: NOise Tolerant Ensemble RCNN for Semi-Supervised Object Detectioncited by 37
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2022: 6; 2023: 11; 2024: 16; 2025: 8; 2026: 2.
43 papers.
Sort:
By area:
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 112
- 2025Baichuan-Omni-1.5 Technical Reportcited by 107
- 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Drivingcited by 100
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2023RDumb: A simple approach that questions our progress in continual test-time adaptationcited by 50
- 2024Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselinescited by 27
- 2025Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Drivingcited by 19
- 2022Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routingcited by 18
- 2023Perception Datasets for Anomaly Detection in Autonomous Driving: A Surveycited by 16
- 2024Task-customized Masked AutoEncoder via Mixture of Cluster-conditional Expertscited by 16
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Servicescited by 14
31 more
- 2023Learning to Name Classes for Vision and Language Modelscited by 12
- 2024Mixture of insighTful Experts (MoTE): The Synergy of Thought Chains and Expert Mixtures in Self-Alignmentcited by 10
- 2024Open-Vocabulary Object Detection via Language Hierarchycited by 10
- 2025Spotting the Unexpected (STU): A 3D LiDAR Dataset for Anomaly Segmentation in Autonomous Drivingcited by 10
- 2023AR-TTA: A Simple Method for Real-World Continual Test-Time Adaptationcited by 8
- 2022Cross-domain Federated Object Detectioncited by 5
- 2023Cross-Domain Car Detection Model with Integrated Convolutional Block Attention Mechanismcited by 5
- 2024Semi-Supervised U-statisticscited by 5
- 2025RICO: Two Realistic Benchmarks and an In-Depth Analysis for Incremental Learning in Object Detectioncited by 5
- 2023Navigating Data Heterogeneity in Federated Learning A Semi-Supervised Federated Object Detectioncited by 4
- 2024PLoc: A New Evaluation Criterion Based on Physical Location for Autonomous Driving Datasetscited by 4
- 2024Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Taskcited by 4
- 20223rd Continual Learning Workshop Challenge on Egocentric Category and Instance Level Object Understandingcited by 3
- 2024MR-MLLM: Mutual Reinforcement of Multimodal Comprehension and Vision Perceptioncited by 3
- 2024XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videoscited by 3
- 2023OpenNet: Incremental Learning for Autonomous Driving Object Detection with Balanced Losscited by 2
- 2024BadODD: Bangladeshi Autonomous Driving Object Detection Datasetcited by 2
- 2024Weakly Supervised Test-Time Domain Adaptation for Object Detectioncited by 2
- 2025Towards One-shot Federated Learning: Advances, Challenges, and Future Directionscited by 2
- 2025Vehicle-centric Perception via Multimodal Structured Pre-trainingcited by 2
- 2023TADIL: Task-Agnostic Domain-Incremental Learning through Task-ID Inference using Transformer Nearest-Centroid Embeddingscited by 1
- 2024Label-Free Model Failure Detection for Lidar-based Point Cloud Segmentationcited by 1
- 2022Label-Efficient Object Detection via Region Proposal Network Pre-Trainingcited by 0
- 2023DeepCompass: AI-driven Location-Orientation Synchronization for Navigating Platformscited by 0
- 2024Multimodal-Enhanced Objectness Learner for Corner Case Detection in Autonomous Drivingcited by 0
- 2024Efficient Transferability Assessment for Selection of Pre-trained Detectorscited by 0
- 2024ClaudesLens: Uncertainty Quantification in Computer Vision Modelscited by 0
- 2025Closer to Reality: Practical Semi-Supervised Federated Learning for Foundation Model Adaptationcited by 0
- 2025FEDEXCHANGE: Bridging the Domain Gap in Federated Object Detection for Freecited by 0
- 2026RailSyn: Diagnosis-Guided Image Generation for Traceable Data Completion in Railway Foreign Object Detectioncited by 0
- 2026RailGen: Improving Railway Intrusion Detection via Agent-Guided Small-Scale Foreign Object Generationcited by 0
- 2026RailGen: Improving Railway Intrusion Detection via Agent-Guided Small-Scale Foreign Object Generation31 Aug 2026
- 2026RailSyn: Diagnosis-Guided Image Generation for Traceable Data Completion in Railway Foreign Object Detection31 Aug 2026
- 2025Vehicle-centric Perception via Multimodal Structured Pre-training22 Dec 2025
- 2025FEDEXCHANGE: Bridging the Domain Gap in Federated Object Detection for Free1 Sep 2025
- 2025Closer to Reality: Practical Semi-Supervised Federated Learning for Foundation Model Adaptation22 Aug 2025
- 2025RICO: Two Realistic Benchmarks and an In-Depth Analysis for Incremental Learning in Object Detection19 Aug 2025
- 2025Towards One-shot Federated Learning: Advances, Challenges, and Future Directions5 May 2025
- 2025Spotting the Unexpected (STU): A 3D LiDAR Dataset for Anomaly Segmentation in Autonomous Driving4 May 2025
- 2025Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving27 Mar 2025
- 2025Baichuan-Omni-1.5 Technical Report26 Jan 2025
- 2024Open-Vocabulary Object Detection via Language Hierarchy27 Oct 2024
- 2024XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos25 Jul 2024
31 more
- 2024Label-Free Model Failure Detection for Lidar-based Point Cloud Segmentation19 Jul 2024
- 2024Weakly Supervised Test-Time Domain Adaptation for Object Detection8 Jul 2024
- 2024MR-MLLM: Mutual Reinforcement of Multimodal Comprehension and Vision Perception22 Jun 2024
- 2024Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselines20 Jun 2024
- 2024ClaudesLens: Uncertainty Quantification in Computer Vision Models18 Jun 2024
- 2024Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Task28 May 2024
- 2024Mixture of insighTful Experts (MoTE): The Synergy of Thought Chains and Expert Mixtures in Self-Alignment1 May 2024
- 2024PLoc: A New Evaluation Criterion Based on Physical Location for Autonomous Driving Datasets29 Mar 2024
- 2024Efficient Transferability Assessment for Selection of Pre-trained Detectors14 Mar 2024
- 2024Semi-Supervised U-statistics29 Feb 2024
- 2024Task-customized Masked AutoEncoder via Mixture of Cluster-conditional Experts8 Feb 2024
- 2024Multimodal-Enhanced Objectness Learner for Corner Case Detection in Autonomous Driving3 Feb 2024
- 2024BadODD: Bangladeshi Autonomous Driving Object Detection Dataset19 Jan 2024
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlook2 Jan 2024
- 2023OpenNet: Incremental Learning for Autonomous Driving Object Detection with Balanced Loss25 Nov 2023
- 2023Navigating Data Heterogeneity in Federated Learning A Semi-Supervised Federated Object Detection26 Oct 2023
- 2023AR-TTA: A Simple Method for Real-World Continual Test-Time Adaptation18 Sep 2023
- 2023DeepCompass: AI-driven Location-Orientation Synchronization for Navigating Platforms15 Sep 2023
- 2023TADIL: Task-Agnostic Domain-Incremental Learning through Task-ID Inference using Transformer Nearest-Centroid Embeddings21 Jun 2023
- 2023RDumb: A simple approach that questions our progress in continual test-time adaptation8 Jun 2023
- 2023Cross-Domain Car Detection Model with Integrated Convolutional Block Attention Mechanism31 May 2023
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services13 Apr 2023
- 2023Learning to Name Classes for Vision and Language Models4 Apr 2023
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectives17 Mar 2023
- 2023Perception Datasets for Anomaly Detection in Autonomous Driving: A Survey6 Feb 2023
- 20223rd Continual Learning Workshop Challenge on Egocentric Category and Instance Level Object Understanding13 Dec 2022
- 2022Label-Efficient Object Detection via Region Proposal Network Pre-Training16 Nov 2022
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarks28 Jul 2022
- 2022Cross-domain Federated Object Detection30 Jun 2022
- 2022Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routing26 May 2022
- 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving15 Mar 2022
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2025Baichuan-Omni-1.5 Technical Reportcited by 107
- 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Drivingcited by 100
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
- 2023RDumb: A simple approach that questions our progress in continual test-time adaptationcited by 50
- 2024Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselinescited by 27
- 2022Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routingcited by 18
- 2023Perception Datasets for Anomaly Detection in Autonomous Driving: A Surveycited by 16
- 2023A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Servicescited by 14
- 2023Learning to Name Classes for Vision and Language Modelscited by 12
- 2024Open-Vocabulary Object Detection via Language Hierarchycited by 10
- 2025Spotting the Unexpected (STU): A 3D LiDAR Dataset for Anomaly Segmentation in Autonomous Drivingcited by 10
12 most cited of 37 All 37 (JSON)
- 2026RailGen: Improving Railway Intrusion Detection via Agent-Guided Small-Scale Foreign Object Generation31 Aug 2026
- 2026RailSyn: Diagnosis-Guided Image Generation for Traceable Data Completion in Railway Foreign Object Detection31 Aug 2026
- 2025Vehicle-centric Perception via Multimodal Structured Pre-training22 Dec 2025
- 2025FEDEXCHANGE: Bridging the Domain Gap in Federated Object Detection for Free1 Sep 2025
- 2025RICO: Two Realistic Benchmarks and an In-Depth Analysis for Incremental Learning in Object Detection19 Aug 2025
- 2025Towards One-shot Federated Learning: Advances, Challenges, and Future Directions5 May 2025
- 2025Spotting the Unexpected (STU): A 3D LiDAR Dataset for Anomaly Segmentation in Autonomous Driving4 May 2025
- 2025Baichuan-Omni-1.5 Technical Report26 Jan 2025
- 2024Open-Vocabulary Object Detection via Language Hierarchy27 Oct 2024
- 2024XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos25 Jul 2024
- 2024Label-Free Model Failure Detection for Lidar-based Point Cloud Segmentation19 Jul 2024
- 2024Weakly Supervised Test-Time Domain Adaptation for Object Detection8 Jul 2024
12 newest of 37 All 37 (JSON)