mlsanityData to 14 Oct 2026

BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning

arXiv 1805.04687 ↗First posted 12 May 2018cs.CVcited by 1,288

Not on the map. Why?

Cited by 72 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Datasets drive vision progress, yet existing driving datasets are impoverished in terms of visual content and supported tasks to study multitask learning for autonomous driving. Researchers are usually constrained to study a small set of problems on one dataset, while real-world computer vision applications require performing tasks of various complexities. We construct BDD100K, the largest driving video dataset with 100K videos and 10 tasks to evaluate the exciting progress of image recognition algorithms on autonomous driving. The dataset possesses geographic, environmental, and weather diversity, which is useful for training models that are less likely to be surprised by new conditions. Based on this diverse dataset, we build a benchmark for heterogeneous multitask learning and study how to solve the tasks together. Our experiments show that special training strategies are needed for existing models to perform such heterogeneous tasks. BDD100K opens the door for future studies in this important venue.

Key facts. Cited by 1,288 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2019: 3; 2020: 0; 2021: 130; 2022: 169; 2023: 262; 2024: 270; 2025: 259; 2026: 195.

1,288 papers.

Sort:

By area:

  1. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  2. 2024Depth Anything V2cited by 1,422
  3. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  4. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  5. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  6. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  7. 2022Language-driven Semantic Segmentationcited by 717
  8. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 537
  9. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  10. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
  11. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  12. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
38 more
  1. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  2. 2021COMBO: Conservative Offline Model-Based Policy Optimizationcited by 370
  3. 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
  4. 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
  5. 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
  6. 2023ViNT: A Foundation Model for Visual Navigationcited by 222
  7. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
  8. 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 219
  9. 2021One Million Scenes for Autonomous Driving: ONCE Datasetcited by 218
  10. 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 215
  11. 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 194
  12. 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
  13. 2022GNM: A General Navigation Model to Drive Any Robotcited by 171
  14. 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
  15. 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
  16. 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
  17. 2022SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptationcited by 146
  18. 2022PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmarkcited by 140
  19. 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
  20. 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
  21. 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 126
  22. 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 122
  23. 2021OptiDICE: Offline Policy Optimization via Stationary Distribution Correction Estimationcited by 121
  24. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
  25. 2024One-Step Image Translation with Text-to-Image Modelscited by 116
  26. 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 114
  27. 2022K-Radar: 4D Radar Object Detection for Autonomous Driving in Various Weather Conditionscited by 108
  28. 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Surveycited by 103
  29. 2021Large-scale Unsupervised Semantic Segmentationcited by 101
  30. 2023TTN: A Domain-Shift Aware Batch Normalization in Test-Time Adaptationcited by 101
  31. 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Drivingcited by 100
  32. 2021Unsupervised Domain Adaptation of Object Detectors: A Surveycited by 93
  33. 2022Towards Grand Unification of Object Trackingcited by 93
  34. 2023Referring Multi-Object Trackingcited by 93
  35. 2022Style-Hallucinated Dual Consistency Learning for Domain Generalized Semantic Segmentationcited by 89
  36. 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
  37. 2022SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentationcited by 87
  38. 2023CLIP the Gap: A Single Domain Generalization Approach for Object Detectioncited by 87

50 most cited of 1,288 All 1,288 (JSON)