mlsanityData to 7 Oct 2026

TruckDrive: Long-Range Autonomous Highway Driving Dataset

arXiv 2603.02413 ↗First posted 2 Mar 2026cs.CVcited by 5

On the map: End-to-end autonomous driving → End-to-end system architecture

Abstract (arXiv)

Safe highway autonomy for heavy trucks remains an open and unsolved challenge: due to long braking distances, scene understanding of hundreds of meters is required for anticipatory planning and to allow safe braking margins. However, existing driving datasets primarily cover urban scenes, with perception effectively limited to short ranges of only up to 100 meters. To address this gap, we introduce TruckDrive, a highway-scale multimodal driving dataset, captured with a sensor suite purpose-built for long range sensing: seven long-range FMCW LiDARs measuring range and radial velocity, three high-resolution short-range LiDARs, eleven 8MP surround cameras with varying focal lengths and ten 4D FMCW radars. The dataset offers 475 thousands samples with 165 thousands densely annotated frames for driving perception benchmarking up to 1,000 meters for 2D detection and 400 meters for 3D detection, depth estimation, tracking, planning and end to end driving over 20 seconds sequences at highway speeds. We find that state-of-the-art autonomous driving models do not generalize to ranges beyond 150 meters, with drops between 31% and 99% in 3D perception tasks, exposing a systematic long-range gap that current architectures and training signals cannot close.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 54 of its 67 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

54 of 67 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarios30 Oct
  2. 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiency6 Feb
  3. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 51

  1. 2020End-to-End Object Detection with Transformerscited by 7,384
  2. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  8. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  9. 2022Planning-oriented Autonomous Drivingcited by 1,068
  10. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
  11. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  12. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
38 more
  1. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
  2. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
  3. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  4. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  5. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  6. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  7. 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
  8. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
  9. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  10. 2017Sparsity Invariant CNNscited by 325
  11. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  12. 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
  13. 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 188
  14. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
  15. 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
  16. 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 141
  17. 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
  18. 2023Visual Point Cloud Forecasting enables Scalable Autonomous Drivingcited by 97
  19. 2022MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queriescited by 90
  20. 2023SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detectioncited by 83
  21. 2019The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenescited by 80
  22. 2023Point Cloud Forecasting as a Proxy for 4D Occupancy Forecastingcited by 76
  23. 2023Far3D: Expanding the Horizon for Surround-view 3D Object Detectioncited by 70
  24. 2019A*3D Dataset: Towards Autonomous Driving in Challenging Environmentscited by 64
  25. 2021Immortal Tracker: Tracklet Never Diescited by 42
  26. 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistencycited by 42
  27. 2020A Benchmark for LiDAR-based Panoptic Segmentation based on KITTIcited by 40
  28. 2020Cityscapes 3D: Dataset and Benchmark for 9 DoF Vehicle Detectioncited by 39
  29. 2023R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Camerascited by 39
  30. 2024Neural Markov Random Field for Stereo Matchingcited by 38
  31. 2022Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutionscited by 35
  32. 2023FSD V2: Improving Fully Sparse 3D Object Detection with Virtual Voxelscited by 34
  33. 2022aiMotive Dataset: A Multimodal Dataset for Robust Autonomous Driving with Long-Range Perceptioncited by 29
  34. 20233DMOTFormer: Graph Transformer for Online 3D Multi-Object Trackingcited by 21
  35. 2025MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priorscited by 19
  36. 2025Orbis: Overcoming Challenges of Long-Horizon Prediction in Driving World Modelscited by 17
  37. 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
  38. 2025Self-Supervised Sparse Sensor Fusion for Long Range Perceptioncited by 8

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset
  2. 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Driving
  3. 2024InfinityDrive: Breaking Time Limits in Driving World Models
  4. 2024A Comprehensive Review of 3D Object Detection in Autonomous Driving: Technological Advances and Future Directions
  5. 2025Investigating Vision-Language Model for Point Cloud-based Vehicle Classification
  6. 2026123D: Unifying Multi-Modal Autonomous Driving Data at Scale
  7. 2025RS2AD: End-to-End Autonomous Driving Data Generation from Roadside Sensor Observations
  8. 2026Bridging the Modality Gap in Roadside LiDAR: A Training-Free Vision-Language Model Framework for Vehicle Classification