TruckDrive: Long-Range Autonomous Highway Driving Dataset
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
Safe highway autonomy for heavy trucks remains an open and unsolved challenge: due to long braking distances, scene understanding of hundreds of meters is required for anticipatory planning and to allow safe braking margins. However, existing driving datasets primarily cover urban scenes, with perception effectively limited to short ranges of only up to 100 meters. To address this gap, we introduce TruckDrive, a highway-scale multimodal driving dataset, captured with a sensor suite purpose-built for long range sensing: seven long-range FMCW LiDARs measuring range and radial velocity, three high-resolution short-range LiDARs, eleven 8MP surround cameras with varying focal lengths and ten 4D FMCW radars. The dataset offers 475 thousands samples with 165 thousands densely annotated frames for driving perception benchmarking up to 1,000 meters for 2D detection and 400 meters for 3D detection, depth estimation, tracking, planning and end to end driving over 20 seconds sequences at highway speeds. We find that state-of-the-art autonomous driving models do not generalize to ranges beyond 150 meters, with drops between 31% and 99% in 3D perception tasks, exposing a systematic long-range gap that current architectures and training signals cannot close.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 54 of its 67 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
54 of 67 references.
Closest ancestors · 3
Same direction, newest first
- 2025WOD-E2E: Waymo Open Dataset for End-to-End Driving in Challenging Long-tail Scenarios30 Oct
- 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiency6 Feb
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 51
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
38 more
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2017Sparsity Invariant CNNscited by 325
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 239
- 2018The ApolloScape Open Dataset for Autonomous Driving and its Applicationcited by 188
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
- 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 141
- 2021Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Predictioncited by 131
- 2023Visual Point Cloud Forecasting enables Scalable Autonomous Drivingcited by 97
- 2022MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queriescited by 90
- 2023SparseFusion: Fusing Multi-Modal Sparse Representations for Multi-Sensor 3D Object Detectioncited by 83
- 2019The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenescited by 80
- 2023Point Cloud Forecasting as a Proxy for 4D Occupancy Forecastingcited by 76
- 2023Far3D: Expanding the Horizon for Surround-view 3D Object Detectioncited by 70
- 2019A*3D Dataset: Towards Autonomous Driving in Challenging Environmentscited by 64
- 2021Immortal Tracker: Tracklet Never Diescited by 42
- 2024PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistencycited by 42
- 2020A Benchmark for LiDAR-based Panoptic Segmentation based on KITTIcited by 40
- 2020Cityscapes 3D: Dataset and Benchmark for 9 DoF Vehicle Detectioncited by 39
- 2023R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Camerascited by 39
- 2024Neural Markov Random Field for Stereo Matchingcited by 38
- 2022Receding Moving Object Segmentation in 3D LiDAR Data Using Sparse 4D Convolutionscited by 35
- 2023FSD V2: Improving Fully Sparse 3D Object Detection with Virtual Voxelscited by 34
- 2022aiMotive Dataset: A Multimodal Dataset for Robust Autonomous Driving with Long-Range Perceptioncited by 29
- 20233DMOTFormer: Graph Transformer for Online 3D Multi-Object Trackingcited by 21
- 2025MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priorscited by 19
- 2025Orbis: Overcoming Challenges of Long-Horizon Prediction in Driving World Modelscited by 17
- 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
- 2025Self-Supervised Sparse Sensor Fusion for Long Range Perceptioncited by 8
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Scaling Self-Play for End-to-End Drivingcited by 4
- 2026Telescope: Learnable Hyperbolic Foveation for Ultra-Long-Range Object Detectioncited by 0
- 2026nuTruck: Benchmarking Autonomous Driving Planning for Distributed Electric-drive Truckscited by 0
- 2026AevaScenes: An FMCW LiDAR Dataset and Benchmark for Long-Range Perceptioncited by 0
- 2026Data-Efficient Adaptation of a Driving VLA to Class 8 Truckscited by 0
- 2026Data-Efficient Adaptation of a Driving VLA to Class 8 Trucks29 Sep 2026
- 2026AevaScenes: An FMCW LiDAR Dataset and Benchmark for Long-Range Perception27 Sep 2026
- 2026nuTruck: Benchmarking Autonomous Driving Planning for Distributed Electric-drive Trucks15 Jul 2026
- 2026Scaling Self-Play for End-to-End Driving17 Jun 2026
- 2026Telescope: Learnable Hyperbolic Foveation for Ultra-Long-Range Object Detection7 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Driving
- 2024InfinityDrive: Breaking Time Limits in Driving World Models
- 2024A Comprehensive Review of 3D Object Detection in Autonomous Driving: Technological Advances and Future Directions
- 2025Investigating Vision-Language Model for Point Cloud-based Vehicle Classification
- 2026123D: Unifying Multi-Modal Autonomous Driving Data at Scale
- 2025RS2AD: End-to-End Autonomous Driving Data Generation from Roadside Sensor Observations
- 2026Bridging the Modality Gap in Roadside LiDAR: A Training-Free Vision-Language Model Framework for Vehicle Classification