LoRFT: Benchmarking Long-Range Vehicle Trajectory Reconstruction from Fixed Highway Cameras
Not on the map. Why?
Abstract (arXiv)
Long-range vehicle trajectories provide important spatio-temporal evidence for traffic safety analysis, autonomous driving evaluation, and data-driven traffic management, yet continuously recovering them from fixed highway cameras remains difficult. As vehicles recede into distant road regions, perspective compression and scale decay often fragment or prematurely terminate automatic tracklets, even when their continuation remains identifiable from motion consistency across neighboring frames. We formulate this problem as recovering the far-range continuation of a vehicle trajectory from a reliable near-field tracklet. We introduce LoRFT, to our knowledge the first open benchmark dedicated to long-range vehicle trajectory reconstruction from fixed highway cameras. LoRFT comprises 22 expressway surveillance scenes, 366,109 video frames, 6,601 manually verified trajectories, 2,694,889 bounding boxes, road-geometry annotations, scene-level splits, and evaluation scripts. We further propose Map-RSTNet, a map-aware residual sequence-to-sequence model that reconstructs distant trajectories in a road-geometry-aligned state space and dynamically refreshes local road geometry during decoding. On LoRFT, Map-RSTNet reduces ADE, FDE, and 5-second RMSE by 11.0%, 15.4%, and 10.5%, respectively, relative to the strongest baseline. These results demonstrate that road-geometry-aware reconstruction can extend usable trajectory records from existing fixed-camera infrastructure. LoRFT provides a reproducible testbed for long-range vehicle trajectory reconstruction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
24 of 40 references.
References · 24
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2020Learning Lane Graph Representations for Motion Forecastingcited by 382
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 295
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 277
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2019The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersectionscited by 137
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 2015UA-DETRAC: A New Benchmark and Protocol for Multi-Object Detection and Trackingcited by 98
- 2022Rope3D: TheRoadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Taskcited by 81
- 2023Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Predictioncited by 47
- 2020openDD: A Large-Scale Roundabout Drone Datasetcited by 29
12 more
- 2023I-24 MOTION: An instrument for freeway traffic sciencecited by 26
- 2023Machine Learning for Autonomous Vehicle's Trajectory Prediction: A comprehensive survey, Challenges, and Future Research Directionscited by 23
- 2020SCALE-Net: Scalable Vehicle Trajectory Prediction Network under Random Number of Interacting Vehicles via Edge-enhanced Graph Convolutional Neural Networkcited by 18
- 2021DeepTrack: Lightweight Deep Learning for Vehicle Path Prediction in Highwayscited by 16
- 2022Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Camerascited by 13
- 2022Automatic vehicle trajectory data reconstruction at scalecited by 8
- 2023Traffic State Estimation from Vehicle Trajectories with Anisotropic Gaussian Processescited by 6
- 2024Goal-based Neural Physics Vehicle Trajectory Prediction Modelcited by 6
- 2022MixNet: Structured Deep Neural Motion Prediction for Autonomous Racingcited by 4
- 2023A POV-based Highway Vehicle Trajectory Dataset and Prediction Architecturecited by 4
- 2024ITPNet: Towards Instantaneous Trajectory Prediction for Autonomous Drivingcited by 2
- 2026Recover to Predict: Progressive Retrospective Learning for Variable-Length Trajectory Predictioncited by 2
Built on by
Not cited yet.