mlsanityData to 7 Oct 2026

Digital-Twin Losses for Lane-Compliant Trajectory Prediction at Urban Intersections

arXiv 2603.05546 ↗First posted 4 Mar 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate and safety-conscious trajectory prediction is a key technology for intelligent transportation systems, especially in V2X-enabled urban environments with complex multi-agent interactions. In this paper, we created a digital twin-driven V2X trajectory prediction pipeline that jointly leverages cooperative perception from vehicles and infrastructure to forecast multi-agent motion at signalized intersections. The proposed model combines a Bi-LSTM-based generator with a structured training objective consisting of a standard mean squared error (MSE) loss and a novel twin loss. The twin loss encodes infrastructure constraints, collision avoidance, diversity across predicted modes, and rule-based priors derived from the digital twin. While the MSE term ensures point-wise accuracy, the twin loss penalizes traffic rule violations, predicted collisions, and mode collapse, guiding the model toward scene-consistent and safety-compliant predictions. We train and evaluate our approach on real-world V2X data sent from the intersection to the vehicle and collected in urban corridors. In addition to standard trajectory metrics (ADE, FDE), we introduce ITS-relevant safety indicators, including infrastructure and rule violation rates. Experimental results demonstrate that the proposed training scheme significantly reduces critical violations while maintaining comparable prediction accuracy and real-time performance, highlighting the potential of digital twin-driven multi-loss learning for V2X-enabled intelligent transportation systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

14 of 21 references.

References · 14

  1. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  2. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  3. 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 528
  4. 2020Learning Lane Graph Representations for Motion Forecastingcited by 380
  5. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  6. 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
  7. 2019Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Datacited by 104
  8. 2024TUMTraf V2X Cooperative Perception Datasetcited by 66
  9. 2021Identifying Driver Interactions via Conditional Behavior Predictioncited by 48
  10. 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
  11. 2023Digital Twins for Autonomous Driving: A Comprehensive Implementation and Demonstrationcited by 10
  12. 2025Motion Forecasting for Autonomous Vehicles: A Surveycited by 8
2 more
  1. 2020Long-term Prediction of Vehicle Behavior using Short-term Uncertainty-aware Trajectories and High-definition Mapscited by 5
  2. 2024Prediction Horizon Requirements for Automated Driving: Optimizing Safety, Comfort, and Efficiencycited by 3

Built on by

Not cited yet.