Behavior-Grounded Lane Representation Learning for Multi-Task Traffic Digital Twins
Not on the map. Why?
Abstract (arXiv)
Traffic digital twins are powerful tools for advanced traffic management, and most systems are built on static geometric representations. However, these representations fail to capture the dynamic functional semantics required for behavior-aware reasoning, such as how a lane operates under complex traffic conditions. To address this gap, we introduce GeoLaneRep, a behavior-grounded lane representation learning framework for traffic digital twins. GeoLaneRep jointly encodes static lane geometry, observed vehicle trajectories, and operational descriptors into a shared, cross-camera semantic embedding. The encoder is trained with a joint objective combining contrastive cross-camera alignment, auxiliary role supervision, and temporal anomaly detection. Across 16 roadside cameras and 132 lanes, the learned embeddings achieve a 0.004 lateral-rank error and an edge-role F1 of 1.000 in zero-shot cross-camera matching, and an AUROC of 0.991 for window-level anomaly detection. We further show that the same behavioral embeddings can condition a diffusion-based generator to synthesize lane geometries that satisfy targeted operational specifications, with 87.9% overall specification accuracy across 38 lane groups. GeoLaneRep thus provides a semantic interface between roadside observations and downstream digital twin tasks, supporting cross-camera transfer, behavior-aware monitoring, and goal-directed lane synthesis. The framework is openly available at https://github.com/raynbowy23/GeoLaneRep.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 37 references that are in the map. First posted on arXiv 3 May 2026.
Builds on
20 of 37 references.
References · 20
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2022Self-supervised Trajectory Representation Learning with Temporal Regularities and Travel Semanticscited by 58
- 2022Jointly Contrastive Representation Learning on Road Network and Trajectorycited by 34
- 2024TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenescited by 29
- 2024CityLLaVA: Efficient Fine-Tuning for VLMs in City Scenariocited by 27
- 2024Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectivescited by 22
8 more
- 2024Smart Mobility Digital Twin Based Automated Vehicle Navigation System: A Proof of Conceptcited by 15
- 2025Bridging Traffic State and Trajectory for Dynamic Road Network and Trajectory Representation Learningcited by 14
- 2023Road Network Representation Learning: A Dual Graph based Approachcited by 12
- 2025Scenario Understanding of Traffic Scenes Through Large Visual Language Modelscited by 8
- 2025Persistent Autoregressive Mapping with Traffic Rules for Autonomous Drivingcited by 5
- 2024Unifying Lane-Level Traffic Prediction from a Graph Structural Perspective: Benchmark and Baselinecited by 3
- 2025Fine-Grained Traffic Inference from Road to Lane via Spatio-Temporal Graph Node Generationcited by 2
- 2025Geo-ORBIT: A Federated Digital Twin Framework for Scene-Adaptive Lane Geometry Detectioncited by 1
Built on by
Not cited yet.