mlsanityData to 14 Oct 2026

VISTA-DZ: Visual Semantic Trajectory Adaptation for Personalized Dilemma Zone Prediction

arXiv 2606.29548 ↗First posted 28 Jun 2026cs.LG cs.AI cs.DBcited by 0

Not on the map. Why?

Abstract (arXiv)

Driver decision making in the dilemma zone at signalized intersections is safety critical, as vehicles approaching a yellow signal must decide whether to stop or proceed within limited time and distance margins. Accurate prediction of both stop-go decisions and decision timing is important for adaptive signal control, advanced driver assistance systems, and human-centered intelligent transportation applications. However, dilemma zone behavior is strongly driver dependent. Similar approach trajectories may lead to different decisions across drivers because of differences in risk preference, braking habit, and decision threshold. Existing personalized models often rely on handcrafted scalar descriptors, which provide useful but limited summaries of individual behavior. This paper proposes VISTA-DZ, a semantic-profile-conditioned framework for personalized stop-go and decision-time prediction. Historical trajectories are converted into visual representations, interpreted by a vision-language model to generate behavioral profiles, and encoded as semantic embeddings to condition a dual-output prediction network. The final model combines a bidirectional GRU encoder, driver-conditioned multi-head cross-attention, and Feature-wise Linear Modulation for temporal evidence selection and feature adaptation. Experiments on the SDZ dataset and a newly collected FDZ dataset show that VISTA-DZ outperforms trajectory-only and handcrafted personalization baselines, achieving 93.26% in-domain simulation accuracy and 90.22% mean accuracy across 20 held-out simulation drivers. Cross-domain results further show feasible zero-shot simulation-to-real transfer and better real-world generalization when simulation data are combined with limited field data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 47 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

19 of 47 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  4. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  5. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  6. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  7. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  8. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  9. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  10. 2016A Learned Representation For Artistic Stylecited by 341
  11. 2024VLP: Vision Language Planning for Autonomous Drivingcited by 126
  12. 2018Driving Policy Transfer via Modularity and Abstractioncited by 92
7 more
  1. 2023Personalized Autonomous Driving with Large Language Models: Field Experimentscited by 48
  2. 2018Learning to Drive from Simulation without Real World Labelscited by 39
  3. 2022SIND: A Drone Dataset at Signalized Intersection in Chinacited by 30
  4. 2025PDB: Not All Drivers Are the Same -- A Personalized Dataset for Understanding Driving Behaviorcited by 6
  5. 2017Driver Identification Using Automobile Sensor Data from a Single Turncited by 5
  6. 2021Driver2vec: Driver Identification from Automotive Datacited by 3
  7. 2024Investigating Personalized Driving Behaviors in Dilemma Zones: Analysis and Prediction of Stop-or-Go Decisionscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025An Intention-driven Lane Change Framework Considering Heterogeneous Dynamic Cooperation in Mixed-traffic Environment ↗
  2. 2026RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policies
  3. 2026VLALight: A Vision-Language-Action Model for Traffic Signal Control
  4. 2026DiffAttn: Diffusion-Based Drivers' Visual Attention Prediction with LLM-Enhanced Semantic Reasoning
  5. 2026Large Language Model based Interactive Decision-Making for Autonomous Driving
  6. 2026Driver-WM: A Driver-Centric Traffic-Conditioned Latent World Model for In-Cabin Dynamics Rollout
  7. 2021A hierarchical behavior prediction framework at signalized intersections
  8. 2025ReAL-AD: Towards Human-Like Reasoning in End-to-End Autonomous Driving