mlsanityData to 14 Oct 2026

Pedestrian Crossing Intent Prediction via Psychological Features and Transformer Fusion

arXiv 2603.19533 ↗First posted 20 Mar 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Pedestrian intention prediction needs to be accurate for autonomous vehicles to navigate safely in urban environments. We present a lightweight, socially informed architecture for pedestrian intention prediction. It fuses four behavioral streams (attention, position, situation, and interaction) using highway encoders, a compact 4-token Transformer, and global self-attention pooling. To quantify uncertainty, we incorporate two complementary heads: a variational bottleneck whose KL divergence captures epistemic uncertainty, and a Mahalanobis distance detector that identifies distributional shift. Together, these components yield calibrated probabilities and actionable risk scores without compromising efficiency. On the PSI 1.0 benchmark, our model outperforms recent vision language models by achieving 0.9 F1, 0.94 AUC-ROC, and 0.78 MCC by using only structured, interpretable features. On the more diverse PSI 2.0 dataset, where, to the best of our knowledge, no prior results exist, we establish a strong initial baseline of 0.78 F1 and 0.79 AUC-ROC. Selective prediction based on Mahalanobis scores increases test accuracy by up to 0.4 percentage points at 80% coverage. Qualitative attention heatmaps further show how the model shifts its cross-stream focus under ambiguity. The proposed approach is modality-agnostic, easy to integrate with vision language pipelines, and suitable for risk-aware intent prediction on resource-constrained platforms.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 34 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

12 of 34 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2016Layer Normalizationcited by 5,669
  5. 2017On Calibration of Modern Neural Networkscited by 4,960
  6. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  7. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  8. 2018SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraintscited by 298
  9. 2015Training Very Deep Networkscited by 173
  10. 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
  11. 2025Pedestrian Intention Prediction via Vision-Language Foundation Modelscited by 5
  12. 2025Seeing Beyond Frames: Zero-Shot Pedestrian Intention Prediction with Raw Temporal Video and Multimodal Cuescited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Adaptive Cross-Modal Fusion with Sparse Attention for Pedestrian Crossing Intention Prediction
  2. 2026PEDESTRIANQA: A Benchmark for Vision-Language Models on Pedestrian Intention and Trajectory Prediction
  3. 2026Decoding Pedestrian Crossing Intention from Egocentric Vision via Vision Language Models
  4. 2025Intention-Aware Diffusion Model for Pedestrian Trajectory Prediction
  5. 2025DRAMA-X: A Fine-grained Intent Prediction and Risk Reasoning Benchmark For Driving
  6. 2026Pedestrian-Aware LLM-Driven Behavioral Planning for Autonomous Vehicles
  7. 2025Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction
  8. 2025Large Language Models for Pedestrian Safety: An Application to Predicting Driver Yielding Behavior at Unsignalized Intersections