IntFormer: Predicting pedestrian intention with the aid of the Transformer architecture
Not on the map. Why?
Abstract (arXiv)
Understanding pedestrian crossing behavior is an essential goal in intelligent vehicle development, leading to an improvement in their security and traffic flow. In this paper, we developed a method called IntFormer. It is based on transformer architecture and a novel convolutional video classification model called RubiksNet. Following the evaluation procedure in a recent benchmark, we show that our model reaches state-of-the-art results with good performance (≈ 40 seq. per second) and size (8× smaller than the best performing model), making it suitable for real-time usage. We also explore each of the input features, finding that ego-vehicle speed is the most important variable, possibly due to the similarity in crossing cases in PIE dataset.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 11 of its 21 references that are in the map. First posted on arXiv 18 May 2021.
Builds on
11 of 21 references.
References · 11
- 2017Attention Is All You Needcited by 59,932
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2021Transformers in Vision: A Surveycited by 1,009
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 852
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2020A Comprehensive Study of Deep Video Action Recognitioncited by 87
- 2019Real-time Intent Prediction of Pedestrians for Autonomous Ground Vehicles via Spatio-Temporal DenseNetcited by 28
- 2019Looking Ahead: Anticipating Pedestrians Crossing with Future Frames Predictioncited by 25
- 2020RNN-based Pedestrian Crossing Prediction using Activity and Pose-related Featurescited by 21
- 2020FuSSI-Net: Fusion of Spatio-temporal Skeletons for Intention Prediction Networkcited by 17
- 2018Joint Attention in Driver-Pedestrian Interaction: from Theory to Practicecited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 3; 2025: 6; 2026: 2.
13 papers.
Sort:
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2022Assessing Cross-dataset Generalization of Pedestrian Crossing Predictorscited by 11
- 2024GTransPDM: A Graph-embedded Transformer with Positional Decoupling for Pedestrian Crossing Intention Predictioncited by 4
- 2025Multi-Context Fusion Transformer for Pedestrian Crossing Intention Prediction in Urban Environmentscited by 3
- 2025ACIT: Attention-Guided Cross-Modal Interaction Transformer for Pedestrian Crossing Intention Predictioncited by 3
- 2024Can Reasons Help Improve Pedestrian Intent Estimation? A Cross-Modal Approachcited by 2
- 2025Seeing Beyond Frames: Zero-Shot Pedestrian Intention Prediction with Raw Temporal Video and Multimodal Cuescited by 2
- 2026VIT-Ped: Visionary Intention Transformer for Pedestrian Behavior Analysiscited by 2
- 2024Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Drivingcited by 1
- 2025Pedestrian Crossing Intention Prediction Using Multimodal Fusion Networkcited by 1
- 2025Temporal-contextual Event Learning for Pedestrian Crossing Intent Predictioncited by 0
- 2025Enhancing Customer Service Chatbots with Context-Aware NLU through Selective Attention and Multi-task Learningcited by 0
- 2026Adaptive Cross-Modal Fusion with Sparse Attention for Pedestrian Crossing Intention Prediction14 Jul 2026
- 2026VIT-Ped: Visionary Intention Transformer for Pedestrian Behavior Analysis5 Jan 2026
- 2025ACIT: Attention-Guided Cross-Modal Interaction Transformer for Pedestrian Crossing Intention Prediction25 Nov 2025
- 2025Multi-Context Fusion Transformer for Pedestrian Crossing Intention Prediction in Urban Environments25 Nov 2025
- 2025Pedestrian Crossing Intention Prediction Using Multimodal Fusion Network25 Nov 2025
- 2025Seeing Beyond Frames: Zero-Shot Pedestrian Intention Prediction with Raw Temporal Video and Multimodal Cues25 Jul 2025
- 2025Enhancing Customer Service Chatbots with Context-Aware NLU through Selective Attention and Multi-task Learning2 Jun 2025
- 2025Temporal-contextual Event Learning for Pedestrian Crossing Intent Prediction4 Apr 2025
- 2024Can Reasons Help Improve Pedestrian Intent Estimation? A Cross-Modal Approach20 Nov 2024
- 2024GTransPDM: A Graph-embedded Transformer with Positional Decoupling for Pedestrian Crossing Intention Prediction30 Sep 2024
- 2024Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Driving24 Aug 2024
- 2022Behavioral Intention Prediction in Driving Scenes: A Survey1 Nov 2022
1 more
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2022Assessing Cross-dataset Generalization of Pedestrian Crossing Predictorscited by 11
- 2024GTransPDM: A Graph-embedded Transformer with Positional Decoupling for Pedestrian Crossing Intention Predictioncited by 4
- 2025Multi-Context Fusion Transformer for Pedestrian Crossing Intention Prediction in Urban Environmentscited by 3
- 2025ACIT: Attention-Guided Cross-Modal Interaction Transformer for Pedestrian Crossing Intention Predictioncited by 3
- 2024Can Reasons Help Improve Pedestrian Intent Estimation? A Cross-Modal Approachcited by 2
- 2025Seeing Beyond Frames: Zero-Shot Pedestrian Intention Prediction with Raw Temporal Video and Multimodal Cuescited by 2
- 2026VIT-Ped: Visionary Intention Transformer for Pedestrian Behavior Analysiscited by 2
- 2024Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Drivingcited by 1
- 2025Pedestrian Crossing Intention Prediction Using Multimodal Fusion Networkcited by 1
- 2025Temporal-contextual Event Learning for Pedestrian Crossing Intent Predictioncited by 0
- 2025Enhancing Customer Service Chatbots with Context-Aware NLU through Selective Attention and Multi-task Learningcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Adaptive Cross-Modal Fusion with Sparse Attention for Pedestrian Crossing Intention Prediction14 Jul 2026
- 2026VIT-Ped: Visionary Intention Transformer for Pedestrian Behavior Analysis5 Jan 2026
- 2025ACIT: Attention-Guided Cross-Modal Interaction Transformer for Pedestrian Crossing Intention Prediction25 Nov 2025
- 2025Multi-Context Fusion Transformer for Pedestrian Crossing Intention Prediction in Urban Environments25 Nov 2025
- 2025Pedestrian Crossing Intention Prediction Using Multimodal Fusion Network25 Nov 2025
- 2025Seeing Beyond Frames: Zero-Shot Pedestrian Intention Prediction with Raw Temporal Video and Multimodal Cues25 Jul 2025
- 2025Enhancing Customer Service Chatbots with Context-Aware NLU through Selective Attention and Multi-task Learning2 Jun 2025
- 2025Temporal-contextual Event Learning for Pedestrian Crossing Intent Prediction4 Apr 2025
- 2024Can Reasons Help Improve Pedestrian Intent Estimation? A Cross-Modal Approach20 Nov 2024
- 2024GTransPDM: A Graph-embedded Transformer with Positional Decoupling for Pedestrian Crossing Intention Prediction30 Sep 2024
- 2024Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Driving24 Aug 2024
- 2022Behavioral Intention Prediction in Driving Scenes: A Survey1 Nov 2022
12 newest of 13 All 13 (JSON)