A Cognitive-Based Trajectory Prediction Approach for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
In autonomous vehicle (AV) technology, the ability to accurately predict the movements of surrounding vehicles is paramount for ensuring safety and operational efficiency. Incorporating human decision-making insights enables AVs to more effectively anticipate the potential actions of other vehicles, significantly improving prediction accuracy and responsiveness in dynamic environments. This paper introduces the Human-Like Trajectory Prediction (HLTP) model, which adopts a teacher-student knowledge distillation framework inspired by human cognitive processes. The HLTP model incorporates a sophisticated teacher-student knowledge distillation framework. The "teacher" model, equipped with an adaptive visual sector, mimics the visual processing of the human brain, particularly the functions of the occipital and temporal lobes. The "student" model focuses on real-time interaction and decision-making, drawing parallels to prefrontal and parietal cortex functions. This approach allows for dynamic adaptation to changing driving scenarios, capturing essential perceptual cues for accurate prediction. Evaluated using the Macao Connected and Autonomous Driving (MoCAD) dataset, along with the NGSIM and HighD benchmarks, HLTP demonstrates superior performance compared to existing models, particularly in challenging environments with incomplete data. The project page is available at Github.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 27 of its 58 references that are in the map. First posted on arXiv 29 Feb 2024.
Builds on
27 of 58 references.
References · 27
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2018Born Again Neural Networkscited by 539
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 276
- 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
15 more
- 2018Convolutional Social Pooling for Vehicle Trajectory Predictioncited by 221
- 2019Multiple Futures Predictioncited by 178
- 2016Eye Tracking for Everyonecited by 155
- 2019Multi-Agent Tensor Fusion for Contextual Trajectory Predictioncited by 131
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2021Predicting Pedestrian Crossing Intention with Feature Fusion and Spatio-Temporal Attentioncited by 48
- 2022How many Observations are Enough? Knowledge Distillation for Trajectory Forecastingcited by 35
- 2023GPT-4 Enhanced Multimodal Grounding for Autonomous Driving: Leveraging Cross-Modal Attention with Large Language Modelscited by 31
- 2023BAT: Behavior-Aware Human-Like Trajectory Prediction for Autonomous Drivingcited by 28
- 2019Efficient Video Classification Using Fewer Framescited by 25
- 2021Congestion-aware Multi-agent Trajectory Prediction for Collision Avoidancecited by 21
- 2024Human Observation-Inspired Trajectory Prediction for Autonomous Driving in Mixed-Autonomy Traffic Environmentscited by 13
- 2023Graph-Based Interaction-Aware Multimodal 2D Vehicle Trajectory Prediction using Diffusion Graph Convolutional Networkscited by 10
- 2017Cooperative Automated Vehicles: a Review of Opportunities and Challenges in Socially Intelligent Vehicles Beyond Networkingcited by 5
- 2021Hierarchical Motion Encoder-Decoder Network for Trajectory Forecastingcited by 4
Built on by
Citing papers per year: 2024: 8; 2025: 6; 2026: 6.
20 papers.
Sort:
By area:
- 2024DriveScape: Towards High-Resolution Controllable Multi-View Driving Video Generationcited by 22
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2024MFTraj: Map-Free, Behavior-Driven Trajectory Prediction for Autonomous Drivingcited by 12
- 2024NEST: A Neuromodulated Small-world Hypergraph Trajectory Prediction Model for Autonomous Drivingcited by 12
- 2025Minds on the Move: Decoding Trajectory Prediction in Autonomous Driving with Cognitive Insightscited by 10
- 2024DRIVE: Dependable Robust Interpretable Visionary Ensemble Framework in Autonomous Drivingcited by 5
- 2024When, Where, and What? A Novel Benchmark for Accident Anticipation and Localization with Large Language Modelscited by 4
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehiclescited by 2
- 2025Embodied Cognition Augmented End2End Autonomous Drivingcited by 2
- 2024Interpretable Interaction Modeling for Trajectory Prediction via Agent Selection and Physical Coefficientcited by 1
- 2025HIPPD: Brain-Inspired Hierarchical Information Processing for Personality Detectioncited by 1
- 2025Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMscited by 1
8 more
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Modelscited by 0
- 2024Characterized Diffusion Networks for Enhanced Autonomous Driving Trajectory Predictioncited by 0
- 2026How vehicles change lanes after encountering crashes: Empirical analysis and modelingcited by 0
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehiclescited by 0
- 2026EdgeVTP: Exploration of Latency-efficient Trajectory Prediction for Edge-based Embedded Vision Applicationscited by 0
- 2026Agent-Centric Social Trajectory Prediction: A Free Energy Principle Perspectivecited by 0
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Predictioncited by 0
- 2026SWIFT: A Small-World Interaction Framework for Flow-Aware Trajectory Prediction in Autonomous Drivingcited by 0
- 2026SWIFT: A Small-World Interaction Framework for Flow-Aware Trajectory Prediction in Autonomous Driving3 Jul 2026
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction30 May 2026
- 2026Agent-Centric Social Trajectory Prediction: A Free Energy Principle Perspective25 May 2026
- 2026EdgeVTP: Exploration of Latency-efficient Trajectory Prediction for Edge-based Embedded Vision Applications18 Apr 2026
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles6 Apr 2026
- 2026How vehicles change lanes after encountering crashes: Empirical analysis and modeling13 Jan 2026
- 2025Embodied Cognition Augmented End2End Autonomous Driving3 Nov 2025
- 2025Addressing Corner Cases in Autonomous Driving: A World Model-based Approach with Mixture of Experts and LLMs23 Oct 2025
- 2025HIPPD: Brain-Inspired Hierarchical Information Processing for Personality Detection10 Oct 2025
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehicles28 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025Minds on the Move: Decoding Trajectory Prediction in Autonomous Driving with Cognitive Insights27 Feb 2025
8 more
- 2024NEST: A Neuromodulated Small-world Hypergraph Trajectory Prediction Model for Autonomous Driving16 Dec 2024
- 2024Characterized Diffusion Networks for Enhanced Autonomous Driving Trajectory Prediction25 Nov 2024
- 2024DRIVE: Dependable Robust Interpretable Visionary Ensemble Framework in Autonomous Driving16 Sep 2024
- 2024DriveScape: Towards High-Resolution Controllable Multi-View Driving Video Generation9 Sep 2024
- 2024When, Where, and What? A Novel Benchmark for Accident Anticipation and Localization with Large Language Models23 Jul 2024
- 2024Interpretable Interaction Modeling for Trajectory Prediction via Agent Selection and Physical Coefficient21 May 2024
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models8 May 2024
- 2024MFTraj: Map-Free, Behavior-Driven Trajectory Prediction for Autonomous Driving2 May 2024
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2024MFTraj: Map-Free, Behavior-Driven Trajectory Prediction for Autonomous Drivingcited by 12
- 2024NEST: A Neuromodulated Small-world Hypergraph Trajectory Prediction Model for Autonomous Drivingcited by 12
- 2025Minds on the Move: Decoding Trajectory Prediction in Autonomous Driving with Cognitive Insightscited by 10
- 2024When, Where, and What? A Novel Benchmark for Accident Anticipation and Localization with Large Language Modelscited by 4
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehiclescited by 2
- 2024Interpretable Interaction Modeling for Trajectory Prediction via Agent Selection and Physical Coefficientcited by 1
- 2025HIPPD: Brain-Inspired Hierarchical Information Processing for Personality Detectioncited by 1
- 2024Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Modelscited by 0
- 2024Characterized Diffusion Networks for Enhanced Autonomous Driving Trajectory Predictioncited by 0
- 2026How vehicles change lanes after encountering crashes: Empirical analysis and modelingcited by 0
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehiclescited by 0
12 most cited of 16 All 16 (JSON)
- 2026SWIFT: A Small-World Interaction Framework for Flow-Aware Trajectory Prediction in Autonomous Driving3 Jul 2026
- 2026From Cues to Horizons: Dynamic Risk Horizon Profiling for Trajectory Prediction30 May 2026
- 2026Agent-Centric Social Trajectory Prediction: A Free Energy Principle Perspective25 May 2026
- 2026EdgeVTP: Exploration of Latency-efficient Trajectory Prediction for Edge-based Embedded Vision Applications18 Apr 2026
- 2026SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles6 Apr 2026
- 2026How vehicles change lanes after encountering crashes: Empirical analysis and modeling13 Jan 2026
- 2025HIPPD: Brain-Inspired Hierarchical Information Processing for Personality Detection10 Oct 2025
- 2025SafeCast: Risk-Responsive Motion Forecasting for Autonomous Vehicles28 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025Minds on the Move: Decoding Trajectory Prediction in Autonomous Driving with Cognitive Insights27 Feb 2025
- 2024NEST: A Neuromodulated Small-world Hypergraph Trajectory Prediction Model for Autonomous Driving16 Dec 2024
- 2024Characterized Diffusion Networks for Enhanced Autonomous Driving Trajectory Prediction25 Nov 2024
12 newest of 16 All 16 (JSON)