TrajEvo: Designing Trajectory Prediction Heuristics via LLM-driven Evolution
Not on the map. Why?
Abstract (arXiv)
Trajectory prediction is a crucial task in modeling human behavior, especially in fields as social robotics and autonomous vehicle navigation. Traditional heuristics based on handcrafted rules often lack accuracy, while recently proposed deep learning approaches suffer from computational cost, lack of explainability, and generalization issues that limit their practical adoption. In this paper, we introduce TrajEvo, a framework that leverages Large Language Models (LLMs) to automatically design trajectory prediction heuristics. TrajEvo employs an evolutionary algorithm to generate and refine prediction heuristics from past trajectory data. We introduce a Cross-Generation Elite Sampling to promote population diversity and a Statistics Feedback Loop allowing the LLM to analyze alternative predictions. Our evaluations show TrajEvo outperforms previous heuristic methods on the ETH-UCY datasets, and remarkably outperforms both heuristics and deep learning methods when generalizing to the unseen SDD dataset. TrajEvo represents a first step toward automated design of fast, explainable, and generalizable trajectory prediction heuristics. We make our source code publicly available to foster future research at https://github.com/ai4co/trajevo.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 34 of its 65 references that are in the map. First posted on arXiv 7 May 2025.
Builds on
34 of 65 references.
References · 34
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2021Core Challenges of Social Robot Navigation: A Surveycited by 97
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
- 2022Remember Intentions: Retrospective-Memory-based Trajectory Predictioncited by 86
- 2019What the Constant Velocity Model Can Teach Us About Pedestrian Motion Predictioncited by 78
22 more
- 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 65
- 2021MG-GAN: A Multi-Generator Model Preventing Out-of-Distribution Samples in Pedestrian Trajectory Predictioncited by 61
- 2023Algorithm Evolution Using Large Language Modelcited by 52
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2024LLM4AD: A Platform for Algorithm Design with Large Language Modelcited by 33
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillationcited by 31
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2022Interpretable Self-Aware Neural Networks for Robust Trajectory Predictioncited by 22
- 2024Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Modelscited by 22
- 2020OpenTraj: Assessing Prediction Complexity in Human Trajectories Datasetscited by 20
- 2023What Truly Matters in Trajectory Prediction for Autonomous Driving?cited by 17
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2022EvolveHypergraph: Group-Aware Dynamic Relational Reasoning for Trajectory Predictioncited by 10
- 2021Semantics-STGCNN: A Semantics-guided Spatial-Temporal Graph Convolutional Network for Multi-class Trajectory Predictioncited by 6
- 2024Uncovering the human motion pattern: Pattern Memory-based Diffusion Model for Trajectory Predictioncited by 4
- 2018Runtime Analysis of Probabilistic Crowding and Restricted Tournament Selection for Bimodal Optimisationcited by 3
- 2024Not All Errors Are Made Equal: A Regret Metric for Detecting System-level Trajectory Prediction Failurescited by 3
- 2025GUIDE-CoT: Goal-driven and User-Informed Dynamic Estimation for Pedestrian Trajectory using Chain-of-Thoughtcited by 3
- 2018Efficient Reciprocal Collision Avoidance between Heterogeneous Agents Using CTMATcited by 2
- 2024PWTO: A Heuristic Approach for Trajectory Optimization in Complex Terrainscited by 2
Built on by
Citing papers per year: 2025: 4; 2026: 1.
5 papers.
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectivescited by 5
- 2026What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Searchcited by 4
- 2025Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Surveycited by 3
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2025USPR: Learning a Unified Solver for Profiled Routingcited by 1
- 2026What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Search21 Apr 2026
- 2025Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Survey11 Sep 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives14 May 2025
- 2025USPR: Learning a Unified Solver for Profiled Routing8 May 2025