EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations
Not on the map. Why?
Abstract (arXiv)
Reliable trajectory prediction from an ego-centric perspective is crucial for robotic navigation in human-centric environments. However, existing methods typically assume noiseless observation histories, failing to account for the perceptual artifacts inherent in first-person vision, such as occlusions, ID switches, and tracking drift. This discrepancy between training assumptions and deployment reality severely limits model robustness. To bridge this gap, we introduce EgoTraj-Bench, built upon TBD dataset, which is the first real-world benchmark that aligns noisy, first-person visual histories with clean, bird's-eye-view future trajectories, enabling robust learning under realistic perceptual constraints. Building on this benchmark, we propose BiFlow, a dual-stream flow matching model that concurrently denoises historical observations and forecasts future motion. To better model agent intent, BiFlow incorporates our EgoAnchor mechanism, which conditions the prediction decoder on distilled historical features via feature modulation. Extensive experiments show that BiFlow achieves state-of-the-art performance, reducing minADE and minFDE by 10-15% on average and demonstrating superior robustness. We anticipate that our benchmark and model will provide a critical foundation for robust real-world ego-centric trajectory prediction. The benchmark library is available at: https://github.com/zoeyliu1999/EgoTraj-Bench.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
29 of 42 references.
References · 29
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
- 2020From Goals, Waypoints & Paths To Long Term Human Trajectory Forecastingcited by 167
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 132
- 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 104
17 more
- 2024Variational Flow Matching for Graph Generationcited by 83
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2019NAOMI: Non-Autoregressive Multiresolution Sequence Imputationcited by 59
- 2017Future Person Localization in First-Person Videoscited by 58
- 2022Efficient Video Prediction via Sparsely Conditioned Flow Matchingcited by 55
- 2019TH"OR: Human-Robot Navigation Data Collection and Accurate Motion Trajectories Datasetcited by 36
- 2025Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalizationcited by 33
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillationcited by 31
- 2024Mitigating the Human-Robot Domain Discrepancy in Visual Pre-training for Robotic Manipulationcited by 23
- 2024LayoutFlow: Flow Matching for Layout Generationcited by 21
- 2020AC-VRNN: Attentive Conditional-VRNN for Multi-Future Trajectory Predictioncited by 16
- 2020Socially Aware Crowd Navigation with Multimodal Pedestrian Trajectory Prediction for Autonomous Vehiclescited by 14
- 2023From Crowd Motion Prediction to Robot Navigation in Crowdscited by 13
- 2023A Novel Benchmarking Paradigm and a Scale- and Motion-Aware Model for Egocentric Pedestrian Trajectory Predictioncited by 12
- 20173DOF Pedestrian Trajectory Prediction Learned from Long-Term Autonomous Mobile Robot Deployment Datacited by 11
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Datacited by 6
- 2022T2FPV: Dataset and Method for Correcting First-Person View Errors in Pedestrian Trajectory Predictioncited by 5
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026EgoDyn-Bench: Evaluating Ego-Motion Understanding in Vision-Centric Foundation Models for Autonomous Drivingcited by 2
- 2026A Closed-Loop Multi-Agent Framework for Robust Multi-Robot Manipulationcited by 1
- 2026TIGFlow-GRPO: Trajectory Forecasting via Interaction-Aware Flow Matching and Reward-Guided Optimizationcited by 0
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Datasetcited by 0
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalizationcited by 0
- 2026Probabilistic Pedestrian Forecasts from a Handheld Phone: World-Frame Heat Maps, Visual-Inertial Height Drift, and Evaluation without Ground Truthcited by 0
- 2026Probabilistic Pedestrian Forecasts from a Handheld Phone: World-Frame Heat Maps, Visual-Inertial Height Drift, and Evaluation without Ground Truth3 Oct 2026
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization17 Sep 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026A Closed-Loop Multi-Agent Framework for Robust Multi-Robot Manipulation8 Jul 2026
- 2026EgoDyn-Bench: Evaluating Ego-Motion Understanding in Vision-Centric Foundation Models for Autonomous Driving22 Apr 2026
- 2026TIGFlow-GRPO: Trajectory Forecasting via Interaction-Aware Flow Matching and Reward-Guided Optimization26 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024EgoNav: Egocentric Scene-aware Human Trajectory Prediction
- 2026Learning Humanoid Navigation from Human Data
- 2026EgoFlow: Gradient-Guided Flow Matching for Egocentric 6DoF Object Motion Generation
- 2026HumanFlow -- Diffusion-Driven MAV Navigation Among Humans via Tightly-Coupled Motion Tracking, Forecasting, and Control
- 2025TrajFlow: Multi-modal Motion Prediction via Flow Matching
- 2026FlowAD: Ego-Scene Interactive Modeling for Autonomous Driving
- 2026EgoAVFlow: Robot Policy Learning with Active Vision from Human Egocentric Videos via 3D Flow
- 2026StepNav: Structured Trajectory Priors for Efficient and Multimodal Visual Navigation