The WayHome: Long-term Motion Prediction on Dynamically Scaled
Not on the map. Why?
Abstract (arXiv)
One of the key challenges for autonomous vehicles is the ability to accurately predict the motion of other objects in the surrounding environment, such as pedestrians or other vehicles. In this contribution, a novel motion forecasting approach for autonomous vehicles is developed, inspired by the work of Gilles et al. [1]. We predict multiple heatmaps with a neuralnetwork-based model for every traffic participant in the vicinity of the autonomous vehicle; with one heatmap per timestep. The heatmaps are used as input to a novel sampling algorithm that extracts coordinates corresponding to the most likely future positions. We experiment with different encoders and decoders, as well as a comparison of two loss functions. Additionally, a new grid-scaling technique is introduced, showing further improved performance. Overall, our approach improves stateof-the-art miss rate performance for the function-relevant prediction interval of 3 seconds while being competitive in longer prediction intervals (up to eight seconds). The evaluation is done on the public 2022 Waymo motion challenge.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 21 references that are in the map. First posted on arXiv 6 Oct 2023.
Builds on
20 of 21 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 728
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 417
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
8 more
- 2021GOHOME: Graph-Oriented Heatmap Output for future Motion Estimationcited by 146
- 2021HOME: Heatmap Output for future Motion Estimationcited by 122
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2022MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge -- Motion Predictioncited by 17
- 2022StopNet: Scalable Trajectory and Occupancy Prediction for Urban Autonomous Drivingcited by 14
- 2022HOPE: Hierarchical Spatial-temporal Network for Occupancy Flow Predictioncited by 11
- 2022VectorFlow: Combining Images and Vectors for Traffic Occupancy and Flow Predictioncited by 6
- 2022Golfer: Trajectory Prediction with Masked Goal Conditioning MnM Networkcited by 3
Built on by
Not cited yet.