MotionCNN: A Strong Baseline for Motion Prediction in Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
To plan a safe and efficient route, an autonomous vehicle should anticipate future motions of other agents around it. Motion prediction is an extremely challenging task that recently gained significant attention within the research community. In this work, we present a simple and yet very strong baseline for multimodal motion prediction based purely on Convolutional Neural Networks. While being easy-to-implement, the proposed approach achieves competitive performance compared to the state-of-the-art methods and ranks 3rd on the 2021 Waymo Open Dataset Motion Prediction Challenge. Our source code is publicly available at GitHub
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 5 Jun 2022.
Builds on
18 of 24 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 537
- 2020VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representationcited by 530
- 2019MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Predictioncited by 420
- 2020TNT: Target-driveN Trajectory Predictioncited by 347
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
6 more
- 2021IntentNet: Learning to Predict Intention from Raw Sensor Datacited by 158
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
- 2019Rules of the Road: Predicting Driving Behavior with a Convolutional Model of Semantic Interactionscited by 117
- 2019Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Datacited by 104
- 2021Auto4D: Learning to Label 4D Objects from Sequential Point Cloudscited by 42
- 2021DenseTNT: Waymo Open Dataset Motion Prediction Challenge 1st Place Solutioncited by 14
Built on by
Citing papers per year: 2022: 5; 2023: 10; 2024: 3; 2025: 3.
21 papers.
Sort:
By area:
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
- 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
- 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptationcited by 41
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Predictioncited by 32
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023EDA: Evolving and Distinct Anchors for Multimodal Motion Predictioncited by 17
- 2022MPA: MultiPath++ Based Architecture for Motion Predictioncited by 13
- 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Predictioncited by 12
- 2024OFMPNet: Deep End-to-End Model for Occupancy and Flow Prediction in Urban Environmentcited by 8
- 2024MoST: Multi-modality Scene Tokenization for Motion Predictioncited by 8
- 2025TrajFlow: Multi-modal Motion Prediction via Flow Matchingcited by 8
9 more
- 2023RedMotion: Motion Prediction via Redundancy Reductioncited by 6
- 2022Scenario-based Evaluation of Prediction Models for Automated Vehiclescited by 4
- 2022Towards trustworthy multi-modal motion prediction: Holistic evaluation and interpretability of outputscited by 4
- 2023Robustness Benchmark of Road User Trajectory Prediction Models for Automated Drivingcited by 1
- 2023Interpretable Long Term Waypoint-Based Trajectory Prediction Modelcited by 1
- 2024Reliable Probabilistic Human Trajectory Prediction for Autonomous Applicationscited by 1
- 2023Kraken: enabling joint trajectory prediction by utilizing Mode Transformer and Greedy Mode Processingcited by 0
- 2025HeLoFusion: An Efficient and Scalable Encoder for Modeling Heterogeneous and Multi-Scale Interactions in Trajectory Predictioncited by 0
- 2025KoopCast: Trajectory Forecasting via Koopman Operatorscited by 0
- 2025KoopCast: Trajectory Forecasting via Koopman Operators19 Sep 2025
- 2025HeLoFusion: An Efficient and Scalable Encoder for Modeling Heterogeneous and Multi-Scale Interactions in Trajectory Prediction15 Sep 2025
- 2025TrajFlow: Multi-modal Motion Prediction via Flow Matching10 Jun 2025
- 2024Reliable Probabilistic Human Trajectory Prediction for Autonomous Applications9 Oct 2024
- 2024MoST: Multi-modality Scene Tokenization for Motion Prediction30 Apr 2024
- 2024OFMPNet: Deep End-to-End Model for Occupancy and Flow Prediction in Urban Environment2 Apr 2024
- 2023EDA: Evolving and Distinct Anchors for Multimodal Motion Prediction15 Dec 2023
- 2023Interpretable Long Term Waypoint-Based Trajectory Prediction Model11 Dec 2023
- 2023Kraken: enabling joint trajectory prediction by utilizing Mode Transformer and Greedy Mode Processing8 Dec 2023
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Prediction20 Aug 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
- 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptation26 Jul 2023
9 more
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying30 Jun 2023
- 2023RedMotion: Motion Prediction via Redundancy Reduction19 Jun 2023
- 2023Robustness Benchmark of Road User Trajectory Prediction Models for Automated Driving4 Apr 2023
- 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Prediction21 Feb 2023
- 2022Towards trustworthy multi-modal motion prediction: Holistic evaluation and interpretability of outputs28 Oct 2022
- 2022Scenario-based Evaluation of Prediction Models for Automated Vehicles11 Oct 2022
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinement27 Sep 2022
- 2022BITS: Bi-level Imitation for Traffic Simulation26 Aug 2022
- 2022MPA: MultiPath++ Based Architecture for Motion Prediction20 Jun 2022
- 2025TrajFlow: Multi-modal Motion Prediction via Flow Matching10 Jun 2025
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 140
- 2022BITS: Bi-level Imitation for Traffic Simulationcited by 80
- 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptationcited by 41
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Predictioncited by 32
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2023EDA: Evolving and Distinct Anchors for Multimodal Motion Predictioncited by 17
- 2022MPA: MultiPath++ Based Architecture for Motion Predictioncited by 13
- 2023Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Predictioncited by 12
- 2024OFMPNet: Deep End-to-End Model for Occupancy and Flow Prediction in Urban Environmentcited by 8
- 2024MoST: Multi-modality Scene Tokenization for Motion Predictioncited by 8
- 2023RedMotion: Motion Prediction via Redundancy Reductioncited by 6
- 2022Scenario-based Evaluation of Prediction Models for Automated Vehiclescited by 4
12 most cited of 19 All 19 (JSON)
- 2025KoopCast: Trajectory Forecasting via Koopman Operators19 Sep 2025
- 2025HeLoFusion: An Efficient and Scalable Encoder for Modeling Heterogeneous and Multi-Scale Interactions in Trajectory Prediction15 Sep 2025
- 2024Reliable Probabilistic Human Trajectory Prediction for Autonomous Applications9 Oct 2024
- 2024MoST: Multi-modality Scene Tokenization for Motion Prediction30 Apr 2024
- 2024OFMPNet: Deep End-to-End Model for Occupancy and Flow Prediction in Urban Environment2 Apr 2024
- 2023EDA: Evolving and Distinct Anchors for Multimodal Motion Prediction15 Dec 2023
- 2023Interpretable Long Term Waypoint-Based Trajectory Prediction Model11 Dec 2023
- 2023Kraken: enabling joint trajectory prediction by utilizing Mode Transformer and Greedy Mode Processing8 Dec 2023
- 2023MacFormer: Map-Agent Coupled Transformer for Real-time and Robust Trajectory Prediction20 Aug 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
- 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptation26 Jul 2023
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying30 Jun 2023
12 newest of 19 All 19 (JSON)