IntentNet: Learning to Predict Intention from Raw Sensor Data
Not on the map. Why?
Cited by 27 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In order to plan a safe maneuver, self-driving vehicles need to understand the intent of other traffic participants. We define intent as a combination of discrete high-level behaviors as well as continuous trajectories describing future motion. In this paper, we develop a one-stage detector and forecaster that exploits both 3D point clouds produced by a LiDAR sensor as well as dynamic maps of the environment. Our multi-task model achieves better accuracy than the respective separate modules while saving computation, which is critical to reducing reaction time in self-driving applications.
Key facts. Cited by 158 papers in the map (data through 7 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 20 Jan 2021.
Builds on
21 of 37 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 549
- 2016R-FCN: Object Detection via Region-based Fully Convolutional Networkscited by 414
9 more
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
- 2016Vehicle Detection from 3D Lidar Using Fully Convolutional Networkcited by 105
- 2016Vote3Deep: Fast Object Detection in 3D Point Clouds Using Efficient Convolutional Neural Networkscited by 72
- 2018Probabilistic Prediction of Vehicle Semantic Intention and Motioncited by 31
- 2017Dynamic Occupancy Grid Prediction for Urban Autonomous Driving: A Deep Learning Approach with Fully Automatic Labelingcited by 30
- 2016Knowledge Transfer for Scene-specific Motion Predictioncited by 11
Built on by
Citing papers per year: 2021: 34; 2022: 43; 2023: 34; 2024: 23; 2025: 16; 2026: 8.
158 papers.
Sort:
By area:
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
38 more
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
- 2022Learning from All Vehiclescited by 135
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 116
- 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 92
- 2023ADAPT: Action-aware Driving Caption Transformercited by 78
- 2022GoRela: Go Relative for Viewpoint-Invariant Motion Forecastingcited by 68
- 2021Learning to Predict Vehicle Trajectories with Model-based Planningcited by 63
- 2022Occupancy Flow Fields for Motion Forecasting in Autonomous Drivingcited by 62
- 2022Symphony: Learning Realistic and Diverse Agents for Autonomous Driving Simulationcited by 61
- 2022Motion Inspired Unsupervised Perception and Prediction in Autonomous Drivingcited by 59
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2021Procedure Planning in Instructional Videos via Contextual Modeling and Model-based Policy Learningcited by 53
- 2021Scalable Scene Flow from Point Clouds in the Real Worldcited by 49
- 2022GANet: Goal Area Network for Motion Forecastingcited by 49
- 2023HiLM-D: Enhancing MLLMs with Multi-Scale High-Resolution Details for Autonomous Drivingcited by 48
- 2022StretchBEV: Stretching Future Instance Prediction Spatially and Temporallycited by 47
- 2021Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networkscited by 42
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecastingcited by 40
- 2021Vehicle trajectory prediction works, but not everywherecited by 39
- 2023ADAPT: Efficient Multi-Agent Trajectory Prediction with Adaptationcited by 39
- 2025HiP-AD: Hierarchical and Multi-Granularity Planning with Deformable Attention for Autonomous Driving in a Single Decodercited by 35
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
- 2022SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Drivingcited by 31
- 2022Behavioral Intention Prediction in Driving Scenes: A Surveycited by 30
- 2023TBP-Former: Learning Temporal Bird's-Eye-View Pyramid for Joint Perception and Prediction in Vision-Centric Autonomous Drivingcited by 30
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2022Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoningcited by 28
- 2022Perceive, Interact, Predict: Learning Dynamic and Static Clues for End-to-End Motion Predictioncited by 28
- 2023WOMD-LiDAR: Raw Sensor Dataset Benchmark for Motion Forecastingcited by 28
- 2023Dynamic Scenario Representation Learning for Motion Forecasting with Heterogeneous Graph Convolutional Recurrent Networkscited by 27
- 2022Trust, but Verify: Cross-Modality Fusion for HD Map Change Detectioncited by 25
50 most cited of 158 All 158 (JSON)
- 2026TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perception25 Sep 2026
- 2026MC-DeTra: Motion-Consistent Joint Object Detection and Socially-Aware Trajectory Forecasting in Bird's-Eye-View Images10 Sep 2026
- 2026TGRIP: A Text-Guided Approach to Vehicle Instance Prediction in Autonomous Driving6 Jul 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
- 2026Interference-Aware K-Step Reachable Communication in Multi-Agent Reinforcement Learning16 Mar 2026
- 2026A Prediction-as-Perception Framework for 3D Object Detection13 Mar 2026
- 2026Li-ViP3D++: Query-Gated Deformable Camera-LiDAR Fusion for End-to-End Perception and Trajectory Prediction28 Jan 2026
- 2025Hierarchical Spatio-Temporal Attention Network with Adaptive Risk-Aware Decision for Forward Collision Warning in Complex Scenarios25 Nov 2025
- 2025CoC-VLA: Delving into Adversarial Domain Transfer for Explainable Autonomous Driving via Chain-of-Causality Visual-Language-Action Model25 Nov 2025
- 2025CubeletWorld: A New Abstraction for Scalable 3D Modeling21 Nov 2025
- 2025Enhanced Motion Forecasting with Plug-and-Play Multimodal Large Language Models20 Oct 2025
38 more
- 2025Perfect Prediction or Plenty of Proposals? What Matters Most in Planning for Autonomous Driving17 Oct 2025
- 2025ProgD: Progressive Multi-scale Decoding with Dynamic Graphs for Joint Multi-agent Motion Forecasting11 Sep 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025ForeSight: Multi-View Streaming Joint Object Detection and Trajectory Forecasting9 Aug 2025
- 2025What to Do Next? Memorizing skills from Egocentric Instructional Video1 Jul 2025
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback18 Apr 2025
- 2025HiP-AD: Hierarchical and Multi-Granularity Planning with Deformable Attention for Autonomous Driving in a Single Decoder11 Mar 2025
- 2025Future-Aware Interaction Network For Motion Forecasting9 Mar 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2025Poly-Autoregressive Prediction for Modeling Interactions12 Feb 2025
- 2025Divide and Merge: Motion and Semantic Learning in End-to-End Autonomous Driving11 Feb 2025
- 2025Motion Forecasting for Autonomous Vehicles: A Survey10 Feb 2025
- 2024Joint Perception and Prediction for Autonomous Driving: A Survey18 Dec 2024
- 2024DECODE: Domain-aware Continual Domain Expansion for Motion Prediction26 Nov 2024
- 2024LiMTR: Time Series Motion Prediction for Diverse Road Users through Multimodal Feature Integration21 Oct 2024
- 2024EgoFSD: Ego-Centric Fully Sparse Paradigm with Uncertainty Denoising and Iterative Refinement for Efficient End-to-End Self-Driving15 Sep 2024
- 2024TLD: A Vehicle Tail Light signal Dataset and Benchmark4 Sep 2024
- 2024What Matters in Range View 3D Object Detection23 Jul 2024
- 2024VisionTrap: Vision-Augmented Trajectory Prediction Guided by Textual Descriptions17 Jul 2024
- 2024Behavior-Inspired Neural Networks for Relational Inference20 Jun 2024
- 2024FutureNet-LOF: Joint Trajectory Prediction and Lane Occupancy Field Prediction with Future Context Encoding20 Jun 2024
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecasting12 Jun 2024
- 2024DeTra: A Unified Model for Object Detection and Trajectory Forecasting6 Jun 2024
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May 2024
- 2024SpotNet: An Image Centric, Lidar Anchored Approach To Long Range Perception24 May 2024
- 2024MoST: Multi-modality Scene Tokenization for Motion Prediction30 Apr 2024
- 2024SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction using Knowledge Graphs30 Apr 2024
- 2024FipTR: A Simple yet Effective Transformer Framework for Future Instance Prediction in Autonomous Driving19 Apr 2024
- 2024Scaling Motion Forecasting Models with Ensemble Distillation5 Apr 2024
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving1 Apr 2024
- 2024TAFormer: A Unified Target-Aware Transformer for Video and Motion Joint Prediction in Aerial Scenes27 Mar 2024
- 2024ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving25 Mar 2024
- 2024M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving19 Mar 2024
- 2024TrajectoryNAS: A Neural Architecture Search for Trajectory Prediction18 Mar 2024
- 2024Are you a robot? Detecting Autonomous Vehicles from Behavior Analysis14 Mar 2024
- 2023TimePillars: Temporally-Recurrent 3D LiDAR Object Detection22 Dec 2023
- 2023Kraken: enabling joint trajectory prediction by utilizing Mode Transformer and Greedy Mode Processing8 Dec 2023
- 2023Cooperative Probabilistic Trajectory Forecasting under Occlusion6 Dec 2023
50 newest of 158 All 158 (JSON)
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2022Learning from All Vehiclescited by 135
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 92
- 2023ADAPT: Action-aware Driving Caption Transformercited by 78
- 2023HiLM-D: Enhancing MLLMs with Multi-Scale High-Resolution Details for Autonomous Drivingcited by 48
- 2022JFP: Joint Future Prediction with Interactive Multi-Agent Modeling for Autonomous Drivingcited by 40
- 2025HiP-AD: Hierarchical and Multi-Granularity Planning with Deformable Attention for Autonomous Driving in a Single Decodercited by 35
- 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
- 2021Exploring Imitation Learning for Autonomous Driving with Feedback Synthesizer and Differentiable Rasterizationcited by 22
12 most cited of 27 All 27 (JSON)
- 2026TGRIP: A Text-Guided Approach to Vehicle Instance Prediction in Autonomous Driving6 Jul 2026
- 2025CoC-VLA: Delving into Adversarial Domain Transfer for Explainable Autonomous Driving via Chain-of-Causality Visual-Language-Action Model25 Nov 2025
- 2025Perfect Prediction or Plenty of Proposals? What Matters Most in Planning for Autonomous Driving17 Oct 2025
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback18 Apr 2025
- 2025HiP-AD: Hierarchical and Multi-Granularity Planning with Deformable Attention for Autonomous Driving in a Single Decoder11 Mar 2025
- 2025Divide and Merge: Motion and Semantic Learning in End-to-End Autonomous Driving11 Feb 2025
- 2024EgoFSD: Ego-Centric Fully Sparse Paradigm with Uncertainty Denoising and Iterative Refinement for Efficient End-to-End Self-Driving15 Sep 2024
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representation30 May 2024
- 2024FipTR: A Simple yet Effective Transformer Framework for Future Instance Prediction in Autonomous Driving19 Apr 2024
- 2024QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving1 Apr 2024
- 2024M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Driving19 Mar 2024
- 2023A Language Agent for Autonomous Driving17 Nov 2023
12 newest of 27 All 27 (JSON)
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 279
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2021Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networkscited by 42
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecastingcited by 40
- 2026TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perceptioncited by 0
- 2026TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perception25 Sep 2026
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecasting12 Jun 2024
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinement27 Sep 2022
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networks12 Jul 2022
- 2021Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks28 Sep 2021
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2025Future-Aware Interaction Network For Motion Forecastingcited by 4
- 2025Future-Aware Interaction Network For Motion Forecasting9 Mar 2025
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2021DenseTNT: End-to-end Trajectory Prediction from Dense Goal Setscited by 292
- 2021MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Predictioncited by 246
- 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoningcited by 128
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 116
- 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
- 2023EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoningcited by 97
- 2021TPCN: Temporal Point Cloud Networks for Motion Forecastingcited by 94
12 most cited of 123 All 123 (JSON)
- 2026MC-DeTra: Motion-Consistent Joint Object Detection and Socially-Aware Trajectory Forecasting in Bird's-Eye-View Images10 Sep 2026
- 2026BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices28 May 2026
- 2026Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties31 Mar 2026
- 2026Interference-Aware K-Step Reachable Communication in Multi-Agent Reinforcement Learning16 Mar 2026
- 2026A Prediction-as-Perception Framework for 3D Object Detection13 Mar 2026
- 2026Li-ViP3D++: Query-Gated Deformable Camera-LiDAR Fusion for End-to-End Perception and Trajectory Prediction28 Jan 2026
- 2025Hierarchical Spatio-Temporal Attention Network with Adaptive Risk-Aware Decision for Forward Collision Warning in Complex Scenarios25 Nov 2025
- 2025CubeletWorld: A New Abstraction for Scalable 3D Modeling21 Nov 2025
- 2025ProgD: Progressive Multi-scale Decoding with Dynamic Graphs for Joint Multi-agent Motion Forecasting11 Sep 2025
- 2025To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software28 Aug 2025
- 2025ForeSight: Multi-View Streaming Joint Object Detection and Trajectory Forecasting9 Aug 2025
- 2025What to Do Next? Memorizing skills from Egocentric Instructional Video1 Jul 2025
12 newest of 123 All 123 (JSON)