Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planning
Not on the map. Why?
Abstract (arXiv)
Growing interest in autonomous driving (AD) and intelligent vehicles (IVs) is fueled by their promise for enhanced safety, efficiency, and economic benefits. While previous surveys have captured progress in this field, a comprehensive and forward-looking summary is needed. Our work fills this gap through three distinct articles. The first part, a "Survey of Surveys" (SoS), outlines the history, surveys, ethics, and future directions of AD and IV technologies. The second part, "Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviors" delves into the development of control, computing system, communication, HD map, testing, and human behaviors in IVs. This part, the third part, reviews perception and planning in the context of IVs. Aiming to provide a comprehensive overview of the latest advancements in AD and IVs, this work caters to both newcomers and seasoned researchers. By integrating the SoS and Part I, we offer unique insights and strive to serve as a bridge between past achievements and future possibilities in this dynamic field.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 106 of its 205 references that are in the map. First posted on arXiv 3 Jun 2023.
Builds on
106 of 205 references.
References · 106
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
38 more
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
- 2018Panoptic Segmentationcited by 796
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 721
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2019Panoptic Feature Pyramid Networkscited by 644
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 532
- 2016Direct Sparse Odometrycited by 479
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 421
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2020Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentationcited by 326
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2017Sparsity Invariant CNNscited by 325
- 2017Joint 3D Proposal Generation and Object Detection from View Aggregationcited by 325
- 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 313
- 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
- 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
- 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 251
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
- 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2020Multi-Task Multi-Sensor Fusion for 3D Object Detectioncited by 203
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2020LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mappingcited by 185
- 2020Hierarchical Multi-Scale Attention for Semantic Segmentationcited by 183
50 most cited of 106 All 106 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 3; 2025: 1; 2026: 1.
9 papers.
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 204
- 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Modelscited by 158
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Surveycited by 30
- 2025InsightDrive: Insight Scene Representation for End-to-End Autonomous Drivingcited by 14
- 2023FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusioncited by 7
- 2023What Matters to Enhance Traffic Rule Compliance of Imitation Learning for End-to-End Autonomous Drivingcited by 2
- 2024A Survey on Hybrid Motion Planning Methods for Automated Driving Systemscited by 1
- 2024Scenarios Engineering driven Autonomous Transportation in Open-Pit Minescited by 0
- 2026SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessmentcited by 0
- 2026SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessment17 Sep 2026
- 2025InsightDrive: Insight Scene Representation for End-to-End Autonomous Driving17 Mar 2025
- 2024Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey19 Aug 2024
- 2024A Survey on Hybrid Motion Planning Methods for Automated Driving Systems8 Jun 2024
- 2024Scenarios Engineering driven Autonomous Transportation in Open-Pit Mines15 Mar 2024
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models28 Sep 2023
- 2023What Matters to Enhance Traffic Rule Compliance of Imitation Learning for End-to-End Autonomous Driving14 Sep 2023
- 2023FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusion14 Aug 2023
- 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Models14 Jul 2023