mlsanityData to 7 Oct 2026

Geo-Context Aware Study of Vision-Based Autonomous Driving Models and Spatial Video Data

arXiv 2109.10895 ↗First posted 20 Aug 2021cs.HC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-based deep learning (DL) methods have made great progress in learning autonomous driving models from large-scale crowd-sourced video datasets. They are trained to predict instantaneous driving behaviors from video data captured by on-vehicle cameras. In this paper, we develop a geo-context aware visualization system for the study of Autonomous Driving Model (ADM) predictions together with large-scale ADM video data. The visual study is seamlessly integrated with the geographical environment by combining DL model performance with geospatial visualization techniques. Model performance measures can be studied together with a set of geospatial attributes over map views. Users can also discover and compare prediction behaviors of multiple DL models in both city-wide and street-level analysis, together with road images and video contents. Therefore, the system provides a new visual exploration platform for DL model designers in autonomous driving. Use cases and domain expert evaluation show the utility and effectiveness of the visualization system.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 65 references that are in the map. First posted on arXiv 20 Aug 2021.

Builds on

25 of 65 references.

References · 25

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2016Pyramid Scene Parsing Networkcited by 2,472
  3. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
  4. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  5. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  6. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  7. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  8. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  9. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  10. 2013Network In Networkcited by 600
  11. 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
  12. 2015DeepDriving: Learning Affordance for Direct Perception in Autonomous Drivingcited by 229
13 more
  1. 2017Deep Reinforcement Learning framework for Autonomous Drivingcited by 224
  2. 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 147
  3. 2018Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontierscited by 117
  4. 2017Explaining How a Deep Neural Network Trained with End-to-End Learning Steers a Carcited by 65
  5. 2018RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Recordscited by 61
  6. 2018End-to-End Race Driving with Deep Reinforcement Learningcited by 38
  7. 2016Explaining Predictions of Non-Linear Classifiers in NLPcited by 37
  8. 2016Learning a Driving Simulatorcited by 33
  9. 2020VATLD: A Visual Analytics System to Assess, Understand and Improve Traffic Light Detectioncited by 28
  10. 2018End-to-End Learning of Driving Models with Surround-View Cameras and Route Plannerscited by 27
  11. 2016Interpretable Deep Neural Networks for Single-Trial EEG Classificationcited by 24
  12. 2016A Taxonomy and Library for Visualizing Learned Features in Convolutional Neural Networkscited by 7
  13. 2019RNNbow: Visualizing Learning via Backpropagation Gradients in Recurrent Neural Networkscited by 7

Built on by

Not cited yet.