mlsanityData to 14 Oct 2026

Beyond One Model Fits All: Ensemble Deep Learning for Autonomous Vehicles

arXiv 2312.05759 ↗First posted 10 Dec 2023cs.RO cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning has revolutionized autonomous driving by enabling vehicles to perceive and interpret their surroundings with remarkable accuracy. This progress is attributed to various deep learning models, including Mediated Perception, Behavior Reflex, and Direct Perception, each offering unique advantages and challenges in enhancing autonomous driving capabilities. However, there is a gap in research addressing integrating these approaches and understanding their relevance in diverse driving scenarios. This study introduces three distinct neural network models corresponding to Mediated Perception, Behavior Reflex, and Direct Perception approaches. We explore their significance across varying driving conditions, shedding light on the strengths and limitations of each approach. Our architecture fuses information from the base, future latent vector prediction, and auxiliary task networks, using global routing commands to select appropriate action sub-networks. We aim to provide insights into effectively utilizing diverse modeling strategies in autonomous driving by conducting experiments and evaluations. The results show that the ensemble model performs better than the individual approaches, suggesting that each modality contributes uniquely toward the performance of the overall model. Moreover, by exploring the significance of each modality, this study offers a roadmap for future research in autonomous driving, emphasizing the importance of leveraging multiple models to achieve robust performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 52 references that are in the map. First posted on arXiv 10 Dec 2023.

Builds on

34 of 52 references.

References · 34

  1. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  2. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  4. 2018World Modelscited by 1,513
  5. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  6. 2017Exploring Generalization in Deep Learningcited by 600
  7. 2020Captum: A unified and generic model interpretability library for PyTorchcited by 547
  8. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
  9. 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 403
  10. 2018Stronger generalization bounds for deep nets via a compression approachcited by 307
  11. 2020Loss landscapes and optimization in over-parameterized non-linear systems and neural networkscited by 233
  12. 2015DeepDriving: Learning Affordance for Direct Perception in Autonomous Drivingcited by 231
22 more
  1. 2015A Critical Review of Recurrent Neural Networks for Sequence Learningcited by 224
  2. 2017Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Artcited by 182
  3. 2018Residual Policy Learningcited by 164
  4. 2017Generalization in Deep Learningcited by 146
  5. 2020Dynamical Variational Autoencoders: A Comprehensive Reviewcited by 128
  6. 2023Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Surveycited by 103
  7. 2018CIRL: Controllable Imitative Reinforcement Learning for Vision-based Self-drivingcited by 97
  8. 2016The Predictron: End-To-End Learning and Planningcited by 93
  9. 2016MultiNet: Real-time Joint Semantic Reasoning for Autonomous Drivingcited by 90
  10. 2017Recent Advances in Recurrent Neural Networkscited by 89
  11. 2017Towards Understanding Generalization of Deep Learning: Perspective of Loss Landscapescited by 84
  12. 2018Conditional Affordance Learning for Driving in Urban Environmentscited by 70
  13. 2021Imitation Learning: Progress, Taxonomies and Challengescited by 58
  14. 2020KFNet: Learning Temporal Camera Relocalization using Kalman Filteringcited by 43
  15. 2015An Empirical Evaluation of Deep Learning on Highway Drivingcited by 35
  16. 2019Deep Learning and Control Algorithms of Direct Perception for Autonomous Drivingcited by 11
  17. 2022Knowledge Augmented Machine Learning with Applications in Autonomous Driving: A Surveycited by 11
  18. 2019Frivolous Units: Wider Networks Are Not Really That Widecited by 10
  19. 2019Fitting a Kalman Smoother to Datacited by 9
  20. 2020On the Road with 16 Neurons: Mental Imagery with Bio-inspired Deep Neural Networkscited by 5
  21. 2023KARNet: Kalman Filter Augmented Recurrent Neural Network for Learning World Models in Autonomous Driving Taskscited by 2
  22. 2023An Overview about Emerging Technologies of Autonomous Drivingcited by 2

Built on by

Not cited yet.