mlsanityData to 7 Oct 2026

An Embarrassingly Pragmatic Introduction to Vision-based Autonomous Robots

arXiv 2112.05534 ↗First posted 15 Nov 2021cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Autonomous robots are currently one of the most popular Artificial Intelligence problems, having experienced significant advances in the last decade, from Self-driving cars and humanoids to delivery robots and drones. Part of the problem is to get a robot to emulate the perception of human beings, our sense of sight, replacing the eyes with cameras and the brain with mathematical models such as Neural Networks. Developing an AI able to drive a car without human intervention and a small robot to deliver packages in the city may seem like different problems, nevertheless from the point of view of perception and vision, both problems have several similarities. The main solutions we currently find focus on the environment perception through visual information using Computer Vision techniques, Machine Learning, and various algorithms to make the robot understand the environment or scene, move, adapt its trajectory and perform its tasks (maintenance, exploration, etc.) without the need for human intervention. In this work, we develop a small-scale autonomous vehicle from scratch, capable of understanding the scene using only visual information, navigating through industrial environments, detecting people and obstacles, or performing simple maintenance tasks. We review the state-of-the-art of fundamental problems and demonstrate that many methods employed at small-scale are similar to the ones employed in real Self-driving cars from companies like Tesla or Lyft. Finally, we discuss the current state of Robotics and autonomous driving and the technological and ethical limitations that we can find in this field.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 103 references that are in the map. First posted on arXiv 15 Nov 2021.

Builds on

35 of 103 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  8. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  9. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  10. 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 698
  11. 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 430
  12. 2018A Survey on Deep Transfer Learningcited by 417
23 more
  1. 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 277
  2. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  3. 2018An Introduction to Deep Reinforcement Learningcited by 201
  4. 2019RetinaFace: Single-stage Dense Face Localisation in the Wildcited by 164
  5. 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
  6. 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
  7. 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
  8. 2019Monocular 3D Object Detection with Pseudo-LiDAR Point Cloudcited by 113
  9. 2020Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Thingscited by 110
  10. 2019Monocular 3D Object Detection Leveraging Accurate Proposals and Shape Reconstructioncited by 106
  11. 2019Deep Fitting Degree Scoring Network for Monocular 3D Object Detectioncited by 67
  12. 2018ApolloCar3D: A Large 3D Car Instance Understanding Benchmark for Autonomous Drivingcited by 59
  13. 2019Simulation-based reinforcement learning for real-world autonomous drivingcited by 51
  14. 2019Bag of Freebies for Training Object Detection Neural Networkscited by 47
  15. 2020Rapidly Adaptable Legged Robots via Evolutionary Meta-Learningcited by 42
  16. 2019AADS: Augmented Autonomous Driving Simulation using Data-driven Algorithmscited by 39
  17. 2020BiDet: An Efficient Binarized Object Detectorcited by 33
  18. 2019Further advantages of data augmentation on convolutional neural networkscited by 19
  19. 2019MuSHR: A Low-Cost, Open-Source Robotic Racecar for Education and Researchcited by 17
  20. 2019Controlling an Autonomous Vehicle with Deep Reinforcement Learningcited by 12
  21. 2020A Real-Time Deep Network for Crowd Countingcited by 7
  22. 2019Approximate LSTMs for Time-Constrained Inference: Enabling Fast Reaction in Self-Driving Carscited by 4
  23. 2020Model Identification and Control of a Low-Cost Wheeled Mobile Robot Using Differentiable Physicscited by 2

Built on by

Not cited yet.