mlsanityData to 7 Oct 2026

Embodied AI-Driven Operation of Smart Cities: A Concise Review

arXiv 2108.09823 ↗First posted 22 Aug 2021cs.AI cs.CY cs.HCcited by 6

Not on the map. Why?

Abstract (arXiv)

A smart city can be seen as a framework, comprised of Information and Communication Technologies (ICT). An intelligent network of connected devices that collect data with their sensors and transmit them using cloud technologies in order to communicate with other assets in the ecosystem plays a pivotal role in this framework. Maximizing the quality of life of citizens, making better use of resources, cutting costs, and improving sustainability are the ultimate goals that a smart city is after. Hence, data collected from connected devices will continuously get thoroughly analyzed to gain better insights into the services that are being offered across the city; with this goal in mind that they can be used to make the whole system more efficient. Robots and physical machines are inseparable parts of a smart city. Embodied AI is the field of study that takes a deeper look into these and explores how they can fit into real-world environments. It focuses on learning through interaction with the surrounding environment, as opposed to Internet AI which tries to learn from static datasets. Embodied AI aims to train an agent that can See (Computer Vision), Talk (NLP), Navigate and Interact with its environment (Reinforcement Learning), and Reason (General Intelligence), all at the same time. Autonomous driving cars and personal companions are some of the examples that benefit from Embodied AI nowadays. In this paper, we attempt to do a concise review of this field. We will go through its definitions, its characteristics, and its current achievements along with different algorithms, approaches, and solutions that are being used in different components of it (e.g. Vision, NLP, RL). We will then explore all the available simulators and 3D interactable databases that will make the research in this area feasible. Finally, we will address its challenges and identify its potentials for future research.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 40 of its 93 references that are in the map. First posted on arXiv 22 Aug 2021.

Builds on

40 of 93 references.

References · 40

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  6. 2015VQA: Visual Question Answeringcited by 2,489
  7. 2019Towards VQA Models That Can Readcited by 1,696
  8. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  9. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  10. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  11. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  12. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
28 more
  1. 2018On Evaluation of Embodied Navigation Agentscited by 526
  2. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
  3. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  4. 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 400
  5. 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
  6. 2017Embodied Question Answeringcited by 335
  7. 2018SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inferencecited by 333
  8. 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 227
  9. 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
  10. 2017IQA: Visual Question Answering in Interactive Environmentscited by 154
  11. 2018Learning to Separate Object Sounds by Watching Unlabeled Videocited by 114
  12. 2018Building Generalizable Agents with a Realistic and Rich 3D Environmentcited by 109
  13. 2019Embodied Question Answering in Photorealistic Environments with Point Cloud Perceptioncited by 103
  14. 2017Grounded Language Learning in a Simulated 3D Worldcited by 100
  15. 2017MINOS: Multimodal Indoor Simulator for Navigation in Complex Environmentscited by 66
  16. 2018Neural Modular Control for Embodied Question Answeringcited by 56
  17. 2016Video Captioning with Transferred Semantic Attributescited by 46
  18. 2018CHALET: Cornell House Agent Learning Environmentcited by 38
  19. 2016Learning to Act by Predicting the Futurecited by 36
  20. 2018Learning Spatial Common Sense with Geometry-Aware Recurrent Networkscited by 35
  21. 2020Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agentscited by 27
  22. 2019Benchmarking Classic and Learned Navigation in Complex 3D Environmentscited by 24
  23. 2019Embodied Visual Recognitioncited by 9
  24. 2020DeepMSRF: A novel Deep Multimodal Speaker Recognition framework with Feature selectioncited by 8
  25. 2021Automatic Generation of Descriptive Titles for Video Clips Using Deep Learningcited by 7
  26. 2020DRDr II: Detecting the Severity Level of Diabetic Retinopathy Using Mask RCNN and Transfer Learningcited by 6
  27. 2020DRDr: Automatic Masking of Exudates and Microaneurysms Caused By Diabetic Retinopathy Using Mask R-CNN and Transfer Learningcited by 5
  28. 2021DRDrV3: Complete Lesion Detection in Fundus Images Using Mask R-CNN, Transfer Learning, and LSTMcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 2; 2024: 1; 2025: 0; 2026: 1.

6 papers.