Embodied AI-Driven Operation of Smart Cities: A Concise Review
Not on the map. Why?
Abstract (arXiv)
A smart city can be seen as a framework, comprised of Information and Communication Technologies (ICT). An intelligent network of connected devices that collect data with their sensors and transmit them using cloud technologies in order to communicate with other assets in the ecosystem plays a pivotal role in this framework. Maximizing the quality of life of citizens, making better use of resources, cutting costs, and improving sustainability are the ultimate goals that a smart city is after. Hence, data collected from connected devices will continuously get thoroughly analyzed to gain better insights into the services that are being offered across the city; with this goal in mind that they can be used to make the whole system more efficient. Robots and physical machines are inseparable parts of a smart city. Embodied AI is the field of study that takes a deeper look into these and explores how they can fit into real-world environments. It focuses on learning through interaction with the surrounding environment, as opposed to Internet AI which tries to learn from static datasets. Embodied AI aims to train an agent that can See (Computer Vision), Talk (NLP), Navigate and Interact with its environment (Reinforcement Learning), and Reason (General Intelligence), all at the same time. Autonomous driving cars and personal companions are some of the examples that benefit from Embodied AI nowadays. In this paper, we attempt to do a concise review of this field. We will go through its definitions, its characteristics, and its current achievements along with different algorithms, approaches, and solutions that are being used in different components of it (e.g. Vision, NLP, RL). We will then explore all the available simulators and 3D interactable databases that will make the research in this area feasible. Finally, we will address its challenges and identify its potentials for future research.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 40 of its 93 references that are in the map. First posted on arXiv 22 Aug 2021.
Builds on
40 of 93 references.
References · 40
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2015VQA: Visual Question Answeringcited by 2,489
- 2019Towards VQA Models That Can Readcited by 1,696
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
28 more
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 400
- 2016Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learningcited by 351
- 2017Embodied Question Answeringcited by 335
- 2018SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inferencecited by 333
- 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 227
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 209
- 2017IQA: Visual Question Answering in Interactive Environmentscited by 154
- 2018Learning to Separate Object Sounds by Watching Unlabeled Videocited by 114
- 2018Building Generalizable Agents with a Realistic and Rich 3D Environmentcited by 109
- 2019Embodied Question Answering in Photorealistic Environments with Point Cloud Perceptioncited by 103
- 2017Grounded Language Learning in a Simulated 3D Worldcited by 100
- 2017MINOS: Multimodal Indoor Simulator for Navigation in Complex Environmentscited by 66
- 2018Neural Modular Control for Embodied Question Answeringcited by 56
- 2016Video Captioning with Transferred Semantic Attributescited by 46
- 2018CHALET: Cornell House Agent Learning Environmentcited by 38
- 2016Learning to Act by Predicting the Futurecited by 36
- 2018Learning Spatial Common Sense with Geometry-Aware Recurrent Networkscited by 35
- 2020Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agentscited by 27
- 2019Benchmarking Classic and Learned Navigation in Complex 3D Environmentscited by 24
- 2019Embodied Visual Recognitioncited by 9
- 2020DeepMSRF: A novel Deep Multimodal Speaker Recognition framework with Feature selectioncited by 8
- 2021Automatic Generation of Descriptive Titles for Video Clips Using Deep Learningcited by 7
- 2020DRDr II: Detecting the Severity Level of Diabetic Retinopathy Using Mask RCNN and Transfer Learningcited by 6
- 2020DRDr: Automatic Masking of Exudates and Microaneurysms Caused By Diabetic Retinopathy Using Mask R-CNN and Transfer Learningcited by 5
- 2021DRDrV3: Complete Lesion Detection in Fundus Images Using Mask R-CNN, Transfer Learning, and LSTMcited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 1; 2025: 0; 2026: 1.
6 papers.
- 2023Information Retrieval Meets Large Language Models: A Strategic Report from Chinese IR Communitycited by 29
- 2024A call for embodied AIcited by 7
- 2023Deep Learning in Healthcare: An In-Depth Analysiscited by 1
- 2022Applications of Machine Learning in Healthcare and Internet of Things (IOT): A Comprehensive Reviewcited by 0
- 2022The application of Evolutionary and Nature Inspired Algorithms in Data Science and Data Analyticscited by 0
- 2026Heterogeneous computing platform for real-time roboticscited by 0
- 2026Heterogeneous computing platform for real-time robotics13 Jan 2026
- 2024A call for embodied AI6 Feb 2024
- 2023Information Retrieval Meets Large Language Models: A Strategic Report from Chinese IR Community19 Jul 2023
- 2023Deep Learning in Healthcare: An In-Depth Analysis12 Feb 2023
- 2022The application of Evolutionary and Nature Inspired Algorithms in Data Science and Data Analytics6 Feb 2022
- 2022Applications of Machine Learning in Healthcare and Internet of Things (IOT): A Comprehensive Review6 Feb 2022