mlsanityData to 14 Oct 2026

Understanding in Artificial Intelligence

arXiv 2101.06573 ↗First posted 17 Jan 2021cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Current Artificial Intelligence (AI) methods, most based on deep learning, have facilitated progress in several fields, including computer vision and natural language understanding. The progress of these AI methods is measured using benchmarks designed to solve challenging tasks, such as visual question answering. A question remains of how much understanding is leveraged by these methods and how appropriate are the current benchmarks to measure understanding capabilities. To answer these questions, we have analysed existing benchmarks and their understanding capabilities, defined by a set of understanding capabilities, and current research streams. We show how progress has been made in benchmark development to measure understanding capabilities of AI methods and we review as well how current methods develop understanding capabilities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 170 of its 279 references that are in the map. First posted on arXiv 17 Jan 2021.

Builds on

170 of 279 references.

References · 170

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2017Mask R-CNNcited by 7,277
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  7. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  8. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  9. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  10. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  11. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  12. 2015VQA: Visual Question Answeringcited by 2,506
38 more
  1. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  2. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  3. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
  4. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  5. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  6. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
  7. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  8. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  9. 2015Teaching Machines to Read and Comprehendcited by 1,049
  10. 2016The LAMBADA dataset: Word prediction requiring a broad discourse contextcited by 992
  11. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  12. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  13. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 904
  14. 2016Complex Embeddings for Simple Link Predictioncited by 902
  15. 2014Show and Tell: A Neural Image Caption Generatorcited by 879
  16. 2018Link Prediction Based on Graph Neural Networkscited by 832
  17. 2015Gated Graph Sequence Neural Networkscited by 796
  18. 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 776
  19. 2014Deep Learning in Neural Networks: An Overviewcited by 770
  20. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
  21. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
  22. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
  23. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 652
  24. 2014Neural Turing Machinescited by 644
  25. 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 619
  26. 2017The NarrativeQA Reading Comprehension Challengecited by 597
  27. 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 556
  28. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 553
  29. 2018Object Detection with Deep Learning: A Reviewcited by 528
  30. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
  31. 2015Unsupervised Learning of Video Representations using LSTMscited by 435
  32. 2016Tutorial on Variational Autoencoderscited by 409
  33. 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 394
  34. 2019MONet: Unsupervised Scene Decomposition and Representationcited by 392
  35. 2015Neural Module Networkscited by 376
  36. 2016Generating Videos with Scene Dynamicscited by 376
  37. 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 372
  38. 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367

50 most cited of 170 All 170 (JSON)

Built on by

Not cited yet.