mlsanityData to 7 Oct 2026

Natural Language Processing with Commonsense Knowledge: A Survey

arXiv 2108.04674 ↗First posted 10 Aug 2021cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Commonsense knowledge is essential for advancing natural language processing (NLP) by enabling models to engage in human-like reasoning, which requires a deeper understanding of context and often involves making inferences based on implicit external knowledge. This paper explores the integration of commonsense knowledge into various NLP tasks. We begin by reviewing prominent commonsense knowledge bases and then discuss the benchmarks used to evaluate the commonsense reasoning capabilities of NLP models, particularly language models. Furthermore, we highlight key methodologies for incorporating commonsense knowledge and their applications across different NLP tasks. The paper also examines the challenges and emerging trends in enhancing NLP systems with commonsense reasoning. All literature referenced in this survey can be accessed via our GitHub repository: https://github.com/yuboxie/awesome-commonsense.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 52 of its 126 references that are in the map. First posted on arXiv 10 Aug 2021.

Builds on

52 of 126 references.

References · 52

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  6. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  7. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  8. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  9. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  10. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
  11. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  12. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
38 more
  1. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  2. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  3. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  4. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  5. 2020Aligning AI With Shared Human Valuescited by 706
  6. 2017The NarrativeQA Reading Comprehension Challengecited by 590
  7. 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
  8. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  9. 2018SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inferencecited by 333
  10. 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 330
  11. 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
  12. 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 277
  13. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  14. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
  15. 2016Enhanced LSTM for Natural Language Inferencecited by 199
  16. 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 198
  17. 2020COSMIC: COmmonSense knowledge for eMotion Identification in Conversationscited by 135
  18. 2019"Going on a vacation" takes longer than "Going for a walk": A Study of Temporal Commonsense Understandingcited by 121
  19. 2020Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Modelscited by 110
  20. 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
  21. 2019Knowledge-Enriched Transformer for Emotion Detection in Textual Conversationscited by 92
  22. 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
  23. 2020GLUCOSE: GeneraLized and COntextualized Story Explanationscited by 85
  24. 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
  25. 2018Improving Question Answering by Commonsense-Based Pre-Trainingcited by 66
  26. 2020TORQUE: A Reading Comprehension Dataset of Temporal Ordering Questionscited by 65
  27. 2019Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approachescited by 64
  28. 2021Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoningcited by 64
  29. 2018Modeling Naive Psychology of Characters in Simple Commonsense Storiescited by 59
  30. 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialogcited by 55
  31. 2020Knowledge Bridging for Empathetic Dialogue Generationcited by 50
  32. 2018Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledgecited by 48
  33. 2018Commonsense for Generative Multi-Hop Question Answering Taskscited by 48
  34. 2021PROST: Physical Reasoning of Objects through Space and Timecited by 48
  35. 2020CSKG: The CommonSense Knowledge Graphcited by 45
  36. 2018EventKG: A Multilingual Event-Centric Temporal Knowledge Graphcited by 43
  37. 2020CARE: Commonsense-Aware Emotional Response Generation with Latent Conceptscited by 20
  38. 2021Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformationcited by 19

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 2; 2023: 0; 2024: 0; 2025: 1.

4 papers.

  1. 2021The Web Is Your Oyster - Knowledge-Intensive NLP against a Very Large Web Corpuscited by 60
  2. 2022CoSe-Co: Text Conditioned Generative CommonSense Contextualizercited by 3
  3. 2022Leveraging class abstraction for commonsense reinforcement learning via residual policy gradient methodscited by 2
  4. 2025TrustDataFilter:Leveraging Trusted Knowledge Base Data for More Effective Filtering of Unknown Informationcited by 0