mlsanityData to 7 Oct 2026

Improving Question Answering by Commonsense-Based Pre-Training

arXiv 1809.03568 ↗First posted 5 Sep 2018cs.CLcited by 66

Not on the map. Why?

Abstract (arXiv)

Although neural network approaches achieve remarkable success on a variety of NLP tasks, many of them struggle to answer questions that require commonsense knowledge. We believe the main reason is the lack of commonsense mboxconnections between concepts. To remedy this, we provide a simple and effective method that leverages external commonsense knowledge base such as ConceptNet. We pre-train direct and indirect relational functions between concepts, and show that these pre-trained functions could be easily added to existing neural network models. Results show that incorporating commonsense-based function improves the baseline on three question answering tasks that require commonsense reasoning. Further analysis shows that our system mboxdiscovers and leverages useful evidence from an external commonsense knowledge base, which is missing in existing neural network models and help derive the correct answer.

Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Sep 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 17; 2022: 15; 2023: 19; 2024: 10; 2025: 5.

66 papers.

Sort:

By area:

  1. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  2. 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 213
  3. 2023Knowledge Graphs: Opportunities and Challengescited by 70
  4. 2022Knowledge Graph Contrastive Learning for Recommendationcited by 69
  5. 2021A Survey on Accuracy-oriented Neural Recommendation: From Collaborative Filtering to Information-rich Recommendationcited by 59
  6. 2021Graph Learning based Recommender Systems: A Reviewcited by 59
  7. 2021RevCore: Review-augmented Conversational Recommendationcited by 47
  8. 2023DiffKG: Knowledge Graph Diffusion Model for Recommendationcited by 41
  9. 2024Thermometer: Towards Universal Calibration for Large Language Modelscited by 38
  10. 2021Conversational Question Answering: A Surveycited by 31
  11. 2022Challenges and Opportunities in Deep Reinforcement Learning with Graph Neural Networks: A Comprehensive review of Algorithms and Applicationscited by 27
  12. 2023ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoningcited by 26
38 more
  1. 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
  2. 2022VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledgecited by 20
  3. 2022DaisyRec 2.0: Benchmarking Recommendation for Rigorous Evaluationcited by 19
  4. 2021Graph-Enhanced Multi-Task Learning of Multi-Level Transition Dynamics for Session-based Recommendationcited by 18
  5. 2023Knowledge Plugins: Enhancing Large Language Models for Domain-Specific Recommendationscited by 16
  6. 2023Semantic Structure Enhanced Event Causality Identificationcited by 15
  7. 2022Reinforced Path Reasoning for Counterfactual Explainable Recommendationcited by 13
  8. 2022Robust and Explainable Identification of Logical Fallacies in Natural Language Argumentscited by 12
  9. 2022LogiGAN: Learning Logical Reasoning via Adversarial Pre-trainingcited by 11
  10. 2021Conditional Attention Networks for Distilling Knowledge Graphs in Recommendationcited by 10
  11. 2021A Simple But Powerful Graph Encoder for Temporal Knowledge Graph Completioncited by 8
  12. 2022Few-Shot Inductive Learning on Temporal Knowledge Graphs using Concept-Aware Informationcited by 8
  13. 2024Symmetric Graph Contrastive Learning against Noisy Views for Recommendationcited by 7
  14. 2021PR-Net: Preference Reasoning for Personalized Video Highlight Detectioncited by 6
  15. 2022Learning Meta Representations of One-shot Relations for Temporal Knowledge Graph Link Predictioncited by 6
  16. 2022Aligning Recommendation and Conversation via Dual Imitationcited by 6
  17. 2024Bridging the User-side Knowledge Gap in Knowledge-aware Recommendations with Large Language Modelscited by 6
  18. 2021Automatic Meta-Path Discovery for Effective Graph-Based Recommendationcited by 5
  19. 2022GIDN: A Lightweight Graph Inception Diffusion Network for High-efficient Link Predictioncited by 5
  20. 2023Pre-training LLMs using human-like development data corpuscited by 5
  21. 2023Learning to Denoise Biomedical Knowledge Graph for Robust Molecular Interaction Predictioncited by 5
  22. 2021Natural Language Processing with Commonsense Knowledge: A Surveycited by 4
  23. 2021Reinforcement Learning based Path Exploration for Sequential Explainable Recommendationcited by 4
  24. 2022Graph-based Extractive Explainer for Recommendationscited by 4
  25. 2024Combining Embedding-Based and Semantic-Based Models for Post-hoc Explanations in Recommender Systemscited by 4
  26. 2024Improving deep learning with prior knowledge and cognitive models: A survey on enhancing explainability, adversarial robustness and zero-shot learningcited by 4
  27. 2021ELIXIR: Learning from User Feedback on Explanations to Improve Recommender Modelscited by 3
  28. 2021Encoding Explanatory Knowledge for Zero-shot Science Question Answeringcited by 3
  29. 2022Generalizable Neuro-symbolic Systems for Commonsense Question Answeringcited by 3
  30. 2023A Comprehensive Study on Knowledge Graph Embedding over Relational Patterns Based on Rule Learningcited by 3
  31. 2021Explainable Student Performance Prediction With Personalized Attention for Explaining Why A Student Failscited by 2
  32. 2023Towards Explainable Collaborative Filtering with Taste Clusters Learningcited by 2
  33. 2023Question Answering with Deep Neural Networks for Semi-Structured Heterogeneous Genealogical Knowledge Graphscited by 2
  34. 2023Knowledge-aware Collaborative Filtering with Pre-trained Language Model for Personalized Review-based Rating Predictioncited by 2
  35. 2024Explainable Session-based Recommendation via Path Reasoningcited by 2
  36. 2024ActionCOMET: A Zero-shot Approach to Learn Image-specific Commonsense Concepts about Actionscited by 2
  37. 2025Boosting Knowledge Graph-based Recommendations through Confidence-Aware Augmentation with Large Language Modelscited by 2
  38. 2023Knowledge Reasoning via Jointly Modeling Knowledge Graphs and Soft Rulescited by 1

50 most cited of 66 All 66 (JSON)