mlsanityData to 7 Oct 2026

BUCA: A Binary Classification Approach to Unsupervised Commonsense Question Answering

arXiv 2305.15932 ↗First posted 25 May 2023cs.CLcited by 3

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Unsupervised commonsense reasoning (UCR) is becoming increasingly popular as the construction of commonsense reasoning datasets is expensive, and they are inevitably limited in their scope. A popular approach to UCR is to fine-tune language models with external knowledge (e.g., knowledge graphs), but this usually requires a large number of training examples. In this paper, we propose to transform the downstream multiple choice question answering task into a simpler binary classification task by ranking all candidate answers according to their reasonableness. To this end, for training the model, we convert the knowledge graph triples into reasonable and unreasonable texts. Extensive experimental results show the effectiveness of our approach on various multiple choice question answering benchmarks. Furthermore, compared with existing UCR approaches using KGs, ours is less data hungry. Our code is available at https://github.com/probe2/BUCA.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 27 of its 52 references that are in the map. First posted on arXiv 25 May 2023.

Builds on

27 of 52 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022MICO: A Multi-alternative Contrastive Learning Framework for Commonsense Knowledge Representation14 Oct

Other references · 26

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
  4. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  5. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  6. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  7. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  8. 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367
  9. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 303
  10. 2020Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningcited by 275
  11. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  12. 2020Unsupervised Commonsense Question Answering with Self-Talkcited by 161
14 more
  1. 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
  2. 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
  3. 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
  4. 2019Commonsense Knowledge Base Completion with Structural and Semantic Contextcited by 61
  5. 2021Knowledge-aware Zero-Shot Learning: Survey and Perspectivecited by 41
  6. 2022Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Surveycited by 38
  7. 2020Self-supervised Knowledge Triplet Learning for Zero-shot Question Answeringcited by 29
  8. 2019Commonsense Properties from Query Logs and Question Answering Forumscited by 26
  9. 2023Facilitating Contrastive Learning of Discourse Relational Senses by Exploiting the Hierarchy of Sense Relationscited by 22
  10. 2020Shallow Discourse Annotation for Chinese TED Talkscited by 13
  11. 2022Zero-shot Commonsense Question Answering with Cloze Translation and Consistency Optimizationcited by 13
  12. 2021A Semantic-based Method for Unsupervised Commonsense Question Answeringcited by 10
  13. 2022Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answeringcited by 10
  14. 2021ArT: All-round Thinker for Unsupervised Commonsense Question-Answeringcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.

  1. 2024Archer: A Human-Labeled Text-to-SQL Dataset with Arithmetic, Commonsense and Hypothetical Reasoningcited by 13
  2. 2024Start from Zero: Triple Set Prediction for Automatic Knowledge Graph Completioncited by 7
  3. 2024Meta-RTL: Reinforcement-Based Meta-Transfer Learning for Low-Resource Commonsense Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2022TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering
  2. 2023A Graph-Guided Reasoning Approach for Open-ended Commonsense Question Answering
  3. 2024ZEBRA: Zero-Shot Example-Based Retrieval Augmentation for Commonsense Question Answering
  4. 2024DCR: Divide-and-Conquer Reasoning for Multi-choice Question Answering with LLMs
  5. 2023Open-ended Commonsense Reasoning with Unrestricted Answer Scope
  6. 2025Reasoning Models are Test Exploiters: Rethinking Multiple-Choice
  7. 2024Plausibly Problematic Questions in Multiple-Choice Benchmarks for Commonsense Reasoning
  8. 2022A Theoretically Grounded Benchmark for Evaluating Machine Commonsense