Ordinal Common-sense Inference
Not on the map. Why?
Abstract (arXiv)
Humans have the capacity to draw common-sense inferences from natural language: various things that are likely but not certain to hold based on established discourse, and are rarely stated explicitly. We propose an evaluation of automated common-sense inference based on an extension of recognizing textual entailment: predicting ordinal human responses on the subjective likelihood of an inference holding in a given context. We describe a framework for extracting common-sense knowledge from corpora, which is then used to construct a dataset for this ordinal entailment task. We train a neural sequence-to-sequence model on this dataset, which we use to score and generate possible inferences. Further, we annotate subsets of previously established datasets via our ordinal annotation protocol in order to then analyze the distinctions between these and what we have constructed.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 6; 2023: 8; 2024: 3; 2025: 5; 2026: 1.
35 papers.
Sort:
By area:
- 2023We're Afraid Language Models Aren't Modeling Ambiguitycited by 124
- 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
- 2021Variational Information Bottleneck for Effective Low-Resource Fine-Tuningcited by 51
- 2023Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statementscited by 44
- 2021COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentencescited by 40
- 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
- 2021Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoningcited by 31
- 2021Learning with Different Amounts of Annotation: From Zero to Many Labelscited by 28
- 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarkscited by 26
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Modelscited by 22
- 2021Modeling Event Plausibility with Consistent Conceptual Abstractioncited by 20
- 2021Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understandingcited by 19
23 more
- 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
- 2021Exploring Transitivity in Neural NLI Models through Veridicalitycited by 15
- 2024Enhancing Systematic Decompositional Natural Language Inference Using Informal Logiccited by 12
- 2025Towards Online Multi-Modal Social Interaction Understandingcited by 12
- 2023CLEVRER-Humans: Describing Physical and Causal Events the Human Waycited by 11
- 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.Scited by 9
- 2025Entailed Between the Lines: Incorporating Implication into NLIcited by 9
- 2021Visual Grounding Strategies for Text-Only Natural Language Processingcited by 7
- 2022Probing neural language models for understanding of words of estimative probabilitycited by 7
- 2021Capturing Label Distribution: A Case Study in NLIcited by 6
- 2023No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inferencecited by 4
- 2023SpaceNLI: Evaluating the Consistency of Predicting Inferences in Spacecited by 4
- 2021Inside ASCENT: Exploring a Deep Commonsense Knowledge Base and its Usage in Question Answeringcited by 3
- 2022Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarioscited by 3
- 2024Defeasible Visual Entailment: Benchmark, Evaluator, and Reward-Driven Optimizationcited by 3
- 2025Giving AI Personalities Leads to More Human-Like Reasoningcited by 3
- 2022Autoencoding Language Model Based Ensemble Learning for Commonsense Validation and Explanationcited by 2
- 2023On Degrees of Freedom in Defining and Testing Natural Language Understandingcited by 1
- 2025Self-Rationalization in the Wild: A Large Scale Out-of-Distribution Evaluation on NLI-related taskscited by 1
- 2026Humans and LLMs Diverge on Probabilistic Inferencescited by 1
- 2022Semantic Novelty Detection and Characterization in Factual Text Involving Named Entitiescited by 0
- 2022KL Regularized Normalization Framework for Low Resource Taskscited by 0
- 2023Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflowcited by 0
- 2026Humans and LLMs Diverge on Probabilistic Inferences26 Feb 2026
- 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks26 Apr 2025
- 2025Towards Online Multi-Modal Social Interaction Understanding25 Mar 2025
- 2025Giving AI Personalities Leads to More Human-Like Reasoning19 Feb 2025
- 2025Self-Rationalization in the Wild: A Large Scale Out-of-Distribution Evaluation on NLI-related tasks7 Feb 2025
- 2025Entailed Between the Lines: Incorporating Implication into NLI13 Jan 2025
- 2024Defeasible Visual Entailment: Benchmark, Evaluator, and Reward-Driven Optimization19 Dec 2024
- 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.S21 Oct 2024
- 2024Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic22 Feb 2024
- 2023CLEVRER-Humans: Describing Physical and Causal Events the Human Way5 Oct 2023
- 2023SpaceNLI: Evaluating the Consistency of Predicting Inferences in Space5 Jul 2023
- 2023No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inference16 Jun 2023
23 more
- 2023On Degrees of Freedom in Defining and Testing Natural Language Understanding24 May 2023
- 2023Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statements5 May 2023
- 2023We're Afraid Language Models Aren't Modeling Ambiguity27 Apr 2023
- 2023Benchmarks for Automated Commonsense Reasoning: A Survey9 Feb 2023
- 2023Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow9 Feb 2023
- 2022KL Regularized Normalization Framework for Low Resource Tasks21 Dec 2022
- 2022Probing neural language models for understanding of words of estimative probability7 Nov 2022
- 2022Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities31 Oct 2022
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Models13 Oct 2022
- 2022Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios16 Sep 2022
- 2022Autoencoding Language Model Based Ensemble Learning for Commonsense Validation and Explanation7 Apr 2022
- 2021Refined Commonsense Knowledge from Large-Scale Web Contents30 Nov 2021
- 2021Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding10 Sep 2021
- 2021Learning with Different Amounts of Annotation: From Zero to Many Labels9 Sep 2021
- 2021Variational Information Bottleneck for Effective Low-Resource Fine-Tuning10 Jun 2021
- 2021COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentences2 Jun 2021
- 2021Inside ASCENT: Exploring a Deep Commonsense Knowledge Base and its Usage in Question Answering28 May 2021
- 2021Modeling Event Plausibility with Consistent Conceptual Abstraction20 Apr 2021
- 2021Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning18 Apr 2021
- 2021Visual Grounding Strategies for Text-Only Natural Language Processing25 Mar 2021
- 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark24 Mar 2021
- 2021Capturing Label Distribution: A Case Study in NLI13 Feb 2021
- 2021Exploring Transitivity in Neural NLI Models through Veridicality26 Jan 2021
- 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Modelscited by 22
- 2023No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inferencecited by 4
- 2022Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarioscited by 3
- 2025Giving AI Personalities Leads to More Human-Like Reasoningcited by 3
- 2025Giving AI Personalities Leads to More Human-Like Reasoning19 Feb 2025
- 2023No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inference16 Jun 2023
- 2023Benchmarks for Automated Commonsense Reasoning: A Survey9 Feb 2023
- 2022SODAPOP: Open-Ended Discovery of Social Biases in Social Commonsense Reasoning Models13 Oct 2022
- 2022Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios16 Sep 2022
- 2023We're Afraid Language Models Aren't Modeling Ambiguitycited by 124
- 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
- 2021Variational Information Bottleneck for Effective Low-Resource Fine-Tuningcited by 51
- 2023Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statementscited by 44
- 2021COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentencescited by 40
- 2021Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoningcited by 31
- 2021Learning with Different Amounts of Annotation: From Zero to Many Labelscited by 28
- 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarkscited by 26
- 2021Modeling Event Plausibility with Consistent Conceptual Abstractioncited by 20
- 2021Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understandingcited by 19
- 2021Refined Commonsense Knowledge from Large-Scale Web Contentscited by 19
- 2021Exploring Transitivity in Neural NLI Models through Veridicalitycited by 15
12 most cited of 30 All 30 (JSON)
- 2026Humans and LLMs Diverge on Probabilistic Inferences26 Feb 2026
- 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks26 Apr 2025
- 2025Towards Online Multi-Modal Social Interaction Understanding25 Mar 2025
- 2025Self-Rationalization in the Wild: A Large Scale Out-of-Distribution Evaluation on NLI-related tasks7 Feb 2025
- 2025Entailed Between the Lines: Incorporating Implication into NLI13 Jan 2025
- 2024Defeasible Visual Entailment: Benchmark, Evaluator, and Reward-Driven Optimization19 Dec 2024
- 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.S21 Oct 2024
- 2024Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic22 Feb 2024
- 2023CLEVRER-Humans: Describing Physical and Causal Events the Human Way5 Oct 2023
- 2023SpaceNLI: Evaluating the Consistency of Predicting Inferences in Space5 Jul 2023
- 2023On Degrees of Freedom in Defining and Testing Natural Language Understanding24 May 2023
- 2023Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statements5 May 2023
12 newest of 30 All 30 (JSON)