Self-Consistent Narrative Prompts on Abductive Natural Language Inference
Not on the map. Why?
Abstract (arXiv)
Abduction has long been seen as crucial for narrative comprehension and reasoning about everyday situations. The abductive natural language inference (αNLI) task has been proposed, and this narrative text-based task aims to infer the most plausible hypothesis from the candidates given two observations. However, the inter-sentential coherence and the model consistency have not been well exploited in the previous works on this task. In this work, we propose a prompt tuning model α-PACE, which takes self-consistency and inter-sentential coherence into consideration. Besides, we propose a general self-consistent framework that considers various narrative sequences (e.g., linear narrative and reverse chronology) for guiding the pre-trained language model in understanding the narrative context of input. We conduct extensive experiments and thorough ablation studies to illustrate the necessity and effectiveness of α-PACE. The performance of our method shows significant improvement against extensive competitive baselines.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 40 of its 63 references that are in the map. First posted on arXiv 15 Sep 2023.
Builds on
40 of 63 references.
References · 40
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
28 more
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2021GPT Understands, Toocited by 715
- 2020Towards a Human-like Open-Domain Chatbotcited by 467
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
- 2021Learning How to Ask: Querying LMs with Mixtures of Soft Promptscited by 376
- 2021Measuring and Improving Consistency in Pretrained Language Modelscited by 361
- 2023Multi-step Jailbreaking Privacy Attacks on ChatGPTcited by 320
- 2019Abductive Commonsense Reasoningcited by 300
- 2021Factual Probing Is [MASK]: Learning vs. Learning to Recallcited by 291
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 278
- 2020UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learningcited by 239
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2021WARP: Word-level Adversarial ReProgrammingcited by 220
- 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
- 2022ChatGPT: The End of Online Exam Integrity?cited by 88
- 2019Make Up Your Mind! Adversarial Generation of Inconsistent Natural Language Explanationscited by 71
- 2023ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relationscited by 39
- 2018Discourse-Aware Neural Rewards for Coherent Text Generationcited by 28
- 2023DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognitioncited by 23
- 2019How Additional Knowledge can Improve Natural Language Commonsense Question Answering?cited by 22
- 2020Social Commonsense Reasoning with Multi-Head Knowledge Attentioncited by 10
- 2020L2R2: Leveraging Ranking for Abductive Reasoningcited by 8
- 2021Exploring Discourse Structures for Argument Impact Classificationcited by 7
- 2021Interactive Model with Structural Loss for Language-based Abductive Reasoningcited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 3; 2026: 2.
11 papers.
- 2024NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surroundingcited by 49
- 2023Privacy in Large Language Models: Attacks, Defenses and Future Directionscited by 48
- 2023Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Modelscited by 35
- 2024Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Informationcited by 20
- 2025LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoningcited by 12
- 2025Controllable Logical Hypothesis Generation for Abductive Reasoning in Knowledge Graphscited by 11
- 2024EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphscited by 9
- 2025Unifying Deductive and Abductive Reasoning in Knowledge Graphs with Masked Diffusion Modelcited by 8
- 2024Constrained Reasoning Chains for Enhancing Theory-of-Mind in Large Language Modelscited by 5
- 2026Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMscited by 5
- 2026HypoAgent: An Agentic Framework for Interactive Abductive Hypothesis Generation over Knowledge Graphscited by 0
- 2026HypoAgent: An Agentic Framework for Interactive Abductive Hypothesis Generation over Knowledge Graphs29 May 2026
- 2026Wiring the 'Why': A Unified Taxonomy and Survey of Abductive Reasoning in LLMs9 Apr 2026
- 2025Unifying Deductive and Abductive Reasoning in Knowledge Graphs with Masked Diffusion Model13 Oct 2025
- 2025Controllable Logical Hypothesis Generation for Abductive Reasoning in Knowledge Graphs27 May 2025
- 2025LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoning16 Feb 2025
- 2024Constrained Reasoning Chains for Enhancing Theory-of-Mind in Large Language Models20 Sep 2024
- 2024Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information5 Aug 2024
- 2024NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding21 Apr 2024
- 2024EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs30 Mar 2024
- 2023Privacy in Large Language Models: Attacks, Defenses and Future Directions16 Oct 2023
- 2023Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models2 Oct 2023
Similar, not cited
Close in wording, no citation either way
- 2026From We to Me: Theory Informed Narrative Shift with Abductive Reasoning
- 2026A Self Consistency Based Reranking for Narrative Question Answering
- 2022rmC small IS2: A Simplified Commonsense Inference Evaluation for Story Prose
- 2025Language Models Might Not Understand You: Evaluating Theory of Mind via Story Prompting
- 2026SwanNLP at SemEval-2026 Task 5: An LLM-based Framework for Plausibility Scoring in Narrative Word Sense Disambiguation
- 2025PRELUDE: A Benchmark Designed to Require Global Comprehension and Reasoning over Long Contexts
- 2026EVAR: Evidence-Validated Hypothesis Admission for Budget-Aware Narrative Reasoning
- 2026Narrative World Model: Narratology-Grounded Writer Memory for Long-Form Fiction