Enhanced LSTM for Natural Language Inference
Not on the map. Why?
Abstract (arXiv)
Reasoning and inference are central to human and artificial intelligence. Modeling inference in human language is very challenging. With the availability of large annotated data (Bowman et al., 2015), it has recently become feasible to train neural network based inference models, which have shown to be very effective. In this paper, we present a new state-of-the-art result, achieving the accuracy of 88.6% on the Stanford Natural Language Inference Dataset. Unlike the previous top models that use very complicated network architectures, we first demonstrate that carefully designing sequential inference models based on chain LSTMs can outperform all previous models. Based on this, we further show that by explicitly considering recursive architectures in both local inference modeling and inference composition, we achieve additional improvement. Particularly, incorporating syntactic parsing information contributes to our best result---it further improves the performance even when added to the already very strong model.
Key facts. Cited by 199 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 73; 2022: 46; 2023: 35; 2024: 27; 2025: 13; 2026: 5.
199 papers.
Sort:
By area:
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2021DocNLI: A Large-scale Dataset for Document-level Natural Language Inferencecited by 75
- 2021CoSQA: 20,000+ Web Queries for Code Search and Question Answeringcited by 74
- 2021Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristicscited by 67
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2021Coreference Resolution without Span Representationscited by 45
- 2021BERT & Family Eat Word Salad: Experiments with Text Understandingcited by 44
- 2021Tracing Text Provenance via Context-Aware Lexical Substitutioncited by 40
- 2021Paradigm Shift in Natural Language Processingcited by 39
38 more
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2021Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Informationcited by 31
- 2023A Survey on Out-of-Distribution Detection in NLPcited by 31
- 2023Revisiting Large Language Models as Zero-shot Relation Extractorscited by 29
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methodscited by 27
- 2023Pushing the Limits of ChatGPT on NLP Taskscited by 27
- 2021Bayesian Attention Belief Networkscited by 25
- 2021NeuralLog: Natural Language Inference with Joint Neural and Logical Reasoningcited by 24
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2021QuantumFed: A Federated Learning Framework for Collaborative Quantum Trainingcited by 22
- 2022DABERT: Dual Attention Enhanced BERT for Semantic Matchingcited by 21
- 2023Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflictscited by 21
- 2021SPECTRA: Sparse Structured Text Rationalizationcited by 19
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue Systemcited by 18
- 2021Hierarchical Cross-Modality Semantic Correlation Learning Model for Multimodal Summarizationcited by 18
- 2022MENLI: Robust Evaluation Metrics from Natural Language Inferencecited by 18
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
- 2022On the Calibration of Massively Multilingual Language Modelscited by 18
- 2023Natural Language Decompositions of Implicit Content Enable Better Text Representationscited by 18
- 2021Hierarchical Multi-head Attentive Network for Evidence-aware Fake News Detectioncited by 17
- 2021The Role of Context in Detecting Previously Fact-Checked Claimscited by 17
- 2021WikiContradiction: Detecting Self-Contradiction Articles on Wikipediacited by 17
- 2022Improving Personality Consistency in Conversation by Persona Extendingcited by 17
- 2024Quantum Kernel-Based Long Short-term Memory for Climate Time-Series Forecastingcited by 17
- 2021Topic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verificationcited by 16
- 2021Uncertainty Calibration for Ensemble-Based Debiasing Methodscited by 16
- 2021LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matchingcited by 15
- 2021Enhancing Backdoor Attacks with Multi-Level MMD Regularizationcited by 15
- 2021Alignment Attention by Matching Key and Query Distributionscited by 14
- 2023Zero-shot Transfer of Article-aware Legal Outcome Classification for European Court of Human Rights Casescited by 14
- 2021A Multi-Level Attention Model for Evidence-Based Fact Checkingcited by 13
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methodscited by 13
- 2022Attentive Deep Neural Networks for Legal Document Retrievalcited by 13
- 2021Reward Optimization for Neural Machine Translation with Learned Metricscited by 12
- 2022Pair-Level Supervised Contrastive Learning for Natural Language Inferencecited by 12
- 2024Lessons from the Use of Natural Language Inference (NLI) in Requirements Engineering Taskscited by 12
- 2022Fact-Saboteurs: A Taxonomy of Evidence Manipulation Attacks against Fact-Verification Systemscited by 11
50 most cited of 199 All 199 (JSON)
- 2026R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection24 Sep 2026
- 2026SVF-CR: Synchronized Visual-Facial Cross-Refinement for Multimodal Ambivalence and Hesitancy Recognition10 Jul 2026
- 2026PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving30 Jun 2026
- 2026Multi-Granularity Reasoning for Natural Language Inference18 Apr 2026
- 2026NeuroGame Transformer: Gibbs-Inspired Attention Driven by Game Theory and Statistical Physics19 Mar 2026
- 2025MuPlon: Multi-Path Causal Optimization for Claim Verification through Controlling Confounding30 Sep 2025
- 2025Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems26 Sep 2025
- 2025Explainable Semantic Text Relations: A Question-Answering Framework for Comparing Document Content10 Sep 2025
- 2025Contextualized Token Discrimination for Speech Search Query Correction4 Sep 2025
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matching2 Sep 2025
- 2025Adversarial Text Generation with Dynamic Contextual Perturbation10 Jun 2025
- 2025Boosting Neural Language Inference via Cascaded Interactive Reasoning10 May 2025
38 more
- 2025Using External knowledge to Enhanced PLM for Semantic Matching10 May 2025
- 2025Learning to Learn with Quantum Optimization via Quantum Neural Networks1 May 2025
- 2025Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Prediction11 Apr 2025
- 2025Contradiction Detection in RAG Systems: Evaluating LLMs as Context Validators for Improved Information Consistency31 Mar 2025
- 2025System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systems8 Mar 2025
- 2025Misspellings in Natural Language Processing: A survey28 Jan 2025
- 2024Unpacking the Resilience of SNLI Contradiction Examples to Attacks15 Dec 2024
- 2024First Train to Generate, then Generate to Train: UnitedSynT5 for Few-Shot NLI12 Dec 2024
- 2024Quantum Kernel-Based Long Short-term Memory for Climate Time-Series Forecasting12 Dec 2024
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matching10 Dec 2024
- 2024CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search2 Dec 2024
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigation16 Nov 2024
- 2024Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting2 Oct 2024
- 2024Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Review26 Sep 2024
- 2024Enhancing adversarial robustness in Natural Language Inference using explanations11 Sep 2024
- 2024Entity-Aware Biaffine Attention Model for Improved Constituent Parsing with Reduced Entity Violations1 Sep 2024
- 2024Towards Boosting LLMs-driven Relevance Modeling with Progressive Retrieved Behavior-augmented Prompting18 Aug 2024
- 2024Leveraging Graph Structures to Detect Hallucinations in Large Language Models5 Jul 2024
- 2024Resolving Word Vagueness with Scenario-guided Adapter for Natural Language Inference21 May 2024
- 2024In-context Contrastive Learning for Event Causality Identification17 May 2024
- 2024Multi-Evidence based Fact Verification via A Confidential Graph Neural Network17 May 2024
- 2024Lessons from the Use of Natural Language Inference (NLI) in Requirements Engineering Tasks24 Apr 2024
- 2024Marking: Visual Grading with Highlighting Errors and Annotating Missing Bits22 Apr 2024
- 2024Explanation based Bias Decoupling Regularization for Natural Language Inference20 Apr 2024
- 2024SLFNet: Generating Semantic Logic Forms from Natural Language Using Semantic Probability Graphs29 Mar 2024
- 2024SSCAE -- Semantic, Syntactic, and Context-aware natural language Adversarial Examples generator18 Mar 2024
- 2024Methods for Matching English Language Addresses14 Mar 2024
- 2024CET2: Modelling Topic Transitions for Coherent and Engaging Knowledge-Grounded Conversations4 Mar 2024
- 2024Sequence graphs realizations and ambiguity in language models13 Feb 2024
- 2024Enhancing Multi-field B2B Cloud Solution Matching via Contrastive Pre-training11 Feb 2024
- 2024Engineering A Large Language Model From Scratch30 Jan 2024
- 2024Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddings15 Jan 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2023Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language15 Dec 2023
- 2023Quantifying Divergence for Human-AI Collaboration and Cognitive Trust14 Dec 2023
- 2023Improving Factual Error Correction by Learning to Inject Factual Errors12 Dec 2023
- 2023Enhancing Answer Selection in Community Question Answering with Pre-trained and Large Language Models29 Nov 2023
- 2023IEKM: A Model Incorporating External Keyword Matrices21 Nov 2023
50 newest of 199 All 199 (JSON)
- 2022Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Modelscited by 9
- 2022Can Transformers Reason in Fragments of Natural Language?cited by 8
- 2023Multi-modal Large Language Model Enhanced Pseudo 3D Perception Framework for Visual Commonsense Reasoningcited by 3
- 2025Boosting Neural Language Inference via Cascaded Interactive Reasoningcited by 0
- 2025Boosting Neural Language Inference via Cascaded Interactive Reasoning10 May 2025
- 2023Multi-modal Large Language Model Enhanced Pseudo 3D Perception Framework for Visual Commonsense Reasoning30 Jan 2023
- 2022Can Transformers Reason in Fragments of Natural Language?10 Nov 2022
- 2022Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models4 May 2022
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2021LGESQL: Line Graph Enhanced Text-to-SQL Model with Mixed Local and Non-Local Relationscited by 119
- 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2021DocNLI: A Large-scale Dataset for Document-level Natural Language Inferencecited by 75
- 2021CoSQA: 20,000+ Web Queries for Code Search and Question Answeringcited by 74
- 2021Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristicscited by 67
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2021Coreference Resolution without Span Representationscited by 45
- 2021BERT & Family Eat Word Salad: Experiments with Text Understandingcited by 44
- 2021Paradigm Shift in Natural Language Processingcited by 39
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
12 most cited of 191 All 191 (JSON)
- 2026R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection24 Sep 2026
- 2026SVF-CR: Synchronized Visual-Facial Cross-Refinement for Multimodal Ambivalence and Hesitancy Recognition10 Jul 2026
- 2026Multi-Granularity Reasoning for Natural Language Inference18 Apr 2026
- 2026NeuroGame Transformer: Gibbs-Inspired Attention Driven by Game Theory and Statistical Physics19 Mar 2026
- 2025MuPlon: Multi-Path Causal Optimization for Claim Verification through Controlling Confounding30 Sep 2025
- 2025Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems26 Sep 2025
- 2025Explainable Semantic Text Relations: A Question-Answering Framework for Comparing Document Content10 Sep 2025
- 2025Contextualized Token Discrimination for Speech Search Query Correction4 Sep 2025
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matching2 Sep 2025
- 2025Adversarial Text Generation with Dynamic Contextual Perturbation10 Jun 2025
- 2025Using External knowledge to Enhanced PLM for Semantic Matching10 May 2025
- 2025Learning to Learn with Quantum Optimization via Quantum Neural Networks1 May 2025
12 newest of 191 All 191 (JSON)