Bilateral Multi-Perspective Matching for Natural Language Sentences
Not on the map. Why?
Abstract (arXiv)
Natural language sentence matching is a fundamental technology for a variety of tasks. Previous approaches either match sentences from a single direction or only apply single granular (word-by-word or sentence-by-sentence) matching. In this work, we propose a bilateral multi-perspective matching (BiMPM) model under the "matching-aggregation" framework. Given two sentences P and Q, our model first encodes them with a BiLSTM encoder. Next, we match the two encoded sentences in two directions P rightarrow Q and P leftarrow Q. In each matching direction, each time step of one sentence is matched against all time-steps of the other sentence from multiple perspectives. Then, another BiLSTM layer is utilized to aggregate the matching results into a fix-length matching vector. Finally, based on the matching vector, the decision is made through a fully connected layer. We evaluate our model on three tasks: paraphrase identification, natural language inference and answer sentence selection. Experimental results on standard benchmark datasets show that our model achieves the state-of-the-art performance on all tasks.
Key facts. Cited by 121 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 30; 2023: 28; 2024: 21; 2025: 18; 2026: 2.
121 papers.
Sort:
By area:
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
- 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 246
- 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 226
- 2023Flocks of Stochastic Parrots: Differentially Private Prompt Learning for Large Language Modelscited by 83
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugincited by 82
- 2022GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspectivecited by 72
- 2021Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n Parameterscited by 66
- 2023How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Taskscited by 58
- 2022Linear Connectivity Reveals Generalization Strategiescited by 56
- 2021Variational Information Bottleneck for Effective Low-Resource Fine-Tuningcited by 51
- 2022MABEL: Attenuating Gender Bias using Textual Entailment Datacited by 31
38 more
- 2023Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learningcited by 31
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2025Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignmentcited by 23
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2022Learning to Transfer Prompts for Text Generationcited by 22
- 2022DABERT: Dual Attention Enhanced BERT for Semantic Matchingcited by 21
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2025WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Modelscited by 18
- 2021Neural ranking models for document retrievalcited by 16
- 2022SalesBot: Transitioning from Chit-Chat to Task-Oriented Dialoguescited by 16
- 2023BatchPrompt: Accomplish more with lesscited by 16
- 2025Should We Still Pretrain Encoders with Masked Language Modeling?cited by 16
- 2021LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matchingcited by 15
- 2022Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Predictionscited by 13
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methodscited by 13
- 2021Explaining Neural Network Predictions on Sentence Pairs via Learning Word-Group Maskscited by 12
- 2021Sequential Cross-Document Coreference Resolutioncited by 12
- 2022SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learningcited by 12
- 2023Paraphrase Detection: Human vs. Machine Contentcited by 12
- 2023TaskWeb: Selecting Better Source Tasks for Multi-task NLPcited by 11
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfercited by 10
- 2024Large Language Model Sentinel: LLM Agent for Adversarial Purificationcited by 10
- 2024TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competitioncited by 10
- 2022Divide and Conquer: Text Semantic Matching with Disentangled Keywords and Intentscited by 9
- 2024Affordable Generative Agentscited by 9
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matchingcited by 9
- 2024GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theorycited by 8
- 2024Eguard: Defending LLM Embeddings Against Inversion Attacks via Text Mutual Information Optimizationcited by 8
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matchingcited by 8
- 2021Graph-augmented Learning to Rank for Querying Large-scale Knowledge Graphcited by 7
- 2022Hyperbolic Relevance Matching for Neural Keyphrase Extractioncited by 7
- 2023Gradient-Boosted Decision Tree for Listwise Context Model in Multimodal Review Helpfulness Predictioncited by 7
- 2023Robustness Over Time: Understanding Adversarial Examples' Effectiveness on Longitudinal Versions of Large Language Modelscited by 7
- 2023Question Answering for Electronic Health Records: A Scoping Review of datasets and modelscited by 7
- 2024Use Random Selection for Now: Investigation of Few-Shot Selection Strategies in LLM-based Text Augmentation for Classificationcited by 7
- 2025GORAG: Graph-based Online Retrieval Augmented Generation for Dynamic Few-shot Social Media Text Classificationcited by 7
- 2023Generate-then-Retrieve: Intent-Aware FAQ Retrieval in Product Searchcited by 6
50 most cited of 121 All 121 (JSON)
- 2026R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection24 Sep 2026
- 2026Avey-B17 Feb 2026
- 2025SA-DiffuSeq: Addressing Computational and Scalability Challenges in Long-Document Generation with Sparse Attention23 Dec 2025
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Experts23 Dec 2025
- 2025PADBen: A Comprehensive Benchmark for Evaluating AI Text Detectors Against Paraphrase Attacks1 Nov 2025
- 2025Minimizing Human Intervention in Online Classification27 Oct 2025
- 2025MeTA-LoRA: Data-Efficient Multi-Task Fine-Tuning for Large Language Models13 Oct 2025
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matching2 Sep 2025
- 2025RRRA: Resampling and Reranking through a Retriever Adapter7 Aug 2025
- 2025Multimodal Fine-grained Reasoning for Post Quality Evaluation21 Jul 2025
- 2025Should We Still Pretrain Encoders with Masked Language Modeling?1 Jul 2025
- 2025Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws29 May 2025
38 more
- 2025ViMRHP: A Vietnamese Benchmark Dataset for Multimodal Review Helpfulness Prediction via Human-AI Collaborative Annotation12 May 2025
- 2025Boosting Neural Language Inference via Cascaded Interactive Reasoning10 May 2025
- 2025MiMu: Mitigating Multiple Shortcut Learning Behavior of Transformers14 Apr 2025
- 2025CEFW: A Comprehensive Evaluation Framework for Watermark in Large Language Models24 Mar 2025
- 2025Improving Neutral Point-of-View Generation with Data- and Parameter-Efficient RL5 Mar 2025
- 2025Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment24 Feb 2025
- 2025WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Models20 Feb 2025
- 2025GORAG: Graph-based Online Retrieval Augmented Generation for Dynamic Few-shot Social Media Text Classification6 Jan 2025
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matching10 Dec 2024
- 2024A Comparative Study of Learning Paradigms in Large Language Models via Intrinsic Dimension9 Dec 2024
- 2024HeteroTune: Efficient Federated Learning for Large Heterogeneous Models25 Nov 2024
- 2024Model Fusion through Bayesian Optimization in Language Model Fine-Tuning11 Nov 2024
- 2024Conditional [MASK] Discrete Diffusion Language Model10 Nov 2024
- 2024VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models7 Nov 2024
- 2024Eguard: Defending LLM Embeddings Against Inversion Attacks via Text Mutual Information Optimization6 Nov 2024
- 2024Use Random Selection for Now: Investigation of Few-Shot Selection Strategies in LLM-based Text Augmentation for Classification14 Oct 2024
- 2024BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation13 Oct 2024
- 2024Auto-Demo Prompting: Leveraging Generated Outputs as Demonstrations for Enhanced Batch Prompting2 Oct 2024
- 2024Bilingual Rhetorical Structure Parsing with Large Parallel Annotations23 Sep 2024
- 2024TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition19 Aug 2024
- 2024GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory18 Jun 2024
- 2024Large Language Model Sentinel: LLM Agent for Adversarial Purification24 May 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024A General and Flexible Multi-concept Parsing Framework for Multilingual Semantic Matching5 Mar 2024
- 2024Sparse Graph Representations for Procedural Instructional Documents6 Feb 2024
- 2024Affordable Generative Agents3 Feb 2024
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2024Noise Contrastive Estimation-based Matching Framework for Low-Resource Security Attack Pattern Recognition18 Jan 2024
- 2024MultiSiam: A Multiple Input Siamese Network For Social Media Text Classification And Duplicate Text Detection6 Jan 2024
- 2023Can persistent homology whiten Transformer-based black-box models? A case study on BERT compression17 Dec 2023
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin15 Dec 2023
- 2023The ICL Consistency Test8 Dec 2023
- 2023Recursion in Recursion: Two-Level Nested Recursion for Length Generalization with Scalability8 Nov 2023
- 2023Post Turing: Mapping the landscape of LLM Evaluation3 Nov 2023
- 2023Paraphrase Types for Generation and Detection23 Oct 2023
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfer23 Oct 2023
- 2023Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning20 Oct 2023
- 2023SHARCS: Efficient Transformers through Routing with Dynamic Width Sub-networks18 Oct 2023
50 newest of 121 All 121 (JSON)
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugincited by 82
- 2025Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignmentcited by 23
- 2024GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theorycited by 8
- 2025Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment24 Feb 2025
- 2024GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory18 Jun 2024
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin15 Dec 2023
- 2025WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Modelscited by 18
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfercited by 10
- 2025GORAG: Graph-based Online Retrieval Augmented Generation for Dynamic Few-shot Social Media Text Classificationcited by 7
- 2025WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Models20 Feb 2025
- 2025GORAG: Graph-based Online Retrieval Augmented Generation for Dynamic Few-shot Social Media Text Classification6 Jan 2025
- 2023Diversify Question Generation with Retrieval-Augmented Style Transfer23 Oct 2023
- 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 226
- 2023Robustness Over Time: Understanding Adversarial Examples' Effectiveness on Longitudinal Versions of Large Language Modelscited by 7
- 2025CEFW: A Comprehensive Evaluation Framework for Watermark in Large Language Modelscited by 0
- 2025CEFW: A Comprehensive Evaluation Framework for Watermark in Large Language Models24 Mar 2025
- 2023Robustness Over Time: Understanding Adversarial Examples' Effectiveness on Longitudinal Versions of Large Language Models15 Aug 2023
- 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts7 Jun 2023
- 2024Large Language Model Sentinel: LLM Agent for Adversarial Purificationcited by 10
- 2024Affordable Generative Agentscited by 9
- 2024Large Language Model Sentinel: LLM Agent for Adversarial Purification24 May 2024
- 2024Affordable Generative Agents3 Feb 2024
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
- 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 246
- 2023Flocks of Stochastic Parrots: Differentially Private Prompt Learning for Large Language Modelscited by 83
- 2022GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspectivecited by 72
- 2021Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n Parameterscited by 66
- 2022Linear Connectivity Reveals Generalization Strategiescited by 56
- 2021Variational Information Bottleneck for Effective Low-Resource Fine-Tuningcited by 51
- 2022MABEL: Attenuating Gender Bias using Textual Entailment Datacited by 31
- 2023Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learningcited by 31
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2022Learning to Transfer Prompts for Text Generationcited by 22
12 most cited of 105 All 105 (JSON)
- 2026R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection24 Sep 2026
- 2026Avey-B17 Feb 2026
- 2025SA-DiffuSeq: Addressing Computational and Scalability Challenges in Long-Document Generation with Sparse Attention23 Dec 2025
- 2025PADBen: A Comprehensive Benchmark for Evaluating AI Text Detectors Against Paraphrase Attacks1 Nov 2025
- 2025Minimizing Human Intervention in Online Classification27 Oct 2025
- 2025MeTA-LoRA: Data-Efficient Multi-Task Fine-Tuning for Large Language Models13 Oct 2025
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matching2 Sep 2025
- 2025RRRA: Resampling and Reranking through a Retriever Adapter7 Aug 2025
- 2025Multimodal Fine-grained Reasoning for Post Quality Evaluation21 Jul 2025
- 2025Should We Still Pretrain Encoders with Masked Language Modeling?1 Jul 2025
- 2025Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws29 May 2025
- 2025ViMRHP: A Vietnamese Benchmark Dataset for Multimodal Review Helpfulness Prediction via Human-AI Collaborative Annotation12 May 2025
12 newest of 105 All 105 (JSON)