Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflicts
Not on the map. Why?
Abstract (arXiv)
Transformer-based pre-trained models have achieved great improvements in semantic matching. However, existing models still suffer from insufficient ability to capture subtle differences. The modification, addition and deletion of words in sentence pairs may make it difficult for the model to predict their relationship. To alleviate this problem, we propose a novel Dual Path Modeling Framework to enhance the model's ability to perceive subtle differences in sentence pairs by separately modeling affinity and difference semantics. Based on dual-path modeling framework we design the Dual Path Modeling Network (DPM-Net) to recognize semantic relations. And we conduct extensive experiments on 10 well-studied semantic matching and robustness test datasets, and the experimental results show that our proposed method achieves consistent improvements over baselines.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 24 Feb 2023.
Builds on
18 of 30 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 2016From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classificationcited by 337
- 2016Enhanced LSTM for Natural Language Inferencecited by 199
- 2019Semantics-aware BERT for Language Understandingcited by 111
- 2021Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitutioncited by 55
- 2021Syntax-BERT: Improving Pre-trained Transformers with Syntax Treescited by 51
6 more
- 2021ExplainaBoard: An Explainable Leaderboard for NLPcited by 50
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2022DABERT: Dual Attention Enhanced BERT for Semantic Matchingcited by 21
- 2018Scheduled Multi-Task Learning: From Syntax to Translationcited by 18
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
- 2020Multi-level Head-wise Match and Aggregation in Transformer for Textual Sequence Matchingcited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 7; 2026: 12.
21 papers.
Sort:
By area:
- 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answeringcited by 25
- 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Modelscited by 20
- 2025Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performancecited by 13
- 2025LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendationcited by 11
- 2025Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modelingcited by 11
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matchingcited by 9
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matchingcited by 8
- 2026Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Modelscited by 7
- 2026DPI: Exploiting Parameter Heterogeneity for Interference-Free Fine-Tuningcited by 5
- 2026Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Loopingcited by 3
- 2026Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuningcited by 2
- 2026MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governancecited by 2
9 more
- 2025Using External knowledge to Enhanced PLM for Semantic Matchingcited by 0
- 2025Boosting Neural Language Inference via Cascaded Interactive Reasoningcited by 0
- 2025Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendationcited by 0
- 2026Temporal-Aware Heterogeneous Graph Reasoning with Multi-View Fusion for Temporal Question Answeringcited by 0
- 2026Efficient Task Adaptation in Large Language Models via Selective Parameter Optimizationcited by 0
- 2026Multi-Granularity Reasoning for Natural Language Inferencecited by 0
- 2026Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reportscited by 0
- 2026AlignDiff: Exploiting Model-Intrinsic Information for Better Preference Data Selectioncited by 0
- 2026Counterfactual Rollout Replay: Forkable Environments as Free Process Rewards for Software Engineering Agentscited by 0
- 2026Counterfactual Rollout Replay: Forkable Environments as Free Process Rewards for Software Engineering Agents27 Sep 2026
- 2026AlignDiff: Exploiting Model-Intrinsic Information for Better Preference Data Selection5 Sep 2026
- 2026MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance22 Aug 2026
- 2026Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reports19 Jul 2026
- 2026Multi-Granularity Reasoning for Natural Language Inference18 Apr 2026
- 2026Efficient Task Adaptation in Large Language Models via Selective Parameter Optimization18 Apr 2026
- 2026Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning15 Apr 2026
- 2026Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models11 Apr 2026
- 2026Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping25 Mar 2026
- 2026Temporal-Aware Heterogeneous Graph Reasoning with Multi-View Fusion for Temporal Question Answering23 Feb 2026
- 2026DPI: Exploiting Parameter Heterogeneity for Interference-Free Fine-Tuning25 Jan 2026
- 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Models7 Jan 2026
9 more
- 2025Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendation10 Oct 2025
- 2025Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modeling29 Sep 2025
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matching2 Sep 2025
- 2025Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performance29 Aug 2025
- 2025LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendation22 Jun 2025
- 2025Boosting Neural Language Inference via Cascaded Interactive Reasoning10 May 2025
- 2025Using External knowledge to Enhanced PLM for Semantic Matching10 May 2025
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matching10 Dec 2024
- 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answering20 Feb 2024
- 2026SCRIBE: Structured Mid-Level Supervision for Tool-Using Language Modelscited by 20
- 2025Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modelingcited by 11
- 2026AlignDiff: Exploiting Model-Intrinsic Information for Better Preference Data Selectioncited by 0
- 2024Question Calibration and Multi-Hop Modeling for Temporal Question Answeringcited by 25
- 2025Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performancecited by 13
- 2025LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendationcited by 11
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matchingcited by 9
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matchingcited by 8
- 2026Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Modelscited by 7
- 2026DPI: Exploiting Parameter Heterogeneity for Interference-Free Fine-Tuningcited by 5
- 2026Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Loopingcited by 3
- 2026Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuningcited by 2
- 2025Using External knowledge to Enhanced PLM for Semantic Matchingcited by 0
- 2025Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendationcited by 0
- 2026Efficient Task Adaptation in Large Language Models via Selective Parameter Optimizationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reports19 Jul 2026
- 2026Multi-Granularity Reasoning for Natural Language Inference18 Apr 2026
- 2026Efficient Task Adaptation in Large Language Models via Selective Parameter Optimization18 Apr 2026
- 2026Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning15 Apr 2026
- 2026Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models11 Apr 2026
- 2026Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping25 Mar 2026
- 2026DPI: Exploiting Parameter Heterogeneity for Interference-Free Fine-Tuning25 Jan 2026
- 2025Tag-Enriched Multi-Attention with Large Language Models for Cross-Domain Sequential Recommendation10 Oct 2025
- 2025StructCoh: Structured Contrastive Learning for Context-Aware Text Semantic Matching2 Sep 2025
- 2025Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performance29 Aug 2025
- 2025LLM-Enhanced Multimodal Fusion for Cross-Domain Sequential Recommendation22 Jun 2025
- 2025Using External knowledge to Enhanced PLM for Semantic Matching10 May 2025
12 newest of 14 All 14 (JSON)