mlsanityData to 7 Oct 2026

DEIM: An effective deep encoding and interaction model for sentence matching

arXiv 2203.10482 ↗First posted 20 Mar 2022cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Natural language sentence matching is the task of comparing two sentences and identifying the relationship between them.It has a wide range of applications in natural language processing tasks such as reading comprehension, question and answer systems. The main approach is to compute the interaction between text representations and sentence pairs through an attention mechanism, which can extract the semantic information between sentence pairs well. However,this kind of method can not gain satisfactory results when dealing with complex semantic features. To solve this problem, we propose a sentence matching method based on deep encoding and interaction to extract deep semantic information. In the encoder layer,we refer to the information of another sentence in the process of encoding a single sentence, and later use a heuristic algorithm to fuse the information. In the interaction layer, we use a bidirectional attention mechanism and a self-attention mechanism to obtain deep semantic information.Finally, we perform a pooling operation and input it to the MLP for classification. we evaluate our model on three tasks: recognizing textual entailment, paraphrase recognition, and answer selection. We conducted experiments on the SNLI and SciTail datasets for the recognizing textual entailment task, the Quora dataset for the paraphrase recognition task, and the WikiQA dataset for the answer selection task. The experimental results show that the proposed algorithm can effectively extract deep semantic features that verify the effectiveness of the algorithm on sentence matching tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 20 Mar 2022.

Builds on

24 of 46 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  6. 2018Deep contextualized word representationscited by 2,285
  7. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  8. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  9. 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
  10. 2016Enhanced LSTM for Natural Language Inferencecited by 199
  11. 2017Bilateral Multi-Perspective Matching for Natural Language Sentencescited by 120
  12. 2021Self-Guided Contrastive Learning for BERT Sentence Representationscited by 103
12 more
  1. 2019Star-Transformercited by 94
  2. 2015Reasoning about Entailment with Neural Attentioncited by 68
  3. 2018Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanismscited by 53
  4. 2015Learning Natural Language Inference with LSTMcited by 51
  5. 2019Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasetscited by 46
  6. 2020Asking Questions the Human Way: Scalable Question-Answer Generation from Text Corpuscited by 40
  7. 2019Simple and Effective Text Matching with Richer Alignment Featurescited by 29
  8. 2018Semantic Sentence Matching with Densely-connected Recurrent and Co-attentive Informationcited by 28
  9. 2018Combining Similarity Features and Deep Representation Learning for Stance Detection in the Context of Checking Fake Newscited by 11
  10. 2017Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorization for Natural Language Inferencecited by 10
  11. 2018Learning to Compose over Tree Structures via POS Tagscited by 3
  12. 2019DELTA: A DEep learning based Language Technology plAtformcited by 3

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.