ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs
Not on the map. Why?
Abstract (arXiv)
How to model a pair of sentences is a critical issue in many NLP tasks such as answer selection (AS), paraphrase identification (PI) and textual entailment (TE). Most prior work (i) deals with one individual task by fine-tuning a specific system; (ii) models each sentence's representation separately, rarely considering the impact of the other sentence; or (iii) relies fully on manually designed, task-specific linguistic features. This work presents a general Attention Based Convolutional Neural Network (ABCNN) for modeling a pair of sentences. We make three contributions. (i) ABCNN can be applied to a wide variety of tasks that require modeling of sentence pairs. (ii) We propose three attention schemes that integrate mutual influence between sentences into CNN; thus, the representation of each sentence takes into consideration its counterpart. These interdependent sentence pair representations are more powerful than isolated sentence representations. (iii) ABCNN achieves state-of-the-art performance on AS, PI and TE tasks.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Dec 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 8; 2023: 4; 2024: 1; 2025: 4; 2026: 1.
35 papers.
Sort:
By area:
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
- 2021FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Cloudscited by 30
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goescited by 29
- 2021MS-MDA: Multisource Marginal Distribution Adaptation for Cross-subject and Cross-session EEG Emotion Recognitioncited by 25
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2021Neural ranking models for document retrievalcited by 16
- 2022Grow-and-Clip: Informative-yet-Concise Evidence Distillation for Answer Explanationcited by 16
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methodscited by 13
- 2021An Explainable CNN Approach for Medical Codes Prediction from Clinical Textcited by 9
- 2023Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detectioncited by 9
- 2021Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledgecited by 7
23 more
- 2022Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wildcited by 7
- 2021Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutionscited by 6
- 2022Explainability in Process Outcome Prediction: Guidelines to Obtain Interpretable and Faithful Modelscited by 5
- 2021TLSAN: Time-aware Long- and Short-term Attention Network for Next-item Recommendationcited by 4
- 2023Beyond Semantics: Learning a Behavior Augmented Relevance Model with Self-supervised Learningcited by 4
- 2021BERT-DRE: BERT with Deep Recursive Encoder for Natural Language Sentence Matchingcited by 3
- 2021A Neural Model for Joint Document and Snippet Ranking in Question Answering for Large Document Collectionscited by 2
- 2022MGA-VQA: Multi-Granularity Alignment for Visual Question Answeringcited by 2
- 2024Towards Flexible Evaluation for Generative Visual Question Answeringcited by 2
- 2021A Novel Deep Learning Method for Textual Sentiment Analysiscited by 1
- 2021A Multi-Size Neural Network with Attention Mechanism for Answer Selectioncited by 1
- 2021Combining Data-driven Supervision with Human-in-the-loop Feedback for Entity Resolutioncited by 1
- 2022EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learningcited by 1
- 2023SECNN: Squeeze-and-Excitation Convolutional Neural Network for Sentence Classificationcited by 1
- 2025M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settingscited by 1
- 2025HalluGen: Synthesizing Realistic and Controllable Hallucinations for Evaluating Image Restorationcited by 1
- 2021Hierarchical Ranking for Answer Selectioncited by 0
- 2021SStaGCN: Simplified stacking based graph convolutional networkscited by 0
- 2022Learning Semantic Textual Similarity via Topic-informed Discrete Latent Variablescited by 0
- 2023Reranking Passages with Coarse-to-Fine Neural Retriever Enhanced by List-Context Informationcited by 0
- 2025How Vital is the Jurisprudential Relevance: Law Article Intervened Legal Case Retrieval and Matchingcited by 0
- 2025Offensive Language Detection on Social Media Using XLNetcited by 0
- 2026R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detectioncited by 0
- 2026R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection24 Sep 2026
- 2025HalluGen: Synthesizing Realistic and Controllable Hallucinations for Evaluating Image Restoration3 Dec 2025
- 2025M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings4 Nov 2025
- 2025Offensive Language Detection on Social Media Using XLNet26 Jun 2025
- 2025How Vital is the Jurisprudential Relevance: Law Article Intervened Legal Case Retrieval and Matching25 Feb 2025
- 2024Towards Flexible Evaluation for Generative Visual Question Answering1 Aug 2024
- 2023SECNN: Squeeze-and-Excitation Convolutional Neural Network for Sentence Classification11 Dec 2023
- 2023Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detection2 Dec 2023
- 2023Reranking Passages with Coarse-to-Fine Neural Retriever Enhanced by List-Context Information23 Aug 2023
- 2023Beyond Semantics: Learning a Behavior Augmented Relevance Model with Self-supervised Learning10 Aug 2023
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methods13 Dec 2022
- 2022Learning Semantic Textual Similarity via Topic-informed Discrete Latent Variables7 Nov 2022
23 more
- 2022EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning31 May 2022
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goes27 Apr 2022
- 2022Explainability in Process Outcome Prediction: Guidelines to Obtain Interpretable and Faithful Models30 Mar 2022
- 2022Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wild8 Mar 2022
- 2022MGA-VQA: Multi-Granularity Alignment for Visual Question Answering25 Jan 2022
- 2022Grow-and-Clip: Informative-yet-Concise Evidence Distillation for Answer Explanation13 Jan 2022
- 2021Combining Data-driven Supervision with Human-in-the-loop Feedback for Entity Resolution20 Nov 2021
- 2021SStaGCN: Simplified stacking based graph convolutional networks16 Nov 2021
- 2021BERT-DRE: BERT with Deep Recursive Encoder for Natural Language Sentence Matching3 Nov 2021
- 2021MS-MDA: Multisource Marginal Distribution Adaptation for Cross-subject and Cross-session EEG Emotion Recognition16 Jul 2021
- 2021A Neural Model for Joint Document and Snippet Ranking in Question Answering for Large Document Collections16 Jun 2021
- 2021A Multi-Size Neural Network with Attention Mechanism for Answer Selection24 Apr 2021
- 2021Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledge12 Apr 2021
- 2021FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Clouds1 Apr 2021
- 2021Attention, please! A survey of Neural Attention Models in Deep Learning31 Mar 2021
- 2021TLSAN: Time-aware Long- and Short-term Attention Network for Next-item Recommendation16 Mar 2021
- 2021Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutions4 Mar 2021
- 2021Neural ranking models for document retrieval23 Feb 2021
- 2021A Novel Deep Learning Method for Textual Sentiment Analysis23 Feb 2021
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks22 Feb 2021
- 2021Biomedical Question Answering: A Survey of Approaches and Challenges10 Feb 2021
- 2021Hierarchical Ranking for Answer Selection1 Feb 2021
- 2021An Explainable CNN Approach for Medical Codes Prediction from Clinical Text14 Jan 2021
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
- 2021FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Cloudscited by 30
- 2022Attention Mechanism in Neural Networks: Where it Comes and Where it Goescited by 29
- 2021MS-MDA: Multisource Marginal Distribution Adaptation for Cross-subject and Cross-session EEG Emotion Recognitioncited by 25
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2021Neural ranking models for document retrievalcited by 16
- 2022Grow-and-Clip: Informative-yet-Concise Evidence Distillation for Answer Explanationcited by 16
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methodscited by 13
- 2021An Explainable CNN Approach for Medical Codes Prediction from Clinical Textcited by 9
- 2023Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detectioncited by 9
- 2021Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledgecited by 7
12 most cited of 34 All 34 (JSON)
- 2026R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection24 Sep 2026
- 2025HalluGen: Synthesizing Realistic and Controllable Hallucinations for Evaluating Image Restoration3 Dec 2025
- 2025M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings4 Nov 2025
- 2025Offensive Language Detection on Social Media Using XLNet26 Jun 2025
- 2025How Vital is the Jurisprudential Relevance: Law Article Intervened Legal Case Retrieval and Matching25 Feb 2025
- 2023SECNN: Squeeze-and-Excitation Convolutional Neural Network for Sentence Classification11 Dec 2023
- 2023Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detection2 Dec 2023
- 2023Reranking Passages with Coarse-to-Fine Neural Retriever Enhanced by List-Context Information23 Aug 2023
- 2023Beyond Semantics: Learning a Behavior Augmented Relevance Model with Self-supervised Learning10 Aug 2023
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methods13 Dec 2022
- 2022Learning Semantic Textual Similarity via Topic-informed Discrete Latent Variables7 Nov 2022
- 2022EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning31 May 2022
12 newest of 34 All 34 (JSON)