# ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs

arXiv: https://arxiv.org/abs/1512.05193 · HTML: https://mlsanity.com/paper/1512.05193/

## Key facts

- Cited by 35 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Dec 2015.

## Built on by (most cited first, 30 of 35)

- [Attention, please! A survey of Neural Attention Models in Deep Learning](https://mlsanity.com/paper/2103.16775/) (2021)
- [Biomedical Question Answering: A Survey of Approaches and Challenges](https://mlsanity.com/paper/2102.05281/) (2021)
- [FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Clouds](https://mlsanity.com/paper/2104.00798/) (2021)
- [Attention Mechanism in Neural Networks: Where it Comes and Where it Goes](https://mlsanity.com/paper/2204.13154/) (2022)
- [MS-MDA: Multisource Marginal Distribution Adaptation for Cross-subject and Cross-session EEG Emotion Recognition](https://mlsanity.com/paper/2107.07740/) (2021)
- [Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks](https://mlsanity.com/paper/2102.10934/) (2021)
- [Neural ranking models for document retrieval](https://mlsanity.com/paper/2102.11903/) (2021)
- [Grow-and-Clip: Informative-yet-Concise Evidence Distillation for Answer Explanation](https://mlsanity.com/paper/2201.05088/) (2022)
- [Paraphrase Identification with Deep Learning: A Review of Datasets and Methods](https://mlsanity.com/paper/2212.06933/) (2022)
- [An Explainable CNN Approach for Medical Codes Prediction from Clinical Text](https://mlsanity.com/paper/2101.11430/) (2021)
- [Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detection](https://mlsanity.com/paper/2312.01060/) (2023)
- [Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledge](https://mlsanity.com/paper/2104.05216/) (2021)
- [Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wild](https://mlsanity.com/paper/2203.03984/) (2022)
- [Enhanced 3D Human Pose Estimation from Videos by using Attention-Based Neural Network with Dilated Convolutions](https://mlsanity.com/paper/2103.03170/) (2021)
- [Explainability in Process Outcome Prediction: Guidelines to Obtain Interpretable and Faithful Models](https://mlsanity.com/paper/2203.16073/) (2022)
- [TLSAN: Time-aware Long- and Short-term Attention Network for Next-item Recommendation](https://mlsanity.com/paper/2103.08971/) (2021)
- [Beyond Semantics: Learning a Behavior Augmented Relevance Model with Self-supervised Learning](https://mlsanity.com/paper/2308.05379/) (2023)
- [BERT-DRE: BERT with Deep Recursive Encoder for Natural Language Sentence Matching](https://mlsanity.com/paper/2111.02188/) (2021)
- [A Neural Model for Joint Document and Snippet Ranking in Question Answering for Large Document Collections](https://mlsanity.com/paper/2106.08908/) (2021)
- [MGA-VQA: Multi-Granularity Alignment for Visual Question Answering](https://mlsanity.com/paper/2201.10656/) (2022)
- [Towards Flexible Evaluation for Generative Visual Question Answering](https://mlsanity.com/paper/2408.00300/) (2024)
- [A Novel Deep Learning Method for Textual Sentiment Analysis](https://mlsanity.com/paper/2102.11651/) (2021)
- [A Multi-Size Neural Network with Attention Mechanism for Answer Selection](https://mlsanity.com/paper/2105.03278/) (2021)
- [Combining Data-driven Supervision with Human-in-the-loop Feedback for Entity Resolution](https://mlsanity.com/paper/2111.10497/) (2021)
- [EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning](https://mlsanity.com/paper/2205.15744/) (2022)
- [SECNN: Squeeze-and-Excitation Convolutional Neural Network for Sentence Classification](https://mlsanity.com/paper/2312.06088/) (2023)
- [M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings](https://mlsanity.com/paper/2511.02349/) (2025)
- [HalluGen: Synthesizing Realistic and Controllable Hallucinations for Evaluating Image Restoration](https://mlsanity.com/paper/2512.03345/) (2025)
- [Hierarchical Ranking for Answer Selection](https://mlsanity.com/paper/2102.00677/) (2021)
- [SStaGCN: Simplified stacking based graph convolutional networks](https://mlsanity.com/paper/2111.08228/) (2021)

## Abstract (arXiv)

How to model a pair of sentences is a critical issue in many NLP tasks such as answer selection (AS), paraphrase identification (PI) and textual entailment (TE). Most prior work (i) deals with one individual task by fine-tuning a specific system; (ii) models each sentence's representation separately, rarely considering the impact of the other sentence; or (iii) relies fully on manually designed, task-specific linguistic features. This work presents a general Attention Based Convolutional Neural Network (ABCNN) for modeling a pair of sentences. We make three contributions. (i) ABCNN can be applied to a wide variety of tasks that require modeling of sentence pairs. (ii) We propose three attention schemes that integrate mutual influence between sentences into CNN; thus, the representation of each sentence takes into consideration its counterpart. These interdependent sentence pair representations are more powerful than isolated sentence representations. (iii) ABCNN achieves state-of-the-art performance on AS, PI and TE tasks.