Dynamic Self-Attention : Computing Attention over Words Dynamically for Sentence Embedding
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose Dynamic Self-Attention (DSA), a new self-attention mechanism for sentence embedding. We design DSA by modifying dynamic routing in capsule network (Sabouretal.,2017) for natural language processing. DSA attends to informative words with a dynamic weight vector. We achieve new state-of-the-art results among sentence encoding methods in Stanford Natural Language Inference (SNLI) dataset with the least number of parameters, while showing comparative results in Stanford Sentiment Treebank (SST) dataset.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 3; 2023: 0; 2024: 1; 2025: 1.
8 papers.
- 2022Boosting Crowd Counting via Multifaceted Attentioncited by 73
- 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directionscited by 51
- 2024MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQLcited by 22
- 2021Weakly Supervised Explainable Phrasal Reasoning with Neural Fuzzy Logiccited by 9
- 2021LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matchingcited by 2
- 2022On the Security Vulnerabilities of Text-to-SQL Modelscited by 2
- 2021DGA-Net Dynamic Gaussian Attention Network for Sentence Semantic Matchingcited by 0
- 2025Meta-aware Learning in text-to-SQL Large Language Modelcited by 0
- 2025Meta-aware Learning in text-to-SQL Large Language Model25 May 2025
- 2024MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQL15 Aug 2024
- 2022On the Security Vulnerabilities of Text-to-SQL Models28 Nov 2022
- 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directions29 Aug 2022
- 2022Boosting Crowd Counting via Multifaceted Attention5 Mar 2022
- 2021Weakly Supervised Explainable Phrasal Reasoning with Neural Fuzzy Logic18 Sep 2021
- 2021LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching6 Aug 2021
- 2021DGA-Net Dynamic Gaussian Attention Network for Sentence Semantic Matching9 Jun 2021