# Sparse Fuzzy Attention for Structured Sentiment Analysis

arXiv: https://arxiv.org/abs/2109.06719 · HTML: https://mlsanity.com/paper/2109.06719/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 26 references that are in the map.
- First posted on arXiv 14 Sep 2021.

## Builds on (most cited first, 12 of 12)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Deep Biaffine Attention for Neural Dependency Parsing](https://mlsanity.com/paper/1611.01734/) (2016)
- [An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysis](https://mlsanity.com/paper/1906.06906/) (2019)
- [Efficient Second-Order TreeCRF for Neural Dependency Parsing](https://mlsanity.com/paper/2005.00975/) (2020)
- [Simpler but More Accurate Semantic Dependency Parsing](https://mlsanity.com/paper/1807.01396/) (2018)
- [Structured Sentiment Analysis as Dependency Graph Parsing](https://mlsanity.com/paper/2105.14504/) (2021)
- [A Fine-Grained Sentiment Dataset for Norwegian](https://mlsanity.com/paper/1911.12722/) (2019)
- [Second-Order Semantic Dependency Parsing with End-to-End Neural Networks](https://mlsanity.com/paper/1906.07880/) (2019)
- [MultiBooked: A Corpus of Basque and Catalan Hotel Reviews Annotated for Aspect-level Sentiment Classification](https://mlsanity.com/paper/1803.08614/) (2018)
- [Second-Order Neural Dependency Parsing with Message Passing and End-to-End Training](https://mlsanity.com/paper/2010.05003/) (2020)
- [High-order Semantic Role Labeling](https://mlsanity.com/paper/2010.04641/) (2020)

## Built on by (most cited first, 5 of 5)

- [Direct parsing to sentiment graphs](https://mlsanity.com/paper/2203.13209/) (2022)
- [Modeling Label Correlations for Second-Order Semantic Dependency Parsing with Mean-Field Inference](https://mlsanity.com/paper/2204.03619/) (2022)
- [Structured Sentiment Analysis as Transition-based Dependency Graph Parsing](https://mlsanity.com/paper/2305.05311/) (2023)
- [Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding](https://mlsanity.com/paper/2501.07329/) (2025)
- [Structured Sentiment Analysis Using Sequence Labeling as Dependency Graph Parsing](https://mlsanity.com/paper/2610.11695/) (2026)

## Abstract (arXiv)

Attention scorers have achieved success in parsing tasks like semantic and syntactic dependency parsing. However, in tasks modeled into parsing, like structured sentiment analysis, "dependency edges" are very sparse which hinders parser performance. Thus we propose a sparse and fuzzy attention scorer with pooling layers which improves parser performance and sets the new state-of-the-art on structured sentiment analysis. We further explore the parsing modeling on structured sentiment analysis with second-order parsing and introduce a novel sparse second-order edge building procedure that leads to significant improvement in parsing performance.