Single-Pass, Depth-Selective Reading for Multi-Aspect Sentiment Analysis
Not on the map. Why?
Abstract (arXiv)
Aspect-Term Sentiment Analysis (ATSA) in multi-aspect sentences faces a fundamental tradeoff between efficiency and expressiveness. Existing models either re-encode the sentence for each aspect or rely on static use of deep representations, leading to redundant computation and limited adaptivity. We argue that Transformer depth is a costly, queryable resource, and propose DABS, a single-pass inference framework that encodes each sentence once to construct a reusable, depth-ordered substrate. Each aspect then queries this shared representation to selectively read relevant tokens and abstraction levels, without re-encoding. This decouples shared sentence encoding from lightweight, aspect-conditioned readout. Experiments on four ATSA benchmarks show that DABS achieves competitive performance while reducing end-to-end computation by up to 60% in multi-aspect settings (M >= 2). Further analyses indicate that adaptive depth querying is most beneficial for linguistically complex cases such as negation and contrast. Code is publicly available at https://github.com/panzhzh/acl-dabs
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 33 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
11 of 33 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 307
- 2023Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decodingcited by 80
- 2023MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Predictioncited by 50
- 2023The Impact of Depth on Compositional Generalization in Transformer Language Modelscited by 38
- 2023Large language models for aspect-based sentiment analysiscited by 17
- 2025LayAlign: Enhancing Multilingual Reasoning in Large Language Models via Layer-Wise Adaptive Fusion and Alignment Strategycited by 10
- 2024It is Simple Sometimes: A Study On Improving Aspect-Based Sentiment Analysis Performancecited by 4
- 2023iACOS: Advancing Implicit Sentiment Extraction with Informative and Adaptive Negative Examplescited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.