# From Two Passes to One: Compact and Efficient Target-Stance Extraction

arXiv: https://arxiv.org/abs/2609.06108 · HTML: https://mlsanity.com/paper/2609.06108/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 17 of its 28 references that are in the map.
- First posted on arXiv 5 Sep 2026.

## Builds on (most cited first, 17 of 17)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension](https://mlsanity.com/paper/1910.13461/) (2019)
- [You Only Look Once: Unified, Real-Time Object Detection](https://mlsanity.com/paper/1506.02640/) (2015)
- [Rich feature hierarchies for accurate object detection and semantic segmentation](https://mlsanity.com/paper/1311.2524/) (2013)
- [Decoupled Weight Decay Regularization](https://mlsanity.com/paper/1711.05101/) (2017)
- [Enriching Word Vectors with Subword Information](https://mlsanity.com/paper/1607.04606/) (2016)
- [BERTweet: A pre-trained language model for English Tweets](https://mlsanity.com/paper/2005.10200/) (2020)
- [Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representations](https://mlsanity.com/paper/2010.03640/) (2020)
- [Stance Detection with Bidirectional Conditional Encoding](https://mlsanity.com/paper/1606.05464/) (2016)
- [Cross-topic Argument Mining from Heterogeneous Sources Using Attention-based Neural Networks](https://mlsanity.com/paper/1802.05758/) (2018)
- [Will-They-Won't-They: A Very Large Dataset for Stance Detection on Twitter](https://mlsanity.com/paper/2005.00388/) (2020)
- [Cross-Target Stance Classification with Self-Attention Networks](https://mlsanity.com/paper/1805.06593/) (2018)
- [KPTimes: A Large-Scale Dataset for Keyphrase Generation on News Documents](https://mlsanity.com/paper/1911.12559/) (2019)
- [MITRE at SemEval-2016 Task 6: Transfer Learning for Stance Detection](https://mlsanity.com/paper/1606.03784/) (2016)
- [Infusing Knowledge from Wikipedia to Enhance Stance Detection](https://mlsanity.com/paper/2204.03839/) (2022)
- [Exploiting Sentiment and Common Sense for Zero-shot Stance Detection](https://mlsanity.com/paper/2208.08797/) (2022)
- [Can Large Language Models Address Open-Target Stance Detection?](https://mlsanity.com/paper/2409.00222/) (2024)

## Abstract (arXiv)

Target-Stance Extraction (TSE) is the task of predicting both the target (or topic) of an author's writing and the author's stance toward it. Existing approaches to TSE use a sequential pipeline of two separate neural models: one to identify the target and another to determine the stance. We present a one-pass, joint architecture that predicts both in a single forward pass, reducing trainable parameters by nearly 50% with only a 4-7 F1 point tradeoff in performance. We further demonstrate that standard target-scrubbing practices artificially suppress target prediction accuracy. Retaining explicit target mentions, as in real-world deployments, improves F1 by at least 6 points across both target classification and target generation settings. These improvements allow for significantly easier integration of TSE in downstream applications such as public opinion tracking.
