Team "better_call_claude": Style Change Detection using a Sequential Sentence Pair Classifier
Not on the map. Why?
Abstract (arXiv)
Style change detection - identifying the points in a document where writing style shifts - remains one of the most important and challenging problems in computational authorship analysis. At PAN 2025, the shared task challenges participants to detect style switches at the most fine-grained level: individual sentences. The task spans three datasets, each designed with controlled and increasing thematic variety within documents. We propose to address this problem by modeling the content of each problem instance - that is, a series of sentences - as a whole, using a Sequential Sentence Pair Classifier (SSPC). The architecture leverages a pre-trained language model (PLM) to obtain representations of individual sentences, which are then fed into a bidirectional LSTM (BiLSTM) to contextualize them within the document. The BiLSTM-produced vectors of adjacent sentences are concatenated and passed to a multi-layer perceptron for prediction per adjacency. Building on the work of previous PAN participants classical text segmentation, the approach is relatively conservative and lightweight. Nevertheless, it proves effective in leveraging contextual information and addressing what is arguably the most challenging aspect of this year's shared task: the notorious problem of "stylistically shallow", short sentences that are prevalent in the proposed benchmark data. Evaluated on the official PAN-2025 test datasets, the model achieves strong macro-F1 scores of 0.923, 0.828, and 0.724 on the EASY, MEDIUM, and HARD data, respectively, outperforming not only the official random baselines but also a much more challenging one: claude-3.7-sonnet's zero-shot performance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 62 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
11 of 62 references.
References · 11
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2018Text Segmentation as a Supervised Learning Taskcited by 76
- 2019SECTOR: A Neural Model for Coherent Topic Segmentation and Classificationcited by 48
- 2020Two-Level Transformer and Auxiliary Coherence Modeling for Improved Text Segmentationcited by 41
- 2024Can Large Language Models Identify Authorship?cited by 41
- 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examplescited by 35
- 2021Transformer over Pre-trained Transformer for Neural Text Segmentation with Enhanced Topic Coherencecited by 22
- 2019Relative contributions of Shakespeare and Fletcher in Henry VIII: An Analysis Based on Most Frequent Words and Most Frequent Rhythmic Patternscited by 6
- 2024Overview of the 2024 ALTA Shared Task: Detect Automatic AI-Generated Sentences for Human-AI Hybrid Articlescited by 2
- 2023ARC-NLP at PAN 2023: Transition-Focused Natural Language Inference for Writing Style Detectioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.