mlsanityData to 7 Oct 2026

SG-UniBuc-NLP at SemEval-2026 Task 6: Multi-Head RoBERTa with Chunking for Long-Context Evasion Detection

arXiv 2604.26375 ↗First posted 29 Apr 2026cs.CL cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We describe our system for SemEval-2026 Task 6 (CLARITY: Unmasking Political Question Evasions), which classifies English political interview responses by coarse-grained clarity (3-way) and fine-grained evasion strategy (9-way). Since responses frequently exceed the 512-token limit of standard Transformer encoders, we apply an overlapping sliding-window chunking strategy with element-wise Max-Pooling aggregation over chunk representations. A shared RoBERTa-large encoder supplies two task-specific heads trained jointly via a multi-task objective, with inference-time ensembling over 7-fold stratified cross-validation. Our system achieves a Macro-F1 of 0.80 on Subtask 1 and 0.51 on Subtask 2, ranking 11th in both subtasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 29 Apr 2026.

Builds on

12 of 22 references.

References · 12

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  4. 2020Longformer: The Long-Document Transformercited by 3,362
  5. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  6. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
  7. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  8. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
  9. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
  10. 2019Hierarchical Transformers for Long Document Classificationcited by 103
  11. 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
  12. 2026SemEval-2026 Task 6: CLARITY -- Unmasking Political Question Evasionscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.