mlsanityData to 13 Oct 2026

Multiperspectivity as a Resource for Narrative Similarity Prediction

arXiv 2603.22103 ↗First posted 23 Mar 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Predicting narrative similarity can be understood as an inherently interpretive task: different, equally valid readings of the same text can produce divergent interpretations and thus different similarity judgments, posing a fundamental challenge for semantic evaluation benchmarks that encode a single ground truth. Rather than treating this multiperspectivity as a challenge to overcome, we propose to incorporate it in the decision making process of predictive systems. To explore this strategy, we created an ensemble of 31 LLM personas. These range from practitioners following interpretive frameworks to more intuitive, lay-style characters. Our experiments were conducted on the SemEval-2026 Task 4 dataset, where the system achieved an accuracy score of 0.705. Accuracy improves with ensemble size, consistent with Condorcet Jury Theorem-like dynamics under weakened independence. Practitioner personas perform worse individually but produce less correlated errors, yielding larger ensemble gains under majority voting. Our error analysis reveals a consistent negative association between gender-focused interpretive vocabulary and accuracy across all persona categories, suggesting either attention to dimensions not relevant for the benchmark or valid interpretations absent from the ground truth. This finding underscores the need for evaluation frameworks that account for interpretive plurality.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 11 of its 28 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

11 of 28 references.

References · 11

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,831
  2. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,001
  3. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 960
  4. 2025Voting or Consensus? Decision-Making in Multi-Agent Debatecited by 58
  5. 2024LLM-TOPLA: Efficient LLM Ensemble by Maximising Diversitycited by 42
  6. 2025Debate-to-Detect: Reformulating Misinformation Detection as a Real-World Debate with Large Language Modelscited by 12
  7. 2025DEBATE, TRAIN, EVOLVE: Self Evolution of Language Model Reasoningcited by 6
  8. 2024Check News in One Click: NLP-Empowered Pro-Kremlin Propaganda Detectioncited by 5
  9. 2024Examining Independence in Ensemble Sentiment Analysis: A Study on the Limits of Large Language Models Using the Condorcet Jury Theoremcited by 4
  10. 2020Majority Voting and the Condorcet's Jury Theoremcited by 3
  11. 2023FaNS: a Facet-based Narrative Similarity Metriccited by 3

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.