mlsanityData to 14 Oct 2026

Speaker attribution in German parliamentary debates with QLoRA-adapted large language models

arXiv 2309.09902 ↗First posted 18 Sep 2023cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

The growing body of political texts opens up new opportunities for rich insights into political dynamics and ideologies but also increases the workload for manual analysis. Automated speaker attribution, which detects who said what to whom in a speech event and is closely related to semantic role labeling, is an important processing step for computational text analysis. We study the potential of the large language model family Llama 2 to automate speaker attribution in German parliamentary debates from 2017-2021. We fine-tune Llama 2 with QLoRA, an efficient training strategy, and observe our approach to achieve competitive performance in the GermEval 2023 Shared Task On Speaker Attribution in German News Articles and Parliamentary Debates. Our results shed light on the capabilities of large language models in automating speaker attribution, revealing a promising avenue for computational analysis of political discourse and the development of semantic role labeling systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 18 Sep 2023.

Builds on

12 of 27 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  7. 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Promptingcited by 165
  8. 2019Simple BERT Models for Relation Extraction and Semantic Role Labelingcited by 154
  9. 2019Sentiment and position-taking analysis of parliamentary debates: A systematic literature reviewcited by 13
  10. 2021Diachronic Analysis of German Parliamentary Proceedings: Ideological Shifts through the Lens of Political Biasescited by 13
  11. 2022Polyglot Prompt: Multilingual Multitask PrompTrainingcited by 6
  12. 2022German Parliamentary Corpus (GerParCor)cited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.