mlsanityData to 7 Oct 2026

RETUYT-INCO at BEA 2026 Shared Task 2: Meta-prompting in Rubric-based Scoring for German

arXiv 2605.11242 ↗First posted 11 May 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we present the RETUYT-INCO participation at the BEA 2026 shared task "Rubric-based Short Answer Scoring for German". Our team participated in track 1 (Unseen answers three-way), track 3 (Unseen answers two-way) and track 4 (Unseen questions two-way). Since these tracks required scoring short student answers using specific rubrics, we looked for ways to handle the changing nature of the task. We created a method called Meta-prompting. In this approach, an LLM creates a custom prompt based on examples from the Train set. This prompt is then used to grade new student answers. Along with this method, we also describe other approaches we used, such as classic machine learning, fine-tuning open-source LLMs, and different prompting techniques. According to the official results, our team placed 6th out of 8 participants in Track 1 with a QWK of 0.729. In Track 3, we secured 4th place out of 9 with a QWK of 0.674, and we also placed 4th out of 8 in Track 4 with a QWK of 0.49.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 4 of its 17 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

4 of 17 references.

References · 4

  1. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  2. 2022Instruction Induction: From Few Examples to Natural Language Task Descriptionscited by 152
  3. 2025RETUYT-INCO at BEA 2025 Shared Task: How Far Can Lightweight Models Go in AI-powered Tutor Evaluation?cited by 2
  4. 2026Concept Tokens: Learning Behavioral Embeddings Through Concept Definitionscited by 1

Built on by

Not cited yet.