mlsanityData to 7 Oct 2026

Efficient Multilingual Dialogue Processing via Translation Pipelines and Distilled Language Models

arXiv 2601.09059 ↗First posted 14 Jan 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents team Kl33n3x's multilingual dialogue summarization and question answering system developed for the NLPAI4Health 2025 shared task. The approach employs a three-stage pipeline: forward translation from Indic languages to English, multitask text generation using a 2.55B parameter distilled language model, and reverse translation back to source languages. By leveraging knowledge distillation techniques, this work demonstrates that compact models can achieve highly competitive performance across nine languages. The system achieved strong win rates across the competition's tasks, with particularly robust performance on Marathi (86.7% QnA), Tamil (86.7% QnA), and Hindi (80.0% QnA), demonstrating the effectiveness of translation-based approaches for low-resource language processing without task-specific fine-tuning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 16 references that are in the map. First posted on arXiv 14 Jan 2026.

Builds on

13 of 16 references.

References · 13

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  9. 2020Knowledge Distillation: A Surveycited by 1,578
  10. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  11. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  12. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
1 more
  1. 2024Are Human Conversations Special? A Large Language Model Perspectivecited by 5

Built on by

Not cited yet.