mlsanityData to 14 Oct 2026

Beyond Clean Text: Evaluating Encoder and Decoder Robustness for Bangla Event Detection in Noisy Text

arXiv 2606.30914 ↗First posted 29 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Event detection (ED) systems are typically evaluated on clean, curated text, leaving their robustness to real-world noise largely unexplored, particularly for low-resource languages such as Bangla. We introduce a generalized Bangla news event ontology and a benchmark comprising 9,979 annotated sentences across 40 event subtypes, spanning clean news text, real-world Automatic Speech Recognition (ASR) transcripts, and orthographically corrupted text. We systematically evaluate fine-tuned encoder-only models (BanglaBERT and XLM-R) alongside instruction-tuned decoder-only large language models (Llama 3 and Gemma 3). Our results reveal a clear architectural trade-off: encoder models achieve higher performance on clean text but degrade substantially under noise, whereas decoder-only LLMs are markedly more robust, particularly when event triggers are corrupted. We further show that embedding annotation guidelines during instruction tuning establishes a higher performance baseline on noisy text but yields inconsistent reductions in performance degradation across noisy conditions. Finally, model scaling consistently improves the robustness of decoder-only LLMs, while combined training on clean and noisy data serves as an effective regularization strategy that disproportionately benefits encoder architectures, significantly narrowing the robustness gap.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 39 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

18 of 39 references.

References · 18

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 125
  5. 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 119
  6. 2020MAVEN: A Massive General Domain Event Detection Datasetcited by 104
  7. 2019Multi-Sentence Argument Linkingcited by 81
  8. 2022Code4Struct: Code Generation for Few-Shot Event Structure Predictioncited by 70
  9. 2021Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processingcited by 68
  10. 2017A Network Perspective on Stratification of Multi-Label Datacited by 37
  11. 2022LEVEN: A Large-Scale Chinese Legal Event Detection Datasetcited by 36
  12. 2023Guideline Learning for In-context Information Extractioncited by 24
6 more
  1. 2025Instruction-Tuning LLMs for Event Extraction with Annotation Guidelinescited by 18
  2. 2024Explicit, Implicit, and Scattered: Revisiting Event Extraction to Capture Complex Argumentscited by 9
  3. 2022MINION: a Large-Scale and Diverse Dataset for Multilingual Event Detectioncited by 8
  4. 2020Synthetic Error Dataset Generation Mimicking Bengali Writing Patterncited by 4
  5. 2024A Comparative Analysis of Noise Reduction Methods in Sentiment Analysis on Noisy Bangla Textscited by 3
  6. 2026Event Detection with a Context-Aware Encoder and LoRA for Improved Performance on Long-Tailed Classescited by 1

Built on by

Not cited yet.