A Benchmark for Bangla Task-Oriented Dialogue Understanding
Not on the map. Why?
Abstract (arXiv)
Task-oriented dialogue understanding remains underexplored for Bangla, particularly in multilingual settings involving English and romanized Bangla (Banglish). We introduce BanglaTOD, a parallel tri-lingual benchmark comprising 209 multi-turn dialogues across nine Bangladesh-specific service domains and 64 intents. Each conversational turn is aligned across Bangla, English, and Banglish, yielding 4,689 language-specific turn records annotated with intents, token-level slots, state updates, and accumulated dialogue states. We establish context-aware baselines for joint intent classification and slot filling using mBERT, BERT-base-uncased, and BanglaBERT. Cross-language analysis reveals substantial performance differences across models and linguistic representations, while removing dialogue history reduces intent accuracy by 19.0--25.7 percentage points. BanglaTOD provides a foundation for multilingual dialogue understanding and future dialogue state tracking research in Bangladesh-specific conversational applications. The dataset is publicly available at hrefhttps://huggingface.co/datasets/afri7here/BanglaTODHugging Face.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
16 of 23 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 434
- 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 318
- 2020Are All Languages Created Equal in Multilingual BERT?cited by 207
- 2019BERT for Joint Intent Classification and Slot Fillingcited by 196
- 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 158
- 2018Cross-Lingual Transfer Learning for Multilingual Task Oriented Dialogcited by 125
- 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 125
- 2020End-to-End Slot Alignment and Recognition for Cross-Lingual NLUcited by 83
- 2022BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Banglacited by 42
- 2021GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systemscited by 31
4 more
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysiscited by 10
- 2021End-to-End Natural Language Understanding Pipeline for Bangla Conversational Agentscited by 2
- 2026Leveraging Code-Mixed Product Metadata and User Feedback for Personalized Recommendation on Daraz Bangladeshcited by 1
- 2026Constraint-Aware Conversational Job Recommendation in Code-Mixed Low-Resource Settingscited by 1
Built on by
Not cited yet.