Advancing Conversational AI with Shona Slang: A Dataset and Hybrid Model for Digital Inclusion
Not on the map. Why?
Abstract (arXiv)
African languages remain underrepresented in natural language processing (NLP), with most corpora limited to formal registers that fail to capture the vibrancy of everyday communication. This work addresses this gap for Shona, a Bantu language spoken in Zimbabwe and Zambia, by introducing a novel Shona--English slang dataset curated from anonymized social media conversations. The dataset is annotated for intent, sentiment, dialogue acts, code-mixing, and tone, and is publicly available at https://github.com/HappymoreMasoka/Workingwithshona-slang. We fine-tuned a multilingual DistilBERT classifier for intent recognition, achieving 96.4% accuracy and 96.3% F1-score, hosted at https://huggingface.co/HappymoreMasoka. This classifier is integrated into a hybrid chatbot that combines rule-based responses with retrieval-augmented generation (RAG) to handle domain-specific queries, demonstrated through a use case assisting prospective students with graduate program information at Pace University. Qualitative evaluation shows the hybrid system outperforms a RAG-only baseline in cultural relevance and user engagement. By releasing the dataset, model, and methodology, this work advances NLP resources for African languages, promoting inclusive and culturally resonant conversational AI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 17 references that are in the map. First posted on arXiv 10 Sep 2025.
Builds on
7 of 17 references.
References · 7
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Lexicon to AI: A Structured-Data Pipeline for Specialized Conversational Systems in Low-Resource Languages
- 2026dziribot: rag based intelligent conversational agent for algerian arabic dialect
- 2025AfriSpeech-MultiBench: A Verticalized Multidomain Multicountry Benchmark Suite for African Accented English ASR
- 2024HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings
- 2026Polite on the Surface, Broken in Practice: A Curated Dataset for Fixing Generation and Register Failures in Low-Resource Bangla Text Generation
- 2024IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Art
- 2024CamelEval: Advancing Culturally Aligned Arabic Language Models and Benchmarks