Amplify Initiative: Building A Localized Data Platform for Globalized AI
Not on the map. Why?
Abstract (arXiv)
Current AI models often fail to account for local context and language, given the predominance of English and Western internet content in their training data. This hinders the global relevance, usefulness, and safety of these models as they gain more users around the globe. Amplify Initiative, a data platform and methodology, leverages expert communities to collect diverse, high-quality data to address the limitations of these models. The platform is designed to enable co-creation of datasets, provide access to high-quality multilingual datasets, and offer recognition to data authors. This paper presents the approach to co-creating datasets with domain experts (e.g., health workers, teachers) through a pilot conducted in Sub-Saharan Africa (Ghana, Kenya, Malawi, Nigeria, and Uganda). In partnership with local researchers situated in these countries, the pilot demonstrated an end-to-end approach to co-creating data with 155 experts in sensitive domains (e.g., physicians, bankers, anthropologists, human and civil rights advocates). This approach, implemented with an Android app, resulted in an annotated dataset of 8,091 adversarial queries in seven languages (e.g., Luganda, Swahili, Chichewa), capturing nuanced and contextual information related to key themes such as misinformation and public interest topics. This dataset in turn can be used to evaluate models for their safety and cultural relevance within the context of these languages.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 18 Apr 2025.
Builds on
17 of 35 references.
References · 17
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
- 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
- 2021Machine Translationese: Effects of Algorithmic Bias on Linguistic Complexity in Machine Translationcited by 70
- 2025Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languagescited by 59
- 2025Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMscited by 54
- 2022Towards Afrocentric NLP for African Languages: Where We Are and Where We Can Gocited by 47
- 2023AfroBench: How Good are Large Language Models on African Languages?cited by 43
5 more
- 2024Do Large Language Models Have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMscited by 19
- 2025Risks of Cultural Erasure in Large Language Modelscited by 9
- 2024EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluationcited by 8
- 2024Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and Englishcited by 8
- 2024Uhura: A Benchmark for Evaluating Scientific Question Answering and Truthfulness in Low-Resource African Languagescited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.