Shaping the Future of Endangered and Low-Resource Languages -- Our Role in the Age of LLMs: A Keynote at ECIR 2024
Not on the map. Why?
Abstract (arXiv)
Isidore of Seville is credited with the adage that it is language that gives birth to a people, and not the other way around , underlining the profound role played by language in the formation of cultural and social identity. Today, of the more than 7100 languages listed, a significant number are endangered. Since the 1970s, linguists, information seekers and enthusiasts have helped develop digital resources and automatic tools to support a wide range of languages, including endangered ones. The advent of Large Language Model (LLM) technologies holds both promise and peril. They offer unprecedented possibilities for the translation and generation of content and resources, key elements in the preservation and revitalisation of languages. They also present threat of homogenisation, cultural oversimplification and the further marginalisation of already vulnerable languages. The talk this paper is based on has proposed an initiatory journey, exploring the potential paths and partnerships between technology and tradition, with a particular focus on the Occitan language. Occitan is a language from Southern France, parts of Spain and Italy that played a major cultural and economic role, particularly in the Middle Ages. It is now endangered according to UNESCO. The talk critically has examined how human expertise and artificial intelligence can work together to offer hope for preserving the linguistic diversity that forms the foundation of our global and especially our European heritage while addressing some of the ethical and practical challenges that accompany the use of these powerful technologies. This paper is based on the keynote I gave at the 46th European Conference on Information Retrieval (ECIR 2024). As an alternative to reading this paper, a video talk is available online. 1 Date: 26 March 2024.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 5 Sep 2024.
Builds on
20 of 38 references.
References · 20
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,338
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 643
- 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
- 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
- 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
8 more
- 2016Transfer Learning for Low-Resource Neural Machine Translationcited by 188
- 2013Exploiting Similarities among Languages for Machine Translationcited by 187
- 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
- 2017A Survey Of Cross-lingual Word Embedding Modelscited by 142
- 2024Teaching Large Language Models an Unseen Language on the Flycited by 29
- 2022Not always about you: Prioritizing community needs when developing endangered language technologycited by 21
- 2024Overview of the TREC 2023 NeuCLIR Trackcited by 17
- 2023Selective Query Processing: a Risk-Sensitive Selection of System Configurationscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.