mlsanityData to 7 Oct 2026

Towards Global AI Inclusivity: A Large-Scale Multilingual Terminology Dataset (GIST)

arXiv 2412.18367 ↗First posted 24 Dec 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

The field of machine translation has achieved significant advancements, yet domain-specific terminology translation, particularly in AI, remains challenging. We introduce GIST, a large-scale multilingual AI terminology dataset containing 5K terms extracted from top AI conference papers spanning 2000 to 2023. The terms are translated into Arabic, Chinese, French, Japanese, and Russian using a hybrid framework that combines LLMs for extraction with human expertise for translation. The dataset's quality is benchmarked against existing resources, demonstrating superior translation accuracy through crowdsourced evaluation. GIST is integrated into translation workflows using post-translation refinement methods that require no retraining, where LLM prompting consistently improves BLEU and COMET scores. A web demonstration on the ACL Anthology platform highlights its practical application, showcasing improved accessibility for non-English speakers. This work aims to address critical gaps in AI terminology resources and fosters global inclusivity and collaboration in AI research. Our data is at https://huggingface.co/datasets/Jerry999/multilingual-terminology

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 106 references that are in the map. First posted on arXiv 24 Dec 2024.

Builds on

35 of 106 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  5. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  6. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  7. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  8. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  9. 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 333
  10. 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
  11. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
  12. 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 190
23 more
  1. 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
  2. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  3. 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 181
  4. 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 108
  5. 2016Guided Open Vocabulary Image Captioning with Constrained Beam Searchcited by 105
  6. 2021Survey of Low-Resource Machine Translationcited by 92
  7. 2019Training Neural Machine Translation To Apply Terminology Constraintscited by 73
  8. 2018Neural Machine Translation Decoding with Terminology Constraintscited by 36
  9. 2020Accurate Word Alignment Induction from Neural Machine Translationcited by 32
  10. 2019Adding Interpretable Attention to Neural Translation Models Improves Word Alignmentcited by 30
  11. 2024How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMscited by 23
  12. 2024Towards Cross-Cultural Machine Translation with Retrieval-Augmented Generation from Multilingual Knowledge Graphscited by 21
  13. 2023Domain Terminology Integration into Machine Translation: Leveraging Large Language Modelscited by 17
  14. 2020Data Augmentation and Terminology Integration for Domain-Specific Sinhala-English-Tamil Statistical Machine Translationcited by 16
  15. 2024Large Language Models for Scientific Information Extraction: An Empirical Study for Virologycited by 12
  16. 2021Continuous Learning in Neural Machine Translation using Bilingual Dictionariescited by 11
  17. 2024Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Levelcited by 11
  18. 2024Automatic Generation of Model and Data Cards: A Step Towards Responsible AIcited by 9
  19. 2023Terminology-Aware Translation with Constrained Decoding and Large Language Model Promptingcited by 8
  20. 2023Voices of Her: Analyzing Gender Differences in the AI Publication Worldcited by 3
  21. 2024KpopMT: Translation Dataset with Terminology for Kpop Fandomcited by 2
  22. 2024Extraction of Research Objectives, Machine Learning Model Names, and Dataset Names from Academic Papers and Analysis of Their Interrelationships Using LLM and Network Analysiscited by 2
  23. 2024On Translating Technical Terminology: A Translation Workflow for Machine-Translated Acronymscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Locate-and-Focus: Enhancing Terminology Translation in Speech Language Modelscited by 3