{"total":297,"rows":[{"id":"2211.05100","title":"BLOOM: A 176B-Parameter Open-Access Multilingual Language Model","created":"2022-11-09","cited_by_count":1984,"area":null},{"id":"2303.12528","title":"MEGA: Multilingual Evaluation of Generative AI","created":"2023-03-22","cited_by_count":293,"area":null},{"id":"2305.15425","title":"Language Model Tokenizers Introduce Unfairness Between Languages","created":"2023-05-17","cited_by_count":214,"area":null},{"id":"2104.08671","title":"When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset","created":"2021-04-18","cited_by_count":201,"area":null},{"id":"2305.13707","title":"Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models","created":"2023-05-23","cited_by_count":192,"area":null},{"id":"2301.03988","title":"SantaCoder: don't reach for the stars!","created":"2023-01-09","cited_by_count":170,"area":null},{"id":"2205.06266","title":"Lifting the Curse of Multilinguality by Pre-training Modular Transformers","created":"2022-05-12","cited_by_count":146,"area":null},{"id":"2204.07580","title":"mGPT: Few-Shot Learners Go Multilingual","created":"2022-04-15","cited_by_count":142,"area":null},{"id":"2112.10508","title":"Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP","created":"2021-12-20","cited_by_count":132,"area":null},{"id":"2108.05542","title":"AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing","created":"2021-08-12","cited_by_count":131,"area":null},{"id":"2103.06678","title":"The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models","created":"2021-03-11","cited_by_count":119,"area":null},{"id":"2104.12250","title":"XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond","created":"2021-04-25","cited_by_count":114,"area":null},{"id":"2105.09680","title":"KLUE: Korean Language Understanding Evaluation","created":"2021-05-20","cited_by_count":114,"area":null},{"id":"2310.08754","title":"Tokenizer Choice For LLM Training: Negligible or Crucial?","created":"2023-10-12","cited_by_count":108,"area":null},{"id":"2112.06598","title":"WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models","created":"2021-12-13","cited_by_count":89,"area":null},{"id":"2301.10472","title":"XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models","created":"2023-01-25","cited_by_count":88,"area":null},{"id":"2407.04069","title":"A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations","created":"2024-07-04","cited_by_count":85,"area":null},{"id":"2404.00929","title":"A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias","created":"2024-04-01","cited_by_count":84,"area":null},{"id":"2109.06082","title":"xGQA: Cross-Lingual Visual Question Answering","created":"2021-09-13","cited_by_count":72,"area":null},{"id":"2504.02768","title":"MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs","created":"2025-04-03","cited_by_count":71,"area":null},{"id":"2402.01035","title":"Getting the most out of your tokenizer for pre-training and domain adaptation","created":"2024-02-01","cited_by_count":66,"area":null},{"id":"2104.08247","title":"What to Pre-Train on? Efficient Intermediate Task Selection","created":"2021-04-16","cited_by_count":63,"area":null},{"id":"2403.06265","title":"Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance","created":"2024-03-10","cited_by_count":61,"area":null},{"id":"2311.07463","title":"MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks","created":"2023-11-13","cited_by_count":57,"area":null},{"id":"2207.06991","title":"Language Modelling with Pixels","created":"2022-07-14","cited_by_count":55,"area":null},{"id":"2212.08045","title":"CLIPPO: Image-and-Language Understanding from Pixels Only","created":"2022-12-15","cited_by_count":55,"area":null},{"id":"2402.00786","title":"CroissantLLM: A Truly Bilingual French-English Language Model","created":"2024-02-01","cited_by_count":53,"area":null},{"id":"2305.16768","title":"Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Review","created":"2023-05-26","cited_by_count":50,"area":null},{"id":"2107.00676","title":"A Primer on Pretrained Multilingual Language Models","created":"2021-07-01","cited_by_count":49,"area":null},{"id":"2209.07562","title":"TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations at Twitter","created":"2022-09-15","cited_by_count":45,"area":null},{"id":"2307.09688","title":"Amazon-M2: A Multilingual Multi-locale Shopping Session Dataset for Recommendation and Text Generation","created":"2023-07-19","cited_by_count":42,"area":null},{"id":"2206.02608","title":"What do tokens know about their characters and how do they know it?","created":"2022-06-06","cited_by_count":36,"area":null},{"id":"2305.11242","title":"Comparing Biases and the Impact of Multilingual Training across Multiple Languages","created":"2023-05-18","cited_by_count":36,"area":null},{"id":"2308.15419","title":"Characterizing Learning Curves During Language Model Pre-Training: Learning, Forgetting, and Stability","created":"2023-08-29","cited_by_count":35,"area":null},{"id":"2311.09205","title":"When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages","created":"2023-11-15","cited_by_count":32,"area":null},{"id":"2403.00025","title":"On the Challenges and Opportunities in Generative AI","created":"2024-02-28","cited_by_count":31,"area":null},{"id":"2405.07883","title":"Zero-Shot Tokenizer Transfer","created":"2024-05-13","cited_by_count":31,"area":null},{"id":"2407.08818","title":"MAGNET: Improving the Multilingual Fairness of Language Models with Adaptive Gradient-Based Tokenization","created":"2024-07-11","cited_by_count":31,"area":null},{"id":"2310.13348","title":"Analyzing Cognitive Plausibility of Subword Tokenization","created":"2023-10-20","cited_by_count":30,"area":null},{"id":"2206.09755","title":"Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold","created":"2022-06-20","cited_by_count":29,"area":null},{"id":"2408.10441","title":"Goldfish: Monolingual Language Models for 350 Languages","created":"2024-08-19","cited_by_count":29,"area":null},{"id":"2502.14830","title":"Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs","created":"2025-02-20","cited_by_count":29,"area":null},{"id":"2311.05741","title":"Efficiently Adapting Pretrained Language Models To New Languages","created":"2023-11-09","cited_by_count":28,"area":null},{"id":"2203.01976","title":"Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languages","created":"2022-03-03","cited_by_count":25,"area":null},{"id":"2308.11878","title":"Cabrita: closing the gap for foreign languages","created":"2023-08-23","cited_by_count":25,"area":null},{"id":"2502.00894","title":"MorphBPE: A Morpho-Aware Tokenizer Bridging Linguistic Complexity for Efficient LLM Training Across Morphologies","created":"2025-02-02","cited_by_count":25,"area":null},{"id":"2212.10503","title":"Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training","created":"2022-12-20","cited_by_count":24,"area":null},{"id":"2312.05976","title":"A Representative Study on Human Detection of Artificially Generated Media Across Countries","created":"2023-12-10","cited_by_count":22,"area":null},{"id":"2406.11477","title":"How Can We Effectively Expand the Vocabulary of LLMs with 0.01GB of Target Language Text?","created":"2024-06-17","cited_by_count":22,"area":null},{"id":"2406.14670","title":"Exploring Design Choices for Building Language-Specific LLMs","created":"2024-06-20","cited_by_count":22,"area":null},{"id":"2507.06378","title":"Evaluating Morphological Alignment of Tokenizers in 70 Languages","created":"2025-07-08","cited_by_count":22,"area":null},{"id":"2106.09063","title":"Specializing Multilingual Language Models: An Empirical Study","created":"2021-06-16","cited_by_count":21,"area":null},{"id":"2210.15461","title":"LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation","created":"2022-10-19","cited_by_count":21,"area":null},{"id":"2304.08865","title":"Romanization-based Large-scale Adaptation of Multilingual Language Models","created":"2023-04-18","cited_by_count":21,"area":null},{"id":"2203.03759","title":"IT5: Text-to-text Pretraining for Italian Language Understanding and Generation","created":"2022-03-07","cited_by_count":20,"area":null},{"id":"2204.14268","title":"How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training?","created":"2022-04-29","cited_by_count":20,"area":null},{"id":"2205.06130","title":"Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models","created":"2022-05-12","cited_by_count":20,"area":null},{"id":"2306.09572","title":"How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese","created":"2023-06-16","cited_by_count":20,"area":null},{"id":"2409.11501","title":"Egalitarian Language Representation in Language Models: It All Begins with Tokenizers","created":"2024-09-17","cited_by_count":20,"area":null},{"id":"2508.04796","title":"Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization","created":"2025-08-06","cited_by_count":20,"area":null},{"id":"2108.08688","title":"Contrastive Language-Image Pre-training for the Italian Language","created":"2021-08-19","cited_by_count":19,"area":null},{"id":"2402.10712","title":"An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model Inference","created":"2024-02-16","cited_by_count":18,"area":null},{"id":"2404.01856","title":"Poro 34B and the Blessing of Multilinguality","created":"2024-04-02","cited_by_count":18,"area":null},{"id":"2104.08570","title":"Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems","created":"2021-04-17","cited_by_count":17,"area":null},{"id":"2305.18893","title":"Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentation","created":"2023-05-30","cited_by_count":17,"area":null},{"id":"2107.11353","title":"Modelling Latent Translations for Cross-Lingual Transfer","created":"2021-07-23","cited_by_count":16,"area":null},{"id":"2208.07864","title":"BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification","created":"2022-08-16","cited_by_count":16,"area":null},{"id":"2307.14031","title":"Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems","created":"2023-07-26","cited_by_count":16,"area":null},{"id":"2312.11779","title":"Tokenization Matters: Navigating Data-Scarce Tokenization for Gender Inclusive Language Technologies","created":"2023-12-19","cited_by_count":16,"area":null},{"id":"2411.18553","title":"Retrofitting Large Language Models with Dynamic Tokenization","created":"2024-11-27","cited_by_count":16,"area":null},{"id":"2304.11434","title":"L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERT","created":"2023-04-22","cited_by_count":15,"area":null},{"id":"2411.05049","title":"ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding","created":"2024-11-07","cited_by_count":15,"area":null},{"id":"2502.20273","title":"How Much is Enough? The Diminishing Returns of Tokenization Training Data","created":"2025-02-27","cited_by_count":15,"area":null},{"id":"2109.07348","title":"Cross-lingual Transfer of Monolingual Models","created":"2021-09-15","cited_by_count":14,"area":null},{"id":"2201.12501","title":"Does Transliteration Help Multilingual Language Modeling?","created":"2022-01-29","cited_by_count":14,"area":null},{"id":"2205.10517","title":"Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese","created":"2022-05-21","cited_by_count":14,"area":null},{"id":"2208.04826","title":"Compositional Evaluation on Japanese Textual Entailment and Similarity","created":"2022-08-09","cited_by_count":14,"area":null},{"id":"2509.05486","title":"The Token Tax: Systematic Bias in Multilingual Tokenization","created":"2025-09-05","cited_by_count":14,"area":null},{"id":"2106.02834","title":"MergeDistill: Merging Pre-trained Language Models using Distillation","created":"2021-06-05","cited_by_count":13,"area":null},{"id":"2401.02709","title":"German Text Embedding Clustering Benchmark","created":"2024-01-05","cited_by_count":13,"area":null},{"id":"2401.14373","title":"TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generation","created":"2024-01-25","cited_by_count":13,"area":null},{"id":"2502.15343","title":"Tokenization is Sensitive to Language Variation","created":"2025-02-21","cited_by_count":13,"area":null},{"id":"2107.12930","title":"gaBERT -- an Irish Language Model","created":"2021-07-27","cited_by_count":12,"area":null},{"id":"2109.04556","title":"Subword Mapping and Anchoring across Languages","created":"2021-09-09","cited_by_count":12,"area":null},{"id":"2111.09618","title":"To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLP","created":"2021-11-18","cited_by_count":12,"area":null},{"id":"2204.09391","title":"You Are What You Write: Preserving Privacy in the Era of Large Language Models","created":"2022-04-20","cited_by_count":12,"area":null},{"id":"2210.07111","title":"A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models","created":"2022-10-13","cited_by_count":12,"area":null},{"id":"2407.05022","title":"A Principled Framework for Evaluating on Typologically Diverse Languages","created":"2024-07-06","cited_by_count":12,"area":null},{"id":"2210.07095","title":"Incorporating Context into Subword Vocabularies","created":"2022-10-13","cited_by_count":11,"area":null},{"id":"2311.11973","title":"Adaptive Training Distributions with Scalable Online Bilevel Optimization","created":"2023-11-20","cited_by_count":11,"area":null},{"id":"2506.03101","title":"Beyond Text Compression: Evaluating Tokenizers Across Scales","created":"2025-06-03","cited_by_count":11,"area":null},{"id":"2509.18750","title":"False Friends Are Not Foes: Investigating Vocabulary Overlap in Multilingual Language Models","created":"2025-09-23","cited_by_count":11,"area":null},{"id":"2601.07220","title":"The Roots of Performance Disparity in Multilingual Language Models: Intrinsic Modeling Difficulty or Design Choices?","created":"2026-01-12","cited_by_count":11,"area":null},{"id":"2108.12465","title":"Code-switched inspired losses for generic spoken dialog representations","created":"2021-08-27","cited_by_count":10,"area":null},{"id":"2203.02092","title":"Deep Lexical Hypothesis: Identifying personality structure in natural language","created":"2022-03-04","cited_by_count":10,"area":null},{"id":"2205.06356","title":"Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages","created":"2022-05-12","cited_by_count":10,"area":null},{"id":"2212.10879","title":"Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?","created":"2022-12-21","cited_by_count":10,"area":null},{"id":"2303.08179","title":"MEDBERT.de: A Comprehensive German BERT Model for the Medical Domain","created":"2023-03-14","cited_by_count":10,"area":null},{"id":"2406.19223","title":"T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings","created":"2024-06-27","cited_by_count":10,"area":null},{"id":"2504.06011","title":"Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindi","created":"2025-04-08","cited_by_count":10,"area":null}],"next_cursor":"100"}