{"list":"other","total":101,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2104.09864","title":"RoFormer: Enhanced Transformer with Rotary Position Embedding","created":"2021-04-20","cited_by_count":4703},{"id":"1911.02116","title":"Unsupervised Cross-lingual Representation Learning at Scale","created":"2019-11-05","cited_by_count":3935},{"id":"1508.07909","title":"Neural Machine Translation of Rare Words with Subword Units","created":"2015-08-31","cited_by_count":2918},{"id":"1803.02155","title":"Self-Attention with Relative Position Representations","created":"2018-03-06","cited_by_count":1120},{"id":"2108.12409","title":"Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation","created":"2021-08-27","cited_by_count":1103},{"id":"2004.09095","title":"The State and Fate of Linguistic Diversity and Inclusion in the NLP World","created":"2020-04-20","cited_by_count":798},{"id":"1906.01502","title":"How multilingual is Multilingual BERT?","created":"2019-06-04","cited_by_count":645},{"id":"2105.13626","title":"ByT5: Towards a token-free future with pre-trained byte-to-byte models","created":"2021-05-28","cited_by_count":509},{"id":"2012.15613","title":"How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models","created":"2020-12-31","cited_by_count":318},{"id":"2004.10643","title":"Universal Dependencies v2: An Evergrowing Multilingual Treebank Collection","created":"2020-04-22","cited_by_count":271},{"id":"2103.06874","title":"CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation","created":"2021-03-11","cited_by_count":232},{"id":"2305.15425","title":"Language Model Tokenizers Introduce Unfairness Between Languages","created":"2023-05-17","cited_by_count":214},{"id":"1803.11138","title":"Colorless green recurrent networks dream hierarchically","created":"2018-03-29","cited_by_count":213},{"id":"2004.03720","title":"Byte Pair Encoding is Suboptimal for Language Model Pretraining","created":"2020-04-07","cited_by_count":192},{"id":"2305.13707","title":"Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models","created":"2023-05-23","cited_by_count":192},{"id":"1912.07840","title":"Cross-Lingual Ability of Multilingual BERT: An Empirical Study","created":"2019-12-17","cited_by_count":182},{"id":"1911.01464","title":"Emerging Cross-lingual Structure in Pretrained Language Models","created":"2019-11-04","cited_by_count":181},{"id":"2304.09151","title":"UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining","created":"2023-04-18","cited_by_count":151},{"id":"2205.06266","title":"Lifting the Curse of Multilinguality by Pre-training Modular Transformers","created":"2022-05-12","cited_by_count":146},{"id":"2412.09871","title":"Byte Latent Transformer: Patches Scale Better Than Tokens","created":"2024-12-13","cited_by_count":146},{"id":"1905.12688","title":"Choosing Transfer Languages for Cross-Lingual Learning","created":"2019-05-29","cited_by_count":144},{"id":"2010.12858","title":"When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models","created":"2020-10-24","cited_by_count":131},{"id":"2305.12182","title":"Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages","created":"2023-05-20","cited_by_count":116},{"id":"2012.15562","title":"UNKs Everywhere: Adapting Multilingual Language Models to New Scripts","created":"2020-12-31","cited_by_count":113},{"id":"2102.11090","title":"Position Information in Transformers: An Overview","created":"2021-02-22","cited_by_count":103},{"id":"2210.15424","title":"What Language Model to Train if You Have One Million GPU Hours?","created":"2022-10-27","cited_by_count":92},{"id":"2402.18376","title":"Tokenization Is More Than Compression","created":"2024-02-28","cited_by_count":89},{"id":"2210.14199","title":"Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models","created":"2022-10-25","cited_by_count":84},{"id":"2106.00085","title":"Language Model Evaluation Beyond Perplexity","created":"2021-05-31","cited_by_count":78},{"id":"2307.03667","title":"Testing the Predictions of Surprisal Theory in 11 Languages","created":"2023-07-07","cited_by_count":77},{"id":"1804.08199","title":"Linguistically-Informed Self-Attention for Semantic Role Labeling","created":"2018-04-23","cited_by_count":71},{"id":"2410.23771","title":"What is Wrong with Perplexity for Long-context Language Modeling?","created":"2024-10-31","cited_by_count":69},{"id":"2109.11635","title":"Revisiting the Uniform Information Density Hypothesis","created":"2021-09-23","cited_by_count":68},{"id":"2402.01035","title":"Getting the most out of your tokenizer for pre-training and domain adaptation","created":"2024-02-01","cited_by_count":66},{"id":"1807.00914","title":"Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing","created":"2018-07-02","cited_by_count":63},{"id":"2503.13423","title":"SuperBPE: Space Travel for Language Models","created":"2025-03-17","cited_by_count":63},{"id":"2305.17179","title":"Tokenization Impacts Multilingual Language Modeling: Assessing Vocabulary Allocation and Overlap Across Languages","created":"2023-05-26","cited_by_count":62},{"id":"2411.14198","title":"Why do language models perform worse for morphologically complex languages?","created":"2024-11-21","cited_by_count":62},{"id":"2403.06265","title":"Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance","created":"2024-03-10","cited_by_count":61},{"id":"2105.06965","title":"Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction","created":"2021-05-14","cited_by_count":59},{"id":"2005.00187","title":"Cross-Linguistic Syntactic Evaluation of Word Prediction Models","created":"2020-05-01","cited_by_count":55},{"id":"2012.05628","title":"As Good as New. How to Successfully Recycle English GPT-2 to Make Models for Other Languages","created":"2020-12-10","cited_by_count":54},{"id":"1806.03743","title":"Are All Languages Equally Hard to Language-Model?","created":"2018-06-10","cited_by_count":53},{"id":"1906.04726","title":"What Kind of Language Is Hard to Language-Model?","created":"2019-06-11","cited_by_count":50},{"id":"2004.00798","title":"Mapping Languages: The Corpus of Global Language Use","created":"2020-04-02","cited_by_count":42},{"id":"2101.11043","title":"Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT","created":"2021-01-26","cited_by_count":41},{"id":"1706.09031","title":"CoNLL-SIGMORPHON 2017 Shared Task: Universal Morphological Reinflection in 52 Languages","created":"2017-06-27","cited_by_count":40},{"id":"2403.10691","title":"MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling","created":"2024-03-15","cited_by_count":40},{"id":"2412.10271","title":"Benchmarking Linguistic Diversity of Large Language Models","created":"2024-12-13","cited_by_count":38},{"id":"2012.06262","title":"Morphology Matters: A Multilingual Language Modeling Analysis","created":"2020-12-11","cited_by_count":37},{"id":"2306.16837","title":"A Formal Perspective on Byte-Pair Encoding","created":"2023-06-29","cited_by_count":36},{"id":"2007.01176","title":"Processing South Asian Languages Written in the Latin Script: the Dakshina Dataset","created":"2020-07-02","cited_by_count":35},{"id":"2407.08818","title":"MAGNET: Improving the Multilingual Fairness of Language Models with Adaptive Gradient-Based Tokenization","created":"2024-07-11","cited_by_count":31},{"id":"2104.05433","title":"Multilingual Language Models Predict Human Reading Behavior","created":"2021-04-12","cited_by_count":29},{"id":"2205.04086","title":"A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank","created":"2022-05-09","cited_by_count":29},{"id":"2507.00885","title":"Scaling Laws Are Unreliable for Downstream Tasks: A Reality Check","created":"2025-07-01","cited_by_count":29},{"id":"1508.02096","title":"Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation","created":"2015-08-09","cited_by_count":28},{"id":"2011.02070","title":"Probing Multilingual BERT for Genetic and Typological Signals","created":"2020-11-04","cited_by_count":27},{"id":"2403.00686","title":"A Bit of a Problem: Measurement Disparities in Dataset Sizes Across Languages","created":"2024-03-01","cited_by_count":25},{"id":"2502.00894","title":"MorphBPE: A Morpho-Aware Tokenizer Bridging Linguistic Complexity for Efficient LLM Training Across Morphologies","created":"2025-02-02","cited_by_count":25},{"id":"2109.15000","title":"A surprisal--duration trade-off across and within the world's languages","created":"2021-09-30","cited_by_count":23},{"id":"2410.12883","title":"Scaling Laws for Multilingual Language Models","created":"2024-10-15","cited_by_count":23},{"id":"2409.11501","title":"Egalitarian Language Representation in Language Models: It All Begins with Tokenizers","created":"2024-09-17","cited_by_count":20},{"id":"2508.04796","title":"Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization","created":"2025-08-06","cited_by_count":20},{"id":"2101.09469","title":"Training Multilingual Pre-trained Language Model with Byte-level Subwords","created":"2021-01-23","cited_by_count":16},{"id":"2103.11189","title":"The Effectiveness of Morphology-aware Segmentation in Low-Resource Neural Machine Translation","created":"2021-03-20","cited_by_count":16},{"id":"2309.13320","title":"GlotScript: A Resource and Tool for Low Resource Writing System Identification","created":"2023-09-23","cited_by_count":15},{"id":"2203.08954","title":"BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages","created":"2022-03-16","cited_by_count":14},{"id":"2410.11627","title":"Tokenization and Morphology in Multilingual Language Models: A Comparative Analysis of mT5 and ByT5","created":"2024-10-15","cited_by_count":14},{"id":"2509.05486","title":"The Token Tax: Systematic Bias in Multilingual Tokenization","created":"2025-09-05","cited_by_count":14},{"id":"2301.13083","title":"Communication Drives the Emergence of Language Universals in Neural Agents: Evidence from the Word-order/Case-marking Trade-off","created":"2023-01-30","cited_by_count":12},{"id":"2505.24689","title":"BPE Stays on SCRIPT: Structured Encoding for Robust Multilingual Pretokenization","created":"2025-05-30","cited_by_count":12},{"id":"1405.4273","title":"Compositional Morphology for Word Representations and Language Modelling","created":"2014-05-16","cited_by_count":11},{"id":"2212.01757","title":"Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer","created":"2022-12-04","cited_by_count":11},{"id":"2402.12363","title":"Emergent Word Order Universals from Cognitively-Motivated Language Models","created":"2024-02-19","cited_by_count":11},{"id":"2509.18750","title":"False Friends Are Not Foes: Investigating Vocabulary Overlap in Multilingual Language Models","created":"2025-09-23","cited_by_count":11},{"id":"2501.14491","title":"Analyzing the Effect of Linguistic Similarity on Cross-Lingual Transfer: Tasks and Experimental Setups Matter","created":"2025-01-24","cited_by_count":10},{"id":"2509.20045","title":"Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Tasks","created":"2025-09-24","cited_by_count":9},{"id":"2307.04626","title":"Measuring Lexical Diversity in Texts: The Twofold Length Problem","created":"2023-07-10","cited_by_count":8},{"id":"2401.10660","title":"Accelerating Multilingual Language Model for Excessively Tokenized Languages","created":"2024-01-19","cited_by_count":8},{"id":"2510.09555","title":"A Comprehensive Evaluation of Multilingual Chain-of-Thought Reasoning: Performance, Consistency, and Faithfulness Across Languages","created":"2025-10-10","cited_by_count":8},{"id":"2307.13405","title":"Towards Bridging the Digital Language Divide","created":"2023-07-25","cited_by_count":7},{"id":"2410.23684","title":"Improbable Bigrams Expose Vulnerabilities of Incomplete Tokens in Byte-Level Tokenizers","created":"2024-10-31","cited_by_count":7},{"id":"2410.24140","title":"Don't Touch My Diacritics","created":"2024-10-31","cited_by_count":7},{"id":"2510.21909","title":"Explaining and Mitigating Crosslingual Tokenizer Inequities","created":"2025-10-24","cited_by_count":7},{"id":"2004.00809","title":"Mapping Languages and Demographics with Georeferenced Corpora","created":"2020-04-02","cited_by_count":6},{"id":"2404.08191","title":"Measuring Cross-lingual Transfer in Bytes","created":"2024-04-12","cited_by_count":6},{"id":"2503.14433","title":"Splintering Nonconcatenative Languages for Better Tokenization","created":"2025-03-18","cited_by_count":6},{"id":"2109.05388","title":"The Impact of Positional Encodings on Multilingual Compression","created":"2021-09-11","cited_by_count":5},{"id":"2403.11130","title":"Exploring Tokenization Strategies and Vocabulary Sizes for Enhanced Arabic Language Models","created":"2024-03-17","cited_by_count":5},{"id":"2510.11557","title":"Invisible Languages of the LLM Universe","created":"2025-10-13","cited_by_count":4},{"id":"2404.18071","title":"Can Perplexity Predict Fine-tuning Performance? An Investigation of Tokenization Effects on Sequential Language Models for Nepali","created":"2024-04-28","cited_by_count":3},{"id":"2502.10140","title":"Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages","created":"2025-02-14","cited_by_count":3},{"id":"2506.07541","title":"Bit-level BPE: Below the byte boundary","created":"2025-06-09","cited_by_count":3},{"id":"2511.05578","title":"UTF-8 Plumbing: Byte-level Tokenizers Unavoidably Enable LLMs to Generate Ill-formed UTF-8","created":"2025-11-05","cited_by_count":3},{"id":"2406.05424","title":"Recent advancements in computational morphology : A comprehensive survey","created":"2024-06-08","cited_by_count":2},{"id":"2109.10433","title":"Transcoding Billions of Unicode Characters per Second with SIMD Instructions","created":"2021-09-21","cited_by_count":1},{"id":"2410.23656","title":"Morphological Typology in BPE Subword Productivity and Language Modeling","created":"2024-10-31","cited_by_count":1}],"next_cursor":"100"}