{"total":88,"rows":[{"id":"2103.06874","title":"CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation","created":"2021-03-11","cited_by_count":232,"area":null},{"id":"2205.06266","title":"Lifting the Curse of Multilinguality by Pre-training Modular Transformers","created":"2022-05-12","cited_by_count":146,"area":null},{"id":"2112.10508","title":"Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP","created":"2021-12-20","cited_by_count":132,"area":null},{"id":"2108.05542","title":"AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing","created":"2021-08-12","cited_by_count":131,"area":null},{"id":"2205.02022","title":"A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation","created":"2022-05-04","cited_by_count":98,"area":null},{"id":"2212.09535","title":"BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting","created":"2022-12-19","cited_by_count":90,"area":null},{"id":"2404.00929","title":"A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias","created":"2024-04-01","cited_by_count":84,"area":null},{"id":"2205.03983","title":"Building Machine Translation Systems for the Next Thousand Languages","created":"2022-05-09","cited_by_count":69,"area":null},{"id":"2207.06991","title":"Language Modelling with Pixels","created":"2022-07-14","cited_by_count":55,"area":null},{"id":"2106.02124","title":"How to Adapt Your Pretrained Multilingual Model to 1600 Languages","created":"2021-06-03","cited_by_count":54,"area":null},{"id":"2104.08726","title":"AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages","created":"2021-04-18","cited_by_count":50,"area":null},{"id":"2107.00676","title":"A Primer on Pretrained Multilingual Language Models","created":"2021-07-01","cited_by_count":49,"area":null},{"id":"2205.12654","title":"Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages","created":"2022-05-25","cited_by_count":48,"area":"distill"},{"id":"2106.16171","title":"Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer","created":"2021-06-30","cited_by_count":47,"area":null},{"id":"2203.09435","title":"Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation","created":"2022-03-17","cited_by_count":44,"area":null},{"id":"2306.07377","title":"Lost in Translation: Large Language Models in Non-English Content Analysis","created":"2023-06-12","cited_by_count":35,"area":null},{"id":"2105.03953","title":"Continual Mixed-Language Pre-Training for Extremely Low-Resource Neural Machine Translation","created":"2021-05-09","cited_by_count":29,"area":null},{"id":"2206.09755","title":"Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold","created":"2022-06-20","cited_by_count":29,"area":null},{"id":"2301.06627","title":"Dissociating language and thought in large language models","created":"2023-01-16","cited_by_count":29,"area":"lr"},{"id":"2401.13303","title":"MaLA-500: Massive Language Adaptation of Large Language Models","created":"2024-01-24","cited_by_count":28,"area":null},{"id":"2203.10753","title":"Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability","created":"2022-03-21","cited_by_count":26,"area":null},{"id":"2109.04607","title":"IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization","created":"2021-09-10","cited_by_count":25,"area":null},{"id":"2212.10503","title":"Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training","created":"2022-12-20","cited_by_count":24,"area":null},{"id":"2106.09063","title":"Specializing Multilingual Language Models: An Empirical Study","created":"2021-06-16","cited_by_count":21,"area":null},{"id":"2106.03958","title":"Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study","created":"2021-06-07","cited_by_count":19,"area":null},{"id":"2402.10712","title":"An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model Inference","created":"2024-02-16","cited_by_count":18,"area":null},{"id":"2309.04679","title":"Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages","created":"2023-09-09","cited_by_count":16,"area":null},{"id":"2202.10062","title":"USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation","created":"2022-02-21","cited_by_count":15,"area":null},{"id":"2211.02738","title":"Intriguing Properties of Compression on Multilingual Models","created":"2022-11-04","cited_by_count":15,"area":null},{"id":"2301.12566","title":"Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillation","created":"2023-01-29","cited_by_count":15,"area":null},{"id":"2305.13582","title":"Translation and Fusion Improves Zero-shot Cross-lingual Information Extraction","created":"2023-05-23","cited_by_count":15,"area":null},{"id":"2205.10517","title":"Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese","created":"2022-05-21","cited_by_count":14,"area":null},{"id":"2201.05601","title":"A Warm Start and a Clean Crawled Corpus -- A Recipe for Good Language Models","created":"2022-01-14","cited_by_count":13,"area":null},{"id":"2109.04556","title":"Subword Mapping and Anchoring across Languages","created":"2021-09-09","cited_by_count":12,"area":null},{"id":"2210.07111","title":"A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models","created":"2022-10-13","cited_by_count":12,"area":null},{"id":"2212.12510","title":"MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning","created":"2022-12-23","cited_by_count":12,"area":null},{"id":"2403.06399","title":"GlossLM: A Massively Multilingual Corpus and Pretrained Model for Interlinear Glossed Text","created":"2024-03-11","cited_by_count":12,"area":null},{"id":"2506.10766","title":"One Tokenizer To Rule Them All: Emergent Language Plasticity via Multilingual Tokenizers","created":"2025-06-12","cited_by_count":12,"area":null},{"id":"2305.09025","title":"Soft Prompt Decoding for Multilingual Dense Retrieval","created":"2023-05-15","cited_by_count":10,"area":null},{"id":"2308.07213","title":"Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI","created":"2023-08-14","cited_by_count":9,"area":null},{"id":"2405.12413","title":"Targeted Multilingual Adaptation for Low-resource Language Families","created":"2024-05-20","cited_by_count":9,"area":null},{"id":"2410.09644","title":"Adapters for Altering LLM Vocabularies: What Languages Benefit the Most?","created":"2024-10-12","cited_by_count":9,"area":null},{"id":"2402.18752","title":"Pre-training Differentially Private Models with Limited Public Data","created":"2024-02-28","cited_by_count":8,"area":null},{"id":"2402.02113","title":"Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon","created":"2024-02-03","cited_by_count":7,"area":null},{"id":"2105.14940","title":"Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads?","created":"2021-05-31","cited_by_count":6,"area":null},{"id":"2204.04873","title":"Adapting BigScience Multilingual Model to Unseen Languages","created":"2022-04-11","cited_by_count":6,"area":null},{"id":"2207.00659","title":"Improving Low-Resource Speech Recognition with Pretrained Speech Models: Continued Pretraining vs. Semi-Supervised Training","created":"2022-07-01","cited_by_count":6,"area":null},{"id":"2403.16571","title":"NSINA: A News Corpus for Sinhala","created":"2024-03-25","cited_by_count":6,"area":null},{"id":"2408.04628","title":"LogogramNLP: Comparing Visual and Textual Representations of Ancient Logographic Writing Systems for NLP","created":"2024-08-08","cited_by_count":6,"area":null},{"id":"2504.02122","title":"Overcoming Vocabulary Constraints with Pixel-level Fallback","created":"2025-04-02","cited_by_count":6,"area":null},{"id":"2204.06457","title":"The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer","created":"2022-04-13","cited_by_count":5,"area":null},{"id":"2409.20366","title":"Disentangling Singlish Discourse Particles with Task-Driven Representation","created":"2024-09-30","cited_by_count":5,"area":null},{"id":"2109.07140","title":"On the Universality of Deep Contextual Language Models","created":"2021-09-15","cited_by_count":4,"area":null},{"id":"2302.07912","title":"Meeting the Needs of Low-Resource Languages: The Value of Automatic Alignments via Pretrained Models","created":"2023-02-15","cited_by_count":4,"area":null},{"id":"2403.08693","title":"Do Language Models Care About Text Quality? Evaluating Web-Crawled Corpora Across 11 Languages","created":"2024-03-13","cited_by_count":4,"area":null},{"id":"2404.05428","title":"Language Models on a Diet: Cost-Efficient Development of Encoders for Closely-Related Languages via Additional Pretraining","created":"2024-04-08","cited_by_count":4,"area":null},{"id":"2406.09717","title":"UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for Low-Resource Languages","created":"2024-06-14","cited_by_count":4,"area":null},{"id":"2211.15965","title":"Extending the Subwording Model of Multilingual Pretrained Models for New Languages","created":"2022-11-29","cited_by_count":3,"area":null},{"id":"2311.08538","title":"Extending Multilingual Machine Translation through Imitation Learning","created":"2023-11-14","cited_by_count":3,"area":null},{"id":"2403.20157","title":"A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translation","created":"2024-03-29","cited_by_count":3,"area":null},{"id":"2410.18957","title":"Bridge-Coder: Unlocking LLMs' Potential to Overcome Language Gaps in Low-Resource Code","created":"2024-10-24","cited_by_count":3,"area":null},{"id":"2502.10140","title":"Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages","created":"2025-02-14","cited_by_count":3,"area":null},{"id":"2203.12865","title":"Multilingual CheckList: Generation and Evaluation","created":"2022-03-24","cited_by_count":2,"area":null},{"id":"2308.01785","title":"Lexicon and Rule-based Word Lemmatization Approach for the Somali Language","created":"2023-08-03","cited_by_count":2,"area":null},{"id":"2310.13228","title":"The Less the Merrier? Investigating Language Representation in Multilingual Models","created":"2023-10-20","cited_by_count":2,"area":null},{"id":"2505.10945","title":"Semantic Aware Linear Transfer by Recycling Pre-trained Language Models for Cross-lingual Transfer","created":"2025-05-16","cited_by_count":2,"area":null},{"id":"2506.01535","title":"Dictionaries to the Rescue: Cross-Lingual Vocabulary Transfer for Low-Resource Languages Using Bilingual Dictionaries","created":"2025-06-02","cited_by_count":2,"area":null},{"id":"2604.16656","title":"Defragmenting Language Models: An Interpretability-based Approach for Vocabulary Expansion","created":"2026-04-17","cited_by_count":2,"area":null},{"id":"2111.03837","title":"Focusing on Potential Named Entities During Active Label Acquisition","created":"2021-11-06","cited_by_count":1,"area":null},{"id":"2210.05425","title":"COVID-19-related Nepali Tweets Classification in a Low Resource Setting","created":"2022-10-11","cited_by_count":1,"area":null},{"id":"2302.06078","title":"NYCU-TWO at Memotion 3: Good Foundation, Good Teacher, then you have Good Meme Analysis","created":"2023-02-13","cited_by_count":1,"area":null},{"id":"2402.11485","title":"LEIA: Facilitating Cross-lingual Knowledge Transfer in Language Models with Entity-based Data Augmentation","created":"2024-02-18","cited_by_count":1,"area":null},{"id":"2501.00874","title":"LUSIFER: Language Universal Space Integration for Enhanced Multilingual Embeddings with Large Language Models","created":"2025-01-01","cited_by_count":1,"area":null},{"id":"2605.13429","title":"TokAlign++: Advancing Vocabulary Adaptation via Better Token Alignment","created":"2026-05-13","cited_by_count":1,"area":null},{"id":"2608.00582","title":"Writing-System-Level Tokenizer Adaptation for Byte-Level BPE","created":"2026-08-01","cited_by_count":1,"area":null},{"id":"2202.06871","title":"Sequence-to-Sequence Resources for Catalan","created":"2022-02-14","cited_by_count":0,"area":null},{"id":"2309.00949","title":"Multilingual Text Representation","created":"2023-09-02","cited_by_count":0,"area":null},{"id":"2311.00268","title":"Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages?","created":"2023-11-01","cited_by_count":0,"area":null},{"id":"2311.09505","title":"SegMix: A Simple Structure-Aware Data Augmentation Method","created":"2023-11-16","cited_by_count":0,"area":null},{"id":"2402.14408","title":"Transferring BERT Capabilities from High-Resource to Low-Resource Languages Using Vocabulary Matching","created":"2024-02-22","cited_by_count":0,"area":null},{"id":"2404.08262","title":"Pretraining and Updates of Domain-Specific LLM: A Case Study in the Japanese Business Domain","created":"2024-04-12","cited_by_count":0,"area":null},{"id":"2503.18117","title":"Detection of Somali-written Fake News and Toxic Messages on the Social Media Using Transformer-based Language Models","created":"2025-03-23","cited_by_count":0,"area":"safety"},{"id":"2510.09032","title":"Exploring Cross-Lingual Knowledge Transfer via Transliteration-Based MLM Fine-Tuning for Critically Low-resource Chakma Language","created":"2025-10-10","cited_by_count":0,"area":null},{"id":"2601.09716","title":"Opportunities and Challenges of Natural Language Processing for Low-Resource Senegalese Languages in Social Science Research","created":"2025-12-24","cited_by_count":0,"area":null},{"id":"2602.09388","title":"Effective vocabulary expansion of multilingual language models for extremely low-resource languages","created":"2026-02-10","cited_by_count":0,"area":null},{"id":"2605.02608","title":"Dependency Parsing Across the Resource Spectrum: Evaluating Architectures on High and Low-Resource Languages","created":"2026-05-04","cited_by_count":0,"area":null},{"id":"2605.29502","title":"Source-Grounded Semantic Reinforcement Learning for Low-Resource Target-Language Generation","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2606.01800","title":"Multilinguality of Large Language Models From a Structural Perspective","created":"2026-06-01","cited_by_count":0,"area":null}],"next_cursor":null}