{"total":144,"rows":[{"id":"2412.04261","title":"Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier","created":"2024-12-05","cited_by_count":129,"area":null},{"id":"2511.04703","title":"Measuring what Matters: Construct Validity in Large Language Model Benchmarks","created":"2025-11-03","cited_by_count":119,"area":null},{"id":"2504.02768","title":"MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs","created":"2025-04-03","cited_by_count":71,"area":null},{"id":"2502.14127","title":"Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above","created":"2025-02-19","cited_by_count":52,"area":null},{"id":"2602.16763","title":"When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation","created":"2026-02-18","cited_by_count":33,"area":null},{"id":"2504.15521","title":"The Bitter Lesson Learned from 2,000+ Multilingual Benchmarks","created":"2025-04-22","cited_by_count":31,"area":null},{"id":"2504.10356","title":"MultiLoKo: a multilingual local knowledge benchmark for LLMs spanning 31 languages","created":"2025-04-14","cited_by_count":26,"area":null},{"id":"2502.14301","title":"SEA-HELM: Southeast Asian Holistic Evaluation of Language Models","created":"2025-02-20","cited_by_count":19,"area":null},{"id":"2502.12982","title":"Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs","created":"2025-02-18","cited_by_count":18,"area":null},{"id":"2502.13252","title":"Multilingual Language Model Pretraining using Machine-translated Data","created":"2025-02-18","cited_by_count":17,"area":null},{"id":"2503.19075","title":"The Case for \"Thick Evaluations\" of Cultural Representation in AI","created":"2025-03-24","cited_by_count":17,"area":null},{"id":"2512.14856","title":"T5Gemma 2: Seeing, Reading, and Understanding Longer","created":"2025-12-16","cited_by_count":17,"area":null},{"id":"2506.19468","title":"MuBench: Assessment of Multilingual Capabilities of Large Language Models Across 61 Languages","created":"2025-06-24","cited_by_count":15,"area":null},{"id":"2505.21693","title":"MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs","created":"2025-05-27","cited_by_count":13,"area":null},{"id":"2509.16188","title":"CultureScope: A Dimensional Lens for Probing Cultural Understanding in LLMs","created":"2025-09-19","cited_by_count":12,"area":null},{"id":"2505.24477","title":"Evaluating Gemini in an arena for learning","created":"2025-05-30","cited_by_count":11,"area":null},{"id":"2510.10159","title":"BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data","created":"2025-10-11","cited_by_count":10,"area":null},{"id":"2502.11020","title":"TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages","created":"2025-02-16","cited_by_count":9,"area":null},{"id":"2504.06536","title":"Lugha-Llama: Adapting Large Language Models for African Languages","created":"2025-04-09","cited_by_count":8,"area":null},{"id":"2508.16431","title":"Cetvel: A Unified Benchmark for Evaluating Language Understanding, Generation and Cultural Capacity of LLMs for Turkish","created":"2025-08-22","cited_by_count":8,"area":null},{"id":"2502.15972","title":"When Cultures Meet: Multicultural Text-to-Image Generation","created":"2025-02-21","cited_by_count":7,"area":null},{"id":"2507.23009","title":"Position: Stop Evaluating AI with Human Tests, Develop Principled, AI-specific Tests instead","created":"2025-07-30","cited_by_count":7,"area":null},{"id":"2509.11414","title":"Continually Adding New Languages to Multilingual Language Models","created":"2025-09-14","cited_by_count":7,"area":null},{"id":"2511.01066","title":"HPLT 3.0: Very Large-Scale Multilingual Resources for LLMs and MT. Mono- and Bi-lingual Data, Multilingual Evaluation, and Pre-Trained Models","created":"2025-11-02","cited_by_count":7,"area":null},{"id":"2502.12829","title":"KazMMLU: Evaluating Language Models on Kazakh, Russian, and Regional Knowledge of Kazakhstan","created":"2025-02-18","cited_by_count":6,"area":null},{"id":"2503.15003","title":"LLM Alignment for the Arabs: A Homogenous Culture or Diverse Ones?","created":"2025-03-19","cited_by_count":6,"area":null},{"id":"2503.20110","title":"Efficient Model Development through Fine-tuning Transfer","created":"2025-03-25","cited_by_count":6,"area":null},{"id":"2507.08924","title":"From KMMLU-Redux to KMMLU-Pro: A Professional Korean Benchmark Suite for LLM Evaluation","created":"2025-07-11","cited_by_count":6,"area":null},{"id":"2508.12459","title":"LoraxBench: A Multitask, Multilingual Benchmark Suite for 20 Indonesian Languages","created":"2025-08-17","cited_by_count":6,"area":null},{"id":"2509.11570","title":"Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challenges","created":"2025-09-15","cited_by_count":6,"area":null},{"id":"2510.21954","title":"Model-Aware Tokenizer Transfer","created":"2025-10-24","cited_by_count":6,"area":null},{"id":"2601.11778","title":"Translation as a Scalable Proxy for Multilingual Evaluation","created":"2026-01-16","cited_by_count":6,"area":null},{"id":"2602.05150","title":"GreekMMLU: A Native-Sourced Multitask Benchmark for Evaluating Language Models in Greek","created":"2026-02-05","cited_by_count":6,"area":null},{"id":"2509.24506","title":"Building Benchmarks from the Ground Up: Community-Centered Evaluation of LLMs in Healthcare Chatbot Settings","created":"2025-09-29","cited_by_count":5,"area":null},{"id":"2602.06221","title":"BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks","created":"2026-02-05","cited_by_count":5,"area":null},{"id":"2603.29791","title":"Reasoning-Driven Synthetic Data Generation and Evaluation","created":"2026-03-31","cited_by_count":5,"area":null},{"id":"2507.22752","title":"CUS-QA: Local-Knowledge-Oriented Open-Ended Question Answering Dataset","created":"2025-07-30","cited_by_count":4,"area":null},{"id":"2508.06094","title":"ConlangCrafter: Constructing Languages with a Multi-Hop LLM Pipeline","created":"2025-08-08","cited_by_count":4,"area":null},{"id":"2509.21294","title":"UPDESH: Synthesizing Grounded Instruction Tuning Data for 13 Indic Languages","created":"2025-09-25","cited_by_count":4,"area":null},{"id":"2511.05613","title":"Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations","created":"2025-11-06","cited_by_count":4,"area":null},{"id":"2511.13368","title":"Donors and Recipients: On Asymmetric Transfer Across Tasks and Languages with Parameter-Efficient Fine-Tuning","created":"2025-11-17","cited_by_count":4,"area":null},{"id":"2512.04844","title":"Mitigating Catastrophic Forgetting in Target Language Adaptation of LLMs via Source-Shielded Updates","created":"2025-12-04","cited_by_count":4,"area":null},{"id":"2604.19292","title":"Location Not Found: Exposing Implicit Local and Global Biases in Multilingual LLMs","created":"2026-04-21","cited_by_count":4,"area":null},{"id":"2505.21092","title":"BLUCK: A Benchmark Dataset for Bengali Linguistic Understanding and Cultural Knowledge","created":"2025-05-27","cited_by_count":3,"area":null},{"id":"2506.00482","title":"Benchmarks Are Not Atomic: Composition-Aware LLM Evaluation using BenchHub","created":"2025-05-31","cited_by_count":3,"area":null},{"id":"2510.05678","title":"Gradual Code-Switching as Inference-Time Cross-Lingual Representational Alignment for LLMs","created":"2025-10-07","cited_by_count":3,"area":null},{"id":"2602.01714","title":"MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmark","created":"2026-02-02","cited_by_count":3,"area":null},{"id":"2602.15210","title":"\\\"UberWeb: Insights from Multilingual Curation for a 20-Trillion-Token Dataset","created":"2026-02-16","cited_by_count":3,"area":null},{"id":"2606.06533","title":"Position: Don't Just \"Fix it in Post\": A Science of AI Must Study Training Dynamics","created":"2026-06-03","cited_by_count":3,"area":null},{"id":"2606.07874","title":"Safety is Contextual, LLM-Judges Are Not: Navigating the Rigid Priors of Evaluators","created":"2026-06-05","cited_by_count":3,"area":null},{"id":"2503.11911","title":"LAG-MMLU: Benchmarking Frontier LLM Understanding in Latvian and Giriama","created":"2025-03-14","cited_by_count":2,"area":null},{"id":"2506.12966","title":"Assessing the Role of Data Quality in Training Bilingual Language Models","created":"2025-06-15","cited_by_count":2,"area":null},{"id":"2507.00999","title":"La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America","created":"2025-07-01","cited_by_count":2,"area":null},{"id":"2507.06137","title":"NeoBabel: A Multilingual Open Tower for Visual Generation","created":"2025-07-08","cited_by_count":2,"area":null},{"id":"2508.19831","title":"Benchmarking Hindi LLMs: A New Suite of Datasets and a Comparative Analysis","created":"2025-08-27","cited_by_count":2,"area":null},{"id":"2510.05291","title":"Camellia: Benchmarking Cultural Biases in LLMs for Asian Languages","created":"2025-10-06","cited_by_count":2,"area":null},{"id":"2510.21193","title":"Estonian Native Large Language Model Benchmark","created":"2025-10-24","cited_by_count":2,"area":null},{"id":"2511.02752","title":"AI Diffusion in Low Resource Language Countries","created":"2025-11-04","cited_by_count":2,"area":null},{"id":"2601.05699","title":"Afri-MCQA: Multimodal Cultural Question Answering for African Languages","created":"2026-01-09","cited_by_count":2,"area":null},{"id":"2601.18306","title":"Calibrating Beyond English: Language Diversity for Better Quantized Multilingual LLM","created":"2026-01-26","cited_by_count":2,"area":null},{"id":"2602.11318","title":"The Consensus Trap: Dissecting Subjectivity and the \"Ground Truth\" Illusion in Data Annotation","created":"2026-02-11","cited_by_count":2,"area":null},{"id":"2603.01211","title":"A Unified Framework to Quantify Cultural Intelligence of AI","created":"2026-03-01","cited_by_count":2,"area":null},{"id":"2604.04704","title":"IDIOLEX: Unified and Continuous Representations for Idiolectal and Stylistic Variation","created":"2026-04-06","cited_by_count":2,"area":null},{"id":"2604.08797","title":"Lessons Without Borders? Evaluating Cultural Alignment of LLMs Using Multilingual Story Moral Generation","created":"2026-04-09","cited_by_count":2,"area":null},{"id":"2604.12911","title":"Round-Trip Translation Reveals What Frontier Multilingual Benchmarks Miss","created":"2026-04-14","cited_by_count":2,"area":null},{"id":"2604.15841","title":"Exploring the Capability Boundaries of LLMs in Mastering of Chinese Chouxiang Language","created":"2026-04-17","cited_by_count":2,"area":null},{"id":"2606.13808","title":"The Culture Funnel: You Can't Align What isn't in the Data","created":"2026-06-11","cited_by_count":2,"area":null},{"id":"2607.26831","title":"Language Models are not Equally Robust to Non-Canonical Tokenization across Languages","created":"2026-07-29","cited_by_count":2,"area":null},{"id":"2502.12886","title":"Are Multilingual Language Models an Off-ramp for Under-resourced Languages? Will we arrive at Digital Language Equality in Europe in 2030?","created":"2025-02-18","cited_by_count":1,"area":null},{"id":"2502.12895","title":"Multilingual European Language Models: Benchmarking Approaches and Challenges","created":"2025-02-18","cited_by_count":1,"area":null},{"id":"2504.09753","title":"Improving Multilingual Capabilities with Cultural and Local Knowledge in Large Language Models While Enhancing Native Performance","created":"2025-04-13","cited_by_count":1,"area":null},{"id":"2505.14395","title":"MUG-Eval: A Proxy Evaluation Framework for Multilingual Generation Capabilities in Any Language","created":"2025-05-20","cited_by_count":1,"area":null},{"id":"2506.20793","title":"Multi-lingual Functional Evaluation for Large Language Models","created":"2025-06-25","cited_by_count":1,"area":null},{"id":"2507.15142","title":"A Case Against Implicit Standards: Homophone Normalization in Machine Translation for Languages that use the Ge'ez Script","created":"2025-07-20","cited_by_count":1,"area":null},{"id":"2510.17001","title":"Vocab Diet: Reshaping the Vocabulary of LLMs via Vector Arithmetic","created":"2025-10-19","cited_by_count":1,"area":null},{"id":"2510.21360","title":"A Diagnostic Benchmark for Sweden-Related Factual Knowledge","created":"2025-10-24","cited_by_count":1,"area":null},{"id":"2511.02135","title":"Graph-Based Alternatives to LLMs for Human Simulation","created":"2025-11-03","cited_by_count":1,"area":null},{"id":"2512.21809","title":"On The Conceptualization and Societal Impact of Cross-Cultural Bias","created":"2025-12-26","cited_by_count":1,"area":null},{"id":"2601.14051","title":"Kakugo: Distillation of Low-Resource Languages into Small Language Models","created":"2026-01-20","cited_by_count":1,"area":null},{"id":"2602.04442","title":"No One-Size-Fits-All: Building Systems For Translation to Bashkir, Kazakh, Kyrgyz, Tatar and Chuvash Using Synthetic And Original Data","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2603.02041","title":"EstLLM: Enhancing Estonian Capabilities in Multilingual LLMs via Continued Pretraining and Post-Training","created":"2026-03-02","cited_by_count":1,"area":null},{"id":"2604.02135","title":"GaelEval: Benchmarking LLM Performance for Scottish Gaelic","created":"2026-04-02","cited_by_count":1,"area":null},{"id":"2604.06210","title":"Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook","created":"2026-03-16","cited_by_count":1,"area":null},{"id":"2604.16937","title":"No One Fits All: From Fixed Prompting to Learned Routing in Multilingual LLMs","created":"2026-04-18","cited_by_count":1,"area":null},{"id":"2604.21751","title":"Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs","created":"2026-04-23","cited_by_count":1,"area":null},{"id":"2605.25360","title":"Learning to Route Languages for Multilingual Policy Optimization","created":"2026-05-25","cited_by_count":1,"area":null},{"id":"2606.03773","title":"KletterMix: Climbing Toward High-Quality German Pretraining Data - The Full Report","created":"2026-06-02","cited_by_count":1,"area":null},{"id":"2606.06586","title":"PolyFact: Comparing Consistency-Driven Post-training Methods for Cross-Lingual Factual Recall","created":"2026-06-04","cited_by_count":1,"area":null},{"id":"2606.18699","title":"TW-LegalBench: Measuring Taiwanese Legal Understanding","created":"2026-06-17","cited_by_count":1,"area":null},{"id":"2607.15232","title":"In-Place Tokenizer Expansion for Pre-trained LLMs","created":"2026-07-16","cited_by_count":1,"area":null},{"id":"2607.28801","title":"Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation","created":"2026-07-30","cited_by_count":1,"area":null},{"id":"2608.30052","title":"The Language of the Question Selects the Market: Query Language and Exit IP as Separable Factors in Commercial Recommendations from a Generative Search Interface","created":"2026-08-30","cited_by_count":1,"area":null},{"id":"2504.04155","title":"GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Models","created":"2025-04-05","cited_by_count":0,"area":null},{"id":"2508.05468","title":"TASE: Token Awareness and Structured Evaluation for Multilingual Language Models","created":"2025-08-07","cited_by_count":0,"area":null},{"id":"2508.13526","title":"MATA: Mindful Assessment of the Telugu Abilities of Large Language Models","created":"2025-08-19","cited_by_count":0,"area":null},{"id":"2510.05644","title":"The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP","created":"2025-10-07","cited_by_count":0,"area":null},{"id":"2510.16565","title":"Language over Content: Tracing Cultural Understanding in Multilingual Large Language Models","created":"2025-10-18","cited_by_count":0,"area":null},{"id":"2512.21580","title":"Gamayun's Path to Multilingual Mastery: Cost-Efficient Training of a 1.5B-Parameter LLM","created":"2025-12-25","cited_by_count":0,"area":null},{"id":"2512.24867","title":"Encyclo-K: Evaluating LLMs with Dynamically Composed Knowledge Statements","created":"2025-12-31","cited_by_count":0,"area":null},{"id":"2601.10804","title":"BYOL: Bring Your Own Language Into LLMs","created":"2026-01-15","cited_by_count":0,"area":null}],"next_cursor":"100"}