{"list":"other","total":54,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2009.03300","title":"Measuring Massive Multitask Language Understanding","created":"2020-09-07","cited_by_count":7963},{"id":"1911.02116","title":"Unsupervised Cross-lingual Representation Learning at Scale","created":"2019-11-05","cited_by_count":3935},{"id":"2108.07732","title":"Program Synthesis with Large Language Models","created":"2021-08-16","cited_by_count":3637},{"id":"2101.03961","title":"Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity","created":"2021-01-11","cited_by_count":3073},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"2207.04672","title":"No Language Left Behind: Scaling Human-Centered Machine Translation","created":"2022-07-11","cited_by_count":1312},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"2212.04089","title":"Editing Models with Task Arithmetic","created":"2022-12-08","cited_by_count":1120},{"id":"2306.01708","title":"TIES-Merging: Resolving Interference When Merging Models","created":"2023-06-02","cited_by_count":818},{"id":"2311.03099","title":"Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch","created":"2023-11-06","cited_by_count":694},{"id":"2111.09832","title":"Merging Models with Fisher-Weighted Averaging","created":"2021-11-18","cited_by_count":621},{"id":"2210.03057","title":"Language Models are Multilingual Chain-of-Thought Reasoners","created":"2022-10-06","cited_by_count":530},{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471},{"id":"2005.00052","title":"MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer","created":"2020-04-30","cited_by_count":445},{"id":"2012.07463","title":"Parameter-Efficient Transfer Learning with Diff Pruning","created":"2020-12-14","cited_by_count":352},{"id":"2308.16884","title":"The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants","created":"2023-08-31","cited_by_count":311},{"id":"2404.16710","title":"LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding","created":"2024-04-25","cited_by_count":307},{"id":"2402.10588","title":"Do Llamas Work in English? On the Latent Language of Multilingual Transformers","created":"2024-02-16","cited_by_count":281},{"id":"2305.12827","title":"Task Arithmetic in the Tangent Space: Improved Editing of Pre-Trained Models","created":"2023-05-22","cited_by_count":221},{"id":"2111.09839","title":"Training Neural Networks with Fixed Sparse Masks","created":"2021-11-18","cited_by_count":214},{"id":"2402.06619","title":"Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning","created":"2024-02-09","cited_by_count":177},{"id":"2306.14870","title":"Composing Parameter-Efficient Modules with Arithmetic Operations","created":"2023-06-26","cited_by_count":156},{"id":"2109.05687","title":"Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning","created":"2021-09-13","cited_by_count":146},{"id":"2205.06266","title":"Lifting the Curse of Multilinguality by Pre-training Modular Transformers","created":"2022-05-12","cited_by_count":146},{"id":"2110.07560","title":"Composable Sparse Fine-Tuning for Cross-Lingual Transfer","created":"2021-10-14","cited_by_count":144},{"id":"2402.16438","title":"Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models","created":"2024-02-26","cited_by_count":126},{"id":"2212.10445","title":"Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization","created":"2022-12-20","cited_by_count":97},{"id":"2310.14799","title":"Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languages","created":"2023-10-23","cited_by_count":97},{"id":"2205.10964","title":"The Geometry of Multilingual Language Model Representations","created":"2022-05-22","cited_by_count":95},{"id":"2301.10472","title":"XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models","created":"2023-01-25","cited_by_count":88},{"id":"2404.02431","title":"On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific Neurons","created":"2024-04-03","cited_by_count":83},{"id":"2401.06838","title":"MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization","created":"2024-01-12","cited_by_count":69},{"id":"2101.11109","title":"First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT","created":"2021-01-26","cited_by_count":65},{"id":"2012.15674","title":"ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora","created":"2020-12-31","cited_by_count":63},{"id":"2403.06350","title":"IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages","created":"2024-03-11","cited_by_count":52},{"id":"2406.01771","title":"LLMs Beyond English: Scaling the Multilingual Capability of LLMs with Cross-Lingual Feedback","created":"2024-06-03","cited_by_count":51},{"id":"2305.16768","title":"Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Review","created":"2023-05-26","cited_by_count":50},{"id":"2401.07037","title":"xCoT: Cross-lingual Instruction Tuning for Cross-lingual Chain-of-Thought Reasoning","created":"2024-01-13","cited_by_count":46},{"id":"2407.02552","title":"RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs","created":"2024-07-02","cited_by_count":43},{"id":"2311.08711","title":"PLUG: Leveraging Pivot Language in Cross-Lingual Instruction Tuning","created":"2023-11-15","cited_by_count":39},{"id":"2401.16405","title":"Scaling Sparse Fine-Tuning to Large Language Models","created":"2024-01-29","cited_by_count":26},{"id":"2109.07306","title":"Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training","created":"2021-09-15","cited_by_count":22},{"id":"2402.14700","title":"Unveiling Linguistic Regions in Large Language Models","created":"2024-02-22","cited_by_count":22},{"id":"2210.01185","title":"ContraCLM: Contrastive Learning For Causal Language Model","created":"2022-10-03","cited_by_count":18},{"id":"2306.02790","title":"Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers","created":"2023-06-05","cited_by_count":18},{"id":"2408.17024","title":"InkubaLM: A small language model for low-resource African languages","created":"2024-08-30","cited_by_count":18},{"id":"2402.13137","title":"The Hidden Space of Transformer Language Adapters","created":"2024-02-20","cited_by_count":17},{"id":"2210.14867","title":"Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning","created":"2022-10-26","cited_by_count":16},{"id":"2305.13286","title":"How do languages influence each other? Studying cross-lingual data sharing during LM fine-tuning","created":"2023-05-22","cited_by_count":14},{"id":"2311.08273","title":"Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks","created":"2023-11-14","cited_by_count":13},{"id":"2311.06379","title":"DeMuX: Data-efficient Multilingual Learning","created":"2023-11-10","cited_by_count":1}],"next_cursor":null}