{"list":"other","total":92,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2009.03300","title":"Measuring Massive Multitask Language Understanding","created":"2020-09-07","cited_by_count":7963},{"id":"1904.09675","title":"BERTScore: Evaluating Text Generation with BERT","created":"2019-04-21","cited_by_count":5512},{"id":"1902.00751","title":"Parameter-Efficient Transfer Learning for NLP","created":"2019-02-02","cited_by_count":4236},{"id":"1606.05250","title":"SQuAD: 100,000+ Questions for Machine Comprehension of Text","created":"2016-06-16","cited_by_count":4148},{"id":"2101.00190","title":"Prefix-Tuning: Optimizing Continuous Prompts for Generation","created":"2021-01-01","cited_by_count":3915},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2104.08691","title":"The Power of Scale for Parameter-Efficient Prompt Tuning","created":"2021-04-18","cited_by_count":3795},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2101.03961","title":"Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity","created":"2021-01-11","cited_by_count":3073},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2109.07958","title":"TruthfulQA: Measuring How Models Mimic Human Falsehoods","created":"2021-09-08","cited_by_count":2975},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"2110.08207","title":"Multitask Prompted Training Enables Zero-Shot Task Generalization","created":"2021-10-15","cited_by_count":1470},{"id":"2106.10199","title":"BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models","created":"2021-06-18","cited_by_count":1245},{"id":"2202.03286","title":"Red Teaming Language Models with Language Models","created":"2022-02-07","cited_by_count":1026},{"id":"2205.05638","title":"Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning","created":"2022-05-11","cited_by_count":896},{"id":"2204.07705","title":"Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks","created":"2022-04-16","cited_by_count":868},{"id":"1905.10650","title":"Are Sixteen Heads Really Better than One?","created":"2019-05-25","cited_by_count":816},{"id":"2307.06435","title":"A Comprehensive Overview of Large Language Models","created":"2023-07-12","cited_by_count":648},{"id":"2309.00267","title":"RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback","created":"2023-09-01","cited_by_count":625},{"id":"2106.04647","title":"Compacter: Efficient Low-Rank Hypercomplex Adapter Layers","created":"2021-06-08","cited_by_count":460},{"id":"2305.07759","title":"TinyStories: How Small Can Language Models Be and Still Speak Coherent English?","created":"2023-05-12","cited_by_count":449},{"id":"2007.07779","title":"AdapterHub: A Framework for Adapting Transformers","created":"2020-07-15","cited_by_count":444},{"id":"2310.06694","title":"Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning","created":"2023-10-10","cited_by_count":415},{"id":"2304.13712","title":"Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond","created":"2023-04-26","cited_by_count":411},{"id":"2005.00333","title":"XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning","created":"2020-05-01","cited_by_count":333},{"id":"2308.12032","title":"From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning","created":"2023-08-23","cited_by_count":307},{"id":"2401.13601","title":"MM-LLMs: Recent Advances in MultiModal Large Language Models","created":"2024-01-24","cited_by_count":278},{"id":"2308.07633","title":"A Survey on Model Compression for Large Language Models","created":"2023-08-15","cited_by_count":269},{"id":"2306.02224","title":"Auto-GPT for Online Decision Making: Benchmarks and Additional Opinions","created":"2023-06-04","cited_by_count":255},{"id":"2312.03732","title":"A Rank Stabilization Scaling Factor for Fine-Tuning with LoRA","created":"2023-11-28","cited_by_count":243},{"id":"2306.09479","title":"Inverse Scaling: When Bigger Isn't Better","created":"2023-06-15","cited_by_count":207},{"id":"2403.18105","title":"Large Language Models for Education: A Survey and Outlook","created":"2024-03-26","cited_by_count":188},{"id":"2402.05119","title":"A Closer Look at the Limitations of Instruction Tuning","created":"2024-02-03","cited_by_count":77},{"id":"2310.07251","title":"Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs","created":"2023-10-11","cited_by_count":64},{"id":"2408.13296","title":"The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities","created":"2024-08-23","cited_by_count":64},{"id":"2305.09246","title":"Maybe Only 0.5% Data is Needed: A Preliminary Exploration of Low Training Data Instruction Tuning","created":"2023-05-16","cited_by_count":58},{"id":"2304.02020","title":"A Bibliometric Review of Large Language Models Research from 2017 to 2023","created":"2023-04-03","cited_by_count":57},{"id":"2310.00492","title":"From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuning","created":"2023-09-30","cited_by_count":56},{"id":"2401.12874","title":"From Understanding to Utilization: A Survey on Explainability for Large Language Models","created":"2024-01-23","cited_by_count":48},{"id":"2502.00234","title":"Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithms","created":"2025-02-01","cited_by_count":47},{"id":"2402.05406","title":"Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes","created":"2024-02-08","cited_by_count":43},{"id":"2405.15319","title":"Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training","created":"2024-05-24","cited_by_count":43},{"id":"2007.09604","title":"Meta-learning for Few-shot Natural Language Processing: A Survey","created":"2020-07-19","cited_by_count":42},{"id":"2412.04315","title":"Densing Law of LLMs","created":"2024-12-05","cited_by_count":40},{"id":"2412.13337","title":"Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs","created":"2024-12-17","cited_by_count":40},{"id":"2208.08489","title":"Understanding Scaling Laws for Recommendation Models","created":"2022-08-17","cited_by_count":38},{"id":"2305.13225","title":"Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistance","created":"2023-05-22","cited_by_count":33},{"id":"2402.02314","title":"Selecting Large Language Model to Fine-tune via Rectified Scaling Law","created":"2024-02-04","cited_by_count":33},{"id":"2406.00936","title":"A Survey of Useful LLM Evaluation","created":"2024-06-03","cited_by_count":29},{"id":"2310.11716","title":"Reflection-Tuning: Data Recycling Improves LLM Instruction-Tuning","created":"2023-10-18","cited_by_count":26},{"id":"2412.06540","title":"Sloth: scaling laws for LLM skills to predict multi-benchmark performance across families","created":"2024-12-09","cited_by_count":24},{"id":"2406.05392","title":"Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey","created":"2024-06-08","cited_by_count":23},{"id":"2407.17467","title":"CMR Scaling Law: Predicting Critical Mixture Ratios for Continual Pre-training of Language Models","created":"2024-07-24","cited_by_count":23},{"id":"2409.15156","title":"Rethinking Conventional Wisdom in Machine Learning: From Generalization to Scaling","created":"2024-09-23","cited_by_count":23},{"id":"2412.01505","title":"Scaling Law for Language Models Training Considering Batch Size","created":"2024-12-02","cited_by_count":22},{"id":"2310.12345","title":"ClusT3: Information Invariant Test-Time Training","created":"2023-10-18","cited_by_count":21},{"id":"2402.01799","title":"Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward","created":"2024-02-02","cited_by_count":21},{"id":"2310.05015","title":"Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language Models","created":"2023-10-08","cited_by_count":19},{"id":"2405.03146","title":"Quantifying the Capabilities of LLMs across Scale and Precision","created":"2024-05-06","cited_by_count":19},{"id":"2406.03777","title":"Empirical Guidelines for Deploying LLMs onto Resource-constrained Edge Devices","created":"2024-06-06","cited_by_count":17},{"id":"2502.04688","title":"M-IFEval: Multilingual Instruction-Following Evaluation","created":"2025-02-07","cited_by_count":17},{"id":"2306.09928","title":"Friend or Foe? Exploring the Implications of Large Language Models on the Science System","created":"2023-06-16","cited_by_count":16},{"id":"2410.17711","title":"Beware of Calibration Data for Pruning Large Language Models","created":"2024-10-23","cited_by_count":15},{"id":"2405.06275","title":"Pruning as a Domain-specific LLM Extractor","created":"2024-05-10","cited_by_count":13},{"id":"2410.16208","title":"Compute-Constrained Data Selection","created":"2024-10-21","cited_by_count":12},{"id":"2310.14103","title":"Revisiting Instruction Fine-tuned Model Evaluation to Guide Industrial Applications","created":"2023-10-21","cited_by_count":11},{"id":"2410.23463","title":"MDCure: A Scalable Pipeline for Multi-Document Instruction-Following","created":"2024-10-30","cited_by_count":10},{"id":"2408.04643","title":"Risks, Causes, and Mitigations of Widespread Deployments of Large Language Models (LLMs): A Survey","created":"2024-08-01","cited_by_count":8},{"id":"2412.19926","title":"Right vs. Right: Can LLMs Make Tough Choices?","created":"2024-12-27","cited_by_count":6},{"id":"2403.15250","title":"Comprehensive Reassessment of Large-Scale Evaluation Outcomes in LLMs: A Multifaceted Statistical Approach","created":"2024-03-22","cited_by_count":5},{"id":"2408.15409","title":"Awes, Laws, and Flaws From Today's LLM Research","created":"2024-08-27","cited_by_count":5},{"id":"2312.10793","title":"Demystifying Instruction Mixing for Fine-tuning Large Language Models","created":"2023-12-17","cited_by_count":4},{"id":"2402.01643","title":"L-TUNING: Synchronized Label Tuning for Prompt and Prefix in LLMs","created":"2023-12-21","cited_by_count":4},{"id":"2404.00913","title":"LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction","created":"2024-04-01","cited_by_count":3},{"id":"2406.14871","title":"I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education","created":"2024-06-21","cited_by_count":3},{"id":"2407.05563","title":"LLMBox: A Comprehensive Library for Large Language Models","created":"2024-07-08","cited_by_count":3},{"id":"2407.18722","title":"Neurosymbolic AI for Enhancing Instructability in Generative AI","created":"2024-07-26","cited_by_count":3},{"id":"2408.17214","title":"Efficient Multi-task Prompt Tuning for Recommendation","created":"2024-08-30","cited_by_count":3},{"id":"2412.04503","title":"A Primer on Large Language Models and their Limitations","created":"2024-12-03","cited_by_count":3},{"id":"2308.10252","title":"LMTuner: An user-friendly and highly-integrable Training Framework for fine-tuning Large Language Models","created":"2023-08-20","cited_by_count":2},{"id":"2501.06802","title":"Unifying Two Types of Scaling Laws from the Perspective of Conditional Kolmogorov Complexity","created":"2025-01-12","cited_by_count":2},{"id":"2404.06404","title":"Apprentices to Research Assistants: Advancing Research with Large Language Models","created":"2024-04-09","cited_by_count":1},{"id":"2410.19812","title":"Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models","created":"2024-10-17","cited_by_count":1}],"next_cursor":null}