{"total":692,"rows":[{"id":"2303.18223","title":"A Survey of Large Language Models","created":"2023-03-31","cited_by_count":2576,"area":null},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512,"area":null},{"id":"2303.17580","title":"HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face","created":"2023-03-30","cited_by_count":1190,"area":null},{"id":"2307.05782","title":"Large Language Models","created":"2023-07-11","cited_by_count":780,"area":null},{"id":"2301.00234","title":"A Survey on In-context Learning","created":"2022-12-31","cited_by_count":721,"area":null},{"id":"2208.01066","title":"What Can Transformers Learn In-Context? A Case Study of Simple Function Classes","created":"2022-08-01","cited_by_count":715,"area":null},{"id":"2211.15661","title":"What learning algorithm is in-context learning? Investigations with linear models","created":"2022-11-28","cited_by_count":684,"area":null},{"id":"2112.08633","title":"Learning To Retrieve Prompts for In-Context Learning","created":"2021-12-16","cited_by_count":648,"area":null},{"id":"2309.05653","title":"MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning","created":"2023-09-11","cited_by_count":487,"area":null},{"id":"2303.03846","title":"Larger language models do in-context learning differently","created":"2023-03-07","cited_by_count":394,"area":null},{"id":"2306.09927","title":"Trained Transformers Learn Linear Models In-Context","created":"2023-06-16","cited_by_count":337,"area":null},{"id":"2310.15916","title":"In-Context Learning Creates Task Vectors","created":"2023-10-24","cited_by_count":312,"area":null},{"id":"2205.05055","title":"Data Distributional Properties Drive Emergent In-Context Learning in Transformers","created":"2022-04-22","cited_by_count":309,"area":null},{"id":"2310.15213","title":"Function Vectors in Large Language Models","created":"2023-10-23","cited_by_count":308,"area":null},{"id":"2306.04637","title":"Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection","created":"2023-06-07","cited_by_count":298,"area":null},{"id":"2502.05564","title":"TabICL: A Tabular Foundation Model for In-Context Learning on Large Data","created":"2025-02-08","cited_by_count":289,"area":null},{"id":"2306.00297","title":"Transformers learn to implement preconditioned gradient descent for in-context learning","created":"2023-06-01","cited_by_count":279,"area":null},{"id":"2311.16079","title":"MEDITRON-70B: Scaling Medical Pretraining for Large Language Models","created":"2023-11-27","cited_by_count":274,"area":null},{"id":"2307.10169","title":"Challenges and Applications of Large Language Models","created":"2023-07-19","cited_by_count":254,"area":null},{"id":"2310.17157","title":"Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time","created":"2023-10-26","cited_by_count":252,"area":null},{"id":"2204.02329","title":"Can language models learn from explanations in context?","created":"2022-04-05","cited_by_count":249,"area":null},{"id":"2311.06668","title":"In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering","created":"2023-11-11","cited_by_count":245,"area":null},{"id":"2305.14160","title":"Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning","created":"2023-05-23","cited_by_count":236,"area":null},{"id":"2301.07067","title":"Transformers as Algorithms: Generalization and Stability in In-context Learning","created":"2023-01-17","cited_by_count":222,"area":null},{"id":"2404.11018","title":"Many-Shot In-Context Learning","created":"2024-04-17","cited_by_count":206,"area":null},{"id":"2212.10559","title":"Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers","created":"2022-12-20","cited_by_count":204,"area":null},{"id":"2307.04721","title":"Large Language Models as General Pattern Machines","created":"2023-07-10","cited_by_count":197,"area":null},{"id":"2211.04486","title":"Active Example Selection for In-Context Learning","created":"2022-11-08","cited_by_count":196,"area":null},{"id":"2307.03576","title":"One Step of Gradient Descent is Provably the Optimal In-Context Learner with One Layer of Linear Self-Attention","created":"2023-07-07","cited_by_count":170,"area":null},{"id":"2212.10375","title":"Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering","created":"2022-12-20","cited_by_count":161,"area":null},{"id":"2306.00802","title":"Birth of a Transformer: A Memory Viewpoint","created":"2023-06-01","cited_by_count":161,"area":null},{"id":"2305.14930","title":"In-Context Impersonation Reveals Large Language Models' Strengths and Biases","created":"2023-05-24","cited_by_count":155,"area":null},{"id":"2305.09731","title":"What In-Context Learning \"Learns\" In-Context: Disentangling Task Recognition and Task Learning","created":"2023-05-16","cited_by_count":152,"area":null},{"id":"2301.11916","title":"Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learning","created":"2023-01-27","cited_by_count":149,"area":null},{"id":"2311.12424","title":"Looped Transformers are Better at Learning Learning Algorithms","created":"2023-11-21","cited_by_count":149,"area":null},{"id":"2306.15063","title":"Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression","created":"2023-06-26","cited_by_count":146,"area":null},{"id":"2306.14892","title":"Supervised Pretraining Can Learn In-Context Reinforcement Learning","created":"2023-06-26","cited_by_count":139,"area":null},{"id":"2402.03921","title":"Large Language Models to Enhance Bayesian Optimization","created":"2024-02-06","cited_by_count":135,"area":null},{"id":"2201.05337","title":"A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models","created":"2022-01-14","cited_by_count":129,"area":null},{"id":"2203.07281","title":"GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models","created":"2022-03-14","cited_by_count":127,"area":null},{"id":"2303.07895","title":"The Learnability of In-Context Learning","created":"2023-03-14","cited_by_count":127,"area":null},{"id":"2405.06823","title":"PLeak: Prompt Leaking Attacks against Large Language Model Applications","created":"2024-05-10","cited_by_count":127,"area":null},{"id":"2401.12794","title":"Benchmarking LLMs via Uncertainty Quantification","created":"2024-01-23","cited_by_count":126,"area":null},{"id":"2305.19420","title":"What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization","created":"2023-05-30","cited_by_count":118,"area":null},{"id":"2312.03002","title":"The mechanistic basis of data dependence and abrupt learning in an in-context classification task","created":"2023-12-03","cited_by_count":118,"area":null},{"id":"2402.11004","title":"The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains","created":"2024-02-16","cited_by_count":118,"area":null},{"id":"2402.14735","title":"How Transformers Learn Causal Structure with Gradient Descent","created":"2024-02-22","cited_by_count":118,"area":null},{"id":"2205.12685","title":"Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations","created":"2022-05-25","cited_by_count":116,"area":null},{"id":"2310.05249","title":"In-Context Convergence of Transformers","created":"2023-10-08","cited_by_count":115,"area":null},{"id":"2212.08037","title":"Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models","created":"2022-12-15","cited_by_count":112,"area":null},{"id":"2212.10773","title":"MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning","created":"2022-12-21","cited_by_count":109,"area":null},{"id":"2309.01809","title":"Are Emergent Abilities in Large Language Models just In-Context Learning?","created":"2023-09-04","cited_by_count":109,"area":null},{"id":"2305.08377","title":"Text Classification via Large Language Models","created":"2023-05-15","cited_by_count":106,"area":null},{"id":"2306.07906","title":"WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferences","created":"2023-06-13","cited_by_count":100,"area":null},{"id":"2309.05858","title":"Uncovering mesa-optimization algorithms in Transformers","created":"2023-09-11","cited_by_count":100,"area":null},{"id":"2309.11765","title":"Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation","created":"2023-09-21","cited_by_count":96,"area":null},{"id":"2310.08391","title":"How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?","created":"2023-10-12","cited_by_count":96,"area":null},{"id":"2304.06131","title":"UniverSeg: Universal Medical Image Segmentation","created":"2023-04-12","cited_by_count":91,"area":null},{"id":"2307.16376","title":"When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities","created":"2023-07-31","cited_by_count":90,"area":null},{"id":"2401.12973","title":"In-Context Language Learning: Architectures and Algorithms","created":"2024-01-23","cited_by_count":89,"area":null},{"id":"2303.07971","title":"A Theory of Emergent In-Context Learning as Implicit Structure Induction","created":"2023-03-14","cited_by_count":86,"area":null},{"id":"2407.14985","title":"Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data","created":"2024-07-20","cited_by_count":85,"area":null},{"id":"2210.14199","title":"Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models","created":"2022-10-25","cited_by_count":84,"area":null},{"id":"2306.04891","title":"In-Context Learning through the Bayesian Prism","created":"2023-06-08","cited_by_count":83,"area":null},{"id":"2401.06766","title":"Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvements","created":"2024-01-12","cited_by_count":83,"area":null},{"id":"2204.13509","title":"On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Model","created":"2022-04-28","cited_by_count":81,"area":null},{"id":"2212.06713","title":"Structured Prompting: Scaling In-Context Learning to 1,000 Examples","created":"2022-12-13","cited_by_count":81,"area":null},{"id":"2305.02499","title":"AutoML-GPT: Automatic Machine Learning with GPT","created":"2023-05-04","cited_by_count":81,"area":null},{"id":"2305.10688","title":"MolXPT: Wrapping Molecules with Text for Generative Pre-training","created":"2023-05-18","cited_by_count":81,"area":null},{"id":"2307.00175","title":"Still No Lie Detector for Language Models: Probing Empirical and Conceptual Roadblocks","created":"2023-06-30","cited_by_count":78,"area":null},{"id":"2311.08360","title":"The Transient Nature of Emergent In-Context Learning in Transformers","created":"2023-11-14","cited_by_count":76,"area":null},{"id":"2403.15371","title":"Can large language models explore in-context?","created":"2024-03-22","cited_by_count":76,"area":null},{"id":"2310.10616","title":"How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations","created":"2023-10-16","cited_by_count":75,"area":null},{"id":"2305.01750","title":"Few-shot In-context Learning for Knowledge Base Question Answering","created":"2023-05-02","cited_by_count":74,"area":null},{"id":"2310.09881","title":"In-Context Learning with Iterative Demonstration Selection","created":"2023-10-15","cited_by_count":74,"area":null},{"id":"2209.07661","title":"On the Relation between Sensitivity and Accuracy in In-context Learning","created":"2022-09-16","cited_by_count":72,"area":null},{"id":"2305.14128","title":"Dr.ICL: Demonstration-Retrieved In-context Learning","created":"2023-05-23","cited_by_count":72,"area":null},{"id":"2309.15649","title":"Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting","created":"2023-09-27","cited_by_count":72,"area":null},{"id":"2211.13892","title":"Complementary Explanations for Effective In-Context Learning","created":"2022-11-25","cited_by_count":71,"area":null},{"id":"2305.05940","title":"Multilingual LLMs are Better Cross-lingual In-context Learners with Alignment","created":"2023-05-10","cited_by_count":71,"area":null},{"id":"2212.09865","title":"Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations","created":"2022-12-19","cited_by_count":70,"area":null},{"id":"2401.11624","title":"In-context Learning with Retrieved Demonstrations for Language Models: A Survey","created":"2024-01-21","cited_by_count":70,"area":null},{"id":"2403.16512","title":"LLMs Are Few-Shot In-Context Low-Resource Language Learners","created":"2024-03-25","cited_by_count":68,"area":null},{"id":"2210.12329","title":"ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback","created":"2022-10-22","cited_by_count":67,"area":null},{"id":"2207.04154","title":"TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversations","created":"2022-07-08","cited_by_count":66,"area":null},{"id":"2410.08292","title":"Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning?","created":"2024-10-10","cited_by_count":65,"area":null},{"id":"2305.14950","title":"Adversarial Demonstration Attacks on Large Language Models","created":"2023-05-24","cited_by_count":63,"area":null},{"id":"2310.03016","title":"Understanding In-Context Learning in Transformers and LLMs by Learning to Learn Discrete Functions","created":"2023-10-04","cited_by_count":63,"area":null},{"id":"2402.00809","title":"Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI","created":"2024-02-01","cited_by_count":62,"area":null},{"id":"2307.15703","title":"Uncertainty in Natural Language Generation: From Theory to Applications","created":"2023-07-28","cited_by_count":61,"area":null},{"id":"2307.07164","title":"Learning to Retrieve In-Context Examples for Large Language Models","created":"2023-07-14","cited_by_count":60,"area":null},{"id":"2305.12907","title":"Meta-in-context learning in large language models","created":"2023-05-22","cited_by_count":59,"area":null},{"id":"2407.00128","title":"When Search Engine Services meet Large Language Models: Visions and Challenges","created":"2024-06-28","cited_by_count":59,"area":null},{"id":"2205.10183","title":"Prototypical Calibration for Few-shot Learning of Language Models","created":"2022-05-20","cited_by_count":58,"area":null},{"id":"2404.07544","title":"From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples","created":"2024-04-11","cited_by_count":57,"area":null},{"id":"2406.00793","title":"Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective","created":"2024-06-02","cited_by_count":57,"area":null},{"id":"2310.00492","title":"From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuning","created":"2023-09-30","cited_by_count":56,"area":null},{"id":"2311.00288","title":"Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks","created":"2023-11-01","cited_by_count":55,"area":null},{"id":"2305.14264","title":"Active Learning Principles for In-Context Learning with Large Language Models","created":"2023-05-23","cited_by_count":54,"area":null},{"id":"2307.09007","title":"On the (In)Effectiveness of Large Language Models for Chinese Text Correction","created":"2023-07-18","cited_by_count":54,"area":null}],"next_cursor":"100"}