{"total":141,"rows":[{"id":"2306.04637","title":"Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection","created":"2023-06-07","cited_by_count":298,"area":null},{"id":"2307.10169","title":"Challenges and Applications of Large Language Models","created":"2023-07-19","cited_by_count":254,"area":null},{"id":"2307.03576","title":"One Step of Gradient Descent is Provably the Optimal In-Context Learner with One Layer of Linear Self-Attention","created":"2023-07-07","cited_by_count":170,"area":null},{"id":"2305.09731","title":"What In-Context Learning \"Learns\" In-Context: Disentangling Task Recognition and Task Learning","created":"2023-05-16","cited_by_count":152,"area":null},{"id":"2306.15063","title":"Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression","created":"2023-06-26","cited_by_count":146,"area":null},{"id":"2310.05249","title":"In-Context Convergence of Transformers","created":"2023-10-08","cited_by_count":115,"area":null},{"id":"2309.01809","title":"Are Emergent Abilities in Large Language Models just In-Context Learning?","created":"2023-09-04","cited_by_count":109,"area":null},{"id":"2310.14724","title":"A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions","created":"2023-10-23","cited_by_count":105,"area":null},{"id":"2310.08391","title":"How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?","created":"2023-10-12","cited_by_count":96,"area":null},{"id":"2310.09881","title":"In-Context Learning with Iterative Demonstration Selection","created":"2023-10-15","cited_by_count":74,"area":null},{"id":"2309.15649","title":"Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting","created":"2023-09-27","cited_by_count":72,"area":null},{"id":"2308.11696","title":"Efficient Benchmarking of Language Models","created":"2023-08-22","cited_by_count":71,"area":null},{"id":"2401.11624","title":"In-context Learning with Retrieved Demonstrations for Language Models: A Survey","created":"2024-01-21","cited_by_count":70,"area":null},{"id":"2410.01131","title":"nGPT: Normalized Transformer with Representation Learning on the Hypersphere","created":"2024-10-01","cited_by_count":70,"area":null},{"id":"2306.11270","title":"Evaluating the Zero-shot Robustness of Instruction-tuned Language Models","created":"2023-06-20","cited_by_count":66,"area":null},{"id":"2312.06528","title":"Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context","created":"2023-12-11","cited_by_count":63,"area":null},{"id":"2408.11053","title":"Revisiting VerilogEval: A Year of Improvements in Large-Language Models for Hardware Code Generation","created":"2024-08-20","cited_by_count":45,"area":null},{"id":"2405.02363","title":"LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Model","created":"2024-05-03","cited_by_count":44,"area":null},{"id":"2507.16003","title":"Learning without training: The implicit dynamics of in-context learning","created":"2025-07-21","cited_by_count":43,"area":null},{"id":"2408.10147","title":"In-Context Learning with Representations: Contextual Generalization of Trained Transformers","created":"2024-08-19","cited_by_count":38,"area":null},{"id":"2503.05788","title":"Emergent Abilities in Large Language Models: A Survey","created":"2025-02-28","cited_by_count":37,"area":null},{"id":"2411.02544","title":"Pretrained transformer efficiently learns low-dimensional target functions in-context","created":"2024-11-04","cited_by_count":31,"area":null},{"id":"2310.00297","title":"Understanding In-Context Learning from Repetitions","created":"2023-09-30","cited_by_count":29,"area":null},{"id":"2310.11409","title":"LLMs as Hackers: Autonomous Linux Privilege Escalation Attacks","created":"2023-10-17","cited_by_count":27,"area":null},{"id":"2402.17709","title":"Case-Based or Rule-Based: How Do Transformers Do the Math?","created":"2024-02-27","cited_by_count":26,"area":null},{"id":"2305.12766","title":"Understanding Emergent In-Context Learning from a Kernel Regression Perspective","created":"2023-05-22","cited_by_count":24,"area":null},{"id":"2405.14982","title":"In-context Time Series Predictor","created":"2024-05-23","cited_by_count":23,"area":null},{"id":"2402.11639","title":"In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness","created":"2024-02-18","cited_by_count":22,"area":null},{"id":"2311.07772","title":"In-context Learning and Gradient Descent Revisited","created":"2023-11-13","cited_by_count":20,"area":null},{"id":"2402.13934","title":"Do Efficient Transformers Really Save Computation?","created":"2024-02-21","cited_by_count":20,"area":null},{"id":"2505.12212","title":"Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning","created":"2025-05-18","cited_by_count":20,"area":null},{"id":"2312.01191","title":"Bootstrapping Interactive Image-Text Alignment for Remote Sensing Image Captioning","created":"2023-12-02","cited_by_count":18,"area":null},{"id":"2401.17426","title":"Superiority of Multi-Head Attention in In-Context Linear Regression","created":"2024-01-30","cited_by_count":17,"area":null},{"id":"2406.15625","title":"Shortcomings of LLMs for Low-Resource Translation: Retrieval and Understanding are Both the Problem","created":"2024-06-21","cited_by_count":17,"area":null},{"id":"2310.14201","title":"Prompt Engineering Through the Lens of Optimal Control","created":"2023-10-22","cited_by_count":16,"area":null},{"id":"2410.03437","title":"Zebra: In-Context Generative Pretraining for Solving Parametric PDEs","created":"2024-10-04","cited_by_count":16,"area":null},{"id":"2510.18871","title":"How Do LLMs Use Their Depth?","created":"2025-10-21","cited_by_count":16,"area":null},{"id":"2305.13016","title":"Iterative Forward Tuning Boosts In-Context Learning in Language Models","created":"2023-05-22","cited_by_count":15,"area":null},{"id":"2309.13701","title":"ALLURE: Auditing and Improving LLM-based Evaluation of Text using Iterative In-Context-Learning","created":"2023-09-24","cited_by_count":15,"area":null},{"id":"2312.01022","title":"Advanced Large Language Model (LLM)-Driven Verilog Development: Enhancing Power, Performance, and Area Optimization in Code Synthesis","created":"2023-12-02","cited_by_count":14,"area":null},{"id":"2405.16236","title":"A transfer learning framework for weak-to-strong generalization","created":"2024-05-25","cited_by_count":14,"area":null},{"id":"2310.17639","title":"In-Context Learning Dynamics with Random Binary Sequences","created":"2023-10-26","cited_by_count":13,"area":null},{"id":"2402.07738","title":"Universal Link Predictor By In-Context Learning on Graphs","created":"2024-02-12","cited_by_count":13,"area":null},{"id":"2305.15695","title":"Asking Before Acting: Gather Information in Embodied Decision Making with Language Models","created":"2023-05-25","cited_by_count":12,"area":null},{"id":"2410.01288","title":"Mitigating Copy Bias in In-Context Learning through Neuron Pruning","created":"2024-10-02","cited_by_count":11,"area":null},{"id":"2410.21698","title":"On the Role of Depth and Looping for In-Context Learning with Task Diversity","created":"2024-10-29","cited_by_count":11,"area":null},{"id":"2501.13075","title":"Evolution and The Knightian Blindspot of Machine Learning","created":"2025-01-22","cited_by_count":11,"area":null},{"id":"2502.09844","title":"Solving Empirical Bayes via Transformers","created":"2025-02-14","cited_by_count":11,"area":null},{"id":"2410.20553","title":"SPICEPilot: Navigating SPICE Code Generation and Simulation with AI Guidance","created":"2024-10-27","cited_by_count":10,"area":null},{"id":"2406.15771","title":"HCQA @ Ego4D EgoSchema Challenge 2024","created":"2024-06-22","cited_by_count":9,"area":null},{"id":"2309.06054","title":"Breaking through the learning plateaus of in-context learning in Transformer","created":"2023-09-12","cited_by_count":8,"area":null},{"id":"2510.27055","title":"Detecting Data Contamination in LLMs via In-Context Learning","created":"2025-10-30","cited_by_count":8,"area":null},{"id":"2405.19795","title":"SLM as Guardian: Pioneering AI Safety with Small Language Models","created":"2024-05-30","cited_by_count":7,"area":null},{"id":"2505.12138","title":"Transformer learns the cross-task prior and regularization for in-context learning","created":"2025-05-17","cited_by_count":7,"area":null},{"id":"2601.15014","title":"Efficient and Minimax Optimal In-context Nonparametric Regression with Transformers","created":"2026-01-21","cited_by_count":7,"area":null},{"id":"2405.17234","title":"Benchmarking General-Purpose In-Context Learning","created":"2024-05-27","cited_by_count":6,"area":null},{"id":"2407.17011","title":"Unveiling In-Context Learning: A Coordinate System to Understand Its Working Mechanism","created":"2024-07-24","cited_by_count":6,"area":null},{"id":"2410.05218","title":"Density estimation with LLMs: a geometric investigation of in-context learning trajectories","created":"2024-10-07","cited_by_count":6,"area":null},{"id":"2410.13981","title":"On the Learn-to-Optimize Capabilities of Transformers in In-Context Sparse Recovery","created":"2024-10-17","cited_by_count":6,"area":null},{"id":"2412.18086","title":"Generating Traffic Scenarios via In-Context Learning to Learn Better Motion Planner","created":"2024-12-24","cited_by_count":6,"area":null},{"id":"2505.14300","title":"Beyond Black-Box Obfuscation: Mechanistic Analysis and Defense of White-Box Monitors","created":"2025-05-20","cited_by_count":6,"area":null},{"id":"2506.05200","title":"Transformers Meet In-Context Learning: A Universal Approximation Theory","created":"2025-06-05","cited_by_count":6,"area":null},{"id":"2310.05884","title":"A Meta-Learning Perspective on Transformers for Causal Language Modeling","created":"2023-10-09","cited_by_count":5,"area":null},{"id":"2310.12477","title":"Exploring In-Context Learning of Textless Speech Language Model for Speech Classification Tasks","created":"2023-10-19","cited_by_count":5,"area":null},{"id":"2312.17055","title":"Beyond Output Matching: Bidirectional Alignment for Enhanced In-Context Learning","created":"2023-12-28","cited_by_count":5,"area":null},{"id":"2412.05710","title":"PromptRefine: Enhancing Few-Shot Performance on Low-Resource Indic Languages with Example Selection from Related Example Banks","created":"2024-12-07","cited_by_count":5,"area":null},{"id":"2506.03426","title":"Adaptive Task Vectors for Large Language Models","created":"2025-06-03","cited_by_count":5,"area":null},{"id":"2511.17864","title":"Equivalence of Context and Parameter Updates in Modern Transformer Blocks","created":"2025-11-22","cited_by_count":5,"area":null},{"id":"2402.15514","title":"Large Scale Generative AI Text Applied to Sports and Music","created":"2024-01-31","cited_by_count":4,"area":null},{"id":"2403.14381","title":"Editing Knowledge Representation of Language Model via Rephrased Prefix Prompts","created":"2024-03-21","cited_by_count":4,"area":null},{"id":"2406.10878","title":"Demonstration Notebook: Finding the Most Suited In-Context Learning Example from Interactions","created":"2024-06-16","cited_by_count":4,"area":null},{"id":"2406.18501","title":"Is In-Context Learning a Type of Error-Driven Learning? Evidence from the Inverse Frequency Effect in Structural Priming","created":"2024-06-26","cited_by_count":4,"area":null},{"id":"2502.08136","title":"In-Context Learning of Linear Dynamical Systems with Transformers: Approximation Bounds and Depth-Separation","created":"2025-02-12","cited_by_count":4,"area":null},{"id":"2503.15579","title":"Understanding the Generalization of In-Context Learning in Transformers: An Empirical Study","created":"2025-03-19","cited_by_count":4,"area":null},{"id":"2505.15813","title":"Meta-Learning an In-Context Transformer Model of Human Higher Visual Cortex","created":"2025-05-21","cited_by_count":4,"area":null},{"id":"2507.20443","title":"Provable In-Context Learning of Nonlinear Regression with Transformers","created":"2025-07-28","cited_by_count":4,"area":null},{"id":"2509.02452","title":"Do LLMs Adhere to Label Definitions? Examining Their Receptivity to External Label Definitions","created":"2025-09-02","cited_by_count":4,"area":null},{"id":"2510.01450","title":"Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regression","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2406.16007","title":"Label Words as Local Task Vectors in In-Context Learning","created":"2024-06-23","cited_by_count":3,"area":null},{"id":"2408.12959","title":"Multimodal Contrastive In-Context Learning","created":"2024-08-23","cited_by_count":3,"area":null},{"id":"2501.15857","title":"Are Transformers Able to Reason by Connecting Separated Knowledge in Training Data?","created":"2025-01-27","cited_by_count":3,"area":null},{"id":"2502.17024","title":"Towards Auto-Regressive Next-Token Prediction: In-Context Learning Emerges from Generalization","created":"2025-02-24","cited_by_count":3,"area":null},{"id":"2505.11004","title":"Illusion or Algorithm? Investigating Memorization, Emergence, and Symbolic Processing in In-Context Learning","created":"2025-05-16","cited_by_count":3,"area":null},{"id":"2505.14042","title":"Adversarially Pretrained Transformers May Be Universally Robust In-Context Learners","created":"2025-05-20","cited_by_count":3,"area":null},{"id":"2505.17838","title":"Continuum Transformers Perform In-Context Learning by Operator Gradient Descent","created":"2025-05-23","cited_by_count":3,"area":null},{"id":"2505.19107","title":"Optimization-Inspired Few-Shot Adaptation for Large Language Models","created":"2025-05-25","cited_by_count":3,"area":null},{"id":"2506.03799","title":"ConText: Driving In-context Learning for Text Removal and Segmentation","created":"2025-06-04","cited_by_count":3,"area":null},{"id":"2507.04221","title":"Context Tuning for In-Context Optimization","created":"2025-07-06","cited_by_count":3,"area":null},{"id":"2507.13540","title":"Provable Low-Frequency Bias of In-Context Learning of Representations","created":"2025-07-17","cited_by_count":3,"area":null},{"id":"2510.08734","title":"Transmuting prompts into weights","created":"2025-10-09","cited_by_count":3,"area":null},{"id":"2306.05036","title":"Mapping the Challenges of HCI: An Application and Evaluation of ChatGPT for Mining Insights at Scale","created":"2023-06-08","cited_by_count":2,"area":null},{"id":"2308.11585","title":"Causal Intersectionality and Dual Form of Gradient Descent for Multimodal Analysis: a Case Study on Hateful Memes","created":"2023-08-19","cited_by_count":2,"area":null},{"id":"2310.13226","title":"Enhancing Zero-Shot Crypto Sentiment with Fine-tuned Language Model and Prompt Engineering","created":"2023-10-20","cited_by_count":2,"area":null},{"id":"2402.16431","title":"RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions","created":"2024-02-26","cited_by_count":2,"area":null},{"id":"2410.09411","title":"Towards the Effect of Examples on In-Context Learning: A Theoretical Case Study","created":"2024-10-12","cited_by_count":2,"area":null},{"id":"2411.02639","title":"Active Prompt Tuning Enables Gpt-40 To Do Efficient Classification Of Microscopy Images","created":"2024-11-04","cited_by_count":2,"area":null},{"id":"2412.09990","title":"Small Language Model as Data Prospector for Large Language Model","created":"2024-12-13","cited_by_count":2,"area":null},{"id":"2412.17019","title":"Reversed Attention: On The Gradient Descent Of Attention Layers In GPT","created":"2024-12-22","cited_by_count":2,"area":null},{"id":"2501.15708","title":"StaICC: Standardized Evaluation for Classification Task in In-context Learning","created":"2025-01-27","cited_by_count":2,"area":null},{"id":"2502.10634","title":"Lost in the Passage: Passage-level In-context Learning Does Not Necessarily Need a \"Passage\"","created":"2025-02-15","cited_by_count":2,"area":null}],"next_cursor":"100"}