{"list":"other","total":71,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"1910.01108","title":"DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter","created":"2019-10-02","cited_by_count":4307},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2101.06804","title":"What Makes Good In-Context Examples for GPT-$3$?","created":"2021-01-17","cited_by_count":1195},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"2212.07677","title":"Transformers learn in-context by gradient descent","created":"2022-12-15","cited_by_count":732},{"id":"2208.01066","title":"What Can Transformers Learn In-Context? A Case Study of Simple Function Classes","created":"2022-08-01","cited_by_count":715},{"id":"2211.15661","title":"What learning algorithm is in-context learning? Investigations with linear models","created":"2022-11-28","cited_by_count":684},{"id":"2307.08621","title":"Retentive Network: A Successor to Transformer for Large Language Models","created":"2023-07-17","cited_by_count":613},{"id":"2110.13985","title":"Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers","created":"2021-10-26","cited_by_count":608},{"id":"2212.14052","title":"Hungry Hungry Hippos: Towards Language Modeling with State Space Models","created":"2022-12-28","cited_by_count":499},{"id":"2406.06484","title":"Parallelizing Linear Transformers with the Delta Rule over Sequence Length","created":"2024-06-10","cited_by_count":396},{"id":"1811.04918","title":"Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers","created":"2018-11-12","cited_by_count":340},{"id":"2306.09927","title":"Trained Transformers Learn Linear Models In-Context","created":"2023-06-16","cited_by_count":337},{"id":"2205.05055","title":"Data Distributional Properties Drive Emergent In-Context Learning in Transformers","created":"2022-04-22","cited_by_count":309},{"id":"2306.04637","title":"Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection","created":"2023-06-07","cited_by_count":298},{"id":"2306.00297","title":"Transformers learn to implement preconditioned gradient descent for in-context learning","created":"2023-06-01","cited_by_count":279},{"id":"2305.00944","title":"Poisoning Language Models During Instruction Tuning","created":"2023-05-01","cited_by_count":269},{"id":"2407.08083","title":"MambaVision: A Hybrid Mamba-Transformer Vision Backbone","created":"2024-07-10","cited_by_count":224},{"id":"1905.13210","title":"Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks","created":"2019-05-30","cited_by_count":222},{"id":"2402.01032","title":"Repeat After Me: Transformers are Better than State Space Models at Copying","created":"2024-02-01","cited_by_count":216},{"id":"2212.10375","title":"Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering","created":"2022-12-20","cited_by_count":161},{"id":"2405.05254","title":"You Only Cache Once: Decoder-Decoder Architectures for Language Models","created":"2024-05-08","cited_by_count":144},{"id":"2312.03002","title":"The mechanistic basis of data dependence and abrupt learning in an in-context classification task","created":"2023-12-03","cited_by_count":118},{"id":"2310.05249","title":"In-Context Convergence of Transformers","created":"2023-10-08","cited_by_count":115},{"id":"2405.16605","title":"Demystify Mamba in Vision: A Linear Attention Perspective","created":"2024-05-26","cited_by_count":102},{"id":"2307.14692","title":"Backdoor Attacks for In-Context Learning with Language Models","created":"2023-07-27","cited_by_count":96},{"id":"2310.08391","title":"How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?","created":"2023-10-12","cited_by_count":96},{"id":"1706.03175","title":"Recovery Guarantees for One-hidden-layer Neural Networks","created":"2017-06-10","cited_by_count":94},{"id":"2210.09221","title":"Vision Transformers provably learn spatial structure","created":"2022-10-13","cited_by_count":93},{"id":"2002.07400","title":"Learning Parities with Neural Networks","created":"2020-02-18","cited_by_count":78},{"id":"2302.06015","title":"A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity","created":"2023-02-12","cited_by_count":77},{"id":"2402.19442","title":"Training Dynamics of Multi-Head Softmax Attention for In-Context Learning: Emergence, Convergence, and Optimality","created":"2024-02-29","cited_by_count":74},{"id":"2401.05949","title":"Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learning","created":"2024-01-11","cited_by_count":53},{"id":"2412.06538","title":"Understanding Factual Recall in Transformers via Associative Memories","created":"2024-12-09","cited_by_count":51},{"id":"2409.10559","title":"Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers","created":"2024-09-09","cited_by_count":50},{"id":"2206.01717","title":"A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features","created":"2022-06-03","cited_by_count":49},{"id":"2402.01258","title":"Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape","created":"2024-02-02","cited_by_count":46},{"id":"2311.09948","title":"Hijacking Large Language Models via Adversarial In-Context Learning","created":"2023-11-16","cited_by_count":45},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40},{"id":"2408.10147","title":"In-Context Learning with Representations: Contextual Generalization of Trained Transformers","created":"2024-08-19","cited_by_count":38},{"id":"2504.10957","title":"When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformers","created":"2025-04-15","cited_by_count":38},{"id":"2306.04073","title":"Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks","created":"2023-06-07","cited_by_count":35},{"id":"2402.15607","title":"How Do Nonlinear Transformers Learn and Generalize in In-Context Learning?","created":"2024-02-23","cited_by_count":35},{"id":"2411.02544","title":"Pretrained transformer efficiently learns low-dimensional target functions in-context","created":"2024-11-04","cited_by_count":31},{"id":"2402.12530","title":"Parallel Structures in Pre-training Data Yield In-Context Learning","created":"2024-02-19","cited_by_count":26},{"id":"2407.10005","title":"Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond","created":"2024-07-13","cited_by_count":24},{"id":"2207.03584","title":"Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology Sampling","created":"2022-07-07","cited_by_count":23},{"id":"1802.06463","title":"Guaranteed Recovery of One-Hidden-Layer Neural Networks via Cross Entropy","created":"2018-02-18","cited_by_count":22},{"id":"2402.02160","title":"Data Poisoning for In-context Learning","created":"2024-02-03","cited_by_count":21},{"id":"2405.16646","title":"A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts","created":"2024-05-26","cited_by_count":21},{"id":"2409.19613","title":"Hybrid Mamba for Few-Shot Segmentation","created":"2024-09-29","cited_by_count":21},{"id":"2310.16173","title":"On the Convergence and Sample Complexity Analysis of Deep Q-Networks with $\\epsilon$-Greedy Exploration","created":"2023-10-24","cited_by_count":17},{"id":"2409.19345","title":"Unveil Benign Overfitting for Transformer in Vision: Training Dynamics, Convergence, and Generalization","created":"2024-09-28","cited_by_count":17},{"id":"2308.11129","title":"Enhancing Graph Transformers with Hierarchical Distance Structural Encoding","created":"2023-08-22","cited_by_count":16},{"id":"2406.01977","title":"What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding","created":"2024-06-04","cited_by_count":14},{"id":"2410.02167","title":"Training Nonlinear Transformers for Chain-of-Thought Inference: A Theoretical Generalization Analysis","created":"2024-10-03","cited_by_count":14},{"id":"2504.04308","title":"Gating is Weighting: Understanding Gated Linear Attention through In-context Learning","created":"2025-04-06","cited_by_count":12},{"id":"2405.16435","title":"Node Identifiers: Compact, Discrete Representations for Efficient Graph Learning","created":"2024-05-26","cited_by_count":10},{"id":"2410.09605","title":"Training Dynamics of Transformers to Recognize Word Co-occurrence via Gradient Flow Analysis","created":"2024-10-12","cited_by_count":9},{"id":"2410.23438","title":"Learning and Transferring Sparse Contextual Bigrams with Linear Transformers","created":"2024-10-30","cited_by_count":9},{"id":"2207.03615","title":"Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data","created":"2022-07-07","cited_by_count":8},{"id":"2406.17167","title":"Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis","created":"2024-06-24","cited_by_count":8},{"id":"2411.05189","title":"Understanding In-Context Learning of Linear Models in Transformers Through an Adversarial Lens","created":"2024-11-07","cited_by_count":8},{"id":"2503.12734","title":"In-Context Linear Regression Demystified: Training Dynamics and Mechanistic Interpretability of Multi-Head Softmax Attention","created":"2025-03-17","cited_by_count":7},{"id":"2403.07310","title":"How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance","created":"2024-03-12","cited_by_count":6},{"id":"2502.15609","title":"On the Robustness of Transformers against Context Hijacking for Linear Classification","created":"2025-02-21","cited_by_count":4},{"id":"2407.09375","title":"HiPPO-Prophecy: State-Space Models can Provably Learn Dynamical Systems in Context","created":"2024-07-12","cited_by_count":3},{"id":"2506.09093","title":"Merging Smarter, Generalizing Better: Enhancing Model Merging on OOD Data","created":"2025-06-10","cited_by_count":3}],"next_cursor":null}