{"list":"other","total":52,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2307.15818","title":"RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control","created":"2023-07-28","cited_by_count":3080},{"id":"2303.03378","title":"PaLM-E: An Embodied Multimodal Language Model","created":"2023-03-06","cited_by_count":2071},{"id":"2309.08600","title":"Sparse Autoencoders Find Highly Interpretable Features in Language Models","created":"2023-09-15","cited_by_count":1420},{"id":"2212.10156","title":"Planning-oriented Autonomous Driving","created":"2022-12-20","cited_by_count":1087},{"id":"2306.05424","title":"Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models","created":"2023-06-08","cited_by_count":1062},{"id":"2311.03658","title":"The Linear Representation Hypothesis and the Geometry of Large Language Models","created":"2023-11-07","cited_by_count":716},{"id":"2208.01066","title":"What Can Transformers Learn In-Context? A Case Study of Simple Function Classes","created":"2022-08-01","cited_by_count":715},{"id":"2310.06824","title":"The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets","created":"2023-10-10","cited_by_count":712},{"id":"2306.09927","title":"Trained Transformers Learn Linear Models In-Context","created":"2023-06-16","cited_by_count":337},{"id":"2309.00941","title":"Emergent Linear Representations in World Models of Self-Supervised Sequence Models","created":"2023-09-02","cited_by_count":319},{"id":"2310.02207","title":"Language Models Represent Space and Time","created":"2023-10-03","cited_by_count":316},{"id":"2310.15916","title":"In-Context Learning Creates Task Vectors","created":"2023-10-24","cited_by_count":312},{"id":"2205.05055","title":"Data Distributional Properties Drive Emergent In-Context Learning in Transformers","created":"2022-04-22","cited_by_count":309},{"id":"2310.15213","title":"Function Vectors in Large Language Models","created":"2023-10-23","cited_by_count":308},{"id":"2305.09731","title":"What In-Context Learning \"Learns\" In-Context: Disentangling Task Recognition and Task Learning","created":"2023-05-16","cited_by_count":152},{"id":"2305.19420","title":"What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization","created":"2023-05-30","cited_by_count":118},{"id":"2312.03002","title":"The mechanistic basis of data dependence and abrupt learning in an in-context classification task","created":"2023-12-03","cited_by_count":118},{"id":"2402.14735","title":"How Transformers Learn Causal Structure with Gradient Descent","created":"2024-02-22","cited_by_count":118},{"id":"2407.20311","title":"Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process","created":"2024-07-29","cited_by_count":108},{"id":"2305.16380","title":"Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer","created":"2023-05-25","cited_by_count":102},{"id":"2305.16130","title":"Language Models Implement Simple Word2Vec-style Vector Arithmetic","created":"2023-05-25","cited_by_count":98},{"id":"2310.08391","title":"How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?","created":"2023-10-12","cited_by_count":96},{"id":"2303.04245","title":"How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding","created":"2023-03-07","cited_by_count":86},{"id":"2306.04891","title":"In-Context Learning through the Bayesian Prism","created":"2023-06-08","cited_by_count":83},{"id":"2311.08360","title":"The Transient Nature of Emergent In-Context Learning in Transformers","created":"2023-11-14","cited_by_count":76},{"id":"2310.10616","title":"How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations","created":"2023-10-16","cited_by_count":75},{"id":"2205.07237","title":"Discovering Latent Concepts Learned in BERT","created":"2022-05-15","cited_by_count":56},{"id":"2412.01003","title":"Competition Dynamics Shape Algorithmic Phases of In-Context Learning","created":"2024-12-01","cited_by_count":54},{"id":"2307.12375","title":"In-Context Learning Learns Label Relationships but Is Not Conventional Learning","created":"2023-07-23","cited_by_count":51},{"id":"2409.10559","title":"Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers","created":"2024-09-09","cited_by_count":50},{"id":"2402.01258","title":"Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape","created":"2024-02-02","cited_by_count":46},{"id":"2311.00871","title":"Pretraining Data Mixtures Enable Narrow Model Selection Capabilities in Transformer Models","created":"2023-11-01","cited_by_count":45},{"id":"2405.19592","title":"Why Larger Language Models Do In-context Learning Differently?","created":"2024-05-30","cited_by_count":45},{"id":"2411.02544","title":"Pretrained transformer efficiently learns low-dimensional target functions in-context","created":"2024-11-04","cited_by_count":31},{"id":"2305.16704","title":"A Closer Look at In-Context Learning under Distribution Shifts","created":"2023-05-26","cited_by_count":25},{"id":"2412.00104","title":"Differential learning kinetics govern the transition from memorization to generalization during in-context learning","created":"2024-11-27","cited_by_count":21},{"id":"2501.09240","title":"Task Vectors in In-Context Learning: Emergence, Formation, and Benefit","created":"2025-01-16","cited_by_count":20},{"id":"2410.23042","title":"Toward Understanding In-context vs. In-weight Learning","created":"2024-10-30","cited_by_count":19},{"id":"2503.05631","title":"Strategy Coopetition Explains the Emergence and Transience of In-Context Learning","created":"2025-03-07","cited_by_count":17},{"id":"2406.00053","title":"Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting","created":"2024-05-28","cited_by_count":15},{"id":"2410.05603","title":"Everything Everywhere All at Once: LLMs can In-Context Learn Multiple Tasks in Superposition","created":"2024-10-08","cited_by_count":14},{"id":"2405.19162","title":"Does learning the right latent variables necessarily improve in-context learning?","created":"2024-05-29","cited_by_count":13},{"id":"2406.03345","title":"Feature contamination: Neural networks learn uncorrelated features and fail to generalize","created":"2024-06-05","cited_by_count":11},{"id":"2412.12276","title":"Emergence and Effectiveness of Task Vectors in In-Context Learning: An Encoder Decoder Perspective","created":"2024-12-16","cited_by_count":9},{"id":"2410.01265","title":"Transformers Handle Endogeneity in In-Context Linear Regression","created":"2024-10-02","cited_by_count":8},{"id":"2502.09297","title":"When Do Neural Networks Learn World Models?","created":"2025-02-13","cited_by_count":8},{"id":"2508.09820","title":"Provable In-Context Vector Arithmetic via Retrieving Task Concepts","created":"2025-08-13","cited_by_count":8},{"id":"2503.16401","title":"Exploring the Hidden Reasoning Process of Large Language Models by Misleading Them","created":"2025-03-20","cited_by_count":3}],"next_cursor":null}