{"list":"other","total":72,"rows":[{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2505.09388","title":"Qwen3 Technical Report","created":"2025-05-14","cited_by_count":8820},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1603.02754","title":"XGBoost: A Scalable Tree Boosting System","created":"2016-03-09","cited_by_count":5166},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2401.06066","title":"DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models","created":"2024-01-11","cited_by_count":867},{"id":"2202.10054","title":"Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution","created":"2022-02-21","cited_by_count":739},{"id":"2404.06395","title":"MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies","created":"2024-04-09","cited_by_count":723},{"id":"2208.01066","title":"What Can Transformers Learn In-Context? A Case Study of Simple Function Classes","created":"2022-08-01","cited_by_count":715},{"id":"2310.01728","title":"Time-LLM: Time Series Forecasting by Reprogramming Large Language Models","created":"2023-10-03","cited_by_count":700},{"id":"2310.10688","title":"A decoder-only foundation model for time-series forecasting","created":"2023-10-14","cited_by_count":692},{"id":"2207.01848","title":"TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second","created":"2022-07-05","cited_by_count":674},{"id":"2412.06464","title":"Gated Delta Networks: Improving Mamba2 with Delta Rule","created":"2024-12-09","cited_by_count":532},{"id":"2010.14701","title":"Scaling Laws for Autoregressive Generative Modeling","created":"2020-10-28","cited_by_count":522},{"id":"2310.07820","title":"Large Language Models Are Zero-Shot Time Series Forecasters","created":"2023-10-11","cited_by_count":500},{"id":"2402.03885","title":"MOMENT: A Family of Open Time-series Foundation Models","created":"2024-02-06","cited_by_count":482},{"id":"2302.06675","title":"Symbolic Discovery of Optimization Algorithms","created":"2023-02-13","cited_by_count":434},{"id":"2502.16982","title":"Muon is Scalable for LLM Training","created":"2025-02-24","cited_by_count":428},{"id":"2012.06678","title":"TabTransformer: Tabular Data Modeling Using Contextual Embeddings","created":"2020-12-11","cited_by_count":409},{"id":"2406.11794","title":"DataComp-LM: In search of the next generation of training sets for language models","created":"2024-06-17","cited_by_count":398},{"id":"2502.02737","title":"SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model","created":"2025-02-04","cited_by_count":335},{"id":"1812.06162","title":"An Empirical Model of Large-Batch Training","created":"2018-12-14","cited_by_count":281},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"2102.01293","title":"Scaling Laws for Transfer","created":"2021-02-02","cited_by_count":272},{"id":"2510.26692","title":"Kimi Linear: An Expressive, Efficient Attention Architecture","created":"2025-10-30","cited_by_count":196},{"id":"2402.07871","title":"Scaling Laws for Fine-Grained Mixture of Experts","created":"2024-02-12","cited_by_count":173},{"id":"2405.10938","title":"Observational Scaling Laws and the Predictability of Language Model Performance","created":"2024-05-17","cited_by_count":130},{"id":"2403.08540","title":"Language models scale reliably with over-training and on downstream tasks","created":"2024-03-13","cited_by_count":113},{"id":"2210.14891","title":"Broken Neural Scaling Laws","created":"2022-10-26","cited_by_count":109},{"id":"2205.10287","title":"On the SDEs and Scaling Rules for Adaptive Gradient Algorithms","created":"2022-05-20","cited_by_count":104},{"id":"2510.13786","title":"The Art of Scaling Reinforcement Learning Compute for LLMs","created":"2025-10-15","cited_by_count":101},{"id":"2509.02046","title":"Fantastic Pretraining Optimizers and Where to Find Them","created":"2025-09-02","cited_by_count":100},{"id":"2406.19146","title":"Resolving Discrepancies in Compute-Optimal Scaling of Language Models","created":"2024-06-27","cited_by_count":88},{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78},{"id":"2407.05872","title":"Scaling Exponents Across Parameterizations and Optimizers","created":"2024-07-08","cited_by_count":76},{"id":"2410.21676","title":"How Does Critical Batch Size Scale in Pre-training?","created":"2024-10-29","cited_by_count":73},{"id":"2309.16620","title":"Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit","created":"2023-09-28","cited_by_count":66},{"id":"2404.07544","title":"From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples","created":"2024-04-11","cited_by_count":57},{"id":"2405.13698","title":"How to set AdamW's weight decay as you scale model and dataset size","created":"2024-05-22","cited_by_count":43},{"id":"2505.13738","title":"Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training","created":"2025-05-19","cited_by_count":43},{"id":"2507.07101","title":"Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful","created":"2025-07-09","cited_by_count":41},{"id":"2409.19913","title":"Scaling Optimal LR Across Token Horizons","created":"2024-09-30","cited_by_count":40},{"id":"2310.20447","title":"Efficient Bayesian Learning Curve Extrapolation using Prior-Data Fitted Networks","created":"2023-10-31","cited_by_count":37},{"id":"2412.04403","title":"Establishing Task Scaling Laws via Compute-Efficient Model Ladders","created":"2024-12-05","cited_by_count":35},{"id":"2402.14547","title":"OmniPred: Language Models as Universal Regressors","created":"2024-02-22","cited_by_count":34},{"id":"2503.04715","title":"Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining","created":"2025-03-06","cited_by_count":34},{"id":"2407.02694","title":"LLM-Select: Feature Selection with Large Language Models","created":"2024-07-02","cited_by_count":30},{"id":"2407.17465","title":"u-$\\mu$P: The Unit-Scaled Maximal Update Parametrization","created":"2024-07-24","cited_by_count":29},{"id":"2408.11029","title":"Scaling Law with Learning Rate Annealing","created":"2024-08-20","cited_by_count":29},{"id":"2507.00885","title":"Scaling Laws Are Unreliable for Downstream Tasks: A Reality Check","created":"2025-07-01","cited_by_count":29},{"id":"2402.04376","title":"Scaling laws for learning with real and surrogate data","created":"2024-02-06","cited_by_count":27},{"id":"2404.16795","title":"In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization","created":"2024-04-25","cited_by_count":26},{"id":"2410.05661","title":"Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models","created":"2024-10-08","cited_by_count":25},{"id":"2412.01505","title":"Scaling Law for Language Models Training Considering Batch Size","created":"2024-12-02","cited_by_count":22},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22},{"id":"2510.19093","title":"Weight Decay may matter more than muP for Learning Rate Transfer in Practice","created":"2025-10-21","cited_by_count":20},{"id":"2509.19189","title":"Functional Scaling Laws in Kernel Regression: Loss Dynamics and Learning Rate Schedules","created":"2025-09-23","cited_by_count":17},{"id":"2006.03361","title":"Learning to Rank Learning Curves","created":"2020-06-05","cited_by_count":16},{"id":"2302.00441","title":"Scaling Laws for Hyperparameter Optimization","created":"2023-02-01","cited_by_count":16},{"id":"2506.21718","title":"Performance Prediction for Large Systems via Text-to-Text Regression","created":"2025-06-26","cited_by_count":14},{"id":"2507.21184","title":"Can Language Models Discover Scaling Laws?","created":"2025-07-27","cited_by_count":13},{"id":"1910.04522","title":"Probabilistic Rollouts for Learning Curve Extrapolation Across Hyperparameter Settings","created":"2019-10-10","cited_by_count":12},{"id":"2411.16782","title":"Scaling Laws for Black box Adversarial Attacks","created":"2024-11-25","cited_by_count":8},{"id":"2510.15262","title":"Robust Layerwise Scaling Rules by Proper Weight Decay Tuning","created":"2025-10-17","cited_by_count":8},{"id":"2409.04777","title":"Optimization Hyper-parameter Laws for Large Language Models","created":"2024-09-07","cited_by_count":7},{"id":"2506.10972","title":"Predictable Scale: Part II, Farseer: A Refined Scaling Law in Large Language Models","created":"2025-06-12","cited_by_count":6},{"id":"2601.05049","title":"How to Set the Learning Rate for Large-Scale Pre-training?","created":"2026-01-08","cited_by_count":5},{"id":"2509.25049","title":"Efficient Hyperparameter Tuning via Trajectory Invariance Principle","created":"2025-09-29","cited_by_count":4},{"id":"2508.19563","title":"Robustness is Important: Limitations of LLMs for Data Fitting","created":"2025-08-27","cited_by_count":2},{"id":"2508.19733","title":"Tune My Adam, Please!","created":"2025-08-27","cited_by_count":2},{"id":"2601.19831","title":"Neural Neural Scaling Laws","created":"2026-01-27","cited_by_count":2}],"next_cursor":null}