{"total":65,"rows":[{"id":"2505.13738","title":"Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training","created":"2025-05-19","cited_by_count":43,"area":null},{"id":"2503.04715","title":"Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining","created":"2025-03-06","cited_by_count":34,"area":null},{"id":"2502.19002","title":"The Sharpness Disparity Principle in Transformers for Accelerating Language Model Pre-Training","created":"2025-02-26","cited_by_count":30,"area":null},{"id":"2506.10896","title":"BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP","created":"2025-06-12","cited_by_count":28,"area":null},{"id":"2507.17634","title":"WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training","created":"2025-07-23","cited_by_count":23,"area":null},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2506.08027","title":"Recipes for Pre-training LLMs with MXFP8","created":"2025-05-30","cited_by_count":22,"area":null},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22,"area":null},{"id":"2606.16899","title":"Fantastic Pretraining Optimizers and Where to Find Them II: Hyperball Optimization","created":"2026-06-15","cited_by_count":16,"area":null},{"id":"2506.19697","title":"Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models","created":"2025-06-24","cited_by_count":13,"area":null},{"id":"2603.04964","title":"Replaying pre-training data improves fine-tuning","created":"2026-03-05","cited_by_count":13,"area":null},{"id":"2508.01483","title":"Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler","created":"2025-08-02","cited_by_count":12,"area":null},{"id":"2602.03685","title":"Universal One-third Time Scaling in Learning Peaked Distributions","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2602.03702","title":"Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2605.02105","title":"Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting","created":"2026-05-04","cited_by_count":10,"area":null},{"id":"2606.18524","title":"On the Residual Scaling of Looped Transformers: Stability and Transferability","created":"2026-06-16","cited_by_count":10,"area":null},{"id":"2608.25774","title":"EXAONE Tabular 1.0 : Technical Report","created":"2026-08-26","cited_by_count":10,"area":null},{"id":"2509.25087","title":"Scaling with Collapse: Efficient and Predictable Training of LLM Families","created":"2025-09-29","cited_by_count":9,"area":null},{"id":"2501.12243","title":"FOCUS: First Order Concentrated Updating Scheme","created":"2025-01-21","cited_by_count":8,"area":null},{"id":"2505.24275","title":"GradPower: Powering Gradients for Faster Language Model Pre-Training","created":"2025-05-30","cited_by_count":8,"area":null},{"id":"2602.06797","title":"Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay","created":"2026-02-06","cited_by_count":8,"area":null},{"id":"2602.04774","title":"Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model","created":"2026-02-04","cited_by_count":7,"area":null},{"id":"2510.24626","title":"Relative Scaling Laws for LLMs","created":"2025-10-28","cited_by_count":6,"area":null},{"id":"2602.14208","title":"Fast Catch-Up, Late Switching: Optimal Batch Size Scheduling via Functional Scaling Laws","created":"2026-02-15","cited_by_count":6,"area":null},{"id":"2506.05447","title":"Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning","created":"2025-06-05","cited_by_count":5,"area":null},{"id":"2601.09000","title":"Universal Dynamics of Warmup Stable Decay: understanding WSD beyond Transformers","created":"2026-01-13","cited_by_count":5,"area":null},{"id":"2509.07972","title":"Theoretical Analysis on how Learning Rate Warmup Accelerates Convergence","created":"2025-09-09","cited_by_count":4,"area":null},{"id":"2509.22935","title":"Compute-Optimal Quantization-Aware Training","created":"2025-09-26","cited_by_count":4,"area":null},{"id":"2603.29805","title":"From Density Matrices to Phase Transitions in Deep Learning: Spectral Early Warnings and Interpretability","created":"2026-03-31","cited_by_count":4,"area":null},{"id":"2510.25244","title":"BSFA: Leveraging the Subspace Dichotomy to Accelerate Neural Network Training","created":"2025-10-29","cited_by_count":3,"area":null},{"id":"2601.12083","title":"Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Models","created":"2026-01-17","cited_by_count":2,"area":null},{"id":"2605.06546","title":"Efficient Pre-Training with Token Superposition","created":"2026-05-07","cited_by_count":2,"area":null},{"id":"2605.26484","title":"Extra-Merge: Tracing the Rank-1 Subspace of Model Merging in Language Model Pre-Training","created":"2026-05-26","cited_by_count":2,"area":null},{"id":"2606.21514","title":"Towards Understanding the Power and Limits of the Muon Optimizer: A River-Valley Perspective","created":"2026-06-19","cited_by_count":2,"area":null},{"id":"2412.14771","title":"ALKAFI-LLAMA3: Fine-Tuning LLMs for Precise Legal Understanding in Palestine","created":"2024-12-19","cited_by_count":1,"area":null},{"id":"2506.18639","title":"ByteSpan: Information-Driven Subword Tokenisation","created":"2025-06-23","cited_by_count":1,"area":null},{"id":"2512.23903","title":"Scaling Remote Sensing Foundation Models: Data Domain Tradeoffs at the Peta-Scale","created":"2025-12-29","cited_by_count":1,"area":null},{"id":"2602.02522","title":"IMU-1: Sample-Efficient Pre-training of Small Language Models","created":"2026-01-25","cited_by_count":1,"area":null},{"id":"2603.05369","title":"Progressive Residual Warmup for Language Model Pretraining","created":"2026-03-05","cited_by_count":1,"area":null},{"id":"2605.25395","title":"EMA-Nesterov: Stabilizing Nesterov's Lookahead for Accelerated Deep Learning Optimization","created":"2026-05-25","cited_by_count":1,"area":null},{"id":"2606.25086","title":"Training for the Model You Return: Improving Optimization for Iterate-Averaged Language Models","created":"2026-06-23","cited_by_count":1,"area":null},{"id":"2608.05088","title":"MALT: Lightweight Curvature-Aware Muon via Diagonal Preconditioning","created":"2026-08-05","cited_by_count":1,"area":null},{"id":"2609.13956","title":"Tabby: An Open Pretraining Recipe for Time Series Foundation Models","created":"2026-09-12","cited_by_count":1,"area":null},{"id":"2506.19294","title":"Duality and Policy Evaluation in Distributionally Robust Bayesian Diffusion Control","created":"2025-06-24","cited_by_count":0,"area":null},{"id":"2507.04206","title":"Mpemba Effect in Large-Language Model Training Dynamics: A Minimal Analysis of the Valley-River model","created":"2025-07-06","cited_by_count":0,"area":null},{"id":"2512.13298","title":"MiniLingua: A Small Open-Source LLM for European Languages","created":"2025-12-15","cited_by_count":0,"area":null},{"id":"2602.01845","title":"No Generation without Representation: Efficient Causal Protein Language Models Enable Zero-Shot Fitness Estimation","created":"2026-02-02","cited_by_count":0,"area":null},{"id":"2603.00786","title":"Interpretable Cross-Network Attention for Resting-State fMRI Representation Learning","created":"2026-02-28","cited_by_count":0,"area":null},{"id":"2605.13652","title":"Beyond Perplexity: A Geometric and Spectral Study of Low-Rank Pre-Training","created":"2026-05-13","cited_by_count":0,"area":null},{"id":"2605.27767","title":"UniMaia: Steering Chess Policies with Language for Human-like Play","created":"2026-05-26","cited_by_count":0,"area":null},{"id":"2606.04327","title":"A Geometric Characterization of the Stationary Plateau for Two-Layer Neural Networks","created":"2026-06-03","cited_by_count":0,"area":null},{"id":"2606.05610","title":"Predictable Scaling Laws of Optimal Hyperparameters for LLM Continued Pre-training","created":"2026-06-04","cited_by_count":0,"area":null},{"id":"2607.10959","title":"WSqD: A Horizon-Free Learning Rate Schedule for Large Model Training","created":"2026-07-12","cited_by_count":0,"area":null},{"id":"2608.09307","title":"Linearized 2-Simplicial Attention","created":"2026-08-10","cited_by_count":0,"area":null},{"id":"2609.01034","title":"The Multiple Timescales of Gradient Descent on the Edge of Stability: A Perturbative Derivation of the Central Flow","created":"2026-09-01","cited_by_count":0,"area":null},{"id":"2609.08069","title":"BrachistoneLR: A Brachistochrone-Inspired Learning-Rate Schedule and a Controlled Benchmark of Scheduling Policies","created":"2026-09-08","cited_by_count":0,"area":null},{"id":"2609.09116","title":"When Does Scale-Invariant Optimization Become Unstable? An Exact Schedule Law with Weight Decay","created":"2026-09-08","cited_by_count":0,"area":null},{"id":"2609.18314","title":"Beyond Quadratic Loss: The Stability Phase Diagram of Adam","created":"2026-09-16","cited_by_count":0,"area":null},{"id":"2609.33016","title":"Relative Generalization Invariance of LLM Pretraining","created":"2026-09-26","cited_by_count":0,"area":null},{"id":"2609.33150","title":"Generalization Dynamics of LM Pre-training","created":"2026-09-27","cited_by_count":0,"area":null},{"id":"2609.39767","title":"How Does Local Landscape Geometry Evolve in Language Model Pre-Training?","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.00446","title":"Exact information accounting for SGD methods","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.03087","title":"Zephon: Elastic Determinism for Online, Stateful Foundation Model Data Loading Pipelines","created":"2026-10-02","cited_by_count":0,"area":null},{"id":"2610.06784","title":"How to scale your HEP ML models: A recipe for robust architecture comparisons at scale","created":"2026-10-05","cited_by_count":0,"area":null},{"id":"2610.08975","title":"The Best Optimizer Depends on Batch Size","created":"2026-10-06","cited_by_count":0,"area":null}],"next_cursor":null}