{"total":118,"rows":[{"id":"2106.07594","title":"Graph Contrastive Learning Automated","created":"2021-06-10","cited_by_count":287,"area":null},{"id":"2101.11517","title":"Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond","created":"2021-01-27","cited_by_count":153,"area":null},{"id":"2209.12892","title":"Learning to Learn with Generative Models of Neural Network Checkpoints","created":"2022-09-26","cited_by_count":86,"area":null},{"id":"2106.04570","title":"BERT Learns to Teach: Knowledge Distillation with Meta Learning","created":"2021-06-08","cited_by_count":61,"area":"distill"},{"id":"2112.13835","title":"Unbiased Gradient Estimation in Unrolled Computation Graphs with Persistent Evolution Strategies","created":"2021-12-27","cited_by_count":52,"area":null},{"id":"2310.07831","title":"Optimal Linear Decay Learning Rate Schedules and Further Refinements","created":"2023-10-11","cited_by_count":43,"area":null},{"id":"2205.13881","title":"Automated Dynamic Algorithm Configuration","created":"2022-05-27","cited_by_count":39,"area":null},{"id":"2201.04038","title":"DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptation","created":"2022-01-11","cited_by_count":36,"area":null},{"id":"2209.11208","title":"A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biases","created":"2022-09-22","cited_by_count":30,"area":null},{"id":"2205.13723","title":"DLTTA: Dynamic Learning Rate for Test-time Adaptation on Cross-domain Medical Images","created":"2022-05-27","cited_by_count":28,"area":null},{"id":"2207.02849","title":"Betty: An Automatic Differentiation Library for Multilevel Optimization","created":"2022-07-05","cited_by_count":27,"area":null},{"id":"2412.17256","title":"B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners","created":"2024-12-23","cited_by_count":26,"area":"lr"},{"id":"2112.09810","title":"Meta Propagation Networks for Graph Few-shot Semi-supervised Learning","created":"2021-12-18","cited_by_count":25,"area":null},{"id":"2303.07502","title":"Meta-learning approaches for few-shot learning: A survey of recent advances","created":"2023-03-13","cited_by_count":25,"area":null},{"id":"2106.00958","title":"A Generalizable Approach to Learning Optimizers","created":"2021-06-02","cited_by_count":23,"area":null},{"id":"2310.00697","title":"Learning How to Propagate Messages in Graph Neural Networks","created":"2023-10-01","cited_by_count":23,"area":null},{"id":"2310.19182","title":"Fast Trainable Projection for Robust Fine-Tuning","created":"2023-10-29","cited_by_count":19,"area":null},{"id":"2102.07847","title":"Meta Back-translation","created":"2021-02-15","cited_by_count":16,"area":null},{"id":"2109.05198","title":"Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information","created":"2021-09-11","cited_by_count":16,"area":null},{"id":"2306.12747","title":"Don't be so Monotone: Relaxing Stochastic Line Search in Over-Parameterized Models","created":"2023-06-22","cited_by_count":15,"area":null},{"id":"2105.10762","title":"AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly","created":"2021-05-22","cited_by_count":14,"area":null},{"id":"2112.09245","title":"Automated Deep Learning: Neural Architecture Search Is Not the End","created":"2021-12-16","cited_by_count":13,"area":null},{"id":"2305.18577","title":"Towards Constituting Mathematical Structures for Learning to Optimize","created":"2023-05-29","cited_by_count":13,"area":null},{"id":"2402.07793","title":"Tuning-Free Stochastic Optimization","created":"2024-02-12","cited_by_count":13,"area":null},{"id":"2403.14374","title":"FIT-RAG: Black-Box RAG with Factual Information and Token Reduction","created":"2024-03-21","cited_by_count":13,"area":"rag"},{"id":"2112.15400","title":"A Theoretical Understanding of Gradient Bias in Meta-Reinforcement Learning","created":"2021-12-31","cited_by_count":12,"area":null},{"id":"2210.12936","title":"Selecting and Composing Learning Rate Policies for Deep Neural Networks","created":"2022-10-24","cited_by_count":12,"area":null},{"id":"2411.01803","title":"Gradient Methods with Online Scaling","created":"2024-11-04","cited_by_count":11,"area":null},{"id":"2103.08233","title":"Robust MAML: Prioritization task buffer with adaptive learning process for model-agnostic meta-learning","created":"2021-03-15","cited_by_count":10,"area":null},{"id":"2107.05855","title":"Automated Learning Rate Scheduler for Large-batch Training","created":"2021-07-13","cited_by_count":10,"area":null},{"id":"2306.00119","title":"Optimal Sets and Solution Paths of ReLU Networks","created":"2023-05-31","cited_by_count":10,"area":null},{"id":"2105.10190","title":"AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks","created":"2021-05-21","cited_by_count":9,"area":null},{"id":"2107.02378","title":"Learning an Explicit Hyperparameter Prediction Function Conditioned on Tasks","created":"2021-07-06","cited_by_count":9,"area":null},{"id":"2203.00089","title":"Amortized Proximal Optimization","created":"2022-02-28","cited_by_count":9,"area":null},{"id":"2206.06900","title":"Grad-GradaGrad? A Non-Monotone Adaptive Stochastic Gradient Method","created":"2022-06-14","cited_by_count":9,"area":null},{"id":"2209.08907","title":"Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning","created":"2022-09-19","cited_by_count":9,"area":null},{"id":"2306.02527","title":"Searching for Optimal Per-Coordinate Step-sizes with Multidimensional Backtracking","created":"2023-06-05","cited_by_count":9,"area":null},{"id":"2310.11291","title":"An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent","created":"2023-10-17","cited_by_count":9,"area":null},{"id":"2310.03156","title":"FedHyper: A Universal and Robust Learning Rate Scheduler for Federated Learning with Hypergradient Descent","created":"2023-10-04","cited_by_count":8,"area":null},{"id":"2407.06183","title":"Stepping on the Edge: Curvature Aware Learning Rate Tuners","created":"2024-07-08","cited_by_count":8,"area":null},{"id":"2110.10461","title":"Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation","created":"2021-10-20","cited_by_count":7,"area":null},{"id":"2202.00145","title":"Step-size Adaptation Using Exponentiated Gradient Updates","created":"2022-01-31","cited_by_count":7,"area":null},{"id":"2304.11153","title":"Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single","created":"2023-04-21","cited_by_count":7,"area":null},{"id":"2302.00252","title":"QLABGrad: a Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning","created":"2023-02-01","cited_by_count":6,"area":null},{"id":"2302.01541","title":"Contrastive Learning with Consistent Representations","created":"2023-02-03","cited_by_count":6,"area":null},{"id":"2401.08893","title":"MADA: Meta-Adaptive Optimizers through hyper-gradient Descent","created":"2024-01-17","cited_by_count":6,"area":null},{"id":"2402.02342","title":"MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters","created":"2024-02-04","cited_by_count":5,"area":null},{"id":"2502.11229","title":"Provable and Practical Online Learning Rate Adaptation with Hypergradient Descent","created":"2025-02-16","cited_by_count":5,"area":null},{"id":"2301.07902","title":"A Nonstochastic Control Approach to Optimization","created":"2023-01-19","cited_by_count":4,"area":null},{"id":"2301.13247","title":"Meta-Learning Adaptive Loss Functions","created":"2023-01-30","cited_by_count":4,"area":null},{"id":"2411.16719","title":"Learn2Synth: Learning Optimal Data Synthesis Using Hypergradients for Brain Image Segmentation","created":"2024-11-23","cited_by_count":4,"area":null},{"id":"2201.12678","title":"A Stochastic Bundle Method for Interpolating Networks","created":"2022-01-29","cited_by_count":3,"area":null},{"id":"2210.06171","title":"Learning to Optimize Quasi-Newton Methods","created":"2022-10-11","cited_by_count":3,"area":null},{"id":"2312.03051","title":"Generating Interpretable Networks using Hypernetworks","created":"2023-12-05","cited_by_count":3,"area":"mechinterp"},{"id":"2312.12483","title":"SCoTTi: Save Computation at Training Time with an adaptive framework","created":"2023-12-19","cited_by_count":3,"area":null},{"id":"2408.09310","title":"Narrowing the Focus: Learned Optimizers for Pretrained Models","created":"2024-08-17","cited_by_count":3,"area":null},{"id":"2505.23081","title":"Gradient Methods with Online Scaling Part I. Theoretical Foundations","created":"2025-05-29","cited_by_count":3,"area":null},{"id":"2506.13274","title":"AdaLRS: Loss-Guided Adaptive Learning Rate Search for Efficient Foundation Model Pretraining","created":"2025-06-16","cited_by_count":3,"area":null},{"id":"2507.07907","title":"A statistical physics framework for optimal learning","created":"2025-07-10","cited_by_count":3,"area":null},{"id":"2603.08118","title":"Model-based Offline RL via Robust Value-Aware Model Learning with Implicitly Differentiable Adaptive Weighting","created":"2026-03-09","cited_by_count":3,"area":"offlinerl"},{"id":"2111.15317","title":"AutoDrop: Training Deep Learning Models with Automatic Learning Rate Drop","created":"2021-11-30","cited_by_count":2,"area":null},{"id":"2203.16723","title":"Exploiting Explainable Metrics for Augmented SGD","created":"2022-03-31","cited_by_count":2,"area":null},{"id":"2209.00629","title":"Online Meta-Learning for Model Update Aggregation in Federated Learning for Click-Through Rate Prediction","created":"2022-08-30","cited_by_count":2,"area":null},{"id":"2209.04683","title":"Simple and Effective Gradient-Based Tuning of Sequence-to-Sequence Models","created":"2022-09-10","cited_by_count":2,"area":null},{"id":"2211.02106","title":"Federated Hypergradient Descent","created":"2022-11-03","cited_by_count":2,"area":null},{"id":"2301.07806","title":"Federated Automatic Differentiation","created":"2023-01-18","cited_by_count":2,"area":null},{"id":"2310.00829","title":"Online Sensitivity Optimization in Differentially Private Learning","created":"2023-10-02","cited_by_count":2,"area":null},{"id":"2310.14963","title":"Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens","created":"2023-10-23","cited_by_count":2,"area":null},{"id":"2403.12918","title":"Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts","created":"2024-03-19","cited_by_count":2,"area":null},{"id":"2407.00665","title":"Resolving Variable Respiratory Motion From Unsorted 4D Computed Tomography","created":"2024-06-30","cited_by_count":2,"area":null},{"id":"2509.21167","title":"A Unified Framework for Diffusion Model Unlearning with f-Divergence","created":"2025-09-25","cited_by_count":2,"area":"diffusion"},{"id":"2512.06370","title":"Greedy Alignment Principle for Optimizer Selection","created":"2025-12-06","cited_by_count":2,"area":null},{"id":"2602.00453","title":"FedMOA: Federated GRPO for Personalized Reasoning LLMs under Heterogeneous Rewards","created":"2026-01-31","cited_by_count":2,"area":"lr"},{"id":"2203.06474","title":"Optimizer Amalgamation","created":"2022-03-12","cited_by_count":1,"area":null},{"id":"2210.01063","title":"On Stability and Generalization of Bilevel Optimization Problem","created":"2022-10-03","cited_by_count":1,"area":null},{"id":"2210.10290","title":"Differentiable Self-Adaptive Learning Rate","created":"2022-10-19","cited_by_count":1,"area":null},{"id":"2302.10058","title":"Differentiable Arbitrating in Zero-sum Markov Games","created":"2023-02-20","cited_by_count":1,"area":null},{"id":"2405.03159","title":"DeepMpMRI: Tensor-decomposition Regularized Learning for Fast and High-Fidelity Multi-Parametric Microstructural MR Imaging","created":"2024-05-06","cited_by_count":1,"area":null},{"id":"2411.15375","title":"AdamZ: An Enhanced Optimisation Method for Neural Network Training","created":"2024-11-22","cited_by_count":1,"area":null},{"id":"2505.22509","title":"Accelerating Optimization via Differentiable Stopping Time","created":"2025-05-28","cited_by_count":1,"area":null},{"id":"2506.08419","title":"Online Learning-guided Learning Rate Adaptation via Gradient Alignment","created":"2025-06-10","cited_by_count":1,"area":null},{"id":"2509.11007","title":"Gradient Methods with Online Scaling Part II. Practical Aspects","created":"2025-09-13","cited_by_count":1,"area":null},{"id":"2512.05084","title":"Gradient Descent with Provably Tuned Learning-rate Schedules","created":"2025-12-04","cited_by_count":1,"area":null},{"id":"2604.13130","title":"Generalization Guarantees on Data-Driven Tuning of Gradient Descent with Langevin Updates","created":"2026-04-13","cited_by_count":1,"area":null},{"id":"2605.13473","title":"OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention","created":"2026-05-13","cited_by_count":1,"area":null},{"id":"2102.10880","title":"A Probabilistically Motivated Learning Rate Adaptation for Stochastic Optimization","created":"2021-02-22","cited_by_count":0,"area":null},{"id":"2104.05447","title":"Meta-Regularization: An Approach to Adaptive Choice of the Learning Rate in Gradient Descent","created":"2021-04-12","cited_by_count":0,"area":null},{"id":"2106.11548","title":"Adaptive Learning Rate and Momentum for Training Deep Neural Networks","created":"2021-06-22","cited_by_count":0,"area":null},{"id":"2108.13880","title":"Using a one dimensional parabolic model of the full-batch loss to estimate learning rates during training","created":"2021-08-31","cited_by_count":0,"area":null},{"id":"2109.10824","title":"Learning by Examples Based on Multi-level Optimization","created":"2021-09-22","cited_by_count":0,"area":null},{"id":"2204.01705","title":"Learning to Accelerate by the Methods of Step-size Planning","created":"2022-04-01","cited_by_count":0,"area":null},{"id":"2205.08231","title":"Hyper-Learning for Gradient-Based Batch Size Adaptation","created":"2022-05-17","cited_by_count":0,"area":null},{"id":"2212.10086","title":"End to End Generative Meta Curriculum Learning For Medical Data Augmentation","created":"2022-12-20","cited_by_count":0,"area":null},{"id":"2301.10133","title":"Read the Signs: Towards Invariance to Gradient Descent's Hyperparameter Initialization","created":"2023-01-24","cited_by_count":0,"area":null},{"id":"2304.00486","title":"Learning by Grouping: A Multilevel Optimization Framework for Improving Fairness in Classification without Losing Accuracy","created":"2023-04-02","cited_by_count":0,"area":null},{"id":"2311.13877","title":"Locally Optimal Descent for Dynamic Stepsize Scheduling","created":"2023-11-23","cited_by_count":0,"area":null},{"id":"2402.18128","title":"Downstream Task Guided Masking Learning in Masked Autoencoders Using Multi-Level Optimization","created":"2024-02-28","cited_by_count":0,"area":null},{"id":"2403.00574","title":"Beyond Single-Model Views for Deep Learning: Optimization versus Generalizability of Stochastic Optimization Algorithms","created":"2024-03-01","cited_by_count":0,"area":null},{"id":"2403.11163","title":"A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques","created":"2024-03-17","cited_by_count":0,"area":null},{"id":"2410.09943","title":"Dynamic Estimation of Learning Rates Using a Non-Linear Autoregressive Model","created":"2024-10-13","cited_by_count":0,"area":null}],"next_cursor":"100"}