{"list":"other","total":73,"rows":[{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1606.08415","title":"Gaussian Error Linear Units (GELUs)","created":"2016-06-27","cited_by_count":3502},{"id":"1903.12261","title":"Benchmarking Neural Network Robustness to Common Corruptions and Perturbations","created":"2019-03-28","cited_by_count":2877},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"1308.3432","title":"Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation","created":"2013-08-15","cited_by_count":2079},{"id":"1712.05877","title":"Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference","created":"2017-12-15","cited_by_count":1593},{"id":"1502.05767","title":"Automatic differentiation in machine learning: a survey","created":"2015-02-20","cited_by_count":855},{"id":"1309.5549","title":"Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming","created":"2013-09-22","cited_by_count":724},{"id":"2012.13255","title":"Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning","created":"2020-12-22","cited_by_count":671},{"id":"1708.03999","title":"ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Models","created":"2017-08-14","cited_by_count":666},{"id":"2203.13591","title":"Continual Test-Time Domain Adaptation","created":"2022-03-25","cited_by_count":525},{"id":"2002.07376","title":"Picking Winning Tickets Before Training by Preserving Gradient Flow","created":"2020-02-18","cited_by_count":471},{"id":"2305.17333","title":"Fine-Tuning Language Models with Just Forward Passes","created":"2023-05-27","cited_by_count":345},{"id":"2007.12223","title":"The Lottery Ticket Hypothesis for Pre-trained BERT Networks","created":"2020-07-23","cited_by_count":275},{"id":"2007.10319","title":"MCUNet: Tiny Deep Learning on IoT Devices","created":"2020-07-20","cited_by_count":273},{"id":"2212.13345","title":"The Forward-Forward Algorithm: Some Preliminary Investigations","created":"2022-12-27","cited_by_count":266},{"id":"1509.06569","title":"Tensorizing Neural Networks","created":"2015-09-22","cited_by_count":250},{"id":"1609.01596","title":"Direct Feedback Alignment Provides Learning in Deep Neural Networks","created":"2016-09-06","cited_by_count":240},{"id":"2111.09839","title":"Training Neural Networks with Fixed Sparse Masks","created":"2021-11-18","cited_by_count":214},{"id":"2210.11466","title":"Surgical Fine-Tuning Improves Adaptation to Distribution Shifts","created":"2022-10-20","cited_by_count":205},{"id":"1312.2139","title":"Optimal rates for zero-order convex optimization: the power of two function evaluations","created":"2013-12-07","cited_by_count":198},{"id":"2010.08678","title":"TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems","created":"2020-10-17","cited_by_count":165},{"id":"2006.06224","title":"A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning","created":"2020-06-11","cited_by_count":162},{"id":"2206.15472","title":"On-Device Training Under 256KB Memory","created":"2022-06-30","cited_by_count":160},{"id":"1805.11770","title":"AutoZOOM: Autoencoder-based Zeroth Order Optimization Method for Attacking Black-box Neural Networks","created":"2018-05-30","cited_by_count":137},{"id":"1801.06601","title":"CMSIS-NN: Efficient Neural Network Kernels for Arm Cortex-M CPUs","created":"2018-01-19","cited_by_count":121},{"id":"1906.06919","title":"Improving Black-box Adversarial Attacks with a Transfer-based Prior","created":"2019-06-17","cited_by_count":121},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121},{"id":"2402.11592","title":"Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark","created":"2024-02-18","cited_by_count":114},{"id":"1805.10367","title":"Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization","created":"2018-05-25","cited_by_count":111},{"id":"2003.00152","title":"Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs","created":"2020-02-29","cited_by_count":104},{"id":"2007.08714","title":"Transfer Learning without Knowing: Reprogramming Black-box Machine Learning Models with Scarce Data and Limited Resources","created":"2020-07-17","cited_by_count":83},{"id":"1912.12607","title":"Towards Unified INT8 Training for Convolutional Neural Network","created":"2019-12-29","cited_by_count":79},{"id":"2310.02025","title":"DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training","created":"2023-10-03","cited_by_count":76},{"id":"2404.01650","title":"Test-Time Model Adaptation with Only Forward Passes","created":"2024-04-02","cited_by_count":74},{"id":"2202.08587","title":"Gradients without Backpropagation","created":"2022-02-17","cited_by_count":73},{"id":"2303.14773","title":"BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning","created":"2023-03-26","cited_by_count":70},{"id":"2306.15969","title":"Separable Physics-Informed Neural Networks","created":"2023-06-28","cited_by_count":66},{"id":"2103.08295","title":"TinyOL: TinyML with Online-Learning on Microcontrollers","created":"2021-03-15","cited_by_count":65},{"id":"2210.03310","title":"Scaling Forward Gradient With Local Losses","created":"2022-10-07","cited_by_count":65},{"id":"2201.11665","title":"Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Pass","created":"2022-01-27","cited_by_count":63},{"id":"2210.04092","title":"Advancing Model Pruning via Bi-level Optimization","created":"2022-10-08","cited_by_count":56},{"id":"2010.14298","title":"A Statistical Framework for Low-bitwidth Training of Deep Neural Networks","created":"2020-10-27","cited_by_count":51},{"id":"1910.12166","title":"Improved Zeroth-Order Variance Reduced Algorithms and Analysis for Nonconvex Optimization","created":"2019-10-27","cited_by_count":47},{"id":"2102.10707","title":"A Zeroth-Order Block Coordinate Descent Algorithm for Huge-Scale Black-Box Optimization","created":"2021-02-21","cited_by_count":46},{"id":"2006.02080","title":"A mathematical model for automatic differentiation in machine learning","created":"2020-06-03","cited_by_count":45},{"id":"2205.08501","title":"Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networks","created":"2022-05-17","cited_by_count":44},{"id":"2305.16296","title":"A Guide Through the Zoo of Biased SGD","created":"2023-05-25","cited_by_count":40},{"id":"2304.01752","title":"Black Box Few-Shot Adaptation for Vision-Language models","created":"2023-04-04","cited_by_count":39},{"id":"1810.10703","title":"K for the Price of 1: Parameter-efficient Multi-task and Transfer Learning","created":"2018-10-25","cited_by_count":34},{"id":"2202.05239","title":"F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization","created":"2022-02-10","cited_by_count":28},{"id":"2306.06968","title":"Can Forward Gradient Match Backpropagation?","created":"2023-06-12","cited_by_count":26},{"id":"2406.18060","title":"AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning","created":"2024-06-26","cited_by_count":25},{"id":"2012.11148","title":"Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization","created":"2020-12-21","cited_by_count":24},{"id":"2310.17752","title":"PockEngine: Sparse and Efficient Fine-tuning in a Pocket","created":"2023-10-26","cited_by_count":23},{"id":"1710.07804","title":"Zeroth-Order Online Alternating Direction Method of Multipliers: Convergence Analysis and Applications","created":"2017-10-21","cited_by_count":22},{"id":"2110.14807","title":"L2ight: Enabling On-Chip Learning for Optical Neural Networks via Efficient in-situ Subspace Optimization","created":"2021-10-27","cited_by_count":21},{"id":"2206.10451","title":"Winning the Lottery Ahead of Time: Efficient Early Network Pruning","created":"2022-06-21","cited_by_count":21},{"id":"2307.09988","title":"TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge","created":"2023-07-19","cited_by_count":18},{"id":"2211.14721","title":"Generalizing Gaussian Smoothing for Random Search","created":"2022-11-27","cited_by_count":15},{"id":"2405.14377","title":"CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization","created":"2024-05-23","cited_by_count":15},{"id":"2308.09858","title":"Tensor-Compressed Back-Propagation-Free Training for (Physics-Informed) Neural Networks","created":"2023-08-18","cited_by_count":12},{"id":"2309.13192","title":"Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation","created":"2023-09-22","cited_by_count":12},{"id":"1506.06472","title":"A Theory of Local Learning, the Learning Channel, and the Optimality of Backpropagation","created":"2015-06-22","cited_by_count":11},{"id":"2305.08960","title":"One Forward is Enough for Neural Network Training via Likelihood Ratio Method","created":"2023-05-15","cited_by_count":11},{"id":"2104.03420","title":"On-FPGA Training with Ultra Memory Reduction: A Low-Precision Tensor Method","created":"2021-04-07","cited_by_count":9},{"id":"2312.15901","title":"Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation","created":"2023-12-26","cited_by_count":6},{"id":"2407.11253","title":"Separable Operator Networks","created":"2024-07-15","cited_by_count":5},{"id":"2401.00413","title":"Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Training","created":"2023-12-31","cited_by_count":4},{"id":"2410.05966","title":"FLOPS: Forward Learning with OPtimal Sampling","created":"2024-10-08","cited_by_count":4},{"id":"2310.11093","title":"SODA: Robust Training of Test-Time Data Adaptors","created":"2023-10-17","cited_by_count":1},{"id":"2405.17761","title":"Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient","created":"2024-05-28","cited_by_count":1}],"next_cursor":null}