{"list":"other","total":125,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"1409.1556","title":"Very Deep Convolutional Networks for Large-Scale Image Recognition","created":"2014-09-04","cited_by_count":15364},{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1905.11946","title":"EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks","created":"2019-05-28","cited_by_count":6442},{"id":"1801.04381","title":"MobileNetV2: Inverted Residuals and Linear Bottlenecks","created":"2018-01-13","cited_by_count":4795},{"id":"1409.0473","title":"Neural Machine Translation by Jointly Learning to Align and Translate","created":"2014-09-01","cited_by_count":4548},{"id":"1506.02142","title":"Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning","created":"2015-06-06","cited_by_count":4448},{"id":"1409.4842","title":"Going Deeper with Convolutions","created":"2014-09-17","cited_by_count":4241},{"id":"1704.04861","title":"MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications","created":"2017-04-17","cited_by_count":3845},{"id":"1412.3555","title":"Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling","created":"2014-12-11","cited_by_count":2367},{"id":"1610.02357","title":"Xception: Deep Learning with Depthwise Separable Convolutions","created":"2016-10-07","cited_by_count":2332},{"id":"1510.00149","title":"Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding","created":"2015-10-01","cited_by_count":2329},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"1308.3432","title":"Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation","created":"2013-08-15","cited_by_count":2079},{"id":"1905.02244","title":"Searching for MobileNetV3","created":"2019-05-06","cited_by_count":1994},{"id":"2006.05525","title":"Knowledge Distillation: A Survey","created":"2020-06-09","cited_by_count":1603},{"id":"1712.05877","title":"Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference","created":"2017-12-15","cited_by_count":1593},{"id":"1909.10351","title":"TinyBERT: Distilling BERT for Natural Language Understanding","created":"2019-09-23","cited_by_count":1167},{"id":"1406.2199","title":"Two-Stream Convolutional Networks for Action Recognition in Videos","created":"2014-06-09","cited_by_count":1068},{"id":"1602.07360","title":"SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size","created":"2016-02-24","cited_by_count":1060},{"id":"1807.11626","title":"MnasNet: Platform-Aware Neural Architecture Search for Mobile","created":"2018-07-31","cited_by_count":943},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1603.05279","title":"XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks","created":"2016-03-16","cited_by_count":849},{"id":"2103.13630","title":"A Survey of Quantization Methods for Efficient Neural Network Inference","created":"2021-03-25","cited_by_count":815},{"id":"1804.03209","title":"Speech Commands: A Dataset for Limited-Vocabulary Speech Recognition","created":"2018-04-09","cited_by_count":752},{"id":"1707.06168","title":"Channel Pruning for Accelerating Very Deep Neural Networks","created":"2017-07-19","cited_by_count":702},{"id":"1708.06519","title":"Learning Efficient Convolutional Networks through Network Slimming","created":"2017-08-22","cited_by_count":676},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"1710.01878","title":"To prune, or not to prune: exploring the efficacy of pruning for model compression","created":"2017-10-05","cited_by_count":603},{"id":"1810.05270","title":"Rethinking the Value of Network Pruning","created":"2018-10-11","cited_by_count":599},{"id":"1511.00363","title":"BinaryConnect: Training Deep Neural Networks with binary weights during propagations","created":"2015-11-02","cited_by_count":592},{"id":"1712.01312","title":"Learning Sparse Neural Networks through $L_0$ Regularization","created":"2017-12-04","cited_by_count":583},{"id":"1608.03665","title":"Learning Structured Sparsity in Deep Neural Networks","created":"2016-08-12","cited_by_count":541},{"id":"2102.00554","title":"Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks","created":"2021-01-31","cited_by_count":527},{"id":"1806.08342","title":"Quantizing deep convolutional networks for efficient inference: A whitepaper","created":"2018-06-21","cited_by_count":521},{"id":"1902.09574","title":"The State of Sparsity in Deep Neural Networks","created":"2019-02-25","cited_by_count":476},{"id":"1805.06085","title":"PACT: Parameterized Clipping Activation for Quantized Neural Networks","created":"2018-05-16","cited_by_count":467},{"id":"2106.04554","title":"A Survey of Transformers","created":"2021-06-08","cited_by_count":401},{"id":"1802.05668","title":"Model compression via distillation and quantization","created":"2018-02-15","cited_by_count":289},{"id":"1412.0233","title":"The Loss Surfaces of Multilayer Networks","created":"2014-11-30","cited_by_count":280},{"id":"2007.10319","title":"MCUNet: Tiny Deep Learning on IoT Devices","created":"2020-07-20","cited_by_count":273},{"id":"2001.00281","title":"ZeroQ: A Novel Zero Shot Quantization Framework","created":"2020-01-01","cited_by_count":269},{"id":"2101.09671","title":"Pruning and Quantization for Deep Neural Network Acceleration: A Survey","created":"2021-01-24","cited_by_count":263},{"id":"1808.01204","title":"Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data","created":"2018-08-03","cited_by_count":261},{"id":"1509.06569","title":"Tensorizing Neural Networks","created":"2015-09-22","cited_by_count":250},{"id":"1911.13299","title":"What's Hidden in a Randomly Weighted Neural Network?","created":"2019-11-29","cited_by_count":237},{"id":"1808.00278","title":"Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithm","created":"2018-08-01","cited_by_count":235},{"id":"1306.0543","title":"Predicting Parameters in Deep Learning","created":"2013-06-03","cited_by_count":224},{"id":"1702.03044","title":"Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights","created":"2017-02-10","cited_by_count":217},{"id":"1901.06032","title":"A Survey of the Recent Architectures of Deep Convolutional Neural Networks","created":"2019-01-17","cited_by_count":213},{"id":"1412.6553","title":"Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition","created":"2014-12-19","cited_by_count":203},{"id":"1911.02549","title":"MLPerf Inference Benchmark","created":"2019-11-06","cited_by_count":199},{"id":"1902.06822","title":"Low-bit Quantization of Neural Networks for Efficient Inference","created":"2019-02-18","cited_by_count":193},{"id":"2004.03333","title":"Binary Neural Networks: A Survey","created":"2020-03-31","cited_by_count":190},{"id":"2004.09576","title":"LSQ+: Improving low-bit quantization through learnable offsets and better initialization","created":"2020-04-20","cited_by_count":189},{"id":"2004.09602","title":"Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation","created":"2020-04-20","cited_by_count":188},{"id":"2010.08678","title":"TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems","created":"2020-10-17","cited_by_count":165},{"id":"1806.02375","title":"Understanding Batch Normalization","created":"2018-06-01","cited_by_count":159},{"id":"2106.08962","title":"Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better","created":"2021-06-16","cited_by_count":154},{"id":"1511.06393","title":"Fixed Point Quantization of Deep Convolutional Networks","created":"2015-11-19","cited_by_count":143},{"id":"2205.02302","title":"Machine Learning Operations (MLOps): Overview, Definition, and Architecture","created":"2022-05-04","cited_by_count":128},{"id":"2106.07597","title":"MLPerf Tiny Benchmark","created":"2021-06-14","cited_by_count":124},{"id":"1801.06601","title":"CMSIS-NN: Efficient Neural Network Kernels for Arm Cortex-M CPUs","created":"2018-01-19","cited_by_count":121},{"id":"1705.08665","title":"Bayesian Compression for Deep Learning","created":"2017-05-24","cited_by_count":116},{"id":"1507.06149","title":"Data-free parameter pruning for Deep Neural Networks","created":"2015-07-22","cited_by_count":112},{"id":"1711.07128","title":"Hello Edge: Keyword Spotting on Microcontrollers","created":"2017-11-20","cited_by_count":110},{"id":"1603.01025","title":"Convolutional Neural Networks using Logarithmic Data Representation","created":"2016-03-03","cited_by_count":99},{"id":"1702.04008","title":"Soft Weight-Sharing for Neural Network Compression","created":"2017-02-13","cited_by_count":99},{"id":"2107.04562","title":"The Bayesian Learning Rule","created":"2021-07-09","cited_by_count":99},{"id":"2005.07093","title":"Bayesian Bits: Unifying Quantization and Pruning","created":"2020-05-14","cited_by_count":94},{"id":"1806.10909","title":"ResNet with one-neuron hidden layers is a Universal Approximator","created":"2018-06-28","cited_by_count":79},{"id":"2002.00104","title":"Post-Training Piecewise Linear Quantization for Deep Neural Networks","created":"2020-01-31","cited_by_count":79},{"id":"1808.04752","title":"A Survey on Methods and Theories of Quantized Neural Networks","created":"2018-08-13","cited_by_count":75},{"id":"1611.06694","title":"Training Sparse Neural Networks","created":"2016-11-21","cited_by_count":73},{"id":"1908.09375","title":"Theoretical Issues in Deep Networks: Approximation, Optimization and Generalization","created":"2019-08-25","cited_by_count":72},{"id":"1611.06321","title":"Learning the Number of Neurons in Deep Networks","created":"2016-11-19","cited_by_count":69},{"id":"2205.07877","title":"A Comprehensive Survey on Model Quantization for Deep Neural Networks in Image Classification","created":"2022-05-14","cited_by_count":65},{"id":"1605.02688","title":"Theano: A Python framework for fast computation of mathematical expressions","created":"2016-05-09","cited_by_count":64},{"id":"2006.03669","title":"An Overview of Neural Network Compression","created":"2020-06-05","cited_by_count":59},{"id":"2010.14246","title":"$\\mu$NAS: Constrained Neural Architecture Search for Microcontrollers","created":"2020-10-27","cited_by_count":55},{"id":"1905.13277","title":"Time Matters in Regularizing Deep Networks: Weight Decay and Data Augmentation Affect Early Learning Dynamics, Matter Little Near Convergence","created":"2019-05-30","cited_by_count":54},{"id":"1705.10388","title":"Model Selection in Bayesian Neural Networks via Horseshoe Priors","created":"2017-05-29","cited_by_count":52},{"id":"1905.12107","title":"SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers","created":"2019-05-28","cited_by_count":52},{"id":"1711.02638","title":"Compression-aware Training of Deep Networks","created":"2017-11-07","cited_by_count":46},{"id":"1908.03299","title":"ToyADMOS: A Dataset of Miniature-Machine Operating Sounds for Anomalous Sound Detection","created":"2019-08-09","cited_by_count":44},{"id":"2005.11138","title":"TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids","created":"2020-05-20","cited_by_count":42},{"id":"1603.09420","title":"Minimal Gated Unit for Recurrent Neural Networks","created":"2016-03-31","cited_by_count":40},{"id":"1705.07283","title":"Structured Bayesian Pruning via Log-Normal Multiplicative Noise","created":"2017-05-20","cited_by_count":39},{"id":"1901.02358","title":"FastGRNN: A Fast, Accurate, Stable and Tiny Kilobyte Sized Gated Recurrent Neural Network","created":"2019-01-08","cited_by_count":38},{"id":"1806.09228","title":"Deep $k$-Means: Re-Training and Parameter Sharing with Harder Cluster Assignments for Compressing Deep Convolutions","created":"2018-06-24","cited_by_count":33},{"id":"1703.05390","title":"Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting","created":"2017-03-15","cited_by_count":32},{"id":"2111.11146","title":"On the Existence of Universal Lottery Tickets","created":"2021-11-22","cited_by_count":30},{"id":"1908.02419","title":"Gradient Descent Finds Global Minima for Generalizable Deep Neural Networks of Practical Sizes","created":"2019-08-05","cited_by_count":29},{"id":"2205.14550","title":"Machine Learning for Microcontroller-Class Hardware: A Review","created":"2022-05-29","cited_by_count":28},{"id":"2010.14495","title":"Are wider nets better given the same number of parameters?","created":"2020-10-27","cited_by_count":27},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27}],"next_cursor":"100"}