Survey of Machine Learning Accelerators
Not on the map. Why?
Abstract (arXiv)
New machine learning accelerators are being announced and released each month for a variety of applications from speech recognition, video object detection, assisted driving, and many data center applications. This paper updates the survey of of AI accelerators and processors from last year's IEEE-HPEC paper. This paper collects and summarizes the current accelerators that have been publicly announced with performance and power consumption numbers. The performance and power values are plotted on a scatter graph and a number of dimensions and observations from the trends on this plot are discussed and analyzed. For instance, there are interesting trends in the plot regarding power consumption, numerical precision, and inference versus training. This year, there are many more announced accelerators that are implemented with many more architectures and technologies from vector engines, dataflow engines, neuromorphic designs, flash-based analog memory processing, and photonic-based processing.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 12; 2024: 1; 2025: 2; 2026: 2.
29 papers.
Sort:
By area:
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 125
- 2023Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipelinecited by 50
- 2021An optical neural network using less than 1 photon per multiplicationcited by 30
- 2023Machine Learning Without a Processor: Emergent Learning in a Nonlinear Electronic Metamaterialcited by 19
- 2023TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollerscited by 18
- 2021AI Accelerator Survey and Trendscited by 17
- 2021Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networkscited by 15
- 2023Ultra-Efficient On-Device Object Detection on AI-Integrated Smart Glasses with TinyissimoYOLOcited by 15
- 2023Optical Transformerscited by 10
- 2022HammingMesh: A Network Topology for Large-Scale Deep Learningcited by 8
- 2022Benchmarking Resource Usage for Efficient Distributed Deep Learningcited by 7
17 more
- 2023DeepSeeColor: Realtime Adaptive Color Correction for Autonomous Underwater Vehicles via Deep Learning Methodscited by 7
- 2024Asymmetrical estimator for training encapsulated deep photonic neural networkscited by 3
- 2021HiKonv: High Throughput Quantized Convolution With Novel Bit-wise Management and Computationcited by 2
- 2023DeepCAM: A Fully CAM-based Inference Accelerator with Variable Hash Lengths for Energy-efficient Deep Neural Networkscited by 2
- 2023Lincoln AI Computing Survey (LAICS) Updatecited by 2
- 2021Implementation of a Binary Neural Network on a Passive Array of Magnetic Tunnel Junctionscited by 1
- 2025Real-Time Semantic Segmentation of Aerial Images Using an Embedded U-Net: A Comparison of CPU, GPU, and FPGA Workflowscited by 1
- 2021A Construction Kit for Efficient Low Power Neural Network Accelerator Designscited by 0
- 2022A photonic chip-based machine learning approach for the prediction of molecular propertiescited by 0
- 2022HiKonv: Maximizing the Throughput of Quantized Convolution With Novel Bit-wise Management and Computationcited by 0
- 2023Exploiting Logic Locking for a Neural Trojan Attack on Machine Learning Acceleratorscited by 0
- 2023Convergence and scaling of Boolean-weight optimization for hardware reservoirscited by 0
- 2023mlirSynth: Automatic, Retargetable Program Raising in Multi-Level IR using Program Synthesiscited by 0
- 2023The Landscape of Modern Machine Learning: A Review of Machine, Distributed and Federated Learningcited by 0
- 2025ML For Hardware Design Interpretability: Challenges and Opportunitiescited by 0
- 2026Evolution Strategy-Based Calibration for Low-Bit Quantization of Speech Modelscited by 0
- 2026A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Modelcited by 0
- 2026A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model22 Sep 2026
- 2026Evolution Strategy-Based Calibration for Low-Bit Quantization of Speech Models9 Mar 2026
- 2025ML For Hardware Design Interpretability: Challenges and Opportunities11 Apr 2025
- 2025Real-Time Semantic Segmentation of Aerial Images Using an Embedded U-Net: A Comparison of CPU, GPU, and FPGA Workflows7 Mar 2025
- 2024Asymmetrical estimator for training encapsulated deep photonic neural networks28 May 2024
- 2023The Landscape of Modern Machine Learning: A Review of Machine, Distributed and Federated Learning5 Dec 2023
- 2023Ultra-Efficient On-Device Object Detection on AI-Integrated Smart Glasses with TinyissimoYOLO2 Nov 2023
- 2023Machine Learning Without a Processor: Emergent Learning in a Nonlinear Electronic Metamaterial1 Nov 2023
- 2023Lincoln AI Computing Survey (LAICS) Update13 Oct 2023
- 2023mlirSynth: Automatic, Retargetable Program Raising in Multi-Level IR using Program Synthesis6 Oct 2023
- 2023TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollers22 May 2023
- 2023Convergence and scaling of Boolean-weight optimization for hardware reservoirs13 May 2023
17 more
- 2023Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipeline13 Apr 2023
- 2023Exploiting Logic Locking for a Neural Trojan Attack on Machine Learning Accelerators12 Apr 2023
- 2023DeepSeeColor: Realtime Adaptive Color Correction for Autonomous Underwater Vehicles via Deep Learning Methods7 Mar 2023
- 2023Optical Transformers20 Feb 2023
- 2023DeepCAM: A Fully CAM-based Inference Accelerator with Variable Hash Lengths for Energy-efficient Deep Neural Networks9 Feb 2023
- 2022HammingMesh: A Network Topology for Large-Scale Deep Learning3 Sep 2022
- 2022HiKonv: Maximizing the Throughput of Quantized Convolution With Novel Bit-wise Management and Computation22 Jul 2022
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language1 Apr 2022
- 2022A photonic chip-based machine learning approach for the prediction of molecular properties3 Mar 2022
- 2022Benchmarking Resource Usage for Efficient Distributed Deep Learning28 Jan 2022
- 2021HiKonv: High Throughput Quantized Convolution With Novel Bit-wise Management and Computation28 Dec 2021
- 2021Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networks27 Dec 2021
- 2021Implementation of a Binary Neural Network on a Passive Array of Magnetic Tunnel Junctions16 Dec 2021
- 2021AI Accelerator Survey and Trends18 Sep 2021
- 2021A Construction Kit for Efficient Low Power Neural Network Accelerator Designs24 Jun 2021
- 2021An optical neural network using less than 1 photon per multiplication27 Apr 2021
- 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systems27 Apr 2021
- 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 125
- 2023Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipelinecited by 50
- 2021An optical neural network using less than 1 photon per multiplicationcited by 30
- 2023Machine Learning Without a Processor: Emergent Learning in a Nonlinear Electronic Metamaterialcited by 19
- 2023TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollerscited by 18
- 2021AI Accelerator Survey and Trendscited by 17
- 2021Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networkscited by 15
- 2023Ultra-Efficient On-Device Object Detection on AI-Integrated Smart Glasses with TinyissimoYOLOcited by 15
- 2023Optical Transformerscited by 10
- 2022HammingMesh: A Network Topology for Large-Scale Deep Learningcited by 8
- 2022Benchmarking Resource Usage for Efficient Distributed Deep Learningcited by 7
- 2023DeepSeeColor: Realtime Adaptive Color Correction for Autonomous Underwater Vehicles via Deep Learning Methodscited by 7
12 most cited of 28 All 28 (JSON)
- 2026A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model22 Sep 2026
- 2026Evolution Strategy-Based Calibration for Low-Bit Quantization of Speech Models9 Mar 2026
- 2025ML For Hardware Design Interpretability: Challenges and Opportunities11 Apr 2025
- 2025Real-Time Semantic Segmentation of Aerial Images Using an Embedded U-Net: A Comparison of CPU, GPU, and FPGA Workflows7 Mar 2025
- 2024Asymmetrical estimator for training encapsulated deep photonic neural networks28 May 2024
- 2023The Landscape of Modern Machine Learning: A Review of Machine, Distributed and Federated Learning5 Dec 2023
- 2023Ultra-Efficient On-Device Object Detection on AI-Integrated Smart Glasses with TinyissimoYOLO2 Nov 2023
- 2023Machine Learning Without a Processor: Emergent Learning in a Nonlinear Electronic Metamaterial1 Nov 2023
- 2023Lincoln AI Computing Survey (LAICS) Update13 Oct 2023
- 2023mlirSynth: Automatic, Retargetable Program Raising in Multi-Level IR using Program Synthesis6 Oct 2023
- 2023TinyissimoYOLO: A Quantized, Low-Memory Footprint, TinyML Object Detection Network for Low Power Microcontrollers22 May 2023
- 2023Convergence and scaling of Boolean-weight optimization for hardware reservoirs13 May 2023
12 newest of 28 All 28 (JSON)