AI and ML Accelerator Survey and Trends
Not on the map. Why?
Abstract (arXiv)
This paper updates the survey of AI accelerators and processors from past three years. This paper collects and summarizes the current commercial accelerators that have been publicly announced with peak performance and power consumption numbers. The performance and power values are plotted on a scatter graph, and a number of dimensions and observations from the trends on this plot are again discussed and analyzed. Two new trends plots based on accelerator release dates are included in this year's paper, along with the additional trends of some neuromorphic, photonic, and memristor-based inference accelerators.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Oct 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 9; 2024: 5; 2025: 5; 2026: 3.
23 papers.
Sort:
By area:
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platformscited by 21
- 2022Intelligent Computing: The Latest Advances, Challenges and Futurecited by 6
- 2023PyDCM: Custom Data Center Models with Reinforcement Learning for Sustainabilitycited by 6
- 2024FOOL: Addressing the Downlink Bottleneck in Satellite Computing with Neural Feature Compressioncited by 6
- 2025Advancing Earth Observation: A Survey on AI-Powered Image Processing in Satellitescited by 6
- 2023RedMule: A Mixed-Precision Matrix-Matrix Operation Engine for Flexible and Energy-Efficient On-Chip Linear Algebra and TinyML Training Accelerationcited by 4
- 2023Cross-Layer Design for AI Acceleration with Non-Coherent Optical Computingcited by 3
- 2023Lincoln AI Computing Survey (LAICS) Updatecited by 2
- 2025Leveraging Neural Graph Compilers in Machine Learning Research for Edge-Cloud Systemscited by 2
- 2025In-memory Training on Analog Devices with Limited Conductance States via Multi-tile Residual Learningcited by 2
- 2023Subgraph Stationary Hardware-Software Inference Co-Designcited by 1
- 2023Stella Nera: A Differentiable Maddness-Based Hardware Accelerator for Efficient Approximate Matrix Multiplicationcited by 1
11 more
- 2024A Configurable Pythonic Data Center Model for Sustainable Cooling and ML Integrationcited by 1
- 2024When In-memory Computing Meets Spiking Neural Networks -- A Perspective on Device-Circuit-System-and-Algorithm Co-designcited by 1
- 2025eMamba: Efficient Acceleration Framework for Mamba Models in Edge Computingcited by 1
- 2026TrainDeeploy: Hardware-Accelerated Parameter-Efficient Fine-Tuning of Small Transformer Models at the Extreme Edgecited by 1
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computingcited by 1
- 2023Hardware Accelerators in Autonomous Drivingcited by 0
- 2023Data Center Audio/Video Intelligence on Device (DAVID) -- An Edge-AI Platform for Smart-Toyscited by 0
- 2024A Precision-Optimized Fixed-Point Near-Memory Digital Processing Unit for Analog In-Memory Computingcited by 0
- 2024Optical Computing for Deep Neural Network Acceleration: Foundations, Recent Developments, and Emerging Directionscited by 0
- 2025LuxIA: A Lightweight Unitary matriX-based Framework Built on an Iterative Algorithm for Photonic Neural Network Trainingcited by 0
- 2026AI-RAN on NPUs: Baseband Processing Without Baseband Chipscited by 0
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computing17 Jul 2026
- 2026AI-RAN on NPUs: Baseband Processing Without Baseband Chips5 Jul 2026
- 2026TrainDeeploy: Hardware-Accelerated Parameter-Efficient Fine-Tuning of Small Transformer Models at the Extreme Edge10 Mar 2026
- 2025LuxIA: A Lightweight Unitary matriX-based Framework Built on an Iterative Algorithm for Photonic Neural Network Training24 Dec 2025
- 2025In-memory Training on Analog Devices with Limited Conductance States via Multi-tile Residual Learning2 Oct 2025
- 2025eMamba: Efficient Acceleration Framework for Mamba Models in Edge Computing14 Aug 2025
- 2025Leveraging Neural Graph Compilers in Machine Learning Research for Edge-Cloud Systems28 Apr 2025
- 2025Advancing Earth Observation: A Survey on AI-Powered Image Processing in Satellites21 Jan 2025
- 2024When In-memory Computing Meets Spiking Neural Networks -- A Perspective on Device-Circuit-System-and-Algorithm Co-design22 Aug 2024
- 2024Optical Computing for Deep Neural Network Acceleration: Foundations, Recent Developments, and Emerging Directions30 Jul 2024
- 2024A Configurable Pythonic Data Center Model for Sustainable Cooling and ML Integration18 Apr 2024
- 2024FOOL: Addressing the Downlink Bottleneck in Satellite Computing with Neural Feature Compression25 Mar 2024
11 more
- 2024A Precision-Optimized Fixed-Point Near-Memory Digital Processing Unit for Analog In-Memory Computing12 Feb 2024
- 2023Data Center Audio/Video Intelligence on Device (DAVID) -- An Edge-AI Platform for Smart-Toys18 Nov 2023
- 2023Stella Nera: A Differentiable Maddness-Based Hardware Accelerator for Efficient Approximate Matrix Multiplication16 Nov 2023
- 2023Lincoln AI Computing Survey (LAICS) Update13 Oct 2023
- 2023PyDCM: Custom Data Center Models with Reinforcement Learning for Sustainability5 Oct 2023
- 2023Hardware Accelerators in Autonomous Driving11 Aug 2023
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms27 Jun 2023
- 2023Subgraph Stationary Hardware-Software Inference Co-Design21 Jun 2023
- 2023Cross-Layer Design for AI Acceleration with Non-Coherent Optical Computing22 Mar 2023
- 2023RedMule: A Mixed-Precision Matrix-Matrix Operation Engine for Flexible and Energy-Efficient On-Chip Linear Algebra and TinyML Training Acceleration10 Jan 2023
- 2022Intelligent Computing: The Latest Advances, Challenges and Future21 Nov 2022
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platformscited by 21
- 2022Intelligent Computing: The Latest Advances, Challenges and Futurecited by 6
- 2023PyDCM: Custom Data Center Models with Reinforcement Learning for Sustainabilitycited by 6
- 2024FOOL: Addressing the Downlink Bottleneck in Satellite Computing with Neural Feature Compressioncited by 6
- 2025Advancing Earth Observation: A Survey on AI-Powered Image Processing in Satellitescited by 6
- 2023RedMule: A Mixed-Precision Matrix-Matrix Operation Engine for Flexible and Energy-Efficient On-Chip Linear Algebra and TinyML Training Accelerationcited by 4
- 2023Cross-Layer Design for AI Acceleration with Non-Coherent Optical Computingcited by 3
- 2023Lincoln AI Computing Survey (LAICS) Updatecited by 2
- 2025Leveraging Neural Graph Compilers in Machine Learning Research for Edge-Cloud Systemscited by 2
- 2025In-memory Training on Analog Devices with Limited Conductance States via Multi-tile Residual Learningcited by 2
- 2023Subgraph Stationary Hardware-Software Inference Co-Designcited by 1
- 2023Stella Nera: A Differentiable Maddness-Based Hardware Accelerator for Efficient Approximate Matrix Multiplicationcited by 1
12 most cited of 22 All 22 (JSON)
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computing17 Jul 2026
- 2026AI-RAN on NPUs: Baseband Processing Without Baseband Chips5 Jul 2026
- 2026TrainDeeploy: Hardware-Accelerated Parameter-Efficient Fine-Tuning of Small Transformer Models at the Extreme Edge10 Mar 2026
- 2025LuxIA: A Lightweight Unitary matriX-based Framework Built on an Iterative Algorithm for Photonic Neural Network Training24 Dec 2025
- 2025In-memory Training on Analog Devices with Limited Conductance States via Multi-tile Residual Learning2 Oct 2025
- 2025Leveraging Neural Graph Compilers in Machine Learning Research for Edge-Cloud Systems28 Apr 2025
- 2025Advancing Earth Observation: A Survey on AI-Powered Image Processing in Satellites21 Jan 2025
- 2024When In-memory Computing Meets Spiking Neural Networks -- A Perspective on Device-Circuit-System-and-Algorithm Co-design22 Aug 2024
- 2024Optical Computing for Deep Neural Network Acceleration: Foundations, Recent Developments, and Emerging Directions30 Jul 2024
- 2024A Configurable Pythonic Data Center Model for Sustainable Cooling and ML Integration18 Apr 2024
- 2024FOOL: Addressing the Downlink Bottleneck in Satellite Computing with Neural Feature Compression25 Mar 2024
- 2024A Precision-Optimized Fixed-Point Near-Memory Digital Processing Unit for Analog In-Memory Computing12 Feb 2024
12 newest of 22 All 22 (JSON)