Gemmini: Enabling Systematic Deep-Learning Architecture Evaluation via Full-Stack Integration
Not on the map. Why?
Abstract (arXiv)
DNN accelerators are often developed and evaluated in isolation without considering the cross-stack, system-level effects in real-world environments. This makes it difficult to appreciate the impact of System-on-Chip (SoC) resource contention, OS overheads, and programming-stack inefficiencies on overall performance/energy-efficiency. To address this challenge, we present Gemmini, an open-source*, full-stack DNN accelerator generator. Gemmini generates a wide design-space of efficient ASIC accelerators from a flexible architectural template, together with flexible programming stacks and full SoCs with shared resources that capture system-level effects. Gemmini-generated accelerators have also been fabricated, delivering up to three orders-of-magnitude speedups over high-performance CPUs on various DNN benchmarks. * https://github.com/ucb-bar/gemmini
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 10; 2024: 10; 2025: 22; 2026: 11.
59 papers.
Sort:
By area:
- 2023Full Stack Optimization of Transformer Inference: a Surveycited by 79
- 2023DiffRate : Differentiable Compression Rate for Efficient Vision Transformerscited by 78
- 2024LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scalecited by 30
- 2025Embodied AI: From LLMs to World Modelscited by 23
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platformscited by 21
- 2024Allo: A Programming Model for Composable Accelerator Designcited by 16
- 2023A Hardware Evaluation Framework for Large Language Model Inferencecited by 14
- 2024HiVeGen -- Hierarchical LLM-based Verilog Generation for Scalable Chip Designcited by 13
- 2025Autocomp: A Powerful and Portable Code Optimizer for Tensor Acceleratorscited by 12
- 2022CFU Playground: Full-Stack Open-Source Framework for Tiny Machine Learning (tinyML) Acceleration on FPGAscited by 11
- 2023MoCA: Memory-Centric, Adaptive Execution for Multi-Tenant Deep Neural Networkscited by 8
- 2024LLM-Aided Compilation for Tensor Acceleratorscited by 8
38 more
- 2025LUT-DLA: Lookup Table as Efficient Extreme Low-Bit Deep Learning Acceleratorcited by 8
- 2022Machine Learning Sensorscited by 5
- 2024MATCH: Model-Aware TVM-based Compilation for Heterogeneous Edge Devicescited by 5
- 2024Iterative Filter Pruning for Concatenation-based CNN Architecturescited by 4
- 2025DOSA: Differentiable Model-Based One-Loop Search for DNN Acceleratorscited by 4
- 2021GNNIE: GNN Inference Engine with Load-balancing and Graph-Specific Cachingcited by 3
- 2022Integration of a systolic array based hardware accelerator into a DNN operator auto-tuning frameworkcited by 3
- 2025Leveraging Compute-in-Memory for Efficient Generative Model Inference in TPUscited by 3
- 2026Economy of Minds: Emerging Multi-Agent Intelligence with Economic Interactionscited by 3
- 2022QUIDAM: A Framework for Quantization-Aware DNN Accelerator and Model Co-Explorationcited by 2
- 2023An Open-Source ML-Based Full-Stack Optimization Framework for Machine Learning Acceleratorscited by 2
- 2024MVQ:Towards Efficient DNN Compression and Acceleration with Masked Vector Quantizationcited by 2
- 2025TPU-Gen: LLM-Driven Custom Tensor Processing Unit Generatorcited by 2
- 2025An Open-Source HW-SW Co-Development Framework Enabling Efficient Multi-Accelerator Systemscited by 2
- 2022Hardware/Software Co-Programmable Framework for Computational SSDs to Accelerate Deep Learning Service on Large-Scale Graphscited by 1
- 2023Tackling the Matrix Multiplication Micro-kernel Generation with Exocited by 1
- 2024Efficient Edge AI: Deploying Convolutional Neural Networks on FPGA with the Gemmini Acceleratorcited by 1
- 2024HAPM -- Hardware Aware Pruning Method for CNN hardware accelerators in resource constrained devicescited by 1
- 2025FORTALESA: Fault-Tolerant Reconfigurable Systolic Array for DNN Inferencecited by 1
- 2025Beyond Moore's Law: Harnessing the Redshift of Generative AI with Effective Hardware-Software Co-Designcited by 1
- 2025HDLxGraph: Bridging Large Language Models and HDL Repositories via HDL Graph Databasescited by 1
- 2025MAHL: Multi-Agent LLM-Guided Hierarchical Chiplet Design with Adaptive Debuggingcited by 1
- 2025LEGO: Spatial Accelerator Generation and Optimization for Tensor Applicationscited by 1
- 2025FaRAccel: FPGA-Accelerated Defense Architecture for Efficient Bit-Flip Attack Resilience in Transformer Modelscited by 1
- 2026NLI:Non-uniform Linear Interpolation Approximation of Nonlinear Operations for Efficient LLMs Inferencecited by 1
- 2026AI+HW 2035: Shaping the Next Decadecited by 1
- 2026HighTide: An Agent-Curated Open-Source VLSI Benchmark Suitecited by 1
- 2023Performance Analysis of DNN Inference/Training with Convolution and non-Convolution Operationscited by 0
- 2023A Survey on Design Methodologies for Accelerating Deep Learning on Heterogeneous Architecturescited by 0
- 2023DEAP: Design Space Exploration for DNN Accelerator Parallelismcited by 0
- 2024Tempus Core: Area-Power Efficient Temporal-Unary Convolution Core for Low-Precision Edge DLAscited by 0
- 2025NVR: Vector Runahead on NPUs for Sparse Memory Accesscited by 0
- 2025CaMDN: Enhancing Cache Efficiency for Multi-tenant DNNs on Integrated NPUscited by 0
- 2025FlexiSAGA: A Flexible Systolic Array GEMM Accelerator for Sparse and Dense Processingcited by 0
- 2025A High-Level Compiler Integration Approach for Deep Learning Accelerators Supporting Abstraction and Optimizationcited by 0
- 2025FedChip: Federated LLM for Artificial Intelligence Accelerator Chip Designcited by 0
- 2025Energy Efficient Exact and Approximate Systolic Array Architecture for Matrix Multiplicationcited by 0
- 2025Systematic Exploration of Multi-core Architectures for Efficient LLM Serving using WaferAI-SIMcited by 0
50 most cited of 59 All 59 (JSON)
- 2026AgentDSE: Reasoning-Augmented Architectural Design Space Exploration20 Jun 2026
- 2026HighTide: An Agent-Curated Open-Source VLSI Benchmark Suite2 Jun 2026
- 2026Economy of Minds: Emerging Multi-Agent Intelligence with Economic Interactions1 Jun 2026
- 2026LLMForge: Multi-Backend Hardware-Aware Neural Architecture Search with Infinite-Head Attention for Edge Language Models17 May 2026
- 2026At the Edge of the Heart: ULP FPGA-Based CNN for On-Device Cardiac Feature Extraction in Smart Health Sensors for Astronauts28 Apr 2026
- 2026Tessera: Secure, Near-Line-Rate Weight Streaming for UMA Edge Accelerators25 Apr 2026
- 2026MATCHA: Efficient Deployment of Deep Neural Networks on Multi-Accelerator Heterogeneous Edge SoCs10 Apr 2026
- 2026LP-GEMM: Integrating Layout Propagation into GEMM Operations6 Apr 2026
- 2026SISA: A Scale-In Systolic Array for GEMM Acceleration31 Mar 2026
- 2026AI+HW 2035: Shaping the Next Decade5 Mar 2026
- 2026NLI:Non-uniform Linear Interpolation Approximation of Nonlinear Operations for Efficient LLMs Inference3 Feb 2026
- 2025DCO: Dynamic Cache Orchestration for LLM Accelerators through Predictive Management8 Dec 2025
38 more
- 2025Approximate Multiplier Induced Error Propagation in Deep Neural Networks6 Dec 2025
- 2025FaRAccel: FPGA-Accelerated Defense Architecture for Efficient Bit-Flip Attack Resilience in Transformer Models28 Oct 2025
- 2025Systematic Exploration of Multi-core Architectures for Efficient LLM Serving using WaferAI-SIM7 Oct 2025
- 2025Embodied AI: From LLMs to World Models24 Sep 2025
- 2025LEGO: Spatial Accelerator Generation and Optimization for Tensor Applications15 Sep 2025
- 2025DOSA: Differentiable Model-Based One-Loop Search for DNN Accelerators12 Sep 2025
- 2025Energy Efficient Exact and Approximate Systolic Array Architecture for Matrix Multiplication31 Aug 2025
- 2025An Open-Source HW-SW Co-Development Framework Enabling Efficient Multi-Accelerator Systems20 Aug 2025
- 2025MAHL: Multi-Agent LLM-Guided Hierarchical Chiplet Design with Adaptive Debugging8 Aug 2025
- 2025FedChip: Federated LLM for Artificial Intelligence Accelerator Chip Design23 Jul 2025
- 2025A High-Level Compiler Integration Approach for Deep Learning Accelerators Supporting Abstraction and Optimization7 Jul 2025
- 2025FlexiSAGA: A Flexible Systolic Array GEMM Accelerator for Sparse and Dense Processing2 Jun 2025
- 2025Autocomp: A Powerful and Portable Code Optimizer for Tensor Accelerators24 May 2025
- 2025HDLxGraph: Bridging Large Language Models and HDL Repositories via HDL Graph Databases21 May 2025
- 2025CaMDN: Enhancing Cache Efficiency for Multi-tenant DNNs on Integrated NPUs10 May 2025
- 2025Beyond Moore's Law: Harnessing the Redshift of Generative AI with Effective Hardware-Software Co-Design9 Apr 2025
- 2025TPU-Gen: LLM-Driven Custom Tensor Processing Unit Generator7 Mar 2025
- 2025FORTALESA: Fault-Tolerant Reconfigurable Systolic Array for DNN Inference6 Mar 2025
- 2025Leveraging Compute-in-Memory for Efficient Generative Model Inference in TPUs1 Mar 2025
- 2025NVR: Vector Runahead on NPUs for Sparse Memory Access19 Feb 2025
- 2025LUT-DLA: Lookup Table as Efficient Extreme Low-Bit Deep Learning Accelerator18 Jan 2025
- 2024Tempus Core: Area-Power Efficient Temporal-Unary Convolution Core for Low-Precision Edge DLAs25 Dec 2024
- 2024MVQ:Towards Efficient DNN Compression and Acceleration with Masked Vector Quantization13 Dec 2024
- 2024HiVeGen -- Hierarchical LLM-based Verilog Generation for Scalable Chip Design6 Dec 2024
- 2024MATCH: Model-Aware TVM-based Compilation for Heterogeneous Edge Devices11 Oct 2024
- 2024HAPM -- Hardware Aware Pruning Method for CNN hardware accelerators in resource constrained devices26 Aug 2024
- 2024Efficient Edge AI: Deploying Convolutional Neural Networks on FPGA with the Gemmini Accelerator14 Aug 2024
- 2024LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale10 Aug 2024
- 2024LLM-Aided Compilation for Tensor Accelerators6 Aug 2024
- 2024Iterative Filter Pruning for Concatenation-based CNN Architectures4 May 2024
- 2024Allo: A Programming Model for Composable Accelerator Design7 Apr 2024
- 2023DEAP: Design Space Exploration for DNN Accelerator Parallelism24 Dec 2023
- 2023A Hardware Evaluation Framework for Large Language Model Inference5 Dec 2023
- 2023A Survey on Design Methodologies for Accelerating Deep Learning on Heterogeneous Architectures29 Nov 2023
- 2023Tackling the Matrix Multiplication Micro-kernel Generation with Exo26 Oct 2023
- 2023An Open-Source ML-Based Full-Stack Optimization Framework for Machine Learning Accelerators23 Aug 2023
- 2023Performance Analysis of DNN Inference/Training with Convolution and non-Convolution Operations29 Jun 2023
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platforms27 Jun 2023
50 newest of 59 All 59 (JSON)
- 2023DiffRate : Differentiable Compression Rate for Efficient Vision Transformerscited by 78
- 2024LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scalecited by 30
- 2025Systematic Exploration of Multi-core Architectures for Efficient LLM Serving using WaferAI-SIMcited by 0
- 2025Systematic Exploration of Multi-core Architectures for Efficient LLM Serving using WaferAI-SIM7 Oct 2025
- 2024LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale10 Aug 2024
- 2023DiffRate : Differentiable Compression Rate for Efficient Vision Transformers29 May 2023
- 2025Embodied AI: From LLMs to World Modelscited by 23
- 2025Embodied AI: From LLMs to World Models24 Sep 2025
- 2023Full Stack Optimization of Transformer Inference: a Surveycited by 79
- 2023A Survey on Deep Learning Hardware Accelerators for Heterogeneous HPC Platformscited by 21
- 2024Allo: A Programming Model for Composable Accelerator Designcited by 16
- 2023A Hardware Evaluation Framework for Large Language Model Inferencecited by 14
- 2024HiVeGen -- Hierarchical LLM-based Verilog Generation for Scalable Chip Designcited by 13
- 2025Autocomp: A Powerful and Portable Code Optimizer for Tensor Acceleratorscited by 12
- 2022CFU Playground: Full-Stack Open-Source Framework for Tiny Machine Learning (tinyML) Acceleration on FPGAscited by 11
- 2023MoCA: Memory-Centric, Adaptive Execution for Multi-Tenant Deep Neural Networkscited by 8
- 2024LLM-Aided Compilation for Tensor Acceleratorscited by 8
- 2025LUT-DLA: Lookup Table as Efficient Extreme Low-Bit Deep Learning Acceleratorcited by 8
- 2022Machine Learning Sensorscited by 5
- 2024MATCH: Model-Aware TVM-based Compilation for Heterogeneous Edge Devicescited by 5
12 most cited of 52 All 52 (JSON)
- 2026HighTide: An Agent-Curated Open-Source VLSI Benchmark Suite2 Jun 2026
- 2026Economy of Minds: Emerging Multi-Agent Intelligence with Economic Interactions1 Jun 2026
- 2026LLMForge: Multi-Backend Hardware-Aware Neural Architecture Search with Infinite-Head Attention for Edge Language Models17 May 2026
- 2026At the Edge of the Heart: ULP FPGA-Based CNN for On-Device Cardiac Feature Extraction in Smart Health Sensors for Astronauts28 Apr 2026
- 2026Tessera: Secure, Near-Line-Rate Weight Streaming for UMA Edge Accelerators25 Apr 2026
- 2026MATCHA: Efficient Deployment of Deep Neural Networks on Multi-Accelerator Heterogeneous Edge SoCs10 Apr 2026
- 2026LP-GEMM: Integrating Layout Propagation into GEMM Operations6 Apr 2026
- 2026SISA: A Scale-In Systolic Array for GEMM Acceleration31 Mar 2026
- 2026AI+HW 2035: Shaping the Next Decade5 Mar 2026
- 2026NLI:Non-uniform Linear Interpolation Approximation of Nonlinear Operations for Efficient LLMs Inference3 Feb 2026
- 2025DCO: Dynamic Cache Orchestration for LLM Accelerators through Predictive Management8 Dec 2025
- 2025Approximate Multiplier Induced Error Propagation in Deep Neural Networks6 Dec 2025
12 newest of 52 All 52 (JSON)