BISMO: A Scalable Bit-Serial Matrix Multiplication Overlay for Reconfigurable Computing
Not on the map. Why?
Abstract (arXiv)
Matrix-matrix multiplication is a key computational kernel for numerous applications in science and engineering, with ample parallelism and data locality that lends itself well to high-performance implementations. Many matrix multiplication-dependent applications can use reduced-precision integer or fixed-point representations to increase their performance and energy efficiency while still offering adequate quality of results. However, precision requirements may vary between different application phases or depend on input data, rendering constant-precision solutions ineffective. We present BISMO, a vectorized bit-serial matrix multiplication overlay for reconfigurable computing. BISMO utilizes the excellent binary-operation performance of FPGAs to offer a matrix multiplication performance that scales with required precision and parallelism. We characterize the resource usage and performance of BISMO across a range of parameters to build a hardware cost model, and demonstrate a peak performance of 6.5 TOPS on the Xilinx PYNQ-Z1 board.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 4; 2023: 1; 2024: 4; 2025: 1; 2026: 2.
21 papers.
Sort:
By area:
- 2021Towards Mixed-Precision Quantization of Neural Networks via Constrained Optimizationcited by 57
- 2022Hardware Approximate Techniques for Deep Neural Network Accelerators: A Surveycited by 39
- 2021MQBench: Towards Reproducible and Deployable Model Quantization Benchmarkcited by 38
- 2021Applications and Techniques for Fast Machine Learning in Sciencecited by 32
- 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applicationscited by 32
- 2024MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantizationcited by 22
- 2023BAFFLE: A Baseline of Backpropagation-Free Federated Learningcited by 12
- 2024RefQSR: Reference-based Quantization for Image Super-Resolution Networkscited by 8
- 2022Mixed-Precision Neural Networks: A Surveycited by 7
- 2021Effective and Fast: A Novel Sequential Single Path Search for Mixed-Precision Quantizationcited by 6
- 2021MWQ: Multiscale Wavelet Quantized Neural Networkscited by 4
- 2024xTern: Energy-Efficient Ternary Neural Network Inference on RISC-V-Based Edge Systemscited by 4
9 more
- 2021GradFreeBits: Gradient Free Bit Allocation for Dynamic Low Precision Neural Networkscited by 2
- 2021N3H-Core: Neuron-designed Neural Network Accelerator via FPGA-based Heterogeneous Computing Corescited by 2
- 2022FxP-QNet: A Post-Training Quantizer for the Design of Mixed Low-Precision DNNs with Dynamic Fixed-Point Representationcited by 2
- 2021Understanding Cache Boundness of ML Operators on ARM Processorscited by 1
- 2021RCT: Resource Constrained Training for Edge AIcited by 1
- 2024ARQ: A Mixed-Precision Quantization Framework for Accurate and Certifiably Robust DNNscited by 1
- 2025Karatsuba Matrix Multiplication and its Efficient Custom Hardware Implementationscited by 0
- 2026Bitwise Systolic Array Architecture for Runtime-Reconfigurable Multi-precision Quantized Multiplication on Hardware Acceleratorscited by 0
- 2026TASQ: Temporal-Adaptive Bit Sparsification Quantization for Diffusion Modelscited by 0
- 2026TASQ: Temporal-Adaptive Bit Sparsification Quantization for Diffusion Models4 Aug 2026
- 2026Bitwise Systolic Array Architecture for Runtime-Reconfigurable Multi-precision Quantized Multiplication on Hardware Accelerators26 Feb 2026
- 2025Karatsuba Matrix Multiplication and its Efficient Custom Hardware Implementations15 Jan 2025
- 2024MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization8 Nov 2024
- 2024ARQ: A Mixed-Precision Quantization Framework for Accurate and Certifiably Robust DNNs31 Oct 2024
- 2024xTern: Energy-Efficient Ternary Neural Network Inference on RISC-V-Based Edge Systems29 May 2024
- 2024RefQSR: Reference-based Quantization for Image Super-Resolution Networks2 Apr 2024
- 2023BAFFLE: A Baseline of Backpropagation-Free Federated Learning28 Jan 2023
- 2022Mixed-Precision Neural Networks: A Survey11 Aug 2022
- 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications25 Apr 2022
- 2022FxP-QNet: A Post-Training Quantizer for the Design of Mixed Low-Precision DNNs with Dynamic Fixed-Point Representation22 Mar 2022
- 2022Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey16 Mar 2022
9 more
- 2021N3H-Core: Neuron-designed Neural Network Accelerator via FPGA-based Heterogeneous Computing Cores15 Dec 2021
- 2021MQBench: Towards Reproducible and Deployable Model Quantization Benchmark5 Nov 2021
- 2021Applications and Techniques for Fast Machine Learning in Science25 Oct 2021
- 2021Towards Mixed-Precision Quantization of Neural Networks via Constrained Optimization13 Oct 2021
- 2021RCT: Resource Constrained Training for Edge AI26 Mar 2021
- 2021MWQ: Multiscale Wavelet Quantized Neural Networks9 Mar 2021
- 2021Effective and Fast: A Novel Sequential Single Path Search for Mixed-Precision Quantization4 Mar 2021
- 2021GradFreeBits: Gradient Free Bit Allocation for Dynamic Low Precision Neural Networks18 Feb 2021
- 2021Understanding Cache Boundness of ML Operators on ARM Processors1 Feb 2021
- 2021Towards Mixed-Precision Quantization of Neural Networks via Constrained Optimizationcited by 57
- 2022Hardware Approximate Techniques for Deep Neural Network Accelerators: A Surveycited by 39
- 2021MQBench: Towards Reproducible and Deployable Model Quantization Benchmarkcited by 38
- 2021Applications and Techniques for Fast Machine Learning in Sciencecited by 32
- 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applicationscited by 32
- 2024MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantizationcited by 22
- 2023BAFFLE: A Baseline of Backpropagation-Free Federated Learningcited by 12
- 2024RefQSR: Reference-based Quantization for Image Super-Resolution Networkscited by 8
- 2022Mixed-Precision Neural Networks: A Surveycited by 7
- 2021Effective and Fast: A Novel Sequential Single Path Search for Mixed-Precision Quantizationcited by 6
- 2021MWQ: Multiscale Wavelet Quantized Neural Networkscited by 4
- 2024xTern: Energy-Efficient Ternary Neural Network Inference on RISC-V-Based Edge Systemscited by 4
12 most cited of 20 All 20 (JSON)
- 2026Bitwise Systolic Array Architecture for Runtime-Reconfigurable Multi-precision Quantized Multiplication on Hardware Accelerators26 Feb 2026
- 2025Karatsuba Matrix Multiplication and its Efficient Custom Hardware Implementations15 Jan 2025
- 2024MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization8 Nov 2024
- 2024ARQ: A Mixed-Precision Quantization Framework for Accurate and Certifiably Robust DNNs31 Oct 2024
- 2024xTern: Energy-Efficient Ternary Neural Network Inference on RISC-V-Based Edge Systems29 May 2024
- 2024RefQSR: Reference-based Quantization for Image Super-Resolution Networks2 Apr 2024
- 2023BAFFLE: A Baseline of Backpropagation-Free Federated Learning28 Jan 2023
- 2022Mixed-Precision Neural Networks: A Survey11 Aug 2022
- 2022Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications25 Apr 2022
- 2022FxP-QNet: A Post-Training Quantizer for the Design of Mixed Low-Precision DNNs with Dynamic Fixed-Point Representation22 Mar 2022
- 2022Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey16 Mar 2022
- 2021N3H-Core: Neuron-designed Neural Network Accelerator via FPGA-based Heterogeneous Computing Cores15 Dec 2021
12 newest of 20 All 20 (JSON)