# Stochastic Rounding: Algorithms and Hardware Accelerator

arXiv: https://arxiv.org/abs/2001.01501 · HTML: https://mlsanity.com/paper/2001.01501/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Jan 2020.

## Built on by (most cited first, 4 of 4)

- [On the influence of stochastic roundoff errors and their bias on the convergence of the gradient descent method with low-precision floating-point computation](https://mlsanity.com/paper/2202.12276/) (2022)
- [A Simple and Efficient Stochastic Rounding Method for Training Neural Networks in Low Precision](https://mlsanity.com/paper/2103.13445/) (2021)
- [FeNN: A RISC-V vector processor for Spiking Neural Network acceleration](https://mlsanity.com/paper/2506.11760/) (2025)
- [The SpiNNaker2 chip: a many-core platform for flexible and scalable brain-inspired computing](https://mlsanity.com/paper/2607.24396/) (2026)

## Abstract (arXiv)

Algorithms and a hardware accelerator for performing stochastic rounding (SR) are presented. The main goal is to augment the ARM M4F based multi-core processor SpiNNaker2 with a more flexible rounding functionality than is available in the ARM processor itself. The motivation of adding such an accelerator in hardware is based on our previous results showing improvements in numerical accuracy of ODE solvers in fixed-point arithmetic with SR, compared to standard round to nearest or bit truncation rounding modes. Furthermore, performing SR purely in software can be expensive, due to requirement of a pseudorandom number generator (PRNG), multiple masking and shifting instructions, and an addition operation. Also, saturation of the rounded values is included, since rounding is usually followed by saturation, which is especially important in fixed-point arithmetic due to a narrow dynamic range of representable values. The main intended use of the accelerator is to round fixed-point multiplier outputs, which are returned unrounded by the ARM processor in a wider fixed-point format than the arguments.