Smooth Approximations of the Rounding Function
Not on the map. Why?
Abstract (arXiv)
We propose novel smooth approximations to the classical rounding function, suitable for differentiable optimization and machine learning applications. Our constructions are based on two approaches: (1) localized sigmoid window functions centered at each integer, and (2) normalized weighted sums of sigmoid derivatives representing local densities. The first method approximates the step-like behavior of rounding through differences of shifted sigmoids, while the second method achieves smooth interpolation between integers via density-based weighting. Both methods converge pointwise to the classical rounding function as the sharpness parameter k tends to infinity, and allow controlled trade-offs between smoothness and approximation accuracy. We demonstrate that by restricting the summation to a small set of nearest integers, the computational cost remains low without sacrificing precision. These constructions provide fully differentiable alternatives to hard rounding, which are valuable in contexts where gradient-based methods are essential.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Apr 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026StableQAT: Stable Quantization-Aware Training at Ultra-Low Bitwidthscited by 2
- 2026SoftJAX & SoftTorch: Empowering Automatic Differentiation Libraries with Informative Gradientscited by 2
- 2026TIACam: Text-Anchored Invariant Feature Learning with Auto-Augmentation for Camera-Robust Zero-Watermarkingcited by 0
- 2026SoftJAX & SoftTorch: Empowering Automatic Differentiation Libraries with Informative Gradients9 Mar 2026
- 2026TIACam: Text-Anchored Invariant Feature Learning with Auto-Augmentation for Camera-Robust Zero-Watermarking21 Feb 2026
- 2026StableQAT: Stable Quantization-Aware Training at Ultra-Low Bitwidths27 Jan 2026