# Fast Convolutional Nets With fbfft: A GPU Performance Evaluation

arXiv: https://arxiv.org/abs/1412.7580 · HTML: https://mlsanity.com/paper/1412.7580/

## Key facts

- Cited by 27 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Dec 2014.

## Built on by (most cited first, 27 of 27)

- [Scaling Local Self-Attention for Parameter Efficient Visual Backbones](https://mlsanity.com/paper/2103.12731/) (2021)
- [ReduNet: A White-box Deep Network from the Principle of Maximizing Rate Reduction](https://mlsanity.com/paper/2105.10446/) (2021)
- [Manipulating Identical Filter Redundancy for Efficient Pruning on Deep and Complicated CNN](https://mlsanity.com/paper/2107.14444/) (2021)
- [Resource-Efficient Deep Learning: A Survey on Model-, Arithmetic-, and Implementation-Level Techniques](https://mlsanity.com/paper/2112.15131/) (2021)
- [As large as it gets: Learning infinitely large Filters via Neural Implicit Functions in the Fourier Domain](https://mlsanity.com/paper/2307.10001/) (2023)
- [Knowledge Distillation Circumvents Nonlinearity for Optical Convolutional Neural Networks](https://mlsanity.com/paper/2102.13323/) (2021)
- [Fast-FNet: Accelerating Transformer Encoder Models via Efficient Fourier Layers](https://mlsanity.com/paper/2209.12816/) (2022)
- [AdaOPC: A Self-Adaptive Mask Optimization Framework For Real Design Patterns](https://mlsanity.com/paper/2303.12723/) (2023)
- [Model Compression using Progressive Channel Pruning](https://mlsanity.com/paper/2507.04792/) (2025)
- [FourierNets enable the design of highly non-local optical encoders for computational imaging](https://mlsanity.com/paper/2104.10611/) (2021)
- [From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks](https://mlsanity.com/paper/2405.06038/) (2024)
- [cuConv: A CUDA Implementation of Convolution for CNN Inference](https://mlsanity.com/paper/2103.16234/) (2021)
- [Efficient and Generic 1D Dilated Convolution Layer for Deep Learning](https://mlsanity.com/paper/2104.08002/) (2021)
- [Learning Convolutional Neural Networks in the Frequency Domain](https://mlsanity.com/paper/2204.06718/) (2022)
- [Kernel-Segregated Transpose Convolution Operation](https://mlsanity.com/paper/2209.03704/) (2022)
- [Low-Rank Winograd Transformation for 3D Convolutional Neural Networks](https://mlsanity.com/paper/2301.11180/) (2023)
- [Convolutional Neural Network Simplification with Progressive Retraining](https://mlsanity.com/paper/2101.04699/) (2021)
- [Testing predictions of representation cost theory with CNNs](https://mlsanity.com/paper/2210.01257/) (2022)
- [Pruning Very Deep Neural Network Channels for Efficient Inference](https://mlsanity.com/paper/2211.08339/) (2022)
- [TFDMNet: A Novel Network Structure Combines the Time Domain and Frequency Domain Features](https://mlsanity.com/paper/2401.15949/) (2024)
- [Phasor-Driven Acceleration for FFT-based CNNs](https://mlsanity.com/paper/2406.00290/) (2024)
- [Flexible Coded Distributed Convolution Computing for Enhanced Straggler Resilience and Numerical Stability in Distributed CNNs](https://mlsanity.com/paper/2411.01579/) (2024)
- [Underwater object detection in sonar imagery with detection transformer and Zero-shot neural architecture search](https://mlsanity.com/paper/2505.06694/) (2025)
- [S3F-Net: A Multi-Modal Approach to Medical Image Classification via Spatial-Spectral Summarizer Fusion Network](https://mlsanity.com/paper/2509.23442/) (2025)
- [Accelerated Rotation-Invariant Convolution for UAV Image Segmentation](https://mlsanity.com/paper/2512.08888/) (2025)
- [Spectral-Structured Diffusion for Single-Image Rain Removal](https://mlsanity.com/paper/2603.09054/) (2026)
- [Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform](https://mlsanity.com/paper/2607.21271/) (2026)

## Abstract (arXiv)

We examine the performance profile of Convolutional Neural Network training on the current generation of NVIDIA Graphics Processing Units. We introduce two new Fast Fourier Transform convolution implementations: one based on NVIDIA's cuFFT library, and another based on a Facebook authored FFT implementation, fbfft, that provides significant speedups over cuFFT (over 1.5x) for whole CNNs. Both of these convolution implementations are available in open source, and are faster than NVIDIA's cuDNN implementation for many common convolutional layers (up to 23.5x for some synthetic kernel configurations). We discuss different performance regimes of convolutions, comparing areas where straightforward time domain convolutions outperform Fourier frequency domain convolutions. Details on algorithmic applications of NVIDIA GPU hardware specifics in the implementation of fbfft are also provided.