# DCT-Conv: Coding filters in convolutional networks with Discrete Cosine Transform

arXiv: https://arxiv.org/abs/2001.08517 · HTML: https://mlsanity.com/paper/2001.08517/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Jan 2020.

## Built on by (most cited first, 4 of 4)

- [Frequency-Controlled Diffusion Model for Versatile Text-Guided Image-to-Image Translation](https://mlsanity.com/paper/2407.03006/) (2024)
- [Memory-Efficient CNN Accelerator Based on Interlayer Feature Map Compression](https://mlsanity.com/paper/2110.06155/) (2021)
- [Frequency Regularization: Restricting Information Redundancy of Convolutional Neural Networks](https://mlsanity.com/paper/2304.07973/) (2023)
- [Neural Weight Step Video Compression](https://mlsanity.com/paper/2112.01504/) (2021)

## Abstract (arXiv)

Convolutional neural networks are based on a huge number of trained weights. Consequently, they are often data-greedy, sensitive to overtraining, and learn slowly. We follow the line of research in which filters of convolutional neural layers are determined on the basis of a smaller number of trained parameters. In this paper, the trained parameters define a frequency spectrum which is transformed into convolutional filters with Inverse Discrete Cosine Transform (IDCT, the same is applied in decompression from JPEG). We analyze how switching off selected components of the spectra, thereby reducing the number of trained weights of the network, affects its performance. Our experiments show that coding the filters with trained DCT parameters leads to improvement over traditional convolution. Also, the performance of the networks modified this way decreases very slowly with the increasing extent of switching off these parameters. In some experiments, a good performance is observed when even 99.9% of these parameters are switched off.