Kervolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
Convolutional neural networks (CNNs) have enabled the state-of-the-art performance in many computer vision tasks. However, little effort has been devoted to establishing convolution in non-linear space. Existing works mainly leverage on the activation layers, which can only provide point-wise non-linearity. To solve this problem, a new operation, kervolution (kernel convolution), is introduced to approximate complex behaviors of human perception systems leveraging on the kernel trick. It generalizes convolution, enhances the model capacity, and captures higher order interactions of features, via patch-wise kernel functions, but without introducing additional parameters. Extensive experiments show that kervolutional neural networks (KNN) achieve higher accuracy and faster convergence than baseline CNN.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 4; 2023: 5; 2024: 1; 2025: 1; 2026: 1.
20 papers.
Sort:
- 2022B-cos Networks: Alignment is All We Need for Interpretabilitycited by 88
- 2021Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neuronscited by 40
- 2022SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensingcited by 34
- 2023B-cos Alignment for Inherently Interpretable CNNs and Vision Transformerscited by 31
- 2021On-Off Center-Surround Receptive Fields for Accurate and Robust Image Classificationcited by 15
- 2021Unsupervised Online Learning for Robotic Interestingness with Visual Memorycited by 5
- 2021Convolutional versus Self-Organized Operational Neural Networks for Real-World Blind Image Denoisingcited by 2
- 2021Towards Understanding the Effectiveness of Attention Mechanismcited by 2
- 2022SSIVD-Net: A Novel Salient Super Image Classification & Detection Technique for Weaponized Violencecited by 2
- 2023Kernel function impact on convolutional neural networkscited by 2
- 2023Single Domain Generalization via Normalised Cross-correlation Based Convolutionscited by 2
- 2024Infinite-Dimensional Feature Interactioncited by 2
8 more
- 2021Universal Adder Neural Networkscited by 1
- 2023Computational and Storage Efficient Quadratic Neurons for Deep Neural Networkscited by 1
- 2021IC Networks: Remodeling the Basic Unit for Convolutional Neural Networkscited by 0
- 2021PowerLinear Activation Functions with application to the first layer of CNNscited by 0
- 2022Exploring Kervolutional Neural Networkscited by 0
- 2023Regularized PolyKervNets: Optimizing Expressiveness and Efficiency for Private Inference in Deep Neural Networkscited by 0
- 2025Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Predictioncited by 0
- 2026Learning with Volterra Neural Networks: A System Theoretic Perspectivecited by 0
- 2026Learning with Volterra Neural Networks: A System Theoretic Perspective1 Sep 2026
- 2025Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Prediction13 Jul 2025
- 2024Infinite-Dimensional Feature Interaction22 May 2024
- 2023Regularized PolyKervNets: Optimizing Expressiveness and Efficiency for Private Inference in Deep Neural Networks23 Dec 2023
- 2023Single Domain Generalization via Normalised Cross-correlation Based Convolutions12 Jul 2023
- 2023B-cos Alignment for Inherently Interpretable CNNs and Vision Transformers19 Jun 2023
- 2023Computational and Storage Efficient Quadratic Neurons for Deep Neural Networks10 Jun 2023
- 2023Kernel function impact on convolutional neural networks20 Feb 2023
- 2022SSIVD-Net: A Novel Salient Super Image Classification & Detection Technique for Weaponized Violence26 Jul 2022
- 2022SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensing16 Jul 2022
- 2022B-cos Networks: Alignment is All We Need for Interpretability20 May 2022
- 2022Exploring Kervolutional Neural Networks6 Jan 2022
8 more
- 2021Unsupervised Online Learning for Robotic Interestingness with Visual Memory18 Nov 2021
- 2021PowerLinear Activation Functions with application to the first layer of CNNs20 Aug 2021
- 2021Towards Understanding the Effectiveness of Attention Mechanism29 Jun 2021
- 2021On-Off Center-Surround Receptive Fields for Accurate and Robust Image Classification13 Jun 2021
- 2021Universal Adder Neural Networks29 May 2021
- 2021Convolutional versus Self-Organized Operational Neural Networks for Real-World Blind Image Denoising4 Mar 2021
- 2021Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neurons10 Feb 2021
- 2021IC Networks: Remodeling the Basic Unit for Convolutional Neural Networks6 Feb 2021
- 2022B-cos Networks: Alignment is All We Need for Interpretabilitycited by 88
- 2021Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neuronscited by 40
- 2022SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensingcited by 34
- 2023B-cos Alignment for Inherently Interpretable CNNs and Vision Transformerscited by 31
- 2021On-Off Center-Surround Receptive Fields for Accurate and Robust Image Classificationcited by 15
- 2021Unsupervised Online Learning for Robotic Interestingness with Visual Memorycited by 5
- 2021Convolutional versus Self-Organized Operational Neural Networks for Real-World Blind Image Denoisingcited by 2
- 2021Towards Understanding the Effectiveness of Attention Mechanismcited by 2
- 2022SSIVD-Net: A Novel Salient Super Image Classification & Detection Technique for Weaponized Violencecited by 2
- 2023Kernel function impact on convolutional neural networkscited by 2
- 2023Single Domain Generalization via Normalised Cross-correlation Based Convolutionscited by 2
- 2024Infinite-Dimensional Feature Interactioncited by 2
12 most cited of 20 All 20 (JSON)
- 2026Learning with Volterra Neural Networks: A System Theoretic Perspective1 Sep 2026
- 2025Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Prediction13 Jul 2025
- 2024Infinite-Dimensional Feature Interaction22 May 2024
- 2023Regularized PolyKervNets: Optimizing Expressiveness and Efficiency for Private Inference in Deep Neural Networks23 Dec 2023
- 2023Single Domain Generalization via Normalised Cross-correlation Based Convolutions12 Jul 2023
- 2023B-cos Alignment for Inherently Interpretable CNNs and Vision Transformers19 Jun 2023
- 2023Computational and Storage Efficient Quadratic Neurons for Deep Neural Networks10 Jun 2023
- 2023Kernel function impact on convolutional neural networks20 Feb 2023
- 2022SSIVD-Net: A Novel Salient Super Image Classification & Detection Technique for Weaponized Violence26 Jul 2022
- 2022SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensing16 Jul 2022
- 2022B-cos Networks: Alignment is All We Need for Interpretability20 May 2022
- 2022Exploring Kervolutional Neural Networks6 Jan 2022
12 newest of 20 All 20 (JSON)