mlsanityData to 7 Oct 2026

QuadraLib: A Performant Quadratic Neural Network Library for Architecture Optimization and Design Exploration

arXiv 2204.01701 ↗First posted 1 Apr 2022cs.LG cs.CVcited by 21

Not on the map. Why?

Abstract (arXiv)

The significant success of Deep Neural Networks (DNNs) is highly promoted by the multiple sophisticated DNN libraries. On the contrary, although some work have proved that Quadratic Deep Neuron Networks (QDNNs) show better non-linearity and learning capability than the first-order DNNs, their neuron design suffers certain drawbacks from theoretical performance to practical deployment. In this paper, we first proposed a new QDNN neuron architecture design, and further developed QuadraLib, a QDNN library to provide architecture optimization and design exploration for QDNNs. Extensive experiments show that our design has good performance regarding prediction accuracy and computation consumption on multiple learning tasks.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 24 of its 48 references that are in the map. First posted on arXiv 1 Apr 2022.

Builds on

24 of 48 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  8. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  9. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  10. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  11. 2016Improved Techniques for Training GANscited by 2,938
  12. 2016Identity Mappings in Deep Residual Networkscited by 1,960
12 more
  1. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  2. 2017Mixed Precision Trainingcited by 1,135
  3. 2015Automatic differentiation in machine learning: a surveycited by 846
  4. 2014Caffe: Convolutional Architecture for Fast Feature Embeddingcited by 287
  5. 2015MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systemscited by 195
  6. 2019On Network Design Spaces for Visual Recognitioncited by 68
  7. 2018Faster CryptoNets: Leveraging Sparsity for Real-World Encrypted Inferencecited by 45
  8. 2021Quadratic Residual Networks: A New Class of Neural Networks for Solving Forward and Inverse Problems in Physics Involving PDEscited by 42
  9. 2020Pi-nets: Deep Polynomial Neural Networkscited by 39
  10. 2017Non-linear Convolution Filters for CNN-based Learningcited by 38
  11. 2017A New Type of Neurons for Machine Learningcited by 16
  12. 2021Sisyphus: A Cautionary Tale of Using Low-Degree Polynomial Activations in Privacy-Preserving Deep Learningcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 8; 2024: 6; 2025: 3; 2026: 3.

21 papers.

Sort:

  1. 2023StEik: Stabilizing the Optimization of Neural Signed Distance Functions and Finer Shape Representationcited by 22
  2. 2023Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networkscited by 6
  3. 2023One Neuron Saved Is One Neuron Earned: On Parametric Efficiency of Quadratic Networkscited by 6
  4. 2022Quadratic Neuron-empowered Heterogeneous Autoencoder for Unsupervised Anomaly Detectioncited by 5
  5. 2023QuadraNet: Improving High-Order Neural Interaction Efficiency with Hardware-Aware Quadratic Neural Networkscited by 5
  6. 2024HOIN: High-Order Implicit Neural Representationscited by 3
  7. 2024No One-Size-Fits-All Neurons: Task-based Neurons for Artificial Neural Networkscited by 3
  8. 2024QuadraNet V2: Efficient and Sustainable Training of High-Order Neural Networks with Quadratic Adaptationcited by 3
  9. 2025Revisiting Feature Interactions from the Perspective of Quadratic Neural Networks for Click-through Rate Predictioncited by 3
  10. 2024PAON: A New Neuron Model using Pad'e Approximantscited by 2
  11. 2024Infinite-Dimensional Feature Interactioncited by 2
  12. 2023Cloud-RAIN: Point Cloud Analysis with Reflectional Invariancecited by 1
9 more
  1. 2023Computational and Storage Efficient Quadratic Neurons for Deep Neural Networkscited by 1
  2. 2023Rational Neural Network Controllerscited by 0
  3. 2023Dendritic Integration Based Quadratic Neural Networks Outperform Traditional Aritificial Onescited by 0
  4. 2024Retinal Vessel Segmentation via Neuron Programmingcited by 0
  5. 2025NeuronSeek: On Stability and Expressivity of Task-driven Neuronscited by 0
  6. 2025NSPDI-SNN: An efficient lightweight SNN based on nonlinear synaptic pruning and dendritic integrationcited by 0
  7. 2026Pad'e Neurons for Efficient Neural Modelscited by 0
  8. 2026Regularized Least Squares Training of Quadratic Neural Networks with Applications to System Identificationcited by 0
  9. 2026TNLearn: An Open Source Python Package for Task-based Neuronscited by 0