Graded Neural Networks
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel framework for graded neural networks (GNNs) built over graded vector spaces V_wn, extending classical neural architectures by incorporating algebraic grading. Leveraging a coordinate-wise grading structure with scalar action λ star x = (λqi xi), defined by a tuple w = (q0, ldots, qn-1), we introduce graded neurons, layers, activation functions, and loss functions that adapt to feature significance. Theoretical properties of graded spaces are established, followed by a comprehensive GNN design, addressing computational challenges like numerical stability and gradient scaling. Potential applications span machine learning and photonic systems, exemplified by high-speed laser-based implementations. This work offers a foundational step toward graded computation, unifying mathematical rigor with practical potential, with avenues for future empirical and hardware exploration.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 4 of its 17 references that are in the map. First posted on arXiv 25 Feb 2025.
Builds on
4 of 17 references.
References · 4
- 2021Convex optimizationcited by 2,515
- 2016Error bounds for approximations with deep ReLU networkscited by 574
- 2024Machine learning for moduli space of genus two curves and an application to isogeny based cryptographycited by 6
- 2024Artificial Neural Networks on Graded Vector Spacescited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025Internalizing Tools as Morphisms in Graded Transformerscited by 1
- 2025Graded Transformerscited by 0
- 2025From Polynomials to Databases: Arithmetic Structures in Galois Theorycited by 0
- 2026Hierarchical Grading in Large Language Modelscited by 0
- 2026Hierarchical Grading in Large Language Models23 Jul 2026
- 2025Internalizing Tools as Morphisms in Graded Transformers21 Nov 2025
- 2025From Polynomials to Databases: Arithmetic Structures in Galois Theory20 Nov 2025
- 2025Graded Transformers27 Jul 2025