Neural Lattice Reduction: A Self-Supervised Geometric Deep Learning Approach
Not on the map. Why?
Abstract (arXiv)
Lattice reduction is a combinatorial optimization problem aimed at finding the most orthogonal basis in a given lattice. The Lenstra-Lenstra-Lov'asz (LLL) algorithm is the best algorithm in the literature for solving this problem. In light of recent research on algorithm discovery, in this work, we would like to answer this question: is it possible to parametrize the algorithm space for lattice reduction problem with neural networks and find an algorithm without supervised data? Our strategy is to use equivariant and invariant parametrizations and train in a self-supervised way. We design a deep neural model outputting factorized unimodular matrices and train it in a self-supervised manner by penalizing non-orthogonal lattice bases. We incorporate the symmetries of lattice reduction into the model by making it invariant to isometries and scaling of the ambient space and equivariant with respect to the hyperocrahedral group permuting and flipping the lattice basis elements. We show that this approach yields an algorithm with comparable complexity and performance to the LLL algorithm on a set of benchmarks. Additionally, motivated by certain applications for wireless communication, we extend our method to a convolutional architecture which performs joint reduction of spatially-correlated lattices arranged in a grid, thereby amortizing its cost over multiple lattices.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 52 references that are in the map. First posted on arXiv 14 Nov 2023.
Builds on
19 of 52 references.
References · 19
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Layer Normalizationcited by 5,579
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2015Pointer Networkscited by 882
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
- 2019Provably Powerful Graph Networkscited by 385
- 2015Deep Learning with Limited Numerical Precisioncited by 368
- 2018Invariant and Equivariant Graph Networkscited by 339
7 more
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 267
- 2019Understanding Straight-Through Estimator in Training Activation Quantized Neural Netscited by 225
- 2018Learning to Solve NP-Complete Problems - A Graph Neural Network for Decision TSPcited by 58
- 2019Graph Colouring Meets Deep Learning: Effective Graph Neural Network Models for Combinatorial Problemscited by 40
- 2021Edge Representation Learning with Hypergraphscited by 37
- 2022Augment with Care: Contrastive Learning for Combinatorial Problemscited by 22
- 2021On the approximation capability of GNNs in node classification/regression taskscited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.