mlsanityData to 14 Oct 2026

Gradient Based Method for the Fusion of Lattice Quantizers

arXiv 2502.06887 ↗First posted 9 Feb 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In practical applications, lattice quantizers leverage discrete lattice points to approximate arbitrary points in the lattice. An effective lattice quantizer significantly enhances both the accuracy and efficiency of these approximations. In the context of high-dimensional lattice quantization, previous work proposed utilizing low-dimensional optimal lattice quantizers and addressed the challenge of determining the optimal length ratio in orthogonal splicing. Notably, it was demonstrated that fixed length ratios and orthogonality yield suboptimal results when combining low-dimensional lattices. Building on this foundation, another approach employed gradient descent to identify optimal lattices, which inspired us to explore the use of neural networks to discover matrices that outperform those obtained from orthogonal splicing methods. We propose two novel approaches to tackle this problem: the Household Algorithm and the Matrix Exp Algorithm. Our results indicate that both the Household Algorithm and the Matrix Exp Algorithm achieve improvements in lattice quantizers across dimensions 13, 15, 17 to 19, 21, and 22. Moreover, the Matrix Exp Algorithm demonstrates superior efficacy in high-dimensional settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). First posted on arXiv 9 Feb 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Lattice Geometry of Neural Network Quantization -- A Short Equivalence Proof of GPTQ and Babai's Algorithm
  2. 2025Learning Grouped Lattice Vector Quantizers for Low-Bit LLM Compression
  3. 2023LL-VQ-VAE: Learnable Lattice Vector-Quantization For Efficient Representations
  4. 2025NestQuant: Nested Lattice Quantization for Matrix Products and LLMs
  5. 2026Leech Lattice Vector Quantization for Efficient LLM Compression
  6. 2026Tetra: Serving Leech-Lattice Quantized LLMs at 2.7 Bits per Parameter
  7. 2024Optimal Quantization for Matrix Multiplication
  8. 2025Spherical Leech Quantization for Visual Tokenization and Generation