mlsanityData to 14 Oct 2026

ApexQuant: Data-Free Elastic Quantization by Residual Re-Isotropization

arXiv 2610.07904 ↗First posted 6 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce ApexQuant, a calibration-free quantization method that recursively re-quantizes the residual error, serving as a refinement layer on top of existing quantizers. We establish that a fresh random rotation returns each residual to the uniform distribution on the hypersphere, which characterizes the rate of progressive error decay across successive passes. This result lets us determine, before any weight is read, how many passes a layer needs for a target weight-space error. Every prefix is itself a valid lower-rate model, so one artifact serves several precisions. We instantiate ApexQuant with three interchangeable stages, scalar, E8 and trellis, and validate it on four open-weight LLMs and on Earth-observation and medical domains where in-distribution data is often unattainable as imagery arrives under restrictive licences or due to patient material under privacy constraints. Progressive re-isotropization comes within a few percent of full precision at four bits and gives the best two-bit arm we measure, in a completely data-free setting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 48 references that are in the map. First posted on arXiv 6 Oct 2026.

Builds on

12 of 48 references.

References · 12

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  5. 2023Mistral 7Bcited by 3,164
  6. 2025Gemma 3 Technical Reportcited by 1,824
  7. 2024TinyLlama: An Open-Source Small Language Modelcited by 618
  8. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 565
  9. 2024SpinQuant: LLM quantization with learned rotationscited by 471
  10. 2025TurboQuant: Online Vector Quantization with Near-optimal Distortion Ratecited by 125
  11. 2026MoBiQuant: Mixture-of-Bits Quantization for Token-Adaptive Any-Precision LLMcited by 1
  12. 2026Multi-Bitwidth Quantization for LLMs Using Additive Codebookscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MF-QAT: Multi-Format Quantization-Aware Training for Elastic Inference
  2. 2026MXSens: Sensitivity-Aware Mixed-Precision Quantization for Efficient LLM Inference
  3. 2026PRQuant: Permutation Residual Quantization for Low-Overhead Inference
  4. 2024QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
  5. 2026Scale Sensitivity in Low-Bit Post-Training Quantization: Curvature of the Quantization Error Landscape
  6. 2026Beyond Outliers: A Data-Free Layer-wise Mixed-Precision Quantization Approach Driven by Numerical and Structural Dual-Sensitivity
  7. 2026DuQuant++: Fine-grained Rotation Enhances Microscaling FP4 Quantization
  8. 2026HARP: Hadamard-Preconditioned Adaptive Rotation Processor for Extreme LLM Quantization