Fast Matrix Multiplication in fp8: Certified Coefficient Optimization and Measured Error
Not on the map. Why?
Abstract (arXiv)
A Strassen-type algorithm has many realizations with the same exact product and multiplication count yet different fp8 error because basis changes reshape coefficient geometry, posing the question of which to run. No current account settles this: classical stability controls worst-case ℓ1 growth, not the expected-error magnitude, and the Dumas--Pernet--Sedoglavic optimizer could only be called probably optimal, its global optimality unproved. To settle this, we attach to each realization a coefficient functional Phi, a scalar summary of its coefficient geometry, which we minimize over the change-of-basis orbit. This Kempf--Ness problem on a Hadamard manifold lets us certify the global Phi optimum rather than merely search for it: an exact moment-map zero fixes Phimin = 200/9, and de Groote's classification extends that optimality to every exact real rank-7 2×2 decomposition. Every exact real rank-7 realization therefore has a Phi-predicted RMS constant at least 5/3 times that of the cubic algorithm, at fixed noise coefficient. We then introduce an explicit block-scaled e4m3 model in which Phi is the leading-order coefficient of relative expected mean-squared error, and we test the resulting Phi-predicted ordering against realized fp8 error. Ordering and re-basing experiments support that prediction within tested fused block-scaled regimes, and on real matmul tiles from four architecture families the Phi-optimal realization falls in the fp8 low-error region. Across two ~70B models on real deepgemm kernels, the same realization removes 10 to 55% of classic Strassen's excess NLL over the clean model. Algorithm realization thus becomes a mathematically certified design problem rather than a tuning choice: an independent low-precision axis with a global Phi optimum and measured fp8 relevance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 31 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
11 of 31 references.
References · 11
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,386
- 2024QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMscited by 634
- 2024SpinQuant: LLM quantization with learned rotationscited by 471
- 2024Optimal Quantization for Matrix Multiplicationcited by 14
- 2019Towards a theory of non-commutative optimization: geodesic first and second order methods for moment maps and polytopescited by 7
- 2026High-Rate Quantized Matrix Multiplication Icited by 7
- 2015Symmetries of matrix multiplication algorithms. Icited by 1
- 2026FalconGEMM: Surpassing Hardware Peaks with Lower-Complexity Matrix Multiplicationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.