# SOAR: Scale Optimization for Accurate Reconstruction in NVFP4 Quantization

arXiv: https://arxiv.org/abs/2605.12245 · HTML: https://mlsanity.com/paper/2605.12245/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 14 of its 48 references that are in the map.
- First posted on arXiv 12 May 2026.

## Builds on (most cited first, 14 of 14)

- [The Llama 3 Herd of Models](https://mlsanity.com/paper/2407.21783/) (2024)
- [Training Verifiers to Solve Math Word Problems](https://mlsanity.com/paper/2110.14168/) (2021)
- [Qwen3 Technical Report](https://mlsanity.com/paper/2505.09388/) (2025)
- [Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge](https://mlsanity.com/paper/1803.05457/) (2018)
- [Microscaling Data Formats for Deep Learning](https://mlsanity.com/paper/2310.10537/) (2023)
- [Pretraining Large Language Models with NVFP4](https://mlsanity.com/paper/2509.25149/) (2025)
- [Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling](https://mlsanity.com/paper/2512.02010/) (2025)
- [Block Rotation is All You Need for MXFP4 Quantization](https://mlsanity.com/paper/2511.04214/) (2025)
- [ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMs](https://mlsanity.com/paper/2601.07475/) (2026)
- [Benchmarking Post-Training Quantization of Large Language Models under Microscaling Floating Point Formats](https://mlsanity.com/paper/2601.09555/) (2026)
- [RaZeR: Pushing the Limits of NVFP4 Quantization with Redundant Zero Remapping](https://mlsanity.com/paper/2501.04052/) (2025)
- [Unveiling the Potential of Quantization with MXFP4: Strategies for Quantization Error Reduction](https://mlsanity.com/paper/2603.08713/) (2026)
- [BATQuant: Outlier-resilient MXFP4 Quantization via Learnable Block-wise Optimization](https://mlsanity.com/paper/2603.16590/) (2026)
- [D2Quant: Accurate Low-bit Post-Training Weight Quantization for LLMs](https://mlsanity.com/paper/2602.02546/) (2026)

## Built on by (most cited first, 4 of 4)

- [FOCUS: FP4 Optimization via Coupled-Relaxation and Dual-Granularity Scaling](https://mlsanity.com/paper/2608.01847/) (2026)
- [Replay the Curvature: Accurate and Scalable NVFP4 Quantization for Large Language Model Inference](https://mlsanity.com/paper/2609.36654/) (2026)
- [RATIO: Reasoning Analysis and Token-level Inference Optimization for Quantized Reasoning Models](https://mlsanity.com/paper/2609.39801/) (2026)
- [OSFP4: Joint Optimization of Diagonal Smoothing and Block Scales for NVFP4 Quantization](https://mlsanity.com/paper/2610.08231/) (2026)

## Abstract (arXiv)

NVFP4 has recently emerged as an efficient 4-bit microscaling format for large language models (LLMs), offering superior numerical fidelity with native hardware support. However, existing methods often yield suboptimal performance due to inflexible scale selection and the coupled treatment of quantization and dequantization scales. To address these issues, we propose Scale Optimization for Accurate Reconstruction (SOAR), a novel post-training quantization framework that improves the accuracy of NVFP4 quantization. At its core, SOAR features Closed-form Joint Scale Optimization (CJSO), which jointly optimizes global and block-wise scales via analytical solutions derived from reconstruction error minimization. Furthermore, it incorporates Decoupled Scale Search (DSS). DSS decouples the high-precision quantization scale from its constrained dequantization counterpart, and performs discrete search to mitigate precision loss from scale quantization. Extensive experiments across multiple LLMs show that our method consistently outperforms existing NVFP4 quantization baselines, achieving superior accuracy under the same memory footprint with no additional hardware overhead. The code and models will be available at https://github.com/steven-bao1/SOAR.