FAIR-Calib: Frontier-Aware Instability-Reweighted Calibration for Post-Training Quantization of Diffusion Large Language Models
Not on the map. Why?
Abstract (arXiv)
Diffusion Large Language Models (dLLMs) refine tokens iteratively but commit them irreversibly, leading to a "stability lag" where early decisions remain fragile even after being written. We reveal that Post-Training Quantization (PTQ) error easily flips these borderline decisions at the write frontier, which are then permanently locked in and amplified. To address this, we propose Frontier-Aware Instability-Reweighted Calibration (FAIR-Calib), a two-stage PTQ framework for dLLMs. Stage I probes a full-precision teacher to estimate a position prior that combines frontier hits and masked-stage reliability. Stage II performs off-policy, layer-wise calibration by minimizing a reweighted hidden-state MSE, effectively prioritizing the protection of fragile frontier states without requiring expensive end-to-end diffusion rollouts. We further theoretically justify our weighted objective as a surrogate for output KL divergence. Empirically, FAIR-Calib consistently outperforms state-of-the-art baselines on LLaDA and Dream (W4A4), significantly reducing frontier decision flips and suppressing post-commit mismatches across diverse benchmarks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
20 of 34 references.
References · 20
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
- 2025Large Language Diffusion Modelscited by 912
- 2025Dream 7B: Diffusion Large Language Modelscited by 544
8 more
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
- 2023OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Modelscited by 424
- 2024QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebookscited by 378
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
- 2024FlatQuant: Flatness Matters for LLM Quantizationcited by 131
- 2025Quantization Meets dLLMs: A Systematic Study of Post-training Quantization for Diffusion LLMscited by 23
- 2025Demystifying Diffusion Objectives: Reweighted Losses are Better Variational Boundscited by 8
- 2019Mask-Predict: Parallel Decoding of Conditional Masked Language Modelscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Uncertainty Quantification for Large Language Diffusion Models
- 2025Rethinking Post-Training Quantization: Introducing a Statistical Pre-Calibration Approach
- 2026On the Quantization Robustness of Diffusion Language Models in Coding Benchmarks
- 2026RDQ: Residual Distribution Quantization for Large Language Models
- 2025DLLMQuant: Quantizing Diffusion-based Large Language Models
- 2025Quant-dLLM: Post-Training Extreme Low-Bit Quantization for Diffusion Large Language Models
- 2025Finish First, Perfect Later: Test-Time Token-Level Cross-Validation for Diffusion Large Language Models
- 2025First-Order Error Matters: Accurate Compensation for Quantized Large Language Models