mlsanityData to 14 Oct 2026

FAIR-Calib: Frontier-Aware Instability-Reweighted Calibration for Post-Training Quantization of Diffusion Large Language Models

arXiv 2606.06547 ↗First posted 4 Jun 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Diffusion Large Language Models (dLLMs) refine tokens iteratively but commit them irreversibly, leading to a "stability lag" where early decisions remain fragile even after being written. We reveal that Post-Training Quantization (PTQ) error easily flips these borderline decisions at the write frontier, which are then permanently locked in and amplified. To address this, we propose Frontier-Aware Instability-Reweighted Calibration (FAIR-Calib), a two-stage PTQ framework for dLLMs. Stage I probes a full-precision teacher to estimate a position prior that combines frontier hits and masked-stage reliability. Stage II performs off-policy, layer-wise calibration by minimizing a reweighted hidden-state MSE, effectively prioritizing the protection of fragile frontier states without requiring expensive end-to-end diffusion rollouts. We further theoretically justify our weighted objective as a surrogate for output KL divergence. Empirically, FAIR-Calib consistently outperforms state-of-the-art baselines on LLaDA and Dream (W4A4), significantly reducing frontier decision flips and suppressing post-commit mismatches across diverse benchmarks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

20 of 34 references.

References · 20

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  6. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  7. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  8. 2016Pointer Sentinel Mixture Modelscited by 3,096
  9. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  10. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
  11. 2025Large Language Diffusion Modelscited by 912
  12. 2025Dream 7B: Diffusion Large Language Modelscited by 544
8 more
  1. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
  2. 2023OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Modelscited by 424
  3. 2024QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebookscited by 378
  4. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
  5. 2024FlatQuant: Flatness Matters for LLM Quantizationcited by 131
  6. 2025Quantization Meets dLLMs: A Systematic Study of Post-training Quantization for Diffusion LLMscited by 23
  7. 2025Demystifying Diffusion Objectives: Reweighted Losses are Better Variational Boundscited by 8
  8. 2019Mask-Predict: Parallel Decoding of Conditional Masked Language Modelscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Uncertainty Quantification for Large Language Diffusion Models
  2. 2025Rethinking Post-Training Quantization: Introducing a Statistical Pre-Calibration Approach
  3. 2026On the Quantization Robustness of Diffusion Language Models in Coding Benchmarks
  4. 2026RDQ: Residual Distribution Quantization for Large Language Models
  5. 2025DLLMQuant: Quantizing Diffusion-based Large Language Models
  6. 2025Quant-dLLM: Post-Training Extreme Low-Bit Quantization for Diffusion Large Language Models
  7. 2025Finish First, Perfect Later: Test-Time Token-Level Cross-Validation for Diffusion Large Language Models
  8. 2025First-Order Error Matters: Accurate Compensation for Quantized Large Language Models