mlsanityData to 14 Oct 2026

Training-Inference Kernel Contracts: Bounding Divergence in Post-Training and Deployment

arXiv 2606.07581 ↗First posted 26 May 2026cs.LG cs.AI cs.ETcited by 1

Not on the map. Why?

Abstract (arXiv)

A modern post-training pipeline often writes one symbol for its policy, pi_theta, while evaluating it through two different programs: a training kernel optimized for autograd and an inference kernel optimized for low-precision, fused, dynamically batched serving. In finite precision, these kernels can induce different distributions at identical weights, with the gap concentrated on slices that aggregate benchmarks under-represent. This paper proposes kernel contracts: a contract-first framework for specifying acceptable divergence between K_train and K_inf. A contract C = (N, S, R, O, Pi) combines numerical, statistical, runtime, and observability clauses with an escalation policy from violations to routing actions. We derive a chain of bounds from logit drift to total-variation distance to bounded reward drift, and specialize it to RL post-training, where per-token importance-ratio drift yields a bound on policy-gradient bias under explicit support and norm assumptions. We also describe a four-stage promotion pipeline, online routing loop, and minimal YAML DSL for contract artifacts. This is a framework and vocabulary paper; we do not report production-scale empirical validation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 22 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

18 of 22 references.

References · 18

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  6. 2017On Calibration of Modern Neural Networkscited by 4,960
  7. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  8. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  9. 2015Trust Region Policy Optimizationcited by 2,580
  10. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
  11. 2019When Does Label Smoothing Help?cited by 988
  12. 2017Deep Reinforcement Learning that Matterscited by 754
6 more
  1. 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 744
  2. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
  3. 2022FP8 Formats for Deep Learningcited by 196
  4. 2020Implementation Matters in Deep Policy Gradients: A Case Study on PPO and TRPOcited by 186
  5. 2020The Hardware Lotterycited by 160
  6. 2025Understanding Reinforcement Learning for Model Training, and future directions with GRAPEcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.