Caliber: Cross-Architecture Extraction-Cost Control for Score-Returning APIs
Not on the map. Why?
Abstract (arXiv)
We present Caliber, an output-perturbation defense against model extraction that formulates noise selection as a calibration problem: how much the defense degrades the supervision signal used to train a surrogate, and the provable per-input query cost of recovering the clean logits. To defend against an attacker that uses returned scores for knowledge distillation, Caliber adds independent and identically distributed Gaussian noise to the internal logits. We establish two properties of the resulting perturbed predictions. Monotone agreement degradation: When the clean logits have a unique maximizer, agreement with the clean prediction decreases strictly with the noise scale, so every target in (1/K,1) corresponds to a unique positive scale; task accuracy is bounded by computable lower and upper envelopes. Per-input recovery cost: We derive a closed-form minimax lower bound on the repeated queries needed to recover the clean logits for a fixed input. Caliber normalizes noise variance by the squared median top-two logit margin and fits the resulting noise-utility relationship with a logistic curve, either per model or shared within a task. Across more than thirty model-dataset combinations, per-model calibration achieves mean absolute relative errors of 0.6-1.4%. End-to-end experiments show that surrogate performance generally tracks the configured degradation, while fixed-input averaging follows the expected variance reduction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 48 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
33 of 48 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2023A Watermark for Large Language Modelscited by 667
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
21 more
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 208
- 2018PRADA: Protecting against DNN Model Stealing Attackscited by 159
- 2024Stealing Part of a Production Language Modelcited by 152
- 2019Thieves on Sesame Street! Model Extraction of BERT-based APIscited by 136
- 2020Data-Free Model Extractioncited by 121
- 2021Dataset Inference: Ownership Resolution in Machine Learningcited by 115
- 2019Prediction Poisoning: Towards Defenses Against DNN Model Stealing Attackscited by 79
- 2019Defending Against Model Stealing Attacks with Adaptive Misinformationcited by 55
- 2017Model Extraction Warning in MLaaS Paradigmcited by 39
- 2021Undistillable: Making A Nasty Teacher That CANNOT teach studentscited by 36
- 2025Antidistillation Samplingcited by 24
- 2022Increasing the Cost of Model Extraction with Calibrated Proof of Workcited by 21
- 2022How to Steer Your Adversary: Targeted and Efficient Model Stealing Defenses with Gradient Redirectioncited by 21
- 2025Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation?cited by 16
- 2025DOGe: Defensive Output Generation for LLM Protection Against Knowledge Distillationcited by 14
- 2023Bucks for Buckets (B4B): Active Defenses Against Stealing Encoderscited by 8
- 2025Catch-Only-One: Non-Transferable Examples for Model-Specific Authorizationcited by 7
- 2025Re-Key-Free, Risky-Free: Adaptable Model Usage Controlcited by 6
- 2026Towards Distillation-Resistant Large Language Models: An Information-Theoretic Perspectivecited by 5
- 2026AI Model Modulation with Logits Redistributioncited by 3
Built on by
Not cited yet.