mlsanityData to 7 Oct 2026

SIRF: A Spec-Internalized Risk Foundation Model for Industrial Content Risk Control

arXiv 2609.11752 ↗First posted 10 Sep 2026cs.AI cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

For industrial content risk control, the real deployment constraint is not average accuracy but how much risk can be auto-handled under high precision and second-level latency. We present SIRF (Spec-Internalized Risk Foundation Model), which internalizes a platform's complex policies, synthesized without additional human annotation via EntiGraph, MAGA rewriting and account-level chain-of-thought (CoT), into the weights via continued pretraining (CPT), so rules are applied at high precision under an ultra-low-latency, verdict-only deployment. A controlled same-source comparison (Qwen3-8B-SFT vs. SIRF-8B-SFT, identical policy injection and verdict-only output form, differing only in policy-grounded CPT) attributes the gain to internalization: SIRF-8B-SFT reaches 71.3% Black Recall@P95, +15.1pp over the baseline, using only ~70M CPT tokens without harming general ability, and among included, logprob-available models under this interface it matches or exceeds far larger systems. SIRF is deployed as a tree-model adjudication layer (20% more mis-penalized samples recovered) and transfers to a freezing scenario at low cost (~70% relative mis-penalization reduction).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 34 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

25 of 34 references.

References · 25

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  6. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  7. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  8. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  10. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  11. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  12. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
13 more
  1. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
  2. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  3. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
  4. 2017Selective Classification for Deep Neural Networkscited by 799
  5. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
  6. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
  7. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  8. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
  9. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 385
  10. 2020Calibration of Pre-trained Transformerscited by 307
  11. 2024Does your data spark joy? Performance gains from domain upsampling at the end of trainingcited by 51
  12. 2026Model Spec Midtraining: Improving How Alignment Training Generalizescited by 11
  13. 2026GLiGuard: Schema-Conditioned Classification for LLM Safeguardcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Static Alignment: Hierarchical Policy Control for LLM Safety via Risk-Aware Chain-of-Thought
  2. 2026Open-Domain Safety Policy Construction
  3. 2026STARS: Skill-Triggered Audit for Request-Conditioned Invocation Safety in Agent Systems
  4. 2026Exploring Systems-Thinking Approaches to Loss of Control Risk
  5. 2026OOD-MMSafe: Advancing MLLM Safety from Harmful Intent to Hidden Consequences
  6. 2026Quantifying Automation Risk in High-Automation AI Systems: A Bayesian Framework for Failure Propagation and Optimal Oversight
  7. 2026SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessment
  8. 2026Beyond Aggregate Risk: Role-Stratified Conformal Risk Control for LLM Tool Calls