LLM Scheming Inversely Scales with Pretraining Language Coverage
Not on the map. Why?
Abstract (arXiv)
With the growing capabilities of frontier models, AI alignment becomes increasingly critical in high-risk deployment settings. While recent work has empirically demonstrated in-context scheming -- the covert pursuit of misaligned objectives while feigning alignment -- in frontier language models, most work has been performed exclusively in English, leaving a major gap in multilingual safety. We apply Petri, an open-source automated auditing framework, to Qwen3-30B-A3B to evaluate deceptive and scheming behaviors across multiple languages. Our findings suggest that scheming scores are inversely correlated with the estimated pretraining language coverage, with low-resource languages averaging 34.2% higher scores compared to high-resource languages on a five-category scheming index. Furthermore, we find that the effect of estimated pretraining language coverage is not uniform across scheming behaviors.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
17 of 23 references.
References · 17
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
- 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
- 2024Frontier Models are Capable of In-context Schemingcited by 287
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
- 2024AI Sandbagging: Language Models can Strategically Underperform on Evaluationscited by 145
- 2023Scheming AIs: Will AIs fake alignment during training in order to get power?cited by 97
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating Itcited by 45
- 2024Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languagescited by 38
- 2025Evaluation Awareness Scales Predictably in Open-Weights Large Language Modelscited by 14
- 2025SALT: Steering Activations towards Leakage-free Thinking in Chain of Thoughtcited by 11
5 more
- 2025Revisiting Multilingual Data Mixtures in Language Model Pretrainingcited by 10
- 2026Evaluating Alignment of Behavioral Dispositions in LLMscited by 7
- 2025Alignment-Constrained Dynamic Pruning for LLMs: Identifying and Preserving Alignment-Critical Circuitscited by 4
- 2026Playing Devil's Advocate: Off-the-Shelf Persona Vectors Rival Targeted Steering for Sycophancycited by 4
- 2026Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT?cited by 3
Built on by
Not cited yet.