mlsanityData to 14 Oct 2026

Jinx: Unlimited LLMs for Probing Alignment Failures

arXiv 2508.08243 ↗First posted 11 Aug 2025cs.CLcited by 2

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

also in 1 more
Abstract (arXiv)

Unlimited, or so-called helpful-only language models are trained without safety alignment constraints and never refuse user queries. They are widely used by leading AI companies as internal tools for red teaming and alignment evaluation. For example, if a safety-aligned model produces harmful outputs similar to an unlimited model, this indicates alignment failures that require further attention. Despite their essential role in assessing alignment, such models are not available to the research community. We introduce Jinx, a helpful-only variant of popular open-weight LLMs. Jinx responds to all queries without refusals or safety filtering, while preserving the base model's capabilities in reasoning and instruction following. It provides researchers with an accessible tool for probing alignment failures, evaluating safety boundaries, and systematically studying failure modes in language model safety.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 14 of its 22 references that are in the map. First posted on arXiv 11 Aug 2025.

Builds on

14 of 22 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 13

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  4. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  5. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
  6. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
  7. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  8. 2025Persona Features Control Emergent Misalignmentcited by 86
  9. 2025International AI Safety Reportcited by 67
  10. 2024Are Your LLMs Capable of Stable Reasoning?cited by 65
  11. 2025Understanding and Enhancing the Transferability of Jailbreaking Attackscited by 22
  12. 2025Why Do Some Language Models Fake Alignment While Others Don't?cited by 20
1 more
  1. 2025Accidental Vulnerability: Factors in Fine-Tuning that Shift Model Safeguardscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Safety Alignment Depth in Large Language Models: A Markov Chain Perspective
  2. 2025The Hidden Space of Safety: Understanding Preference-Tuned LLMs in Multilingual context
  3. 2026Safety at One Shot: Patching Fine-Tuned LLMs with A Single Instance
  4. 2025Safety Game: Inference-Time Alignment of Black-Box LLMs via Constrained Optimization
  5. 2026Can Safety Emerge from Weak Supervision? A Systematic Analysis of Small Language Models
  6. 2025Picky LLMs and Unreliable RMs: An Empirical Study on Safety Alignment after Instruction Tuning
  7. 2025Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challenges
  8. 2026Aligned but Fragile: Enhancing LLM Safety Robustness via Zeroth-Order Optimization