mlsanityData to 7 Oct 2026

FinRT: Distilling Adaptive Red-Teaming Strategies into Reusable Adversarial Generators in Consumer Finance

arXiv 2609.36474 ↗First posted 29 Sep 2026cs.CL cs.CR cs.LGcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

In regulated industries like consumer finance, seemingly harmless user queries can exploit large language model vulnerabilities, triggering safety failures and pushing responses dangerously close to policy limits. Existing automated red-teaming methods trade off attack effectiveness against generation cost, while treating coverage, severity, and diversity as incidental rather than joint objectives. We introduce FinRT, a structured framework that builds reusable adversarial prompt generators from adaptive red-teaming strategies. Across the six victim models in consumer finance, FinRT substantially outperforms adaptive search baselines while amortizing target-facing attack generation into a reusable generator. FinRT nearly doubles the attack success rate over the adaptive baseline Rainbow Teaming (32.9% vs. 17.2%), increases maximum adversarial severity by 33%, and preserves comparable intra-policy-domain semantic diversity to iterative search methods. Our method achieves high cross-model transferability while exhibiting distinct victim-family specialization patterns.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 17 of its 40 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

17 of 40 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Adaptive Instruction Composition for Automated LLM Red-Teaming22 Apr
  2. 2025Jailbreak-Zero: A Path to Pareto Optimal Red Teaming for Large Language Models18 Dec
  3. 2025AutoRed: A Free-form Adversarial Prompt Generation Framework for Automated Red Teaming9 Oct
  4. 2024SAGE-RT: Synthetic Alignment data Generation for Safety Evaluation and Red Teaming14 Aug

Other references · 13

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  3. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  4. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
  5. 2023BloombergGPT: A Large Language Model for Financecited by 923
  6. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 619
  7. 2020Efficient Intent Detection with Dual Sentence Encoderscited by 419
  8. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  9. 2022Parameter-Efficient Legal Domain Adaptationcited by 12
  10. 2025SafeLawBench: Towards Safe Alignment of Large Language Modelscited by 9
  11. 2026StealthGraph: Exposing Domain-Specific Risks in LLMs through Knowledge-Graph-Guided Harmful Prompt Generationcited by 4
  12. 2026FinSafetyBench: Evaluating LLM Safety in Real-World Financial Scenarioscited by 3
1 more
  1. 2026Risk-Adjusted Harm Scoring for Automated Red Teaming for LLMs in Financial Servicescited by 1

Built on by

Not cited yet.