mlsanityData to 14 Oct 2026

Analysis of Threat-Based Manipulation in Large Language Models: A Dual Perspective on Vulnerabilities and Performance Enhancement Opportunities

arXiv 2507.21133 ↗First posted 22 Jul 2025cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) demonstrate complex responses to threat-based manipulations, revealing both vulnerabilities and unexpected performance enhancement opportunities. This study presents a comprehensive analysis of 3,390 experimental responses from three major LLMs (Claude, GPT-4, Gemini) across 10 task domains under 6 threat conditions. We introduce a novel threat taxonomy and multi-metric evaluation framework to quantify both negative manipulation effects and positive performance improvements. Results reveal systematic vulnerabilities, with policy evaluation showing the highest metric significance rates under role-based threats, alongside substantial performance enhancements in numerous cases with effect sizes up to +1336%. Statistical analysis indicates systematic certainty manipulation (pFDR < 0.0001) and significant improvements in analytical depth and response quality. These findings have dual implications for AI safety and practical prompt engineering in high-stakes applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 13 references that are in the map. First posted on arXiv 22 Jul 2025.

Builds on

7 of 13 references.

References · 7

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  2. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  3. 2022Red Teaming Language Models with Language Modelscited by 1,026
  4. 2023Whose Opinions Do Language Models Reflect?cited by 773
  5. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
  6. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
  7. 2022In conversation with Artificial Intelligence: aligning language models with human valuescited by 62

Built on by

Not cited yet.