mlsanityData to 7 Oct 2026

LLM-Guided Prompt Evolution for Password Guessing

arXiv 2604.12601 ↗First posted 14 Apr 2026cs.CR cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Passwords still remain a dominant authentication method, yet their security is routinely subverted by predictable user choices and large-scale credential leaks. Automated password guessing is a key tool for stress-testing password policies and modeling attacker behavior. This paper applies LLM-driven evolutionary computation to automatically optimize prompts for the LLM password guessing framework. Using OpenEvolve, an open-source system combining MAP-Elites quality-diversity search with an island population model we evolve prompts that maximize cracking rate on a RockYou-derived test set. We evaluate three configurations: a local setup with Qwen3 8B, a single compact cloud model Gemini-2.5 Flash, and a two-model ensemble of frontier LLMs. The approach raises the cracking rates from 2.02% to 8.48%. Character distribution analysis further confirms how evolved prompts produce statistically more realistic passwords. Automated prompt evolution is a low-barrier yet effective way to strengthen LLM-based password auditing and underlining how attack pipelines show tendency via automated improvements.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 30 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

11 of 30 references.

References · 11

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  2. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  3. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  4. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  5. 2015Illuminating search spaces by mapping elitescited by 406
  6. 2024Large Language Model Safety: A Holistic Surveycited by 56
  7. 2017PassGAN: A Deep Learning Approach for Password Guessingcited by 25
  8. 2025The Rogue Scalpel: Activation Steering Compromises LLM Safetycited by 18
  9. 2025Emergent Misalignment via In-Context Learning: Narrow in-context examples can produce broadly misaligned LLMscited by 17
  10. 2023SE#PCFG: Semantically Enhanced PCFG for Password Analysis and Crackingcited by 4
  11. 2025Even with AI, Bijection Discovery is Still Hard: The Opportunities and Challenges of OpenEvolve for Novel Bijection Constructioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.