LLM-Guided Prompt Evolution for Password Guessing
Not on the map. Why?
Abstract (arXiv)
Passwords still remain a dominant authentication method, yet their security is routinely subverted by predictable user choices and large-scale credential leaks. Automated password guessing is a key tool for stress-testing password policies and modeling attacker behavior. This paper applies LLM-driven evolutionary computation to automatically optimize prompts for the LLM password guessing framework. Using OpenEvolve, an open-source system combining MAP-Elites quality-diversity search with an island population model we evolve prompts that maximize cracking rate on a RockYou-derived test set. We evaluate three configurations: a local setup with Qwen3 8B, a single compact cloud model Gemini-2.5 Flash, and a two-model ensemble of frontier LLMs. The approach raises the cracking rates from 2.02% to 8.48%. Character distribution analysis further confirms how evolved prompts produce statistically more realistic passwords. Automated prompt evolution is a low-barrier yet effective way to strengthen LLM-based password auditing and underlining how attack pipelines show tendency via automated improvements.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 30 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
11 of 30 references.
References · 11
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2015Illuminating search spaces by mapping elitescited by 406
- 2024Large Language Model Safety: A Holistic Surveycited by 56
- 2017PassGAN: A Deep Learning Approach for Password Guessingcited by 25
- 2025The Rogue Scalpel: Activation Steering Compromises LLM Safetycited by 18
- 2025Emergent Misalignment via In-Context Learning: Narrow in-context examples can produce broadly misaligned LLMscited by 17
- 2023SE#PCFG: Semantically Enhanced PCFG for Password Analysis and Crackingcited by 4
- 2025Even with AI, Bijection Discovery is Still Hard: The Opportunities and Challenges of OpenEvolve for Novel Bijection Constructioncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.