StealthRank: LLM Ranking Manipulation via Stealthy Prompt Optimization
Not on the map. Why?
Abstract (arXiv)
The integration of large language models (LLMs) into information retrieval systems introduces new attack surfaces, particularly for adversarial ranking manipulations. We present StealthRank, a novel adversarial attack method that manipulates LLM-driven ranking systems while maintaining textual fluency and stealth. Unlike existing methods that often introduce detectable anomalies, StealthRank employs an energy-based optimization framework combined with Langevin dynamics to generate StealthRank Prompts (SRPs)-adversarial text sequences embedded within item or document descriptions that subtly yet effectively influence LLM ranking mechanisms. We evaluate StealthRank across multiple LLMs, demonstrating its ability to covertly boost the ranking of target items while avoiding explicit manipulation traces. Our results show that StealthRank consistently outperforms state-of-the-art adversarial ranking baselines in both effectiveness and stealth, highlighting critical vulnerabilities in LLM-driven ranking systems. Our code is publicly available at hrefhttps://github.com/Tangyiming205069/controllable-seohere.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 18 of its 60 references that are in the map. First posted on arXiv 8 Apr 2025.
Builds on
18 of 60 references.
References · 18
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2023Detecting Language Model Attacks with Perplexitycited by 431
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 230
- 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMscited by 199
- 2022COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamicscited by 161
- 2024When Search Engine Services meet Large Language Models: Visions and Challengescited by 59
- 2024DrugAgent: Automating AI-aided Drug Discovery Programming through LLM Multi-Agent Collaborationcited by 44
- 2024Adversarial Search Engine Optimization for Large Language Modelscited by 40
- 2023Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experimentcited by 36
6 more
- 2024Ranking Manipulation for Conversational Search Enginescited by 26
- 2024AD-LLM: Benchmarking Large Language Models for Anomaly Detectioncited by 26
- 2024Stealthy Attack on Large Language Model based Recommendationcited by 19
- 2024AutoJailbreak: Exploring Jailbreak Attacks and Defenses through a Dependency Lenscited by 14
- 2024A Large-Scale Simulation on Large Language Models for Decision-Making in Political Sciencecited by 10
- 2025Dynamics of Adversarial Attacks on Large Language Model-Based Search Enginescited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025C-SEO Bench: Does Conversational SEO Work?cited by 11
- 2026Defenses Against Prompt Attacks Learn Surface Heuristicscited by 11
- 2025Are LLMs Reliable Rankers? Rank Manipulation via Two-Stage Token Optimizationcited by 9
- 2026How Much Can We Trust LLM Search Agents? Measuring Endorsement Vulnerability to Web Content Manipulationcited by 6
- 2026Multimodal Generative Engine Optimization: Rank Manipulation for Vision-Language Model Rankerscited by 3
- 2026Controlling Output Rankings in Generative Engines for LLM-based Searchcited by 3
- 2026Diagnosing and Repairing Citation Failures in Generative Engine Optimizationcited by 3
- 2026Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Biascited by 3
- 2026GEO-Bench: Benchmarking Ranking Manipulation in Generative Engine Optimizationcited by 2
- 2026Ranked by Position: Order Sensitivity as an Exploitable Attack Surface in LLM Listwise Recommenderscited by 1
- 2026The Vulnerability of LLM Rankers to Prompt Injection Attackscited by 0
- 2026One Polluted Page Is Enough: Evaluating Web Content Pollution in LLM Recommenderscited by 0
- 2026Ranked by Position: Order Sensitivity as an Exploitable Attack Surface in LLM Listwise Recommenders26 Jul 2026
- 2026Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Bias13 Jul 2026
- 2026How Much Can We Trust LLM Search Agents? Measuring Endorsement Vulnerability to Web Content Manipulation15 Jun 2026
- 2026One Polluted Page Is Enough: Evaluating Web Content Pollution in LLM Recommenders11 Jun 2026
- 2026GEO-Bench: Benchmarking Ranking Manipulation in Generative Engine Optimization27 May 2026
- 2026Diagnosing and Repairing Citation Failures in Generative Engine Optimization10 Mar 2026
- 2026The Vulnerability of LLM Rankers to Prompt Injection Attacks18 Feb 2026
- 2026Controlling Output Rankings in Generative Engines for LLM-based Search3 Feb 2026
- 2026Multimodal Generative Engine Optimization: Rank Manipulation for Vision-Language Model Rankers18 Jan 2026
- 2026Defenses Against Prompt Attacks Learn Surface Heuristics12 Jan 2026
- 2025Are LLMs Reliable Rankers? Rank Manipulation via Two-Stage Token Optimization8 Oct 2025
- 2025C-SEO Bench: Does Conversational SEO Work?6 Jun 2025