SCI-Defense: Defending Manipulation Attacks from Generative Engine Optimization
Not on the map. Why?
Abstract (arXiv)
LLM-based ranking systems are vulnerable to Generative Engine Optimization (GEO) attacks, where adversaries inject semantic signals into product descriptions to artificially boost rankings. We propose SCI-Defense, a three-component defense framework combining Perplexity detection (PPL), Semantic Integrity Scoring (SIS), and Inter-Candidate Detection (ICD). SIS evaluates four manipulation dimensions: Authority Attribution (AA), Narrative Purposiveness (NP), Comparative Claims (CA), and Temporal Claims (TC). Evaluated on 600 Amazon product descriptions across 6 categories, SCI-Defense achieves Precision=1.000 and FPR=0.000, with Recall of 1.000, 0.952, and 0.830 against String, Reasoning, and Review attacks respectively. On 600 MS MARCO web passages, String attacks are blocked with perfect recall while Review attacks yield near-zero recall, as web passages lack the persuasion-oriented signals that SIS targets in product descriptions. We demonstrate that existing defenses -- PPL-only filters, SafetyClf content classifiers, and paraphrasing -- achieve zero recall against semantic manipulation attacks. We further demonstrate new attacks such as Specification Amplification and Use-Case Saturation can expose semantic relevance manipulation as a structural defense blind spot that suggests directions for future research.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
21 of 26 references.
References · 21
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2023A Watermark for Large Language Modelscited by 667
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
- 2023Detecting Language Model Attacks with Perplexitycited by 411
- 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 356
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 307
- 2023Are aligned neural networks adversarially aligned?cited by 305
- 2023Large Language Models are Effective Text Rankers with Pairwise Ranking Promptingcited by 302
9 more
- 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 153
- 2023RankZephyr: Effective and Robust Zero-Shot Listwise Reranking is a Breeze!cited by 151
- 2025DataSentinel: A Game-Theoretic Detection of Prompt Injection Attackscited by 124
- 2023RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Modelscited by 69
- 2024JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Modelscited by 67
- 2023GEO: Generative Engine Optimizationcited by 53
- 2024Jailbreaking Large Language Models Against Moderation Guardrails via Cipher Characterscited by 39
- 2024Adversarial Search Engine Optimization for Large Language Modelscited by 37
- 2024Ranking Manipulation for Conversational Search Enginescited by 23
Built on by
Citing papers per year: 2026: 3.
3 papers.