Evolving and Detecting Multi-Turn Deception using Geometric Signatures
Not on the map. Why?
Abstract (arXiv)
Safety defenses for large language models (LLMs) are typically trained and evaluated on single-turn prompts, yet real attacks often unfold as indirect, multi-turn probing. To defend against this more nuanced form of deception, we present a unified pipeline that generates realistic multi-turn deceptive question sets via multi-objective genetic prompt optimization with co-evolving mutation operators. We validate this dataset through a human study, which also revealed that early generations yielded the most convincing deception and practical constraints such as adherence filtering and ordering effects. Using this data, we were able to detect deceptive attempts to access prohibited information using simple, explainable geometric signals in embedding space coupled with a lightweight feed-forward classifier. Three geometric features (angular coverage, distance ratio, and linearity) augmented with pairwise similarity statistics led to a compact predictive model that achieved consistently high recall (0.89) across base, reworded, and truncated (three-turn) scenarios, with test-time F1 ranging from 0.74-0.86. The results support a central hypothesis that multi-turn deceptive intent leaves a stable geometric footprint that enables lightweight, transparent screening without expensive end-to-end training. We further discuss responsible uses, limitations, and paths toward larger, more diverse human-evaluated datasets. The primary contribution to artificial intelligence is the multi-objective evolutionary framework for prompt generation, and the engineering application is the deployment of a lightweight geometric detection system for LLM safety infrastructure.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
19 of 29 references.
References · 19
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 240
- 2023Efficient Guided Generation for Large Language Modelscited by 192
- 2025MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMscited by 171
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yetcited by 145
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 96
- 2016Embedding Projector: Interactive Visualization and Interpretation of Embeddingscited by 43
- 2023Generating Faithful Synthetic Data with Large Language Models: A Case Study in Computational Social Sciencecited by 37
7 more
- 2024Jailbreaking and Mitigation of Vulnerabilities in Large Language Modelscited by 33
- 2024Content Moderation by LLM: From Accuracy to Legitimacycited by 30
- 2023TarGEN: Targeted Data Generation with Large Language Modelscited by 17
- 2024Does Safety Training of LLMs Generalize to Semantically Related Natural Prompts?cited by 15
- 2024Towards Safety and Helpfulness Balanced Responses via Controllable Large Language Modelscited by 14
- 2022Exploring Dimensionality Reduction Techniques in Multilingual Transformerscited by 6
- 2023Subjectivity in Unsupervised Machine Learning Model Selectioncited by 2
Built on by
Not cited yet.