Operational Evidence Gaps for LLMs in Fraud Detection and Trust-and-Safety Workflows
Not on the map. Why?
Abstract (arXiv)
LLMs are now proposed for fraud detection, scam investigation, content moderation, and other trust-and-safety workflows. Much of the public literature still evaluates them as models, with less attention to their behavior as components in operational pipelines. This creates a practical evidence question: what would justify placing an LLM inside a live workflow with latency, cost, escalation, human-review, and adversarial-risk constraints? We address this question through a fraud-first survey of deployment evidence. We code 49 operationally relevant sources on LLM use in fraud detection, investigation support, content moderation, and cross-cutting robustness (18 fraud, 14 moderation, 17 cross-cutting), supplemented by 15 contextual references that establish the survey boundaries. These sources include systems, benchmarks, frameworks, and deployment-relevant surveys, not 49 production deployments. The main finding is an evidence imbalance. Fraud supplies the largest task-specific portion of the coded corpus. The moderation papers, however, include more explicit public evidence on latency, cost, governance, and fairness. Among the 18 fraud and investigation sources, none report clean per-decision latency, per-decision dollar cost, or calibration evidence; most report offline task performance, retrieval gains, or case-study accuracy instead. The survey contributes a role-and-evidence organizing frame, FORTE, for locating LLMs as classifiers, retrieval interfaces, explanation generators, reviewer assistants, agents, feature extractors, or escalation components. It also contributes a minimum deployment-evidence checklist covering latency budget, cost per decision, decision threshold, explanation integrity, and adversarial pressure. The resulting agenda identifies studies needed to support deployment claims for LLM-based fraud and trust-and-safety work.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 69 references that are in the map. First posted on arXiv 12 Jul 2026.
Builds on
42 of 69 references.
References · 42
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 369
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
- 2024AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Expertscited by 136
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studiescited by 131
- 2024Safeguarding Large Language Models: A Surveycited by 78
- 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safetycited by 67
- 2025Safety in Large Reasoning Models: A Surveycited by 64
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 45
- 2025Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Modelscited by 31
- 2024Content Moderation by LLM: From Accuracy to Legitimacycited by 30
- 2024SLM-Mod: Small Language Models Surpass LLMs at Content Moderationcited by 27
30 more
- 2025From Judgment to Interference: Early Stopping LLM Harmful Outputs via Streaming Content Monitoringcited by 22
- 2025Learning Conformal Abstention Policies for Adaptive Risk Management in Large Language and Vision-Language Modelscited by 21
- 2026How Vulnerable Are AI Agents to Indirect Prompt Injections? Insights from a Large-Scale Public Competitioncited by 17
- 2025Poly-Guard: Massive Multi-Domain Safety Policy-Grounded Guardrail Datasetcited by 14
- 2025DGP: A Dual-Granularity Prompting Framework for Fraud Detection with Graph-Enhanced LLMscited by 12
- 2025Can LLMs Find Fraudsters? Multi-level LLM Enhanced Graph Fraud Detectioncited by 10
- 2025Guardians and Offenders: A Survey on Harmful Content Generation and Safety Mitigation of LLMcited by 9
- 2026AI Agents May Always Fall for Prompt Injectionscited by 9
- 2026FlexGuard: Continuous Risk Scoring for Strictness-Adaptive LLM Content Moderationcited by 7
- 2025EXPLICATE: Enhancing Phishing Detection through Explainable AI and LLM-Powered Interpretabilitycited by 6
- 2026Breaking the Chain: A Causal Analysis of LLM Faithfulness to Intermediate Structurescited by 6
- 2025Co-Investigator AI: The Rise of Agentic AI for Smarter, Trustworthy AML Compliance Narrativescited by 4
- 2025Understanding Structured Financial Data with LLMs: A Case Study on Fraud Detectioncited by 4
- 2026LLM Performance Predictors: Learning When to Escalate in Hybrid Human-AI Moderation Systemscited by 4
- 2026Dialect vs Demographics: Quantifying LLM Bias from Implicit Linguistic Signals vs. Explicit User Profilescited by 4
- 2026UCCI: Calibrated Uncertainty for Cost-Optimal LLM Cascade Routingcited by 4
- 2025Exploring the In-Context Learning Capabilities of LLMs for Money Laundering Detection in Financial Graphscited by 3
- 2025LLM-Enhanced Self-Evolving Reinforcement Learning for Multi-Step E-Commerce Payment Fraud Risk Detectioncited by 3
- 2025Measuring What LLMs Think They Do: SHAP Faithfulness and Deployability on Financial Tabular Classificationcited by 3
- 2025FAA Framework: A Large Language Model-Based Approach for Credit Card Fraud Investigationscited by 2
- 2025Domain Knowledge-Enhanced LLMs for Fraud and Concept Drift Detectioncited by 2
- 2025Longitudinal Monitoring of LLM Content Moderation of Social Issuescited by 2
- 2026When to Invoke: Refining LLM Fairness with Toxicity Assessmentcited by 2
- 2024Application of AI-based Models for Online Fraud Detection and Analysiscited by 1
- 2025Can Large Language Models Automate Phishing Warning Explanations? A Controlled Experiment on Effectiveness and User Perceptioncited by 1
- 2026Reinforcement Learning of Large Language Models for Interpretable Credit Card Fraud Detectioncited by 1
- 2026LLM-Assisted Authentication and Fraud Detectioncited by 1
- 2026Semantic Chameleon: Corpus-Dependent Poisoning Attacks and Defenses in RAG Systemscited by 1
- 2026Redefining AI Red Teaming in the Agentic Era: From Weeks to Hourscited by 1
- 2026Compliance-Scored Best-of-N Guardrail Orchestration for Multimodal Document Generation in Payments Dispute Defensecited by 1
Built on by
Not cited yet.