Dialogue to Detection: A Multimodal Hybrid NLP Pipeline for Insurance Fraud Detection
Not on the map. Why?
Abstract (arXiv)
Insurance fraud imposes substantial financial losses and operational inefficiencies, raising premiums and impacting trust among legitimate policyholders. Early detection at FNOL remains a persistent challenge. Existing approaches rely largely on private, text-only datasets, limiting progress on multimodal methods that integrate linguistic, behavioural, and speaker-based indicators. We introduce a synthetic multimodal framework that replicates FNOL conditions. It generates agent-customer dialogue transcripts and two-speaker audios, performs ASR and diarisation. Downstream modules combine NER, regex-based feature extraction, LLM-RAG retrieval, and speaker embeddings in a rule-based risk score to flag narrative reuse, structural inconsistencies, and cross-case voice repetition while balancing sensitivity and false positives. Dataset validation and component-level evaluations show stability and transfer potential, offering a reproducible baseline beyond text-only fraud detection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 47 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
9 of 47 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2021GPT Understands, Toocited by 715
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 174
- 2019Fraud detection in telephone conversations for financial services using linguistic featurescited by 3
- 2023AutoFraudNet: A Multimodal Network to Detect Fraud in the Auto Insurance Industrycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025TeleAntiFraud-28k: An Audio-Text Slow-Thinking Dataset for Telecom Fraud Detection
- 2026SAFE-QAQ: End-to-End Slow-Thinking Audio-Text Fraud Detection via Reinforcement Learning
- 2026Behavior-Grounded Semantic Enrichment for Financial Fraud Modeling and Reasoning
- 2026Incremental Risk Assessment of Progressive Elder Financial Scams via Instruction-Tuned Small Language Models
- 2025Understanding Structured Financial Data with LLMs: A Case Study on Fraud Detection
- 2025Introducing Axlerod: An LLM-based Chatbot for Assisting Independent Insurance Agents
- 2026CLAIR-Fin: An Adversarial Multi-Agent Framework for Claim-Level Verification and Adaptive Debate in Cross-Modal Financial QA
- 2024INS-MMBench: A Comprehensive Benchmark for Evaluating LVLMs' Performance in Insurance