mlsanityData to 14 Oct 2026

AutoFraudNet: A Multimodal Network to Detect Fraud in the Auto Insurance Industry

arXiv 2301.07526 ↗First posted 15 Jan 2023cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

In the insurance industry detecting fraudulent claims is a critical task with a significant financial impact. A common strategy to identify fraudulent claims is looking for inconsistencies in the supporting evidence. However, this is a laborious and cognitively heavy task for human experts as insurance claims typically come with a plethora of data from different modalities (e.g. images, text and metadata). To overcome this challenge, the research community has focused on multimodal machine learning frameworks that can efficiently reason through multiple data sources. Despite recent advances in multimodal learning, these frameworks still suffer from (i) challenges of joint-training caused by the different characteristics of different modalities and (ii) overfitting tendencies due to high model complexity. In this work, we address these challenges by introducing a multimodal reasoning framework, AutoFraudNet (Automobile Insurance Fraud Detection Network), for detecting fraudulent auto-insurance claims. AutoFraudNet utilizes a cascaded slow fusion framework and state-of-the-art fusion block, BLOCK Tucker, to alleviate the challenges of joint-training. Furthermore, it incorporates a light-weight architectural design along with additional losses to prevent overfitting. Through extensive experiments conducted on a real-world dataset, we demonstrate: (i) the merits of multimodal approaches, when compared to unimodal and bimodal methods, and (ii) the effectiveness of AutoFraudNet in fusing various modalities to boost performance (over 3% in PR AUC).

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 46 references that are in the map. First posted on arXiv 15 Jan 2023.

Builds on

21 of 46 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  6. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  7. 2014Going Deeper with Convolutionscited by 4,241
  8. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
  9. 2021SimVLM: Simple Visual Language Model Pretraining with Weak Supervisioncited by 647
  10. 2013Network In Networkcited by 605
  11. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 505
  12. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 344
9 more
  1. 2021An Empirical Study of Training End-to-End Vision-and-Language Transformerscited by 271
  2. 2019MMTM: Multimodal Transfer Module for CNN Fusioncited by 129
  3. 2017Multi-modal Factorized Bilinear Pooling with Co-Attention Learning for Visual Question Answeringcited by 117
  4. 2021SiT: Self-supervised vIsion Transformercited by 99
  5. 2017Beyond Bilinear: Generalized Multimodal Factorized High-order Pooling for Visual Question Answeringcited by 79
  6. 2019BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detectioncited by 62
  7. 2020On the Benefits of Early Fusion in Multimodal Representation Learningcited by 27
  8. 2018An Anti-fraud System for Car Insurance Claim Based on Visual Evidencecited by 6
  9. 2022GaLeNet: Multimodal Learning for Disaster Prediction, Management and Reliefcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Detecting Financial Fraud with Hybrid Deep Learning: A Mix-of-Experts Approach to Sequential and Anomalous Patterns
  2. 2026Behavior-Grounded Semantic Enrichment for Financial Fraud Modeling and Reasoning
  3. 2025Can Multi-modal (reasoning) LLMs detect document manipulation?
  4. 2026SAGE: An LLM-driven Self Reflective Agentic Framework for Fraud Detection
  5. 2026FraudBench: A Multimodal Benchmark for Detecting AI-Generated Fraudulent Refund Evidence
  6. 2026Toward Auditable Fraud Detection: Combining Graph Features, Model Explanations, and Agentic Case Investigation
  7. 2025Understanding Structured Financial Data with LLMs: A Case Study on Fraud Detection
  8. 2024INS-MMBench: A Comprehensive Benchmark for Evaluating LVLMs' Performance in Insurance