# A Deep Learning Approach for Multimodal Deception Detection

arXiv: https://arxiv.org/abs/1803.00344 · HTML: https://mlsanity.com/paper/1803.00344/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Mar 2018.

## Built on by (most cited first, 14 of 14)

- [MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targets](https://mlsanity.com/paper/2109.05184/) (2021)
- [A Survey on Multimodal Disinformation Detection](https://mlsanity.com/paper/2103.12541/) (2021)
- [Combating Online Misinformation Videos: Characterization, Detection, and Future Directions](https://mlsanity.com/paper/2302.03242/) (2023)
- [Audio-Visual Deception Detection: DOLOS Dataset and Parameter-Efficient Crossmodal Learning](https://mlsanity.com/paper/2303.12745/) (2023)
- [Quiver: Supporting GPUs for Low-Latency, High-Throughput GNN Serving with Workload Awareness](https://mlsanity.com/paper/2305.10863/) (2023)
- [MDPE: A Multimodal Deception Dataset with Personality and Emotional Characteristics](https://mlsanity.com/paper/2407.12274/) (2024)
- [Deception detection in text and its relation to the cultural dimension of individualism/collectivism](https://mlsanity.com/paper/2105.12530/) (2021)
- [Hate Speech Classification Using SVM and Naive BAYES](https://mlsanity.com/paper/2204.07057/) (2022)
- [Deception Detection in Videos using the Facial Action Coding System](https://mlsanity.com/paper/2105.13659/) (2021)
- [Can lies be faked? Comparing low-stakes and high-stakes deception video datasets from a Machine Learning perspective](https://mlsanity.com/paper/2211.13035/) (2022)
- [Constructing Robust Emotional State-based Feature with a Novel Voting Scheme for Multi-modal Deception Detection in Videos](https://mlsanity.com/paper/2104.08373/) (2021)
- [Machine Learning-based Lie Detector applied to a Novel Annotated Game Dataset](https://mlsanity.com/paper/2104.12345/) (2021)
- [LoRA-like Calibration for Multimodal Deception Detection using ATSFace Data](https://mlsanity.com/paper/2309.01383/) (2023)
- [Machine Learning Technique Based Fake News Detection](https://mlsanity.com/paper/2309.13069/) (2023)

## Abstract (arXiv)

Automatic deception detection is an important task that has gained momentum in computational linguistics due to its potential applications. In this paper, we propose a simple yet tough to beat multi-modal neural model for deception detection. By combining features from different modalities such as video, audio, and text along with Micro-Expression features, we show that detecting deception in real life videos can be more accurate. Experimental results on a dataset of real-life deception videos show that our model outperforms existing techniques for deception detection with an accuracy of 96.14% and ROC-AUC of 0.9799.