# Variational Fusion for Multimodal Sentiment Analysis

arXiv: https://arxiv.org/abs/1908.06008 · HTML: https://mlsanity.com/paper/1908.06008/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Aug 2019.

## Built on by (most cited first, 2 of 2)

- [Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments](https://mlsanity.com/paper/2211.03587/) (2022)
- [psifx -- Psychological and Social Interactions Feature Extraction Package](https://mlsanity.com/paper/2407.10266/) (2024)

## Abstract (arXiv)

Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others. Most of the recent work on multimodal fusion does not guarantee the fidelity of the multimodal representation with respect to the unimodal representations. In this paper, we propose a variational autoencoder-based approach for modality fusion that minimizes information loss between unimodal and multimodal representations. We empirically show that this method outperforms the state-of-the-art methods by a significant margin on several popular datasets.
