# Visual and Textual Sentiment Analysis Using Deep Fusion Convolutional Neural Networks

arXiv: https://arxiv.org/abs/1711.07798 · HTML: https://mlsanity.com/paper/1711.07798/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Nov 2017.

## Built on by (most cited first, 3 of 3)

- [The Multimodal Sentiment Analysis in Car Reviews (MuSe-CaR) Dataset: Collection, Insights and Improvements](https://mlsanity.com/paper/2101.06053/) (2021)
- [Identifying Illicit Drug Dealers on Instagram with Large-scale Multimodal Data Fusion](https://mlsanity.com/paper/2108.08301/) (2021)
- [A General Framework for Learning Prosodic-Enhanced Representation of Rap Lyrics](https://mlsanity.com/paper/2103.12615/) (2021)

## Abstract (arXiv)

Sentiment analysis is attracting more and more attentions and has become a very hot research topic due to its potential applications in personalized recommendation, opinion mining, etc. Most of the existing methods are based on either textual or visual data and can not achieve satisfactory results, as it is very hard to extract sufficient information from only one single modality data. Inspired by the observation that there exists strong semantic correlation between visual and textual data in social medias, we propose an end-to-end deep fusion convolutional neural network to jointly learn textual and visual sentiment representations from training examples. The two modality information are fused together in a pooling layer and fed into fully-connected layers to predict the sentiment polarity. We evaluate the proposed approach on two widely used data sets. Results show that our method achieves promising result compared with the state-of-the-art methods which clearly demonstrate its competency.