Multimodal and Crossmodal AI for Smart Data Analysis
Not on the map. Why?
Abstract (arXiv)
Recently, the multimodal and crossmodal AI techniques have attracted the attention of communities. The former aims to collect disjointed and heterogeneous data to compensate for complementary information to enhance robust prediction. The latter targets to utilize one modality to predict another modality by discovering the common attention sharing between them. Although both approaches share the same target: generate smart data from collected raw data, the former demands more modalities while the latter aims to decrease the variety of modalities. This paper first discusses the role of multimodal and crossmodal AI in smart data analysis in general. Then, we introduce the multimodal and crossmodal AI framework (MMCRAI) to balance the abovementioned approaches and make it easy to scale into different domains. This framework is integrated into xDataPF (the cross-data platform https://www.xdata.nict.jp/). We also introduce and discuss various applications built on this framework and xDataPF.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 26 references that are in the map. First posted on arXiv 3 Sep 2022.
Builds on
7 of 26 references.
References · 7
- 2017Attention Is All You Needcited by 59,932
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2016A Comprehensive Survey on Cross-modal Retrievalcited by 62
- 2020Survey on Deep Multi-modal Data Analytics: Collaboration, Rivalry and Fusioncited by 53
- 2021Applications of deep learning in traffic congestion detection, prediction and alleviation: A surveycited by 14
- 2020Self-Supervised learning with cross-modal transformers for emotion recognitioncited by 12
- 2020When Machine Learning Meets Congestion Control: A Survey and Comparisoncited by 7
Built on by
Citing papers per year: 2025: 1.
1 paper.