mlsanityData to 7 Oct 2026

Document Classification Pattern Recognition via Information Fusion: A Systematic Review of Multimodal and Multiview Representation Approaches

arXiv 2605.23910 ↗First posted 7 Apr 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Information fusion is used widely to improve document classification by the integration of multiple data sources (multimodal) or representations (multiview). However, the field lacks a unified framework, a quantitative synthesis of its effectiveness, and clear guidance for practitioners. This systematic review addresses these gaps by analysing 139 primary studies. It introduces a formal framework to structure the field, presents the results of a qualitative analysis to identify key trends, and performs a random-effects meta-analysis (to our knowledge, the first focused on document classification) to quantify performance gains. Our meta-analysis reveals that multimodal fusion improves accuracy (mean gain of +5.28 percentage points, p=0.0016) significantly -- the F1-score effect is directionally positive but statistically non-significant in our primary model. Multiview fusion provides consistent but modest gains for accuracy (+4.67%), F1-score (+3.08%), and recall (all p<0.05). Critically, our qualitative synthesis uncovers challenges in reproducibility in methodological rigour: only 11.8% (multimodal) and 23.3% (multiview) of the studies use statistical tests to validate their findings, which undermines the reliability of many of their results. This review's primary contributions are a unifying framework, the first quantitative evidence base, and data-driven guidelines. This review concludes that successful information fusion depends not on algorithmic complexity, but on the strategic alignment of the fusion method with the task context and a commitment to more rigorous validation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 133 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

24 of 133 references.

References · 24

  1. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  2. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
  3. 2016A Survey of Multi-View Representation Learningcited by 107
  4. 2020Does my multimodal model learn cross-modal interactions? It's harder to tell than you might think!cited by 61
  5. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  6. 2023Towards Unifying Medical Vision-and-Language Pre-training via Soft Promptscited by 35
  7. 2024Review of multimodal machine learning approaches in healthcarecited by 30
  8. 2015Bridge Correlational Neural Networks for Multilingual Multimodal Representation Learningcited by 18
  9. 2022VLCDoC: Vision-Language Contrastive Pre-Training Model for Cross-Modal Document Classificationcited by 14
  10. 2023UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learningcited by 13
  11. 2021Deep Learning for Technical Document Classificationcited by 11
  12. 2023MetaTroll: Few-shot Detection of State-Sponsored Trolls with Transformer Adapterscited by 7
12 more
  1. 2020Cross-Domain Structure Preserving Projection for Heterogeneous Domain Adaptationcited by 6
  2. 2024Multimodal Metadata Assignment for Cultural Heritage Artifactscited by 5
  3. 2024From Attributes to Natural Language: A Survey and Foresight on Text-based Person Re-identificationcited by 5
  4. 2016A deep learning approach for predicting the quality of online health expert question-answering servicescited by 4
  5. 2019Co-regularized Multi-view Sparse Reconstruction Embedding for Dimension Reductioncited by 3
  6. 2021A Comparative Study of Speaker Role Identification in Air Traffic Communication Using Deep Learning Approachescited by 3
  7. 2021Multi-View Active Learning for Short Text Classification in User-Generated Datacited by 3
  8. 2022Sequence-aware multimodal page classification of Brazilian legal documentscited by 3
  9. 2023A Multi-Modal Multilingual Benchmark for Document Image Classificationcited by 3
  10. 2021On-Device Document Classification using multimodal featurescited by 2
  11. 2023Multimodal Side-Tuning for Document Classificationcited by 2
  12. 2023Multimodal Classification of Teaching Activities from University Lecture Recordingscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.