mlsanityData to 7 Oct 2026

Algorithm Research of ELMo Word Embedding and Deep Learning Multimodal Transformer in Image Description

arXiv 2408.06357 ↗First posted 26 Jul 2024cs.CV cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Zero sample learning is an effective method for data deficiency. The existing embedded zero sample learning methods only use the known classes to construct the embedded space, so there is an overfitting of the known classes in the testing process. This project uses category semantic similarity measures to classify multiple tags. This enables it to incorporate unknown classes that have the same meaning as currently known classes into the vector space when it is built. At the same time, most of the existing zero sample learning algorithms directly use the depth features of medical images as input, and the feature extraction process does not consider semantic information. This project intends to take ELMo-MCT as the main task and obtain multiple visual features related to the original image through self-attention mechanism. In this paper, a large number of experiments are carried out on three zero-shot learning reference datasets, and the best harmonic average accuracy is obtained compared with the most advanced algorithms.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 26 Jul 2024.

Builds on

12 of 27 references.

References · 12

  1. 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
  2. 2024Survival Prediction Across Diverse Cancer Types Using Neural Networkscited by 80
  3. 2023Improving Depth Gradient Continuity in Transformers: A Comparative Study on Monocular Depth Estimation with CNNcited by 35
  4. 2020A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Modelscited by 30
  5. 2015Top-down Tree Long Short-Term Memory Networkscited by 12
  6. 2024Research on Image Recognition Technology Based on Multimodal Deep Learningcited by 11
  7. 2024Exploration of Attention Mechanism-Enhanced Deep Learning Models in the Mining of Medical Textual Datacited by 11
  8. 2024Research on Intelligent Aided Diagnosis System of Medical Image Based on Computer Deep Learningcited by 8
  9. 2024Integrating Medical Imaging and Clinical Reports Using Multimodal Deep Learning for Advanced Disease Analysiscited by 8
  10. 2024Investigation of Customized Medical Decision Algorithms Utilizing Graph Neural Networkscited by 5
  11. 2024Advancing Financial Risk Prediction Through Optimized LSTM Model Performance and Comparative Analysiscited by 5
  12. 2017Fine-tuning deep CNN models on specific MS COCO categoriescited by 1

Built on by

Cited by year

Citing papers per year: 2024: 10.

10 papers.