mlsanityData to 7 Oct 2026

Enhancing Scientific Figure Captioning Through Cross-modal Learning

arXiv 2406.17047 ↗First posted 24 Jun 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Scientific charts are essential tools for effectively communicating research findings, serving as a vital medium for conveying information and revealing data patterns. With the rapid advancement of science and technology, coupled with the advent of the big data era, the volume and diversity of scientific research data have surged, leading to an increase in the number and variety of charts. This trend presents new challenges for researchers, particularly in efficiently and accurately generating appropriate titles for these charts to better convey their information and results. Automatically generated chart titles can enhance information retrieval systems by providing precise data for detailed chart classification. As research in image captioning and text summarization matures, the automatic generation of scientific chart titles has gained significant attention. By leveraging natural language processing, machine learning, and multimodal techniques, it is possible to automatically extract key information from charts and generate accurate, concise titles that better serve the needs of researchers. This paper presents a novel approach to scientific chart title generation, demonstrating its effectiveness in improving the clarity and accessibility of research data.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 25 references that are in the map. First posted on arXiv 24 Jun 2024.

Builds on

19 of 25 references.

References · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  3. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  4. 2014Show and Tell: A Neural Image Caption Generatorcited by 877
  5. 2016Image Captioning with Semantic Attentioncited by 260
  6. 2017Gated Multimodal Units for Information Fusioncited by 244
  7. 2024Visual In-Context Learning for Large Vision-Language Modelscited by 124
  8. 2016A Survey of Multi-View Representation Learningcited by 107
  9. 2019Trends in Integration of Vision and Language Research: A Survey of Tasks, Datasets, and Methodscited by 55
  10. 2022ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classificationcited by 45
  11. 2021EventBERT: A Pre-Trained Model for Event Correlation Reasoningcited by 40
  12. 2023SciCap+: A Knowledge Augmented Dataset to Study the Challenges of Scientific Figure Captioningcited by 24
7 more
  1. 2024MemoryMamba: Memory-Augmented State Space Model for Defect Recognitioncited by 24
  2. 2019Figure Captioning with Reasoning and Sequence-Level Trainingcited by 21
  3. 2023Summaries as Captions: Generating Figure Captions for Scientific Documents with Automated Text Summarizationcited by 14
  4. 2023A scoping review on multimodal deep learning in biomedical images and textscited by 13
  5. 2023FigCaps-HF: A Figure-to-Caption Generative Framework and Benchmark with Human Feedbackcited by 7
  6. 2023CapText: Large Language Model-based Caption Generation From Image Context and Descriptioncited by 3
  7. 2024The Solution for the ICCV 2023 1st Scientific Figure Captioning Challengecited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.