mlsanityData to 14 Oct 2026

COSMMIC: Comment-Sensitive Multimodal Multilingual Indian Corpus for Summarization and Headline Generation

arXiv 2506.15372 ↗First posted 18 Jun 2025cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Despite progress in comment-aware multimodal and multilingual summarization for English and Chinese, research in Indian languages remains limited. This study addresses this gap by introducing COSMMIC, a pioneering comment-sensitive multimodal, multilingual dataset featuring nine major Indian languages. COSMMIC comprises 4,959 article-image pairs and 24,484 reader comments, with ground-truth summaries available in all included languages. Our approach enhances summaries by integrating reader insights and feedback. We explore summarization and headline generation across four configurations: (1) using article text alone, (2) incorporating user comments, (3) utilizing images, and (4) combining text, comments, and images. To assess the dataset's effectiveness, we employ state-of-the-art language models such as LLama3 and GPT-4. We conduct a comprehensive study to evaluate different component combinations, including identifying supportive comments, filtering out noise using a dedicated comment classifier using IndicBERT, and extracting valuable insights from images with a multilingual CLIP-based classifier. This helps determine the most effective configurations for natural language generation (NLG) tasks. Unlike many existing datasets that are either text-only or lack user comments in multimodal settings, COSMMIC uniquely integrates text, images, and user feedback. This holistic approach bridges gaps in Indian language resources, advancing NLP research and fostering inclusivity.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 64 references that are in the map. First posted on arXiv 18 Jun 2025.

Builds on

30 of 64 references.

References · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  7. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 535
  8. 2023Benchmarking Large Language Models for News Summarizationcited by 445
  9. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  10. 2023MEGA: Multilingual Evaluation of Generative AIcited by 293
  11. 2020WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarizationcited by 154
  12. 2020MLSUM: The Multilingual Summarization Corpuscited by 121
18 more
  1. 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
  2. 2023MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Taskscited by 57
  3. 2024IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languagescited by 56
  4. 2023CLIPSyntel: CLIP and LLM Synergy for Multimodal Question Summarization in Healthcarecited by 43
  5. 2022IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languagescited by 42
  6. 2021N24News: A New Dataset for Multimodal News Classificationcited by 40
  7. 2013Polyglot: Distributed Word Representations for Multilingual NLPcited by 19
  8. 2018Abstractive Text Summarization by Incorporating Reader Commentscited by 15
  9. 2022Summary-Oriented Vision Modeling for Multimodal Abstractive Summarizationcited by 14
  10. 2023Large Scale Multi-Lingual Multi-Modal Summarization Datasetcited by 12
  11. 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videoscited by 12
  12. 2023PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in Indiacited by 11
  13. 2024XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tagscited by 9
  14. 2023V=arta: A Large-Scale Headline-Generation Dataset for Indic Languagescited by 8
  15. 2017Reader-Aware Multi-Document Summarization: An Enhanced Model and The First Datasetcited by 6
  16. 2023LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarizationcited by 4
  17. 2024M2DS: Multilingual Dataset for Multi-document Summarisationcited by 3
  18. 2022Grafting Pre-trained Models for Multimodal Headline Generationcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

  1. 2025DRISHTIKON: A Multimodal Multilingual Benchmark for Testing Language Models' Understanding on Indian Culturecited by 13
  2. 2025Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languagescited by 0