N24News: A New Dataset for Multimodal News Classification
Not on the map. Why?
Abstract (arXiv)
Current news datasets merely focus on text features on the news and rarely leverage the feature of images, excluding numerous essential features for news classification. In this paper, we propose a new dataset, N24News, which is generated from New York Times with 24 categories and contains both text and image information in each news. We use a multitask multimodal method and the experimental results show multimodal news classification performs better than text-only news classification. Depending on the length of the text, the classification accuracy can be increased by up to 8.11%. Our research reveals the relationship between the performance of a multimodal classifier and its sub-classifiers, and also the possible improvements when applying multimodal in news classification. N24News is shown to have great potential to prompt the multimodal news studies.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 30 Aug 2021.
Builds on
19 of 36 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2018How2: A Large-scale Dataset for Multimodal Language Understandingcited by 137
- 2019Multimodal Intelligence: Representation Learning, Information Fusion, and Applicationscited by 89
- 2018CentralNet: a Multilayer Approach for Multimodal Fusioncited by 86
7 more
- 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
- 2017End-to-End Multimodal Emotion Recognition using Deep Neural Networkscited by 69
- 2015Where To Look: Focus Regions for Visual Question Answeringcited by 64
- 2019r/Fakeddit: A New Multimodal Benchmark Dataset for Fine-grained Fake News Detectioncited by 53
- 2019Fact-Checking Meets Fauxtography: Verifying Claims About Imagescited by 52
- 2019Read, Attend and Comment: A Deep Architecture for Automatic News Comment Generationcited by 12
- 2019Neural Language Modeling with Visual Featurescited by 9
Built on by
Citing papers per year: 2022: 1; 2023: 9; 2024: 13; 2025: 6; 2026: 11.
40 papers.
Sort:
By area:
- 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Taskscited by 222
- 2023Latent Space Translation via Semantic Alignmentcited by 46
- 2023MasakhaNEWS: News Topic Classification for African languagescited by 30
- 2025Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrievalcited by 26
- 2023From Bricks to Bridges: Product of Invariances to Enhance Latent Space Communicationcited by 20
- 2023Threshold KNN-Shapley: A Linear-Time and Privacy-Friendly Approach to Data Valuationcited by 19
- 2024Efficient Data Shapley for Weighted Nearest Neighbor Algorithmscited by 18
- 2024NLP-ADBench: NLP Anomaly Detection Benchmarkcited by 17
- 2024Beyond Binary: Towards Fine-Grained LLM-Generated Text Detection via Role Recognition and Involvement Measurementcited by 16
- 2022Multi-modal Misinformation Detection: Approaches, Challenges and Opportunitiescited by 14
- 2023Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognitioncited by 14
- 2023UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learningcited by 13
28 more
- 2024Multi-expert Prompting Improves Reliability, Safety, and Usefulness of Large Language Modelscited by 13
- 2024Latent Space Translation via Inverse Relative Projectioncited by 10
- 2025The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contextscited by 8
- 2024Multimodal Generalized Category Discoverycited by 7
- 2025FreeRet: MLLMs as Training-Free Retrieverscited by 7
- 2024The Adversarial AI-Art: Understanding, Generation, Detection, and Benchmarkingcited by 4
- 2024Intrinsic Dimension Correlation: uncovering nonlinear connections in multimodal representationscited by 4
- 2024Fake News Detection: It's All in the Data!cited by 4
- 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representationscited by 3
- 2026Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMscited by 3
- 2024Harnessing Shared Relations via Multimodal Mixup Contrastive Learning for Multimodal Classificationcited by 2
- 2025COSMMIC: Comment-Sensitive Multimodal Multilingual Indian Corpus for Summarization and Headline Generationcited by 2
- 2023KhabarChin: Automatic Detection of Important News in the Persian Languagecited by 1
- 2024EntityCLIP: Entity-Centric Image-Text Matching via Multimodal Attentive Contrastive Learningcited by 1
- 2026Analyzing Diffusion and Autoregressive Vision Language Models in Multimodal Embedding Spacecited by 1
- 2026Reconstructing Content with Collaborative Attention for Universal Multimodal Representation Learningcited by 1
- 2026MultiPress: A Multi-Agent Framework for Interpretable Multimodal News Classificationcited by 1
- 2023QR-CLIP: Introducing Explicit Open-World Knowledge for Location and Time Reasoningcited by 0
- 2023Early Classifying Multimodal Sequencescited by 0
- 2024Knowledge Bases in Support of Large Language Models for Processing Web Newscited by 0
- 2025Visual Semantic Description Generation with MLLMs for Image-Text Matchingcited by 0
- 2025Modeling Human Responses to Multimodal AI Contentcited by 0
- 2026Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actionscited by 0
- 2026Enhancing Foundation VLM Robustness to Missing Modality: Scalable Diffusion for Bi-directional Feature Restorationcited by 0
- 2026Towards Faithful Multimodal Concept Bottleneck Modelscited by 0
- 2026Iterative Definition Refinement for Zero-Shot Classification via LLM-Based Semantic Prototype Optimizationcited by 0
- 2026From matrix inversion to constraints: provably tighter confidence regions for importance weights in label shiftcited by 0
- 2026Lens: Bringing the Right Semantic Perspective into Focus for Training-Free Multimodal Representation Learningcited by 0
- 2026From matrix inversion to constraints: provably tighter confidence regions for importance weights in label shift13 Sep 2026
- 2026Lens: Bringing the Right Semantic Perspective into Focus for Training-Free Multimodal Representation Learning28 Jul 2026
- 2026Iterative Definition Refinement for Zero-Shot Classification via LLM-Based Semantic Prototype Optimization30 Apr 2026
- 2026MultiPress: A Multi-Agent Framework for Interpretable Multimodal News Classification4 Apr 2026
- 2026Towards Faithful Multimodal Concept Bottleneck Models13 Mar 2026
- 2026Reconstructing Content with Collaborative Attention for Universal Multimodal Representation Learning2 Mar 2026
- 2026Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMs5 Feb 2026
- 2026Enhancing Foundation VLM Robustness to Missing Modality: Scalable Diffusion for Bi-directional Feature Restoration3 Feb 2026
- 2026Beyond a Single Perspective: Text Anomaly Detection with Multi-View Language Representations25 Jan 2026
- 2026Analyzing Diffusion and Autoregressive Vision Language Models in Multimodal Embedding Space19 Jan 2026
- 2026Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actions12 Jan 2026
- 2025FreeRet: MLLMs as Training-Free Retrievers29 Sep 2025
28 more
- 2025Modeling Human Responses to Multimodal AI Content14 Aug 2025
- 2025Visual Semantic Description Generation with MLLMs for Image-Text Matching11 Jul 2025
- 2025COSMMIC: Comment-Sensitive Multimodal Multilingual Indian Corpus for Summarization and Headline Generation18 Jun 2025
- 2025Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval26 May 2025
- 2025The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contexts23 May 2025
- 2024NLP-ADBench: NLP Anomaly Detection Benchmark6 Dec 2024
- 2024Knowledge Bases in Support of Large Language Models for Processing Web News13 Nov 2024
- 2024Multi-expert Prompting Improves Reliability, Safety, and Usefulness of Large Language Models1 Nov 2024
- 2024EntityCLIP: Entity-Centric Image-Text Matching via Multimodal Attentive Contrastive Learning23 Oct 2024
- 2024Beyond Binary: Towards Fine-Grained LLM-Generated Text Detection via Role Recognition and Involvement Measurement18 Oct 2024
- 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks7 Oct 2024
- 2024Harnessing Shared Relations via Multimodal Mixup Contrastive Learning for Multimodal Classification26 Sep 2024
- 2024Multimodal Generalized Category Discovery18 Sep 2024
- 2024Fake News Detection: It's All in the Data!2 Jul 2024
- 2024Intrinsic Dimension Correlation: uncovering nonlinear connections in multimodal representations22 Jun 2024
- 2024Latent Space Translation via Inverse Relative Projection21 Jun 2024
- 2024The Adversarial AI-Art: Understanding, Generation, Detection, and Benchmarking22 Apr 2024
- 2024Efficient Data Shapley for Weighted Nearest Neighbor Algorithms20 Jan 2024
- 2023KhabarChin: Automatic Detection of Important News in the Persian Language6 Dec 2023
- 2023Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition18 Nov 2023
- 2023Latent Space Translation via Semantic Alignment1 Nov 2023
- 2023From Bricks to Bridges: Product of Invariances to Enhance Latent Space Communication2 Oct 2023
- 2023Threshold KNN-Shapley: A Linear-Time and Privacy-Friendly Approach to Data Valuation30 Aug 2023
- 2023UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning16 May 2023
- 2023Early Classifying Multimodal Sequences2 May 2023
- 2023MasakhaNEWS: News Topic Classification for African languages19 Apr 2023
- 2023QR-CLIP: Introducing Explicit Open-World Knowledge for Location and Time Reasoning2 Feb 2023
- 2022Multi-modal Misinformation Detection: Approaches, Challenges and Opportunities25 Mar 2022
- 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Taskscited by 222
- 2025FreeRet: MLLMs as Training-Free Retrieverscited by 7
- 2026Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMscited by 3
- 2026Analyzing Diffusion and Autoregressive Vision Language Models in Multimodal Embedding Spacecited by 1
- 2026Reconstructing Content with Collaborative Attention for Universal Multimodal Representation Learningcited by 1
- 2026Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actionscited by 0
- 2026Enhancing Foundation VLM Robustness to Missing Modality: Scalable Diffusion for Bi-directional Feature Restorationcited by 0
- 2026Reconstructing Content with Collaborative Attention for Universal Multimodal Representation Learning2 Mar 2026
- 2026Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMs5 Feb 2026
- 2026Enhancing Foundation VLM Robustness to Missing Modality: Scalable Diffusion for Bi-directional Feature Restoration3 Feb 2026
- 2026Analyzing Diffusion and Autoregressive Vision Language Models in Multimodal Embedding Space19 Jan 2026
- 2026Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actions12 Jan 2026
- 2025FreeRet: MLLMs as Training-Free Retrievers29 Sep 2025
- 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks7 Oct 2024
- 2025Modeling Human Responses to Multimodal AI Contentcited by 0
- 2025Modeling Human Responses to Multimodal AI Content14 Aug 2025
- 2023Latent Space Translation via Semantic Alignmentcited by 46
- 2023MasakhaNEWS: News Topic Classification for African languagescited by 30
- 2025Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrievalcited by 26
- 2023From Bricks to Bridges: Product of Invariances to Enhance Latent Space Communicationcited by 20
- 2023Threshold KNN-Shapley: A Linear-Time and Privacy-Friendly Approach to Data Valuationcited by 19
- 2024Efficient Data Shapley for Weighted Nearest Neighbor Algorithmscited by 18
- 2024NLP-ADBench: NLP Anomaly Detection Benchmarkcited by 17
- 2024Beyond Binary: Towards Fine-Grained LLM-Generated Text Detection via Role Recognition and Involvement Measurementcited by 16
- 2022Multi-modal Misinformation Detection: Approaches, Challenges and Opportunitiescited by 14
- 2023Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognitioncited by 14
- 2023UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learningcited by 13
- 2024Multi-expert Prompting Improves Reliability, Safety, and Usefulness of Large Language Modelscited by 13
12 most cited of 30 All 30 (JSON)
- 2026From matrix inversion to constraints: provably tighter confidence regions for importance weights in label shift13 Sep 2026
- 2026Lens: Bringing the Right Semantic Perspective into Focus for Training-Free Multimodal Representation Learning28 Jul 2026
- 2026Iterative Definition Refinement for Zero-Shot Classification via LLM-Based Semantic Prototype Optimization30 Apr 2026
- 2026Towards Faithful Multimodal Concept Bottleneck Models13 Mar 2026
- 2025Visual Semantic Description Generation with MLLMs for Image-Text Matching11 Jul 2025
- 2025COSMMIC: Comment-Sensitive Multimodal Multilingual Indian Corpus for Summarization and Headline Generation18 Jun 2025
- 2025Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval26 May 2025
- 2025The Coherence Trap: When MLLM-Crafted Narratives Exploit Manipulated Visual Contexts23 May 2025
- 2024NLP-ADBench: NLP Anomaly Detection Benchmark6 Dec 2024
- 2024Knowledge Bases in Support of Large Language Models for Processing Web News13 Nov 2024
- 2024Multi-expert Prompting Improves Reliability, Safety, and Usefulness of Large Language Models1 Nov 2024
- 2024EntityCLIP: Entity-Centric Image-Text Matching via Multimodal Attentive Contrastive Learning23 Oct 2024
12 newest of 30 All 30 (JSON)