Media Cloud: Massive Open Source Collection of Global News on the Open Web
Not on the map. Why?
Abstract (arXiv)
We present the first full description of Media Cloud, an open source platform based on crawling hyperlink structure in operation for over 10 years, that for many uses will be the best way to collect data for studying the media ecosystem on the open web. We document the key choices behind what data Media Cloud collects and stores, how it processes and organizes these data, and its open API access as well as user-facing tools. We also highlight the strengths and limitations of the Media Cloud collection strategy compared to relevant alternatives. We give an overview two sample datasets generated using Media Cloud and discuss how researchers can use the platform to create their own datasets.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Apr 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 3; 2023: 1; 2024: 7; 2025: 6; 2026: 3.
20 papers.
Sort:
- 2022MN-DS: A Multilabeled News Dataset for News Articles Hierarchical Classificationcited by 8
- 2022NELA-GT-2022: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articlescited by 6
- 2024LLM Teacher-Student Framework for Text Classification With No Manually Annotated Data: A Case Study in IPTC News Topic Classificationcited by 6
- 2025Identifying and Investigating Global News Coverage of Critical Events Such as Disasters and Terrorist Attackscited by 4
- 2026DiscoverLLM: From Executing Intents to Discovering Themcited by 3
- 2022It's the Same Old Story! Enriching Event-Centric Knowledge Graphs by Narrative Aspectscited by 2
- 2024Mapping News Narratives Using LLMs and Narrative-Structured Text Embeddingscited by 2
- 2023From Nuisance to News Sense: Augmenting the News with Cross-Document Evidence and Contextcited by 1
- 2024Lost in Recursion: Mining Rich Event Semantics in Knowledge Graphscited by 1
- 2024NewsHomepages: Homepage Layouts Capture Information Prioritization Decisionscited by 1
- 2025Beyond the Battlefield: Framing Analysis of Media Coverage in Conflict Reportingcited by 1
- 2026Infini-News: Efficiently Queryable Access to 1.3 Billion Processed Common Crawl News Articlescited by 1
8 more
- 2024Artificial Intelligence in Brazilian News: A Mixed-Methods Analysiscited by 0
- 2024Author Unknown: Evaluating Performance of Author Extraction Libraries on Global Online News Articlescited by 0
- 2024Auditing Google's Search Algorithm: Measuring News Diversity Across Brazil, the UK, and the UScited by 0
- 2025Multilingualism, Transnationality, and K-pop in the Online #StopAsianHate Movementcited by 0
- 2025BAR-Analytics: A Web-based Platform for Analyzing Information Spreading Barriers in News: Comparative Analysis Across Multiple Barriers and Eventscited by 0
- 2025SemCAFE: When Named Entities make the Difference Assessing Web Source Reliability through Entity-level Analyticscited by 0
- 2025FRaN-X: FRaming and Narratives-eXplorercited by 0
- 2026From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSMcited by 0
- 2026From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM20 Sep 2026
- 2026Infini-News: Efficiently Queryable Access to 1.3 Billion Processed Common Crawl News Articles18 May 2026
- 2026DiscoverLLM: From Executing Intents to Discovering Them3 Feb 2026
- 2025FRaN-X: FRaming and Narratives-eXplorer9 Jul 2025
- 2025Identifying and Investigating Global News Coverage of Critical Events Such as Disasters and Terrorist Attacks15 Jun 2025
- 2025Beyond the Battlefield: Framing Analysis of Media Coverage in Conflict Reporting12 Jun 2025
- 2025SemCAFE: When Named Entities make the Difference Assessing Web Source Reliability through Entity-level Analytics3 Apr 2025
- 2025BAR-Analytics: A Web-based Platform for Analyzing Information Spreading Barriers in News: Comparative Analysis Across Multiple Barriers and Events31 Mar 2025
- 2025Multilingualism, Transnationality, and K-pop in the Online #StopAsianHate Movement4 Mar 2025
- 2024LLM Teacher-Student Framework for Text Classification With No Manually Annotated Data: A Case Study in IPTC News Topic Classification29 Nov 2024
- 2024NewsHomepages: Homepage Layouts Capture Information Prioritization Decisions21 Nov 2024
- 2024Auditing Google's Search Algorithm: Measuring News Diversity Across Brazil, the UK, and the US31 Oct 2024
8 more
- 2024Artificial Intelligence in Brazilian News: A Mixed-Methods Analysis22 Oct 2024
- 2024Author Unknown: Evaluating Performance of Author Extraction Libraries on Global Online News Articles13 Oct 2024
- 2024Mapping News Narratives Using LLMs and Narrative-Structured Text Embeddings10 Sep 2024
- 2024Lost in Recursion: Mining Rich Event Semantics in Knowledge Graphs25 Apr 2024
- 2023From Nuisance to News Sense: Augmenting the News with Cross-Document Evidence and Context6 Oct 2023
- 2022MN-DS: A Multilabeled News Dataset for News Articles Hierarchical Classification22 Dec 2022
- 2022It's the Same Old Story! Enriching Event-Centric Knowledge Graphs by Narrative Aspects8 May 2022
- 2022NELA-GT-2022: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articles10 Mar 2022
- 2022MN-DS: A Multilabeled News Dataset for News Articles Hierarchical Classificationcited by 8
- 2022NELA-GT-2022: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articlescited by 6
- 2024LLM Teacher-Student Framework for Text Classification With No Manually Annotated Data: A Case Study in IPTC News Topic Classificationcited by 6
- 2025Identifying and Investigating Global News Coverage of Critical Events Such as Disasters and Terrorist Attackscited by 4
- 2026DiscoverLLM: From Executing Intents to Discovering Themcited by 3
- 2022It's the Same Old Story! Enriching Event-Centric Knowledge Graphs by Narrative Aspectscited by 2
- 2024Mapping News Narratives Using LLMs and Narrative-Structured Text Embeddingscited by 2
- 2023From Nuisance to News Sense: Augmenting the News with Cross-Document Evidence and Contextcited by 1
- 2024Lost in Recursion: Mining Rich Event Semantics in Knowledge Graphscited by 1
- 2024NewsHomepages: Homepage Layouts Capture Information Prioritization Decisionscited by 1
- 2025Beyond the Battlefield: Framing Analysis of Media Coverage in Conflict Reportingcited by 1
- 2026Infini-News: Efficiently Queryable Access to 1.3 Billion Processed Common Crawl News Articlescited by 1
12 most cited of 20 All 20 (JSON)
- 2026From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM20 Sep 2026
- 2026Infini-News: Efficiently Queryable Access to 1.3 Billion Processed Common Crawl News Articles18 May 2026
- 2026DiscoverLLM: From Executing Intents to Discovering Them3 Feb 2026
- 2025FRaN-X: FRaming and Narratives-eXplorer9 Jul 2025
- 2025Identifying and Investigating Global News Coverage of Critical Events Such as Disasters and Terrorist Attacks15 Jun 2025
- 2025Beyond the Battlefield: Framing Analysis of Media Coverage in Conflict Reporting12 Jun 2025
- 2025SemCAFE: When Named Entities make the Difference Assessing Web Source Reliability through Entity-level Analytics3 Apr 2025
- 2025BAR-Analytics: A Web-based Platform for Analyzing Information Spreading Barriers in News: Comparative Analysis Across Multiple Barriers and Events31 Mar 2025
- 2025Multilingualism, Transnationality, and K-pop in the Online #StopAsianHate Movement4 Mar 2025
- 2024LLM Teacher-Student Framework for Text Classification With No Manually Annotated Data: A Case Study in IPTC News Topic Classification29 Nov 2024
- 2024NewsHomepages: Homepage Layouts Capture Information Prioritization Decisions21 Nov 2024
- 2024Auditing Google's Search Algorithm: Measuring News Diversity Across Brazil, the UK, and the US31 Oct 2024
12 newest of 20 All 20 (JSON)