# Is the Sample Good Enough? Comparing Data from Twitter's Streaming API with Twitter's Firehose

arXiv: https://arxiv.org/abs/1306.5204 · HTML: https://mlsanity.com/paper/1306.5204/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Jun 2013.

## Built on by (most cited first, 16 of 16)

- [Location reference recognition from texts: A survey and comparison](https://mlsanity.com/paper/2207.01683/) (2022)
- [Textwash -- automated open-source text anonymisation](https://mlsanity.com/paper/2208.13081/) (2022)
- [On Sampling Collaborative Filtering Datasets](https://mlsanity.com/paper/2201.04768/) (2022)
- [Unraveling Social Perceptions & Behaviors towards Migrants on Twitter](https://mlsanity.com/paper/2112.06642/) (2021)
- [Machine Learning Approaches for Mental Illness Detection on Social Media: A Systematic Review of Biases and Methodological Challenges](https://mlsanity.com/paper/2410.16204/) (2024)
- [Navigating the Post-API Dilemma | Search Engine Results Pages Present a Biased View of Social Media Data](https://mlsanity.com/paper/2401.15479/) (2024)
- [Recommending Training Set Sizes for Classification](https://mlsanity.com/paper/2102.09382/) (2021)
- [The emojification of sentiment on social media: Collection and analysis of a longitudinal Twitter sentiment dataset](https://mlsanity.com/paper/2108.13898/) (2021)
- [Sentiment and structure in word co-occurrence networks on Twitter](https://mlsanity.com/paper/2110.00587/) (2021)
- [An NLP-Assisted Bayesian Time Series Analysis for Prevalence of Twitter Cyberbullying During the COVID-19 Pandemic](https://mlsanity.com/paper/2208.04980/) (2022)
- [Digital Gatekeepers: Google's Role in Curating Hashtags and Subreddits](https://mlsanity.com/paper/2506.14370/) (2025)
- [Regional Differences in Information Privacy Concerns After the Facebook-Cambridge Analytica Data Scandal](https://mlsanity.com/paper/2202.07075/) (2022)
- [Twitter Permeability to financial events: an experiment towards a model for sensing irregularities](https://mlsanity.com/paper/2312.11530/) (2023)
- [Social Media for Mental Health: Data, Methods, and Findings](https://mlsanity.com/paper/2511.07914/) (2025)
- [From Web(logs) to Web(AI): Questions, Platforms, and Methods across Twenty Editions of ICWSM](https://mlsanity.com/paper/2610.00205/) (2026)
- [Is the Platform Part of the Measurement? A Protocol and Simulation Study for Cross-Platform Equivalence of Machine-Labelled Policy Sentiment](https://mlsanity.com/paper/2610.16757/) (2026)

## Abstract (arXiv)

Twitter is a social media giant famous for the exchange of short, 140-character messages called "tweets". In the scientific community, the microblogging site is known for openness in sharing its data. It provides a glance into its millions of users and billions of tweets through a "Streaming API" which provides a sample of all tweets matching some parameters preset by the API user. The API service has been used by many researchers, companies, and governmental institutions that want to extract knowledge in accordance with a diverse array of questions pertaining to social media. The essential drawback of the Twitter API is the lack of documentation concerning what and how much data users get. This leads researchers to question whether the sampled data is a valid representation of the overall activity on Twitter. In this work we embark on answering this question by comparing data collected using Twitter's sampled API service with data collected using the full, albeit costly, Firehose stream that includes every single published tweet. We compare both datasets using common statistical metrics as well as metrics that allow us to compare topics, networks, and locations of tweets. The results of our work will help researchers and practitioners understand the implications of using the Streaming API.