Machines in the Crowd? Measuring the Footprint of Machine-Generated Text on Reddit
Not on the map. Why?
Abstract (arXiv)
Generative Artificial Intelligence is reshaping online communication by enabling large-scale production of Machine-Generated Text (MGT) at low cost. While its presence is rapidly growing across the Web, little is known about how MGT integrates into social media environments. In this paper, we present the first large-scale characterization of MGT on Reddit. Using a state-of-the-art statistical method for detection of MGT, we analyze over two years of activity (2022-2024) across 51 subreddits representative of Reddit's main community types such as information seeking, social support, and discussion. We study the concentration of MGT across communities and over time, and compared MGT to human-authored text in terms of social signals it expresses and engagement it receives. Our very conservative estimate of MGT prevalence indicates that synthetic text is marginally present on Reddit, but it can reach peaks of up to 9% in some communities in some months. MGT is unevenly distributed across communities, more prevalent in subreddits focused on technical knowledge and social support, and often concentrated in the activity of a small fraction of users. MGT also conveys distinct social signals of warmth and status giving typical of language of AI assistants. Despite these stylistic differences, MGT achieves engagement levels comparable than human-authored content and in a few cases even higher, suggesting that AI-generated text is becoming an organic component of online social discourse. This work offers the first perspective on the MGT footprint on Reddit, paving the way for new investigations involving platform governance, detection strategies, and community dynamics.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
30 of 48 references.
References · 30
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
- 2020The Pushshift Reddit Datasetcited by 292
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
- 2024Emergent social conventions and collective bias in LLM populationscited by 123
- 2023MGTBench: Benchmarking Machine-Generated Text Detectioncited by 93
- 2020Artificial Intelligence in the Creative Industries: A Reviewcited by 61
18 more
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 60
- 2023Stylometric Detection of AI-Generated Text in Twitter Timelinescited by 59
- 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 53
- 2023The Persuasive Power of Large Language Modelscited by 47
- 2023Machine-Made Media: Monitoring the Mobilization of Machine-Generated Articles on Misinformation and Mainstream News Websitescited by 38
- 2024Are We in the AI-Generated Text World Already? Quantifying and Monitoring AIGT on Social Mediacited by 35
- 2025How malicious AI swarms can threaten democracy: The fusion of agentic AI and LLMs marks a new frontier in information warfarecited by 20
- 2020Ten Social Dimensions of Conversations and Relationshipscited by 18
- 2021What Makes Online Communities 'Better'? Measuring Values, Consensus, and Conflict across Thousands of Subredditscited by 13
- 2022The language of opinion change on social media under the lens of communicative actioncited by 12
- 2023Advancing the Search Frontier with AI Agentscited by 12
- 2024Is Contrasting All You Need? Contrastive Learning for the Detection and Attribution of AI-generated Textcited by 11
- 2025OpenTuringBench: An Open-Model-based Benchmark and Framework for Machine-Generated Text Detection and Attributioncited by 9
- 2024Examining the Prevalence and Dynamics of AI-Generated Media in Art Subredditscited by 8
- 2024Exposing Cross-Platform Coordinated Inauthentic Activity in the Run-Up to the 2024 U.S. Electioncited by 7
- 2024AI Rules? Characterizing Reddit Community Policies Towards AI-Generated Contentcited by 5
- 2019Coloring in the Links: Capturing Social Ties as They are Perceivedcited by 2
- 2024Causal Modeling of Climate Activism on Redditcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?cited by 3
- 2026How AI Writing Assistance Distorts Perceptions of AI Users and Their Opinionscited by 1
- 2026Luminol-AIDetect: Fast Zero-shot Machine-Generated Text Detection based on Perplexity under Text Shufflingcited by 1
- 2026DeGenTWeb: A First Look at LLM-dominant Websitescited by 1
- 2026DeGenTWeb: A First Look at LLM-dominant Websites30 Apr 2026
- 2026Luminol-AIDetect: Fast Zero-shot Machine-Generated Text Detection based on Perplexity under Text Shuffling28 Apr 2026
- 2026How AI Writing Assistance Distorts Perceptions of AI Users and Their Opinions24 Apr 2026
- 2025On the Detectability of LLM-Generated Text: What Exactly Is LLM-Generated Text?23 Oct 2025