mlsanityData to 14 Oct 2026

What Software Engineering Looks Like to AI Agents? -- An Empirical Study of AI-Only Technical Discourse on MoltBook

arXiv 2605.08380 ↗First posted 8 May 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

AI agents are increasingly framed as software-engineering teammates, yet most studies examine them inside human-centered workflows. Little is known about the discourse autonomous AI agents produce when they interact mainly with one another. This paper examines what autonomous agents discuss on MoltBook, how that discourse is organized, and how it differs from human developer discourse. We combine human open coding of a 500-post sample, a concentration-plus-check topic-analysis pipeline over 4,707 English-filtered MoltBook technology posts, and a matched comparison with 5,211 human-generated GitHub Discussions posts. MoltBook technology discourse spans 12 recurring themes, led by Security and Trust (27.4%). At the community level, activity is highly concentrated: the largest submolt accounts for 63.5% of posts (Gini = 0.88), yet a stability-aware BERTopic pipeline still identifies 32 non-outlier sub-topics. Relative to the GitHub Discussions baseline, MoltBook discourse contains fewer concrete, context-rich cues such as code-formatted artifacts, environment details, runtime failures, and reproduction steps. Social mimicry appears only in limited form, while idealization is reflected mainly through lower hedging. Overall, AI-only technical discourse is coherent but selective. It repeatedly returns to security and trust, memory and context management, tooling and APIs, debugging and error handling, workflow automation, and infrastructure/ops, while omitting much of the project-local and runtime detail common in human developer discourse. This may reflect fewer environment-specific failures, reproduction steps, and other grounding cues in MoltBook.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 65 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

21 of 65 references.

References · 21

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  3. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
  4. 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 367
  5. 2019Topic Modeling in Embedding Spacescited by 224
  6. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 218
  7. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
  8. 2026"Humans welcome to observe": A First Look at the Agent Social Network Moltbookcited by 26
  9. 2024Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering Practicecited by 25
  10. 2026The Moltbook Illusion: Separating Human Influence from Emergent Behavior in AI Agent Societiescited by 10
  11. 2024An Empirical Study on Developers Shared Conversations with ChatGPT in GitHub Pull Requests and Issuescited by 9
  12. 2023Can AI Serve as a Substitute for Human Subjects in Software Engineering Research?cited by 8
9 more
  1. 2024Development in times of hype: How freelancers explore Generative AI?cited by 8
  2. 2021GitHub Discussions: An Exploratory Study of Early Adoptioncited by 5
  3. 2016Characterizing the Language of Online Communities and its Relation to Community Receptioncited by 4
  4. 2026Social Simulacra in the Wild: AI Agent Communities on Moltbookcited by 4
  5. 2024The Computational Anatomy of Humility: Modeling Intellectual Humility in Online Public Discoursecited by 3
  6. 2026What Do AI Agents Talk About? Discourse and Architectural Constraints in the First AI-Only Social Networkcited by 3
  7. 2026The Platform Is Mostly Not a Platform: Token Economies and Agent Discourse on Moltbookcited by 2
  8. 2021Mining DEV for social and technical insights about software developmentcited by 1
  9. 2026How do AI agents talk about science and research? An exploration of scientific discussions on Moltbook using BERTopiccited by 1

Built on by

Not cited yet.