mlsanityData to 14 Oct 2026

Scaling Participation in Modular AI Systems

arXiv 2606.07812 ↗First posted 5 Jun 2026cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Humanity is a mosaic of multifaceted talents and needs, and any truly intelligent AI must reflect that richness. Yet the LLMs used by all are built by the few -- a centralized market of monolithic AI models structurally ill-suited to capture the diversity of human knowledge, reasoning, and values. Here we introduce scaling participation, a new paradigm in which modular, community-sourced AI systems are built from the bottom up through the contributions of diverse stakeholders. Participants contribute small models trained on their own interests and priorities; these models then collaborate in modular frameworks as compositional AI systems, repurposing existing collaboration algorithms for this bottom-up paradigm. Participatory AI systems outperform monolithic LLMs by up to 15.42% (95% CI: [10.09%, 21.13%]) across 15 tasks, such as reasoning and factuality, surpassing models with more parameters than all contributed components combined. Further experiments show that these systems are especially strong at representing diverse cultures, values, and communities, benefit from contributor diversity, substantially improve on each contributor's original priorities, and exhibit emergent capabilities that allow them to solve over 15% of problems where all individual models fail. Scaling participation provides a technical foundation, demonstrated here with academic contributors and benchmark evaluations, for transitioning from the monolithic status quo toward an open, bottom-up, and collaborative AI future.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 108 of its 130 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

108 of 130 references.

References · 108

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  6. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  7. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  8. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  9. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  10. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
  11. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  12. 2016Sequence-Level Knowledge Distillationcited by 801
38 more
  1. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  2. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 748
  3. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  4. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
  5. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
  6. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
  7. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 564
  8. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 384
  9. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  10. 20242 OLMo 2 Furiouscited by 340
  11. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  12. 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 295
  13. 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
  14. 2024Generative Representational Instruction Tuningcited by 233
  15. 2025Learning to Reason without External Rewardscited by 210
  16. 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
  17. 2024Are We Done with MMLU?cited by 194
  18. 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 173
  19. 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 165
  20. 2026Towards End-to-End Automation of AI Researchcited by 159
  21. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 141
  22. 2025Checklists Are Better Than Reward Models For Aligning Language Modelscited by 128
  23. 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaborationcited by 113
  24. 2022Language Model Cascadescited by 107
  25. 2025Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoningcited by 106
  26. 2024The Art of Saying No: Contextual Noncompliance in Language Modelscited by 105
  27. 2025SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learningcited by 100
  28. 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
  29. 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 97
  30. 2025Multiagent Finetuning: Self Improvement with Diverse Reasoning Chainscited by 95
  31. 2024Tuning Language Models by Proxycited by 89
  32. 2022Petals: Collaborative Inference and Fine-tuning of Large Modelscited by 87
  33. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 84
  34. 2025ReasonIR: Training Retrievers for Reasoning Taskscited by 77
  35. 2025Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspectivecited by 76
  36. 2025In-the-Flow Agentic System Optimization for Effective Planning and Tool Usecited by 72
  37. 2025DeepRetrieval: Hacking Real Search Engines and Retrievers with Large Language Models via Reinforcement Learningcited by 66
  38. 2024Protecting Privacy in Multimodal Large Language Models with MLLMU-Benchcited by 64

50 most cited of 108 All 108 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

  1. 2026You're Hired: Strategic Model Selection for LLM Collaborationcited by 0
  2. 2026Multi-LLM Collaborative Alignment via Stackelberg Gamescited by 0