Society-in-the-Loop: Programming the Algorithmic Social Contract
Not on the map. Why?
Abstract (arXiv)
Recent rapid advances in Artificial Intelligence (AI) and Machine Learning have raised many questions about the regulatory and governance mechanisms for autonomous machines. Many commentators, scholars, and policy-makers now call for ensuring that algorithms governing our lives are transparent, fair, and accountable. Here, I propose a conceptual framework for the regulation of AI and algorithmic systems. I argue that we need tools to program, debug and maintain an algorithmic social contract, a pact between various human stakeholders, mediated by machines. To achieve this, we can adapt the concept of human-in-the-loop (HITL) from the fields of modeling and simulation, and interactive machine learning. In particular, I propose an agenda I call society-in-the-loop (SITL), which combines the HITL control paradigm with mechanisms for negotiating the values of various stakeholders affected by AI systems, and monitoring compliance with the agreement. In short, `SITL = HITL + Social Contract.'
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 8; 2023: 7; 2024: 4; 2025: 5; 2026: 4.
35 papers.
Sort:
By area:
- 2023Auditing large language models: a three-layered approachcited by 135
- 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Modelscited by 115
- 2021Fairness Perceptions of Algorithmic Decision-Making: A Systematic Review of the Empirical Literaturecited by 27
- 2023Building Socio-culturally Inclusive Stereotype Resources with Community Engagementcited by 25
- 2021The MineRL BASALT Competition on Learning from Human Feedbackcited by 24
- 2021Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Makingcited by 23
- 2025A Pragmatic View of AI Personhoodcited by 12
- 2022Putting AI Ethics into Practice: The Hourglass Model of Organizational AI Governancecited by 6
- 2023China and the U.S. produce more impactful AI research when collaborating togethercited by 6
- 2025Human-AI Governance (HAIG): A Trust-Utility Approachcited by 4
- 2022Human-centered mechanism design with Democratic AIcited by 3
- 2022Artificial intelligence in government: Concepts, standards, and a unified frameworkcited by 3
23 more
- 2023The Ethics of AI Value Chainscited by 3
- 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
- 2022HCMD-zero: Learning Value Aligned Mechanisms from Datacited by 2
- 2023Unraveling the Interconnected Axes of Heterogeneity in Machine Learning for Democratic and Inclusive Advancementscited by 2
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Makingcited by 2
- 2025EconGym: A Scalable AI Testbed with Diverse Economic Taskscited by 2
- 2021Artificial Intelligence as an Anti-Corruption Tool (AI-ACT) -- Potentials and Pitfalls for Top-down and Bottom-up Approachescited by 1
- 2021Ethical AI-Powered Regression Test Selectioncited by 1
- 2023A multidomain relational framework to guide institutional AI research and adoptioncited by 1
- 2024Mapping the Potential of Explainable AI for Fairness Along the AI Lifecyclecited by 1
- 2024Challenging the Human-in-the-loop in Algorithmic Decision-makingcited by 1
- 2026Governance by Design: Architecting Agentic AI for Organizational Learning and Scalable Autonomycited by 1
- 2021Descriptive AI Ethics: Collecting and Understanding the Public Opinioncited by 0
- 2021Toward a Rational and Ethical Sociotechnical System of Autonomous Vehicles: A Novel Application of Multi-Criteria Decision Analysiscited by 0
- 2022Contextualizing Artificially Intelligent Morality: A Meta-Ethnography of Top-Down, Bottom-Up, and Hybrid Models for Theoretical and Applied Ethics in Artificial Intelligencecited by 0
- 2022Tackling problems, harvesting benefits -- A systematic review of the regulatory debate around AIcited by 0
- 2022Finding Common Ground for Incoherent Horn Expressionscited by 0
- 2024Exploring Public Opinion on Responsible AI Through The Lens of Cultural Consensus Theorycited by 0
- 2024The Switch, the Ladder, and the Matrix: Models for Classifying AI Systemscited by 0
- 2025Laypeople's Attitudes Towards Fair, Affirmative, and Discriminatory Decision-Making Algorithmscited by 0
- 2026Is Decentralized AI Governable? From Regulative Policy to Constitutive Protocolcited by 0
- 2026The Governance Inversion Hypothesis: Why More AI Regulation May Produce Less Organisational Controlcited by 0
- 2026Second-Order Policy Effects as State Transitions: A Source-Linked Benchmark for Policy Simulationcited by 0
- 2026Second-Order Policy Effects as State Transitions: A Source-Linked Benchmark for Policy Simulation15 Aug 2026
- 2026The Governance Inversion Hypothesis: Why More AI Regulation May Produce Less Organisational Control23 May 2026
- 2026Is Decentralized AI Governable? From Regulative Policy to Constitutive Protocol23 May 2026
- 2026Governance by Design: Architecting Agentic AI for Organizational Learning and Scalable Autonomy17 Apr 2026
- 2025A Pragmatic View of AI Personhood30 Oct 2025
- 2025EconGym: A Scalable AI Testbed with Diverse Economic Tasks13 Jun 2025
- 2025Laypeople's Attitudes Towards Fair, Affirmative, and Discriminatory Decision-Making Algorithms12 May 2025
- 2025Human-AI Governance (HAIG): A Trust-Utility Approach3 May 2025
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Making24 Jan 2025
- 2024The Switch, the Ladder, and the Matrix: Models for Classifying AI Systems7 Jul 2024
- 2024Challenging the Human-in-the-loop in Algorithmic Decision-making17 May 2024
- 2024Mapping the Potential of Explainable AI for Fairness Along the AI Lifecycle29 Apr 2024
23 more
- 2024Exploring Public Opinion on Responsible AI Through The Lens of Cultural Consensus Theory6 Jan 2024
- 2023The Value-Sensitive Conversational Agent Co-Design Framework18 Oct 2023
- 2023The Ethics of AI Value Chains31 Jul 2023
- 2023Building Socio-culturally Inclusive Stereotype Resources with Community Engagement20 Jul 2023
- 2023Unraveling the Interconnected Axes of Heterogeneity in Machine Learning for Democratic and Inclusive Advancements11 Jun 2023
- 2023China and the U.S. produce more impactful AI research when collaborating together21 Apr 2023
- 2023A multidomain relational framework to guide institutional AI research and adoption17 Mar 2023
- 2023Auditing large language models: a three-layered approach16 Feb 2023
- 2022Artificial intelligence in government: Concepts, standards, and a unified framework31 Oct 2022
- 2022Finding Common Ground for Incoherent Horn Expressions14 Sep 2022
- 2022Tackling problems, harvesting benefits -- A systematic review of the regulatory debate around AI7 Sep 2022
- 2022Putting AI Ethics into Practice: The Hourglass Model of Organizational AI Governance1 Jun 2022
- 2022Contextualizing Artificially Intelligent Morality: A Meta-Ethnography of Top-Down, Bottom-Up, and Hybrid Models for Theoretical and Applied Ethics in Artificial Intelligence15 Apr 2022
- 2022HCMD-zero: Learning Value Aligned Mechanisms from Data21 Feb 2022
- 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Models7 Feb 2022
- 2022Human-centered mechanism design with Democratic AI27 Jan 2022
- 2021The MineRL BASALT Competition on Learning from Human Feedback5 Jul 2021
- 2021Ethical AI-Powered Regression Test Selection30 Jun 2021
- 2021Fairness Perceptions of Algorithmic Decision-Making: A Systematic Review of the Empirical Literature22 Mar 2021
- 2021Artificial Intelligence as an Anti-Corruption Tool (AI-ACT) -- Potentials and Pitfalls for Top-down and Bottom-up Approaches23 Feb 2021
- 2021Toward a Rational and Ethical Sociotechnical System of Autonomous Vehicles: A Novel Application of Multi-Criteria Decision Analysis4 Feb 2021
- 2021Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Making1 Feb 2021
- 2021Descriptive AI Ethics: Collecting and Understanding the Public Opinion15 Jan 2021
- 2023Auditing large language models: a three-layered approachcited by 135
- 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Modelscited by 115
- 2021Fairness Perceptions of Algorithmic Decision-Making: A Systematic Review of the Empirical Literaturecited by 27
- 2023Building Socio-culturally Inclusive Stereotype Resources with Community Engagementcited by 25
- 2021The MineRL BASALT Competition on Learning from Human Feedbackcited by 24
- 2021Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Makingcited by 23
- 2022Putting AI Ethics into Practice: The Hourglass Model of Organizational AI Governancecited by 6
- 2023China and the U.S. produce more impactful AI research when collaborating togethercited by 6
- 2025Human-AI Governance (HAIG): A Trust-Utility Approachcited by 4
- 2022Human-centered mechanism design with Democratic AIcited by 3
- 2022Artificial intelligence in government: Concepts, standards, and a unified frameworkcited by 3
- 2023The Ethics of AI Value Chainscited by 3
12 most cited of 32 All 32 (JSON)
- 2026Second-Order Policy Effects as State Transitions: A Source-Linked Benchmark for Policy Simulation15 Aug 2026
- 2026The Governance Inversion Hypothesis: Why More AI Regulation May Produce Less Organisational Control23 May 2026
- 2026Is Decentralized AI Governable? From Regulative Policy to Constitutive Protocol23 May 2026
- 2025EconGym: A Scalable AI Testbed with Diverse Economic Tasks13 Jun 2025
- 2025Laypeople's Attitudes Towards Fair, Affirmative, and Discriminatory Decision-Making Algorithms12 May 2025
- 2025Human-AI Governance (HAIG): A Trust-Utility Approach3 May 2025
- 2025Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Making24 Jan 2025
- 2024The Switch, the Ladder, and the Matrix: Models for Classifying AI Systems7 Jul 2024
- 2024Challenging the Human-in-the-loop in Algorithmic Decision-making17 May 2024
- 2024Mapping the Potential of Explainable AI for Fairness Along the AI Lifecycle29 Apr 2024
- 2024Exploring Public Opinion on Responsible AI Through The Lens of Cultural Consensus Theory6 Jan 2024
- 2023The Ethics of AI Value Chains31 Jul 2023
12 newest of 32 All 32 (JSON)