mlsanityData to 7 Oct 2026

Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders

arXiv 2205.08928 ↗First posted 18 May 2022cs.HC cs.CY cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

Child welfare agencies across the United States are turning to data-driven predictive technologies (commonly called predictive analytics) which use government administrative data to assist workers' decision-making. While some prior work has explored impacted stakeholders' concerns with current uses of data-driven predictive risk models (PRMs), less work has asked stakeholders whether such tools ought to be used in the first place. In this work, we conducted a set of seven design workshops with 35 stakeholders who have been impacted by the child welfare system or who work in it to understand their beliefs and concerns around PRMs, and to engage them in imagining new uses of data and technologies in the child welfare system. We found that participants worried current PRMs perpetuate or exacerbate existing problems in child welfare. Participants suggested new ways to use data and data-driven tools to better support impacted communities and suggested paths to mitigate possible harms of these tools. Participants also suggested low-tech or no-tech alternatives to PRMs to address problems in child welfare. Our study sheds light on how researchers and designers can work in solidarity with impacted communities, possibly to circumvent or oppose child welfare agencies.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 16 of its 146 references that are in the map. First posted on arXiv 18 May 2022.

Builds on

16 of 146 references.

References · 16

  1. 2020Participation is not a Design Fix for Machine Learningcited by 110
  2. 2020A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scorescited by 74
  3. 2019Counterfactual Risk Assessments, Evaluation, and Fairnesscited by 59
  4. 2017A Voting-Based System for Ethical Decision Makingcited by 55
  5. 2019Metric Learning for Individual Fairnesscited by 51
  6. 2021The Flaws of Policies Requiring Human Oversight of Government Algorithmscited by 44
  7. 2022Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Supportcited by 37
  8. 2020Metric-Free Individual Fairness in Online Learningcited by 30
  9. 2021Soliciting Stakeholders' Fairness Notions in Child Maltreatment Predictive Systemscited by 27
  10. 2021Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"cited by 26
  11. 2020A Human-Centered Review of the Algorithms used within the U.S. Child Welfare Systemcited by 23
  12. 2021A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfarecited by 23
4 more
  1. 2019ORES: Lowering Barriers with Participatory Machine Learning in Wikipediacited by 16
  2. 2020Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systemscited by 16
  3. 2020What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Designcited by 14
  4. 2022How to Train a (Bad) Algorithmic Caseworker: A Quantitative Deconstruction of Risk Assessments in Child-Welfarecited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 6; 2025: 4; 2026: 1.

15 papers.

Sort:

By area: