mlsanityData to 14 Oct 2026

How Children Design and Reason about Trustworthy AI Chatbots

arXiv 2609.25244 ↗First posted 21 Sep 2026cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Children increasingly interact with AI chatbots, making trust calibration essential to AI literacy. Prior research has examined children's trust in AI mainly as users evaluating systems built by others, rather than as designers of their own chatbots. We developed a chatbot-building environment with adjustable trust-relevant traits (e.g., confidence, transparency, formality, assertiveness), rules, and persona. We conducted mixed-methods study with 115 learners (ages 8-18) who made 119 chatbots. We examined how children configured their chatbots, reasoned about trustworthiness, and how closely chatbot behavior aligned with their designs. Younger students (age 10-13) set significantly higher confidence than older students (age 14-18), and some deliberately built chatbots that gave wrong answers on purpose, yet still called them trustworthy, arguing that a chatbot does what it was built to do. Younger students equated trust with purpose-fulfillment, while older students linked it to transparent, calibrated design. Students also calibrated academic chatbots to be more transparent and formal than hobby chatbots. We identify seven design dimensions describing what children believe makes a chatbot trustworthy, and discuss implications for AI literacy tools.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 70 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

8 of 70 references.

References · 8

  1. 2023"Alexa doesn't have that many feelings": Children's understanding of AI through interactions with smart speakers in their homescited by 8
  2. 2020Teaching Tech to Talk: K-12 Conversational Artificial Intelligence Literacy Curriculum and Development Toolscited by 6
  3. 2021"Alexa, Can I Program You?": Student Perceptions of Conversational Artificial Intelligence Before and After Programming Alexacited by 6
  4. 2024Children's Overtrust and Shifting Perspectives of Generative AIcited by 5
  5. 2023Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practicescited by 4
  6. 2022Learning Affects Trust: Design Recommendations and Concepts for Teaching Children -- and Nearly Anyone -- about Conversational Agentscited by 2
  7. 2025Ask Me Anything: Exploring children's attitudes toward an age-tailored AI-powered chatbotcited by 2
  8. 2026Exploring Teacher-Chatbot Interaction and Affect in Block-Based Programmingcited by 1

Built on by

Not cited yet.