Participatory provenance as representational auditing for AI-mediated public consultation
Not on the map. Why?
Abstract (arXiv)
AI-assisted consultation can speed large-scale public engagement, but concise summaries may reflect some submissions more closely than others. This paper introduces participatory provenance, a framework for auditing how semantic coverage is distributed from submissions to summary sentences. Applied to two topics in Canada's 2025 AI Strategy consultation (5,253 records; 2,861 participants), official summaries had higher observed mean coverage than exact-length random text, although statistical significance depended on the embedding model. Low coverage concentrated in semantic regions, especially those centered on criticism of educational technology and distrust of technology and oversight, whereas few or no records crossed the operational threshold in several better-covered regions. Same-budget, cross-fitted extractive benchmarks improved mean and lower-tail coverage on held-out submissions, showing that better semantic coverage was feasible without longer summaries. Consultation summaries should be evaluated not only for coherence and factual support, but also for how coverage is distributed across the range of submitted views.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 82 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
27 of 82 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2018Datasheets for Datasetscited by 1,386
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
15 more
- 2018Model Cards for Model Reportingcited by 1,080
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 672
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2017Algorithmic decision making and the cost of fairnesscited by 403
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
- 2017Joint Distribution Optimal Transportation for Domain Adaptationcited by 282
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 265
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 246
- 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 174
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 138
- 2020Participation is not a Design Fix for Machine Learningcited by 111
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 87
- 2023Towards a Responsible AI Metrics Catalogue: A Collection of Metrics for AI Accountabilitycited by 16
Built on by
Not cited yet.