Who Gets Heeded? An Obligation-Level Audit of Responsiveness in EPA Rulemaking
Not on the map. Why?
Abstract (arXiv)
Notice-and-comment rulemaking gives any affected party the same formal right to influence federal regulation, but formal access is not substantive capacity to shape rule text. Existing strategies operate at the rule or aggregate-corpus level, too coarse to capture the discrete regulatory obligations where commenters seek change. We introduce obligation-level responsiveness auditing, an auditable, AI-assisted framework for measuring whether public-comment engagement co-occurs with changes to specific regulatory duties. The framework extracts proposed and final-rule obligations, matches comments to the obligations they address, and classifies proposed-final outcomes; each load-bearing component is evaluated against blind human judgment. We apply the framework to 70,075 comments across 36 EPA anchor rulemakings, drawn from a corpus of 786,197 comments across 6,145 dockets from 2010-2022. Three descriptive findings emerge. First, engagement is associated with revision at a modest within-docket magnitude. Second, support-versus-opposition direction does not clearly differentiate outcomes, an informative null inconsistent with simple preference-aggregation. Third, under a permissive reconstruction of commenter type, organizational-majority engagement concentrates in editorial-refinement rather than substantive-modification outcomes at the cross-docket level. A blind human audit of the load-bearing outcome contrast preserves this third finding under corrected labels and reveals that text-similarity methods are insufficient for distinguishing editorial from substantive regulatory change, a measurement-validity lesson we treat as a supporting methodological contribution. Together, these findings locate the equity asymmetry upstream of agency response: in differential capacity across commenter populations to identify, interpret, and contest specific legal obligations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 36 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
7 of 36 references.
References · 7
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 138
- 2023Automated Annotation with Generative AI Requires Validationcited by 76
- 2024From Transparency to Accountability and Back: A Discussion of Access and Evidence in AI Auditingcited by 15
- 2019Argument Identification in Public Comments from eRulemakingcited by 1
- 2026All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs?cited by 1
Built on by
Not cited yet.