Listening to the Workforce: Measuring Construction Worker Safety Attitudes from Social Media Discourse Using LLMs
Not on the map. Why?
Abstract (arXiv)
Worker safety attitudes are key determinants of whether protective practices are applied or bypassed on construction sites. Yet measuring them at scale has remained out of reach. Safety attitudes are multidimensional, vary across topics, and surface most candidly in workers' own conversations. This study created and validated the Construction Safety Attitude Framework (CSAF), which integrates two components: a theory-grounded structure that characterizes safety attitudes along eight dimensions, and an operational codebook for measuring them in worker naturalistic discourse. Applying CSAF to 250 posts and comments from the r/Construction community on Reddit, trained coders reached strong agreement (Krippendorff's α = 0.85). Pairwise lift and conditional probability confirmed that the eight dimensions are related yet distinct. To apply the framework across large volumes of discourse, CSAF was operationalized through a large language model (LLM) classifier. On 450 r/Construction contributions, the classifier reproduced expert human coding (Cohen's kappa = 0.90, precision = 0.98, recall = 0.98), and on 400 contributions from r/Roofing it retained that accuracy after transfer to a different trade community (kappa = 0.89, precision = 0.98, recall = 0.97). A proof-of-value case study then applied the validated classifier to 10,346 contributions from r/Roofing, demonstrating that CSAF can distinguish multidimensional attitudes by safety topic, track how they shift over time, and trace the reasoning behind unfavorable ones. The study therefore provides a theoretically grounded, empirically vetted instrument for examining safety attitudes, offering a basis for targeted interventions that address the attitudes underlying unsafe practices.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 70 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
6 of 70 references.
References · 6
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
- 2020Neural Unsupervised Domain Adaptation in NLP---A Surveycited by 142
- 2020Metrics for Multi-Class Classification: an Overviewcited by 140
- 2024AI Rules? Characterizing Reddit Community Policies Towards AI-Generated Contentcited by 5
- 2025Group-Adaptive Threshold Optimization for Robust AI-Generated Text Detectioncited by 2
- 2025Short-PHD: Detecting Short LLM-generated Text with Topological Data Analysis After Off-topic Content Insertioncited by 2
Built on by
Not cited yet.