Is Your Neighborhood Safe? Place-based Stigma in Large Language Models' Urban Safety Judgments
Not on the map. Why?
Abstract (arXiv)
Large language models are increasingly used to inform safety decisions in cities, such as where it is safe to walk, rent, or travel. We ask whether such judgments track measured risk or the patterns attached to an urban neighborhood's name. We probe seven instruct-tuned models under three conditions that dissociate name from geography: coordinates-only, name-only, and name+coordinates, across 186 neighborhoods in Los Angeles and Chicago, joined to violent crime and American Community Survey data. First, ratings are nearly flat under coordinates for six of seven models, while names carry most between neighborhood variation and are moderately calibrated to violent crime; only at frontier scale does the coordinate channel show appreciable variation. Second, names lower safety ratings more for neighborhoods with higher shares of the locally dominant marginalized group (percent Black in Chicago, percent Hispanic in Los Angeles), and this name effect tracks demographic share in all seven models and both cities. In Los Angeles, where demographic share and crime are more separable, the effect survives controls for crime and income and is confirmed by crime-matched pairs. An enforcement-elasticity analysis further shows that over-caution tracks near-fully-reported homicide rather than discretionary, deployment-driven offenses. Third, the effect scales with geographic knowledge: models that better distinguish real neighborhoods apply more demographic stereotype to them. Because neighborhood names carry both genuine crime signal and demographic stereotype, removing names reduces both bias and accuracy. We discuss implications for deploying LLMs in advice and decision-support settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 23 Aug 2026.
Builds on
12 of 29 references.
References · 12
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2021Ethical and social risks of harm from Language Modelscited by 966
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
- 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 710
- 2019The Woman Worked as a Babysitter: On Biases in Language Generationcited by 541
- 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
- 2024Large Language Models are Geographically Biasedcited by 93
- 2023Are Large Language Models Geospatially Knowledgeable?cited by 30
- 2025CitySim: Modeling Urban Behaviors and City Dynamics with Large-Scale LLM-Driven Agent Simulationcited by 28
- 2024On the Scaling Laws of Geographical Representation in Language Modelscited by 14
- 2025Large Language Model Powered Intelligent Urban Agents: Concepts, Capabilities, and Applicationscited by 4
Built on by
Not cited yet.