# Using Deep Learning and Google Street View to Estimate the Demographic Makeup of the US

arXiv: https://arxiv.org/abs/1702.06683 · HTML: https://mlsanity.com/paper/1702.06683/

## Key facts

- Cited by 66 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Feb 2017.

## Built on by (most cited first, 30 of 66)

- [PIGEON: Predicting Image Geolocations](https://mlsanity.com/paper/2307.05845/) (2023)
- [SustainBench: Benchmarks for Monitoring the Sustainable Development Goals with Machine Learning](https://mlsanity.com/paper/2111.04724/) (2021)
- [Incidents1M: a large-scale dataset of images with natural disasters, damage, and incidents](https://mlsanity.com/paper/2201.04236/) (2022)
- [Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Prediction](https://mlsanity.com/paper/2302.13094/) (2023)
- [Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models](https://mlsanity.com/paper/2402.01749/) (2024)
- [Explainable GeoAI: Can saliency maps help interpret artificial intelligence's learning process? An empirical study on natural feature detection](https://mlsanity.com/paper/2303.09660/) (2023)
- [AI Sees Your Location, But With A Bias Toward The Wealthy World](https://mlsanity.com/paper/2502.11163/) (2025)
- [Bridging the Digital Divide: Performance Variation across Socio-Economic Factors in Vision-Language Models](https://mlsanity.com/paper/2311.05746/) (2023)
- [Learning Neighborhood Representation from Multi-Modal Multi-Graph: Image, Text, Mobility Graph and Beyond](https://mlsanity.com/paper/2105.02489/) (2021)
- [Quantifying Spatial Homogeneity of Urban Road Networks via Graph Neural Networks](https://mlsanity.com/paper/2101.00307/) (2021)
- [Classification of Urban Morphology with Deep Learning: Application on Urban Vitality](https://mlsanity.com/paper/2105.09908/) (2021)
- [Estimating building energy efficiency from street view imagery, aerial imagery, and land surface temperature data](https://mlsanity.com/paper/2206.02270/) (2022)
- [Deep hybrid model with satellite imagery: how to combine demand modeling and computer vision for behavior analysis?](https://mlsanity.com/paper/2303.04204/) (2023)
- [CityPulse: Fine-Grained Assessment of Urban Change with Street View Time Series](https://mlsanity.com/paper/2401.01107/) (2024)
- [A Gaussian Process Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equations](https://mlsanity.com/paper/2401.03492/) (2024)
- [EMPLACE: Self-Supervised Urban Scene Change Detection](https://mlsanity.com/paper/2503.17716/) (2025)
- [Generative AI for Urban Planning: Synthesizing Satellite Imagery via Diffusion Models](https://mlsanity.com/paper/2505.08833/) (2025)
- [Monitoring crop phenology with street-level imagery using computer vision](https://mlsanity.com/paper/2112.09190/) (2021)
- [Streetscape Analysis with Generative AI (SAGAI): Vision-Language Assessment and Mapping of Urban Scenes](https://mlsanity.com/paper/2504.16538/) (2025)
- [Using Social Media Images for Building Function Classification](https://mlsanity.com/paper/2202.07315/) (2022)
- [Surveilling Surveillance: Estimating the Prevalence of Surveillance Cameras with Street View Data](https://mlsanity.com/paper/2105.01764/) (2021)
- [Zero-shot Building Attribute Extraction from Large-Scale Vision and Language Models](https://mlsanity.com/paper/2312.12479/) (2023)
- [Persona-aware and Explainable Bikeability Assessment: A Vision-Language Model Approach](https://mlsanity.com/paper/2601.03534/) (2026)
- [Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data](https://mlsanity.com/paper/2103.05107/) (2021)
- [Explainable, automated urban interventions to improve pedestrian and vehicle safety](https://mlsanity.com/paper/2110.11672/) (2021)
- [Computer vision-based analysis of buildings and built environments: A systematic review of current approaches](https://mlsanity.com/paper/2208.00881/) (2022)
- [Detecting Neighborhood Gentrification at Scale via Street-level Visual Data](https://mlsanity.com/paper/2301.01842/) (2023)
- [URSimulator: Human-Perception-Driven Prompt Tuning for Enhanced Virtual Urban Renewal via Diffusion Models](https://mlsanity.com/paper/2409.14589/) (2024)
- [RampNet: A Two-Stage Pipeline for Bootstrapping Curb Ramp Detection in Streetscape Images from Open Government Metadata](https://mlsanity.com/paper/2508.09415/) (2025)
- [Do We Really Even Need Data? A Modern Look at Drawing Inference with Predicted Data](https://mlsanity.com/paper/2512.05456/) (2025)

## Abstract (arXiv)

The United States spends more than 1B each year on initiatives such as the American Community Survey (ACS), a labor-intensive door-to-door study that measures statistics relating to race, gender, education, occupation, unemployment, and other demographic factors. Although a comprehensive source of data, the lag between demographic changes and their appearance in the ACS can exceed half a decade. As digital imagery becomes ubiquitous and machine vision techniques improve, automated data analysis may provide a cheaper and faster alternative. Here, we present a method that determines socioeconomic trends from 50 million images of street scenes, gathered in 200 American cities by Google Street View cars. Using deep learning-based computer vision techniques, we determined the make, model, and year of all motor vehicles encountered in particular neighborhoods. Data from this census of motor vehicles, which enumerated 22M automobiles in total (8% of all automobiles in the US), was used to accurately estimate income, race, education, and voting patterns, with single-precinct resolution. (The average US precinct contains approximately 1000 people.) The resulting associations are surprisingly simple and powerful. For instance, if the number of sedans encountered during a 15-minute drive through a city is higher than the number of pickup trucks, the city is likely to vote for a Democrat during the next Presidential election (88% chance); otherwise, it is likely to vote Republican (82%). Our results suggest that automated systems for monitoring demographic trends may effectively complement labor-intensive approaches, with the potential to detect trends with fine spatial resolution, in close to real time.