Worldwide city transport typology prediction with sentence-BERT based supervised learning via Wikipedia
Not on the map. Why?
Abstract (arXiv)
An overwhelming majority of the world's human population lives in urban areas and cities. Understanding a city's transportation typology is immensely valuable for planners and policy makers whose decisions can potentially impact millions of city residents. Despite the value of understanding a city's typology, labeled data (city and it's typology) is scarce, and spans at most a few hundred cities in the current transportation literature. To break this barrier, we propose a supervised machine learning approach to predict a city's typology given the information in its Wikipedia page. Our method leverages recent breakthroughs in natural language processing, namely sentence-BERT, and shows how the text-based information from Wikipedia can be effectively used as a data source for city typology prediction tasks that can be applied to over 2000 cities worldwide. We propose a novel method for low-dimensional city representation using a city's Wikipedia page, which makes supervised learning of city typology labels tractable even with a few hundred labeled samples. These features are used with labeled city samples to train binary classifiers (logistic regression) for four different city typologies: (i) congestion, (ii) auto-heavy, (iii) transit-heavy, and (iv) bike-friendly cities resulting in reasonably high AUC scores of 0.87, 0.86, 0.61 and 0.94 respectively. Our approach provides sufficient flexibility for incorporating additional variables in the city typology models and can be applied to study other city typologies as well. Our findings can assist a diverse group of stakeholders in transportation and urban planning fields, and opens up new opportunities for using text-based information from Wikipedia (or similar platforms) as data sources in such fields.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 8 of its 79 references that are in the map. First posted on arXiv 29 Mar 2022.
Builds on
8 of 79 references.
References · 8
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2016Bag of Tricks for Efficient Text Classificationcited by 876
- 2014Distributed Representations of Sentences and Documentscited by 678
- 2019Predicting Economic Development using Geolocated Wikipedia Articlescited by 11
- 2014Towards a comparative science of cities: using mobile traffic records in New York, London and Hong Kongcited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 1.
3 papers.
- 2022A deep real options policy for sequential service region design and timingcited by 0
- 2023Enabling CMF Estimation in Data-Constrained Scenarios: A Semantic-Encoding Knowledge Mining Modelcited by 0
- 2024Hierarchical Multi-label Classification for Fine-level Event Extraction from Aviation Accident Reportscited by 0
- 2024Hierarchical Multi-label Classification for Fine-level Event Extraction from Aviation Accident Reports26 Mar 2024
- 2023Enabling CMF Estimation in Data-Constrained Scenarios: A Semantic-Encoding Knowledge Mining Model15 Nov 2023
- 2022A deep real options policy for sequential service region design and timing30 Dec 2022