# Urban Region Representation Learning with Attentive Fusion

arXiv: https://arxiv.org/abs/2312.04606 · HTML: https://mlsanity.com/paper/2312.04606/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- Builds on 18 of its 41 references that are in the map.
- First posted on arXiv 7 Dec 2023.

## Builds on (most cited first, 18 of 18)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Graph Attention Networks](https://mlsanity.com/paper/1710.10903/) (2017)
- [Efficient Estimation of Word Representations in Vector Space](https://mlsanity.com/paper/1301.3781/) (2013)
- [Heterogeneous Graph Attention Network](https://mlsanity.com/paper/1903.07293/) (2019)
- [Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction](https://mlsanity.com/paper/1610.00081/) (2016)
- [Tile2Vec: Unsupervised representation learning for spatially distributed data](https://mlsanity.com/paper/1805.02855/) (2018)
- [Beyond Self-attention: External Attention using Two Linear Layers for Visual Tasks](https://mlsanity.com/paper/2105.02358/) (2021)
- [A Survey of Multi-View Representation Learning](https://mlsanity.com/paper/1610.01206/) (2016)
- [Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding](https://mlsanity.com/paper/2001.11101/) (2020)
- [Contrastive Trajectory Similarity Learning with Dual-Feature Attention](https://mlsanity.com/paper/2210.05155/) (2022)
- [Spatial-Temporal Hypergraph Self-Supervised Learning for Crime Prediction](https://mlsanity.com/paper/2204.08587/) (2022)
- [Multi-Graph Fusion Networks for Urban Region Embedding](https://mlsanity.com/paper/2201.09760/) (2022)
- [Region Embedding with Intra and Inter-View Contrastive Learning](https://mlsanity.com/paper/2211.08975/) (2022)
- [A Contextual Master-Slave Framework on Urban Region Graph for Urban Village Detection](https://mlsanity.com/paper/2211.14633/) (2022)
- [Learning Neighborhood Representation from Multi-Modal Multi-Graph: Image, Text, Mobility Graph and Beyond](https://mlsanity.com/paper/2105.02489/) (2021)
- [Effective Urban Region Representation Learning Using Heterogeneous Urban Graph Attention Network (HUGAT)](https://mlsanity.com/paper/2202.09021/) (2022)
- [Semi-supervised Learning with Network Embedding on Ambient RF Signals for Geofencing Services](https://mlsanity.com/paper/2210.07889/) (2022)

## Built on by (most cited first, 12 of 12)

- [FlexiReg: Flexible Urban Region Representation Learning](https://mlsanity.com/paper/2503.09128/) (2025)
- [POI-Enhancer: An LLM-based Semantic Enhancement Framework for POI Representation Learning](https://mlsanity.com/paper/2502.10038/) (2025)
- [Self-Supervised Representation Learning for Geospatial Objects: A Survey](https://mlsanity.com/paper/2408.12133/) (2024)
- [Urban Region Pre-training and Prompting: A Graph-based Approach](https://mlsanity.com/paper/2408.05920/) (2024)
- [DualCast: A Model to Disentangle Aperiodic Events from Traffic Series](https://mlsanity.com/paper/2411.18286/) (2024)
- [Generalising Traffic Forecasting to Regions without Traffic Observations](https://mlsanity.com/paper/2508.08947/) (2025)
- [UrbanVerse: Learning Urban Region Representation Across Cities and Tasks](https://mlsanity.com/paper/2602.15750/) (2026)
- [A Modality-Tailored Graph Modeling Framework for Urban Region Representation via Contrastive Learning](https://mlsanity.com/paper/2509.23772/) (2025)
- [ToPT: Task-Oriented Prompt Tuning for Urban Region Representation Learning](https://mlsanity.com/paper/2602.01610/) (2026)
- [MARCUS: Missing-Aware Region Representation with Contextual Urban Signals for Rent Prediction](https://mlsanity.com/paper/2608.18546/) (2026)
- [Synergistic Fusion of Topological Structure and Temporal Semantics of Mobility for Urban Region Embedding](https://mlsanity.com/paper/2609.08268/) (2026)
- [When Correlations Mislead: Confounder-Aware Multi-View Urban Region Representation Learning](https://mlsanity.com/paper/2609.15305/) (2026)

## Abstract (arXiv)

An increasing number of related urban data sources have brought forth novel opportunities for learning urban region representations, i.e., embeddings. The embeddings describe latent features of urban regions and enable discovering similar regions for urban planning applications. Existing methods learn an embedding for a region using every different type of region feature data, and subsequently fuse all learned embeddings of a region to generate a unified region embedding. However, these studies often overlook the significance of the fusion process. The typical fusion methods rely on simple aggregation, such as summation and concatenation, thereby disregarding correlations within the fused region embeddings. To address this limitation, we propose a novel model named HAFusion. Our model is powered by a dual-feature attentive fusion module named DAFusion, which fuses embeddings from different region features to learn higher-order correlations between the regions as well as between the different types of region features. DAFusion is generic - it can be integrated into existing models to enhance their fusion process. Further, motivated by the effective fusion capability of an attentive module, we propose a hybrid attentive feature learning module named HALearning to enhance the embedding learning from each individual type of region features. Extensive experiments on three real-world datasets demonstrate that our model HAFusion outperforms state-of-the-art methods across three different prediction tasks. Using our learned region embedding leads to consistent and up to 31% improvements in the prediction accuracy.
