Urban Region Pre-training and Prompting: A Graph-based Approach
Not on the map. Why?
Abstract (arXiv)
Urban region representation is crucial for various urban downstream tasks. However, despite the proliferation of methods and their success, acquiring general urban region knowledge and adapting to different tasks remains challenging. Existing work pays limited attention to the fine-grained functional layout semantics in urban regions, limiting their ability to capture transferable knowledge across regions. Further, inadequate handling of the unique features and relationships required for different downstream tasks may also hinder effective task adaptation. In this paper, we propose a Graph-based Urban Region Pre-training and Prompting framework (GURPP) for region representation learning. Specifically, we first construct an urban region graph and develop a subgraph-centric urban region pre-training model to capture the heterogeneous and transferable patterns of entity interactions. This model pre-trains knowledge-rich region embeddings using contrastive learning and multi-view learning methods. To further refine these representations, we design two graph-based prompting methods: a manually-defined prompt to incorporate explicit task knowledge and a task-learnable prompt to discover hidden knowledge, which enhances the adaptability of these embeddings to different tasks. Extensive experiments on various urban region prediction tasks and different cities demonstrate the superior performance of our framework.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 40 of its 92 references that are in the map. First posted on arXiv 12 Aug 2024.
Builds on
40 of 92 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2016Variational Graph Auto-Encoderscited by 1,373
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
- 2015LINE: Large-scale Information Network Embeddingcited by 582
- 2020Heterogeneous Graph Transformercited by 581
- 2014Deep metric learning using Triplet networkcited by 421
- 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
28 more
- 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 147
- 2020Graph Meta Learning via Local Subgraphscited by 89
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 86
- 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
- 2023UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Webcited by 77
- 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
- 2023Improving Visual Prompt Tuning for Self-supervised Vision Transformerscited by 57
- 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
- 2022KerGNNs: Interpretable Graph Neural Networks with Graph Kernelscited by 50
- 2023HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learningcited by 45
- 2024HiGPT: Heterogeneous Graph Language Modelcited by 44
- 2023MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphscited by 40
- 2023Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphscited by 39
- 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environmentcited by 37
- 2019Contextualized Spatial-Temporal Network for Taxi Origin-Destination Demand Predictioncited by 34
- 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
- 2022Multi-Graph Fusion Networks for Urban Region Embeddingcited by 32
- 2023HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networkscited by 32
- 2022Region Embedding with Intra and Inter-View Contrastive Learningcited by 24
- 2023Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Predictioncited by 23
- 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
- 2023City Foundation Models for Learning General Purpose Representations from OpenStreetMapcited by 21
- 2023UUKG: Unified Urban Knowledge Graph Dataset for Urban Spatiotemporal Predictioncited by 20
- 2023GraphPro: Graph Pre-training and Prompt Learning for Recommendationcited by 17
- 2023Urban Region Embedding via Multi-View Contrastive Predictioncited by 13
- 2023Urban Region Representation Learning with Attentive Fusioncited by 12
- 2024CGAP: Urban Region Representation Learning with Coarsened Graph Attention Poolingcited by 11
- 2022Learning Economic Indicators by Aggregating Multi-Level Geospatial Informationcited by 9
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 3.
8 papers.
- 2024Does Graph Prompt Work? A Data Operation Perspective with Theoretical Analysiscited by 10
- 2025Boundary Prompting: Elastic Urban Region Representation via Graph-based Spatial Tokenizationcited by 2
- 2025A Survey of Cross-domain Graph Learning: Progress and Future Directionscited by 2
- 2025Real-time Spatial Retrieval Augmented Generation for Urban Environmentscited by 1
- 2025A Modality-Tailored Graph Modeling Framework for Urban Region Representation via Contrastive Learningcited by 0
- 2026UrbanWell: Benchmarking Multimodal Large Language Models for Spatio-Temporal Urban Wellbeing Analyticscited by 0
- 2026MARCUS: Missing-Aware Region Representation with Contextual Urban Signals for Rent Predictioncited by 0
- 2026Synergistic Fusion of Topological Structure and Temporal Semantics of Mobility for Urban Region Embeddingcited by 0
- 2026Synergistic Fusion of Topological Structure and Temporal Semantics of Mobility for Urban Region Embedding8 Sep 2026
- 2026MARCUS: Missing-Aware Region Representation with Contextual Urban Signals for Rent Prediction19 Aug 2026
- 2026UrbanWell: Benchmarking Multimodal Large Language Models for Spatio-Temporal Urban Wellbeing Analytics14 Jun 2026
- 2025A Modality-Tailored Graph Modeling Framework for Urban Region Representation via Contrastive Learning28 Sep 2025
- 2025Real-time Spatial Retrieval Augmented Generation for Urban Environments4 May 2025
- 2025A Survey of Cross-domain Graph Learning: Progress and Future Directions14 Mar 2025
- 2025Boundary Prompting: Elastic Urban Region Representation via Graph-based Spatial Tokenization11 Mar 2025
- 2024Does Graph Prompt Work? A Data Operation Perspective with Theoretical Analysis2 Oct 2024