mlsanityData to 7 Oct 2026

Urban Region Pre-training and Prompting: A Graph-based Approach

arXiv 2408.05920 ↗First posted 12 Aug 2024cs.AI cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Urban region representation is crucial for various urban downstream tasks. However, despite the proliferation of methods and their success, acquiring general urban region knowledge and adapting to different tasks remains challenging. Existing work pays limited attention to the fine-grained functional layout semantics in urban regions, limiting their ability to capture transferable knowledge across regions. Further, inadequate handling of the unique features and relationships required for different downstream tasks may also hinder effective task adaptation. In this paper, we propose a Graph-based Urban Region Pre-training and Prompting framework (GURPP) for region representation learning. Specifically, we first construct an urban region graph and develop a subgraph-centric urban region pre-training model to capture the heterogeneous and transferable patterns of entity interactions. This model pre-trains knowledge-rich region embeddings using contrastive learning and multi-view learning methods. To further refine these representations, we design two graph-based prompting methods: a manually-defined prompt to incorporate explicit task knowledge and a task-learnable prompt to discover hidden knowledge, which enhances the adaptability of these embeddings to different tasks. Extensive experiments on various urban region prediction tasks and different cities demonstrate the superior performance of our framework.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 40 of its 92 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

40 of 92 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  4. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  5. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  6. 2016Variational Graph Auto-Encoderscited by 1,373
  7. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  8. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
  9. 2015LINE: Large-scale Information Network Embeddingcited by 582
  10. 2020Heterogeneous Graph Transformercited by 581
  11. 2014Deep metric learning using Triplet networkcited by 421
  12. 2023GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networkscited by 166
28 more
  1. 2023All in One: Multi-task Prompting for Graph Neural Networkscited by 147
  2. 2020Graph Meta Learning via Local Subgraphscited by 89
  3. 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 86
  4. 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
  5. 2023UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Webcited by 77
  6. 2023Graph Prompt Learning: A Comprehensive Survey and Beyondcited by 61
  7. 2023Improving Visual Prompt Tuning for Self-supervised Vision Transformerscited by 57
  8. 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
  9. 2022KerGNNs: Interpretable Graph Neural Networks with Graph Kernelscited by 50
  10. 2023HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learningcited by 45
  11. 2024HiGPT: Heterogeneous Graph Language Modelcited by 44
  12. 2023MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphscited by 40
  13. 2023Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphscited by 39
  14. 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environmentcited by 37
  15. 2019Contextualized Spatial-Temporal Network for Taxi Origin-Destination Demand Predictioncited by 34
  16. 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
  17. 2022Multi-Graph Fusion Networks for Urban Region Embeddingcited by 32
  18. 2023HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networkscited by 32
  19. 2022Region Embedding with Intra and Inter-View Contrastive Learningcited by 24
  20. 2023Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Predictioncited by 23
  21. 2024Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Modelscited by 23
  22. 2023City Foundation Models for Learning General Purpose Representations from OpenStreetMapcited by 21
  23. 2023UUKG: Unified Urban Knowledge Graph Dataset for Urban Spatiotemporal Predictioncited by 20
  24. 2023GraphPro: Graph Pre-training and Prompt Learning for Recommendationcited by 17
  25. 2023Urban Region Embedding via Multi-View Contrastive Predictioncited by 13
  26. 2023Urban Region Representation Learning with Attentive Fusioncited by 12
  27. 2024CGAP: Urban Region Representation Learning with Coarsened Graph Attention Poolingcited by 11
  28. 2022Learning Economic Indicators by Aggregating Multi-Level Geospatial Informationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 3.

8 papers.