OsmT: Bridging OpenStreetMap Queries and Natural Language with Open-source Tag-aware Language Models
Not on the map. Why?
Abstract (arXiv)
Bridging natural language and structured query languages is a long-standing challenge in the database community. While recent advances in language models have shown promise in this direction, existing solutions often rely on large-scale closed-source models that suffer from high inference costs, limited transparency, and lack of adaptability for lightweight deployment. In this paper, we present OsmT, an open-source tag-aware language model specifically designed to bridge natural language and Overpass Query Language (OverpassQL), a structured query language for accessing large-scale OpenStreetMap (OSM) data. To enhance the accuracy and structural validity of generated queries, we introduce a Tag Retrieval Augmentation (TRA) mechanism that incorporates contextually relevant tag knowledge into the generation process. This mechanism is designed to capture the hierarchical and relational dependencies present in the OSM database, addressing the topological complexity inherent in geospatial query formulation. In addition, we define a reverse task, OverpassQL-to-Text, which translates structured queries into natural language explanations to support query interpretation and improve user accessibility. We evaluate OsmT on a public benchmark against strong baselines and observe consistent improvements in both query generation and interpretation. Despite using significantly fewer parameters, our model achieves competitive accuracy, demonstrating the effectiveness of open-source pre-trained language models in bridging natural language and structured query languages within schema-rich geospatial environments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 60 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
40 of 60 references.
References · 40
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2025Qwen3 Technical Reportcited by 8,195
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024GPT-4o System Cardcited by 4,467
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
28 more
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
- 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
- 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
- 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
- 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 301
- 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
- 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 183
- 2022Translation between Molecules and Natural Languagecited by 173
- 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 118
- 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
- 2024The Dawn of Natural Language to SQL: Are We Fully Ready?cited by 78
- 2023K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilizationcited by 69
- 2023GeoLLM: Extracting Geospatial Knowledge from Large Language Modelscited by 62
- 2018A Graph-to-Sequence Model for AMR-to-Text Generationcited by 56
- 2024BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuningcited by 54
- 2024PURPLE: Making a Large Language Model a Better SQL Writercited by 34
- 2018Improving a Neural Semantic Parser by Counterfactual Learning from Human Bandit Feedbackcited by 32
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2024Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translationcited by 17
- 2024Geolocation Representation from Large Language Models are Generic Enhancers for Spatio-Temporal Learningcited by 15
- 2023Text-to-OverpassQL: A Natural Language Interface for Complex Geodata Querying of OpenStreetMapcited by 9
- 2023Timestamps as Prompts for Geography-Aware Location Recommendationcited by 6
- 2018D2KE: From Distance to Kernel and Embeddingcited by 4
- 2024TransFlower: An Explainable Transformer-Based Model with Flow-to-Flow Attention for Commuting Flow Predictioncited by 2
- 2024DataVisT5: A Pre-trained Language Model for Jointly Understanding Text and Data Visualizationcited by 2
Built on by
Not cited yet.