mlsanityData to 7 Oct 2026

OsmT: Bridging OpenStreetMap Queries and Natural Language with Open-source Tag-aware Language Models

arXiv 2512.04738 ↗First posted 4 Dec 2025cs.CL cs.AI cs.DBcited by 0

Not on the map. Why?

Abstract (arXiv)

Bridging natural language and structured query languages is a long-standing challenge in the database community. While recent advances in language models have shown promise in this direction, existing solutions often rely on large-scale closed-source models that suffer from high inference costs, limited transparency, and lack of adaptability for lightweight deployment. In this paper, we present OsmT, an open-source tag-aware language model specifically designed to bridge natural language and Overpass Query Language (OverpassQL), a structured query language for accessing large-scale OpenStreetMap (OSM) data. To enhance the accuracy and structural validity of generated queries, we introduce a Tag Retrieval Augmentation (TRA) mechanism that incorporates contextually relevant tag knowledge into the generation process. This mechanism is designed to capture the hierarchical and relational dependencies present in the OSM database, addressing the topological complexity inherent in geospatial query formulation. In addition, we define a reverse task, OverpassQL-to-Text, which translates structured queries into natural language explanations to support query interpretation and improve user accessibility. We evaluate OsmT on a public benchmark against strong baselines and observe consistent improvements in both query generation and interpretation. Despite using significantly fewer parameters, our model achieves competitive accuracy, demonstrating the effectiveness of open-source pre-trained language models in bridging natural language and structured query languages within schema-rich geospatial environments.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 60 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

40 of 60 references.

References · 40

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  7. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  8. 2025Qwen3 Technical Reportcited by 8,195
  9. 2017Inductive Representation Learning on Large Graphscited by 6,284
  10. 2024Qwen2.5 Technical Reportcited by 4,713
  11. 2024GPT-4o System Cardcited by 4,467
  12. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
28 more
  1. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  2. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  3. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
  4. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
  5. 2023Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluationcited by 378
  6. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
  7. 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 301
  8. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  9. 2024CodeS: Towards Building Open-source Language Models for Text-to-SQLcited by 183
  10. 2022Translation between Molecules and Natural Languagecited by 173
  11. 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 118
  12. 2023BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associationscited by 100
  13. 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
  14. 2024The Dawn of Natural Language to SQL: Are We Fully Ready?cited by 78
  15. 2023K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilizationcited by 69
  16. 2023GeoLLM: Extracting Geospatial Knowledge from Large Language Modelscited by 62
  17. 2018A Graph-to-Sequence Model for AMR-to-Text Generationcited by 56
  18. 2024BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuningcited by 54
  19. 2024PURPLE: Making a Large Language Model a Better SQL Writercited by 34
  20. 2018Improving a Neural Semantic Parser by Counterfactual Learning from Human Bandit Feedbackcited by 32
  21. 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
  22. 2024Metasql: A Generate-then-Rank Framework for Natural Language to SQL Translationcited by 17
  23. 2024Geolocation Representation from Large Language Models are Generic Enhancers for Spatio-Temporal Learningcited by 15
  24. 2023Text-to-OverpassQL: A Natural Language Interface for Complex Geodata Querying of OpenStreetMapcited by 9
  25. 2023Timestamps as Prompts for Geography-Aware Location Recommendationcited by 6
  26. 2018D2KE: From Distance to Kernel and Embeddingcited by 4
  27. 2024TransFlower: An Explainable Transformer-Based Model with Flow-to-Flow Attention for Commuting Flow Predictioncited by 2
  28. 2024DataVisT5: A Pre-trained Language Model for Jointly Understanding Text and Data Visualizationcited by 2

Built on by

Not cited yet.