OpenBench: A New Benchmark and Baseline for Semantic Navigation in Smart Logistics
Not on the map. Why?
Abstract (arXiv)
The increasing demand for efficient last-mile delivery in smart logistics underscores the role of autonomous robots in enhancing operational efficiency and reducing costs. Traditional navigation methods, which depend on high-precision maps, are resource-intensive, while learning-based approaches often struggle with generalization in real-world scenarios. To address these challenges, this work proposes the Openstreetmap-enhanced oPen-air sEmantic Navigation (OPEN) system that combines foundation models with classic algorithms for scalable outdoor navigation. The system uses off-the-shelf OpenStreetMap (OSM) for flexible map representation, thereby eliminating the need for extensive pre-mapping efforts. It also employs Large Language Models (LLMs) to comprehend delivery instructions and Vision-Language Models (VLMs) for global localization, map updates, and house number recognition. To compensate the limitations of existing benchmarks that are inadequate for assessing last-mile delivery, this work introduces a new benchmark specifically designed for outdoor navigation in residential areas, reflecting the real-world challenges faced by autonomous delivery systems. Extensive experiments in simulated and real-world environments demonstrate the proposed system's efficacy in enhancing navigation efficiency and reliability. To facilitate further research, our code and benchmark are publicly available.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Feb 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025CostNav: A Navigation Benchmark for Real-World Economic-Cost Evaluation of Physical AI Agentscited by 1
- 2026G-DRAGON: Geospatial Reasoning and Dynamic Planning for Retrieval-Augmented Outdoor Navigationcited by 0
- 2026Event-Adaptive Motion Planning with Distilled Vision-Language Model in Safety-Critical Situationscited by 0
- 2026Physico-Geospatial Grounded Scene Interpretation for Mobile Roboticscited by 0
- 2026Physico-Geospatial Grounded Scene Interpretation for Mobile Robotics6 Sep 2026
- 2026Event-Adaptive Motion Planning with Distilled Vision-Language Model in Safety-Critical Situations24 Jun 2026
- 2026G-DRAGON: Geospatial Reasoning and Dynamic Planning for Retrieval-Augmented Outdoor Navigation25 May 2026
- 2025CostNav: A Navigation Benchmark for Real-World Economic-Cost Evaluation of Physical AI Agents25 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026osmAG-Nav: A Hierarchical Semantic Topometric Navigation Stack for Robust Lifelong Indoor Autonomy ↗
- 2026Spatial and Semantic Reasoning for LLM-Driven Robot Navigation via MCP
- 2025osmAG-LLM: Zero-Shot Open-Vocabulary Object Navigation via Semantic Maps and Large Language Models Reasoning
- 2024CoNVOI: Context-aware Navigation using Vision Language Models in Outdoor and Indoor Environments
- 2025Efficient Navigation in Unknown Indoor Environments with Vision-Language Models
- 2026MapReason-OSM: Can Vision-Language Models Make Graph-Verifiable Mobility Decisions from Street Maps ?
- 2025Can Large Vision Language Models Read Maps Like a Human?
- 2026Leveraging Semantic Maps for City-Scale Cross-View Localization