mlsanityData to 14 Oct 2026

Extracting Semantics: LLM-Guided Automatic Population of Robot Ontology from URDF

arXiv 2606.17073 ↗First posted 10 Jun 2026cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

While commonsense knowledge may suffice for virtual agents, embodied robots interacting with humans require grounded and semantically rich representations of both their environment and their own physical embodiment. In cognitive robotics, ontologies are effective for integrating such heterogeneous knowledge to enable explainable reasoning, even during continuous knowledge updates. Yet, their manual construction remains a bottleneck. We present a preliminary approach for the automatic generation of robot semantic abstractions by transforming Unified Robot Description Format (URDF) models into populated ontologies. Although URDF files provide structural and kinematic descriptions, their identifiers often require commonsense interpretation to recover meaningful semantics, a task at which Large Language Models (LLMs) excel. Our pipeline leverages LLMs to infer semantic relationships by prompting them with concepts from an existing ontology, ensuring the final classification remains aligned with the formal model. To improve reliability, the pipeline combines majority voting across multiple LLM queries along with syntactic and schema-level validation to ensure that generated outputs conform to the expected representation format and ontology constraints. We evaluate the approach on multiple robot descriptions and discuss the generated abstractions. Initial results indicate that the proposed method can effectively bridge the gap between low-level robot descriptions and the structured, grounded knowledge representations required for human-robot interaction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 18 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

8 of 18 references.

References · 8

  1. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  2. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  3. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  4. 2024From human experts to machines: An LLM supported approach to ontology and knowledge graph constructioncited by 40
  5. 2023Towards Ontology Construction with Language Modelscited by 23
  6. 2024Ontology Population using LLMscited by 4
  7. 2023Exploring Large Language Models as a Source of Common-Sense Knowledge for Robotscited by 2
  8. 2024Combining Ontological Knowledge and Large Language Model for User-Friendly Service Robotscited by 2

Built on by

Not cited yet.