mlsanityData to 14 Oct 2026

Are Open-Vocabulary Models Ready for Detection of MEP Elements on Construction Sites

arXiv 2501.09267 ↗First posted 16 Jan 2025cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

The construction industry has long explored robotics and computer vision, yet their deployment on construction sites remains very limited. These technologies have the potential to revolutionize traditional workflows by enhancing accuracy, efficiency, and safety in construction management. Ground robots equipped with advanced vision systems could automate tasks such as monitoring mechanical, electrical, and plumbing (MEP) systems. The present research evaluates the applicability of open-vocabulary vision-language models compared to fine-tuned, lightweight, closed-set object detectors for detecting MEP components using a mobile ground robotic platform. A dataset collected with cameras mounted on a ground robot was manually annotated and analyzed to compare model performance. The results demonstrate that, despite the versatility of vision-language models, fine-tuned lightweight models still largely outperform them in specialized environments and for domain-specific tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 16 Jan 2025.

Builds on

9 of 17 references.

References · 9

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  4. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  5. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
  6. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
  7. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
  8. 2024Robotic deployment on construction sites: considerations for safety and productivity impactcited by 2
  9. 2023ConstScene: Dataset and Model for Advancing Robust Semantic Segmentation in Construction Environmentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Autonomous Construction-Site Safety Inspection Using Mobile Robots: A Multilayer VLM-LLM Pipeline ↗
  2. 2026Can Vision-Language Models Understand Construction Workers? An Exploratory Study
  3. 2024Demystifying the Potential of ChatGPT-4 Vision for Construction Progress Monitoring
  4. 2024Evaluating Cascaded Methods of Vision-Language Models for Zero-Shot Detection and Association of Hardhats for Increased Construction Safety
  5. 2026Integration of Object Detection and Small VLMs for Construction Safety Hazard Identification
  6. 2025Using Vision Language Models for Safety Hazard Identification in Construction
  7. 2025Automating construction safety inspections using a multi-modal vision-language RAG framework
  8. 2025Are Large Pre-trained Vision Language Models Effective Construction Safety Inspectors?