mlsanityData to 7 Oct 2026

Ishigaki-IDS: An Open-Weight Verifier-Aware Model for Information Delivery Specification Drafting in Building Information Modeling

arXiv 2606.08545 ↗First posted 7 Jun 2026cs.CL cs.SEcited by 0

Not on the map. Why?

Abstract (arXiv)

Building Information Modeling (BIM) projects require information requirements to be described as machine-checkable Information Delivery Specification (IDS) files in order to verify whether building models contain the required attributes. However, IDS authoring remains a practical bottleneck: practitioners must handle domain vocabulary, strict XML schema constraints, and external validator conformance while also checking whether the requirement itself is correctly expressed. We present Ishigaki-IDS, an open-weight LLM specialized for verifier-aware IDS draft generation. The model combines continued pretraining on BIM/IDS corpora, supervised fine-tuning on information-requirement-to-IDS pairs, and reinforcement learning with verifiable rewards from an external validator. The goal is not to replace expert review, but to move IDS authoring from low-level XML and schema repair toward validator-loadable drafts that practitioners can inspect and correct. On the 166-case expert-created Ishigaki-IDS-Bench, Ishigaki-IDS-8B achieves an IDSAuditPass score of 0.651, a validator-pass metric for generated IDS files, substantially outperforming Claude Opus 4.5, the strongest single-shot LLM baseline we evaluated, at 0.331. It also obtains an Audit-Gated FacetF1 of 0.282, which measures requirement-facet alignment among validator-passing drafts. The same recipe scales: 14B and 32B variants reach IDSAuditPass 0.753 / 0.693 and Audit-Gated FacetF1 0.392 / 0.369. In a workflow check with six BIM practitioners, Ishigaki-assisted authoring reduced aggregate work time by 54.7% under the same validation and alignment endpoint. These results suggest that verifier-aware IDS generation can reduce the practical burden of converting BIM information requirements into reviewable IDS drafts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 27 references that are in the map. First posted on arXiv 7 Jun 2026.

Builds on

11 of 27 references.

References · 11

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  2. 2023Let's Verify Step by Stepcited by 3,598
  3. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  4. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  5. 2023LIMA: Less Is More for Alignmentcited by 1,080
  6. 2023Efficient Guided Generation for Large Language Modelscited by 192
  7. 2016Language to Logical Form with Neural Attentioncited by 158
  8. 2017Abstract Syntax Networks for Code Generation and Semantic Parsingcited by 92
  9. 2024Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledgecited by 6
  10. 2023LLP-Bench: A Large Scale Tabular Benchmark for Learning from Label Proportionscited by 5
  11. 2026Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirementscited by 1

Built on by

Not cited yet.