Coverage-Aware Web Crawling for Domain-Specific Supplier Discovery via a Web--Knowledge--Web Pipeline
Not on the map. Why?
Abstract (arXiv)
Identifying the full landscape of small and medium-sized enterprises (SMEs) in specialized industry sectors is critical for supply-chain resilience, yet existing business databases suffer from substantial coverage gaps -- particularly for sub-tier suppliers and firms in emerging niche markets. We propose a Web--Knowledge--Web (W→K→W) pipeline that iteratively (1)~crawls domain-specific web sources to discover candidate supplier entities, (2)~extracts and consolidates structured knowledge into a heterogeneous knowledge graph using domain-adapted few-shot LLM prompting, and (3)~uses the knowledge graph's topology and coverage signals to guide subsequent crawling toward under-represented regions of the supplier space. To quantify discovery completeness, we introduce a coverage estimation framework inspired by ecological species-richness estimators (Chao1, ACE) adapted for web-entity populations. Experiments on the semiconductor equipment manufacturing sector (NAICS 333242) demonstrate that the W→K→W pipeline achieves the highest precision (0.165) and F1 (0.123) among all methods while using only 144 pages -- 32% fewer than the 213-page baseline budget -- building a knowledge graph of 664 entities and 542 relations with 100% relation type-consistency.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 11 of its 28 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
11 of 28 references.
References · 11
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2020Knowledge Graphscited by 619
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 100
- 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
- 2025Neural Pruning for 3D Scene Reconstruction: Efficient NeRF Accelerationcited by 9
- 2024Benchmarking Large Language Models for Image Classification of Marine Mammalscited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Sustainable Hybrid Document-Routed Retrieval for Financial RAG: Resolving the Robustness-Precision Trade-offcited by 13
- 2026When Corrective Hints Hurt: Prompt Design in Reasoner-Guided Repair of LLM Overcaution on Entailed Negations under OWL~2~DLcited by 1
- 2026Energy-Efficient On-Device RAG on a Mobile NPU: System Design and Benchmark on Snapdragon X Elitecited by 1
- 2026Energy-Efficient On-Device RAG on a Mobile NPU: System Design and Benchmark on Snapdragon X Elite9 Jun 2026
- 2026When Corrective Hints Hurt: Prompt Design in Reasoner-Guided Repair of LLM Overcaution on Entailed Negations under OWL~2~DL25 Apr 2026
- 2026Sustainable Hybrid Document-Routed Retrieval for Financial RAG: Resolving the Robustness-Precision Trade-off26 Mar 2026