mlsanityData to 14 Oct 2026

When Does Bigger Help? A Controlled Study of LLM Scale for Ontology Learning

arXiv 2608.31118 ↗First posted 31 Aug 2026cs.AIcited by 0

On the map: Mixture-of-experts → MoE large language models

Abstract (arXiv)

The effect of Large Language Model (LLM) scale on ontology learning (OL) performance remains insufficiently characterized. We present a controlled evaluation of 13 models spanning dense and Mixture-of-Experts variants from the Qwen3.5 and Qwen3.6 lineages, together with proprietary GPT release variants, using the OntoLearner retrieval-augmented generation pipeline. All models are evaluated with the same embedding model, retrieval configuration, prompt templates, decoding settings, datasets, and metrics on term typing, taxonomy discovery, and non-taxonomic relationship extraction across four biomedical and materials science and engineering ontologies. Within the dense Qwen3.5 lineage, increasing parameter count primarily improves precision rather than recall, with the largest gains occurring between 9B and 27B parameters. However, the effect of scale is neither monotonic nor uniform across tasks and domains. Dense 27B models outperform substantially larger sparse models on term typing, whereas larger Mixture-of-Experts models achieve the strongest open-weight results on taxonomy discovery. Non-taxonomic relationship extraction remains difficult across model scales, particularly for the Materials Data Science ontology. Performance differences across matched Qwen variants and proprietary GPT releases further indicate that architecture and model lineage can outweigh nominal parameter count. These findings show that model size alone is an insufficient selection criterion for OL and provide empirical guidance for reproducible LLM-assisted ontology engineering.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MoE large language models, one of 12 directions in Mixture-of-experts. Builds on 23 of its 59 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

23 of 59 references.

References · 23

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  4. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  5. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  6. 2022Emergent Abilities of Large Language Modelscited by 2,512
  7. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  8. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  9. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  10. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
  11. 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
  12. 2023LLMs4OL: Large Language Models for Ontology Learningcited by 77
11 more
  1. 2022Inverse scaling can become U-shapedcited by 76
  2. 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 42
  3. 2025Scaling Laws Are Unreliable for Downstream Tasks: A Reality Checkcited by 29
  4. 2025Ontology Generation using Large Language Modelscited by 25
  5. 2024LLMs4OL 2024 Overview: The 1st Large Language Models for Ontology Learning Challengecited by 8
  6. 2025Assessing the Capability of Large Language Models for Domain-Specific Ontology Generationcited by 7
  7. 2025Ontology Learning and Knowledge Graph Construction: A Comparison of Approaches and Their Impact on RAG Performancecited by 4
  8. 2025Heterogeneous LLM Methods for Ontology Learning (Few-Shot Prompting, Ensemble Typing, and Attention-Based Taxonomies)cited by 3
  9. 2026OntoLearner: A Modular Python Library for Ontology Learning with Large Language Modelscited by 3
  10. 2026OntoExtend: A Framework for Requirement-driven and Scalable Ontology Extension with LLMscited by 2
  11. 2026From Prompt to Graph: Comparing LLM-Based Information Extraction Strategies in Domain-Specific Ontology Developmentcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Transforming Expert Knowledge into Scalable Ontology via Large Language Models
  2. 2025Improving LLM-based Ontology Matching with fine-tuning on synthetic data
  3. 2026pro-team at LLMs4OL 2026 Tasks Flagship and Reuse: Retrieval-Augmented Generation and Vocabulary-Constrained Filtering for Ontology Learning
  4. 2026Benchmarking Resource-Efficient LLMs for Research Topic Ontology Generation in the Biomedical Field
  5. 2025Leveraging Large Language Models for Generating Research Topic Ontologies: A Multi-Disciplinary Study
  6. 2025OntoTune: Ontology-Driven Self-training for Aligning Large Language Models
  7. 2025KROMA: Ontology Matching with Knowledge Retrieval and Large Language Models
  8. 2026LLM-Guided Ontology-Driven Knowledge Graph Construction from Unstructured Text