HugSelect: An Explainable Multi-Criteria Decision-Support Framework for foundation-model selection
Not on the map. Why?
Abstract (arXiv)
Foundation models are increasingly reused as software components, making model selection a critical software-engineering decision. Current model hubs primarily support discovery through popularity metrics, often neglecting functional capabilities, operational constraints, and community-perceived quality. We argue that foundation-model selection should be treated as an explicit, auditable software-component selection task rather than as keyword search, popularity ranking, or opaque conversational advice. This paper proposes HugSelect, an explainable decision-support framework for foundation-model selection. HugSelect builds a knowledge base of 71,274 models by combining repository metadata, extracted functional capabilities, and perceived quality attributes derived from community discussions into a unified pipeline. It ranks candidate models using a weighted additive model that exposes criterion-level score decompositions. We evaluated HugSelect through pipeline validation, comparative case studies against four commercial LLM-based recommendation systems (44 scenarios), fine-grained ablation, and an exploratory user study (n = 10). Extraction pipelines achieved an F1 score of 0.801 for functional features and an accuracy of 0.84 for quality-attribute mapping. HugSelect achieved a model-level Coverage@10 of 0.61 and family-level Coverage@10 of 0.91, showing recommendation quality comparable to that of the evaluated commercial systems, with no significant overall differences in ranking quality, while providing stable, traceable, and inspectable reasoning. Ablation confirmed that functional features were the main driver of retrieval accuracy, and preliminary user feedback suggests that the framework is useful and intuitive.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 51 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
9 of 51 references.
References · 9
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2024Large Language Models: A Surveycited by 525
- 2023Foundational Models in Medical Imaging: A Comprehensive Survey and Future Visioncited by 76
- 2024Automated categorization of pre-trained models for software engineering: A case study with a Hugging Face datasetcited by 3
- 2025Benchmarking Recommendation, Classification, and Tracing Based on Hugging Face Knowledge Graphcited by 3
- 2025Empirical Evaluation of AI-Assisted Software Package Selection: A Knowledge Graph Approachcited by 2
- 2024Learning to Rank Pre-trained Vision-Language Models for Downstream Taskscited by 1
- 2025Evidence-Driven Decision Support for AI Model Selection in Research Software Engineeringcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.