mlsanityData to 14 Oct 2026

MSEval: A Dataset for Material Selection in Conceptual Design to Evaluate Algorithmic Models

arXiv 2407.09719 ↗First posted 12 Jul 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Material selection plays a pivotal role in many industries, from manufacturing to construction. Material selection is usually carried out after several cycles of conceptual design, during which designers iteratively refine the design solution and the intended manufacturing approach. In design research, material selection is typically treated as an optimization problem with a single correct answer. Moreover, it is also often restricted to specific types of objects or design functions, which can make the selection process computationally expensive and time-consuming. In this paper, we introduce MSEval, a novel dataset which is comprised of expert material evaluations across a variety of design briefs and criteria. This data is designed to serve as a benchmark to facilitate the evaluation and modification of machine learning models in the context of material selection for conceptual design.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 44 references that are in the map. First posted on arXiv 12 Jul 2024.

Builds on

16 of 44 references.

References · 16

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  7. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  8. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
  9. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  10. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  11. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  12. 2017Crowdsourcing Multiple Choice Science Questionscited by 765
4 more
  1. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  2. 2021Datasets: A Community Library for Natural Language Processingcited by 530
  3. 2023From Concept to Manufacturing: Evaluating Vision-Language Models for Engineering Designcited by 51
  4. 2022Generative Transformers for Design Concept Generationcited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.