mlsanityData to 14 Oct 2026

1.5 million materials narratives generated by chatbots

arXiv 2308.13687 ↗First posted 25 Aug 2023cond-mat.mtrl-sci cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

The advent of artificial intelligence (AI) has enabled a comprehensive exploration of materials for various applications. However, AI models often prioritize frequently encountered materials in the scientific literature, limiting the selection of suitable candidates based on inherent physical and chemical properties. To address this imbalance, we have generated a dataset of 1,494,017 natural language-material paragraphs based on combined OQMD, Materials Project, JARVIS, COD and AFLOW2 databases, which are dominated by ab initio calculations and tend to be much more evenly distributed on the periodic table. The generated text narratives were then polled and scored by both human experts and ChatGPT-4, based on three rubrics: technical accuracy, language and structure, and relevance and depth of content, showing similar scores but with human-scored depth of content being the most lagging. The merger of multi-modality data sources and large language model (LLM) holds immense potential for AI frameworks to help the exploration and discovery of solid-state materials for specific applications.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 11 of its 48 references that are in the map. First posted on arXiv 25 Aug 2023.

Builds on

11 of 48 references.

References · 11

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2022Emergent Abilities of Large Language Modelscited by 2,512
  6. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  7. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  8. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
  9. 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
  10. 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
  11. 2023Can ChatGPT be used to generate scientific hypotheses?cited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.