Enhancing Large Language Models with Domain-Specific Knowledge: The Case in Topological Materials
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs), such as ChatGPT, have demonstrated impressive performance in the text generation task, showing the ability to understand and respond to complex instructions. However, the performance of naive LLMs in speciffc domains is limited due to the scarcity of domain-speciffc corpora and specialized training. Moreover, training a specialized large-scale model necessitates signiffcant hardware resources, which restricts researchers from leveraging such models to drive advances. Hence, it is crucial to further improve and optimize LLMs to meet speciffc domain demands and enhance their scalability. Based on the condensed matter data center, we establish a material knowledge graph (MaterialsKG) and integrate it with literature. Using large language models and prompt learning, we develop a specialized dialogue system for topological materials called TopoChat. Compared to naive LLMs, TopoChat exhibits superior performance in structural and property querying, material recommendation, and complex relational reasoning. This system enables efffcient and precise retrieval of information and facilitates knowledge interaction, thereby encouraging the advancement on the ffeld of condensed matter materials.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 54 references that are in the map. First posted on arXiv 10 Sep 2024.
Builds on
23 of 54 references.
References · 23
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 385
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2024LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domaincited by 118
11 more
- 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 93
- 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 85
- 2023A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challengecited by 55
- 2023CrysGNN : Distilling pre-trained knowledge to enhance property prediction for crystalline materialscited by 14
- 2024Development and Testing of Retrieval Augmented Generation in Large Language Models -- A Case Study Reportcited by 13
- 2022Nebula Graph: An open source distributed graph databasecited by 8
- 2023Materials Informatics Transformer: A Language Model for Interpretable Materials Properties Predictioncited by 7
- 2023Discovery of 2D materials using Transformer Network based Generative Designcited by 5
- 2023Materials Expert-Artificial Intelligence for Materials Discoverycited by 2
- 2023Topological, or Non-topological? A Deep Learning Based Predictioncited by 1
- 2023Bridging the Semantic-Numerical Gap: A Numerical Reasoning Method of Cross-modal Knowledge Graph for Material Property Predictioncited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.