Domain-specific ChatBots for Science using Embeddings
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have emerged as powerful machine-learning systems capable of handling a myriad of tasks. Tuned versions of these systems have been turned into chatbots that can respond to user queries on a vast diversity of topics, providing informative and creative replies. However, their application to physical science research remains limited owing to their incomplete knowledge in these areas, contrasted with the needs of rigor and sourcing in science domains. Here, we demonstrate how existing methods and software tools can be easily combined to yield a domain-specific chatbot. The system ingests scientific documents in existing formats, and uses text embedding lookup to provide the LLM with domain-specific contextual information when composing its reply. We similarly demonstrate that existing image embedding methods can be used for search and retrieval across publication figures. These results confirm that LLMs are already suitable for use by physical scientists in accelerating their research efforts.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 69 references that are in the map. First posted on arXiv 15 Jun 2023.
Builds on
32 of 69 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
20 more
- 2023Let's Verify Step by Stepcited by 3,598
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
- 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 671
- 2022PAL: Program-aided Language Modelscited by 635
- 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 417
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
- 2023Large Language Models as Tool Makerscited by 293
- 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
- 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
- 2023Emergent autonomous scientific research capabilities of large language modelscited by 127
- 2023ChatGPT is not all you need. A State of the Art Review of large Generative AI modelscited by 85
- 2023Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Samplingcited by 46
- 2023Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativitycited by 24
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 2.
4 papers.
- 2024VISION: A Modular AI Assistant for Natural Human-Instrument Interaction at Scientific User Facilitiescited by 10
- 2023Virtual Scientific Companion for Synchrotron Beamlines: A Prototypecited by 2
- 2025CelloAI: Leveraging Large Language Models for HPC Software Development in High Energy Physicscited by 2
- 2025Generative AI for Strategic Plan Developmentcited by 0
- 2025CelloAI: Leveraging Large Language Models for HPC Software Development in High Energy Physics22 Aug 2025
- 2025Generative AI for Strategic Plan Development10 Aug 2025
- 2024VISION: A Modular AI Assistant for Natural Human-Instrument Interaction at Scientific User Facilities24 Dec 2024
- 2023Virtual Scientific Companion for Synchrotron Beamlines: A Prototype28 Dec 2023