mlsanityData to 7 Oct 2026

Domain-specific ChatBots for Science using Embeddings

arXiv 2306.10067 ↗First posted 15 Jun 2023cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have emerged as powerful machine-learning systems capable of handling a myriad of tasks. Tuned versions of these systems have been turned into chatbots that can respond to user queries on a vast diversity of topics, providing informative and creative replies. However, their application to physical science research remains limited owing to their incomplete knowledge in these areas, contrasted with the needs of rigor and sourcing in science domains. Here, we demonstrate how existing methods and software tools can be easily combined to yield a domain-specific chatbot. The system ingests scientific documents in existing formats, and uses text embedding lookup to provide the LLM with domain-specific contextual information when composing its reply. We similarly demonstrate that existing image embedding methods can be used for search and retrieval across publication figures. These results confirm that LLMs are already suitable for use by physical scientists in accelerating their research efforts.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 69 references that are in the map. First posted on arXiv 15 Jun 2023.

Builds on

32 of 69 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  9. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  10. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  11. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  12. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
20 more
  1. 2023Let's Verify Step by Stepcited by 3,598
  2. 2020Longformer: The Long-Document Transformercited by 3,362
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  6. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  7. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  8. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  9. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
  10. 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 671
  11. 2022PAL: Program-aided Language Modelscited by 635
  12. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 417
  13. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 351
  14. 2023Large Language Models as Tool Makerscited by 293
  15. 2023TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIscited by 184
  16. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
  17. 2023Emergent autonomous scientific research capabilities of large language modelscited by 127
  18. 2023ChatGPT is not all you need. A State of the Art Review of large Generative AI modelscited by 85
  19. 2023Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Samplingcited by 46
  20. 2023Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativitycited by 24

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1; 2025: 2.

4 papers.