Galactic ChitChat: Using Large Language Models to Converse with Astronomy Literature
Not on the map. Why?
Abstract (arXiv)
We demonstrate the potential of the state-of-the-art OpenAI GPT-4 large language model to engage in meaningful interactions with Astronomy papers using in-context prompting. To optimize for efficiency, we employ a distillation technique that effectively reduces the size of the original input paper by 50%, while maintaining the paragraph structure and overall semantic integrity. We then explore the model's responses using a multi-document context (ten distilled documents). Our findings indicate that GPT-4 excels in the multi-document domain, providing detailed answers contextualized within the framework of related research findings. Our results showcase the potential of large language models for the astronomical community, offering a promising avenue for further exploration, particularly the possibility of utilizing the models for hypothesis generation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 5 of its 14 references that are in the map. First posted on arXiv 12 Apr 2023.
Builds on
5 of 14 references.
References · 5
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
Built on by
Citing papers per year: 2023: 2; 2024: 2.
4 papers.
- 2023AstroLLaMA: Towards Specialized Foundation Models in Astronomycited by 41
- 2023Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Contentcited by 7
- 2024What is the Role of Large Language Models in the Evolution of Astronomy Research?cited by 4
- 2024Designing an Evaluation Framework for Large Language Models in Astronomy Researchcited by 3
- 2024What is the Role of Large Language Models in the Evolution of Astronomy Research?30 Sep 2024
- 2024Designing an Evaluation Framework for Large Language Models in Astronomy Research30 May 2024
- 2023AstroLLaMA: Towards Specialized Foundation Models in Astronomy12 Sep 2023
- 2023Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Content26 Aug 2023