mlsanityData to 14 Oct 2026

What is the Role of Large Language Models in the Evolution of Astronomy Research?

arXiv 2409.20252 ↗First posted 30 Sep 2024astro-ph.IM cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

ChatGPT and other state-of-the-art large language models (LLMs) are rapidly transforming multiple fields, offering powerful tools for a wide range of applications. These models, commonly trained on vast datasets, exhibit human-like text generation capabilities, making them useful for research tasks such as ideation, literature review, coding, drafting, and outreach. We conducted a study involving 13 astronomers at different career stages and research fields to explore LLM applications across diverse tasks over several months and to evaluate their performance in research-related activities. This work was accompanied by an anonymous survey assessing participants' experiences and attitudes towards LLMs. We provide a detailed analysis of the tasks attempted and the survey answers, along with specific output examples. Our findings highlight both the potential and limitations of LLMs in supporting research while also addressing general and research-specific ethical considerations. We conclude with a series of recommendations, emphasizing the need for researchers to complement LLMs with critical thinking and domain expertise, ensuring these tools serve as aids rather than substitutes for rigorous scientific inquiry.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 50 references that are in the map. First posted on arXiv 30 Sep 2024.

Builds on

16 of 50 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  3. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
  4. 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
  5. 2023GPT detectors are biased against non-native English writerscited by 178
  6. 2022Talking About Large Language Modelscited by 175
  7. 2024Is ChatGPT Transforming Academics' Writing Style?cited by 26
  8. 2023Challenging the appearance of machine intelligence: Cognitive bias in LLMs and Best Practices for Adoptioncited by 21
  9. 2016Women Through the Glass Ceiling: Gender Asymmetries in Wikipediacited by 17
  10. 2023Friend or Foe? Exploring the Implications of Large Language Models on the Science Systemcited by 16
  11. 2024Intent-based Prompt Calibration: Enhancing prompt optimization with synthetic boundary casescited by 13
  12. 2024Delving into the Utilisation of ChatGPT in Scientific Publications in Astronomycited by 7
4 more
  1. 2024pathfinder: A Semantic Framework for Literature Review and Knowledge Discovery in Astronomycited by 6
  2. 2023Galactic ChitChat: Using Large Language Models to Converse with Astronomy Literaturecited by 4
  3. 2018Gender Differences in Participation and Reward on Stack Overflowcited by 2
  4. 2015Software Use in Astronomy: an Informal Surveycited by 1

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.