mlsanityData to 14 Oct 2026

Harnessing the Power of Adversarial Prompting and Large Language Models for Robust Hypothesis Generation in Astronomy

arXiv 2306.11648 ↗First posted 20 Jun 2023astro-ph.IM astro-ph.GA cs.AIcited by 11

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

This study investigates the application of Large Language Models (LLMs), specifically GPT-4, within Astronomy. We employ in-context prompting, supplying the model with up to 1000 papers from the NASA Astrophysics Data System, to explore the extent to which performance can be improved by immersing the model in domain-specific literature. Our findings point towards a substantial boost in hypothesis generation when using in-context prompting, a benefit that is further accentuated by adversarial prompting. We illustrate how adversarial prompting empowers GPT-4 to extract essential details from a vast knowledge base to produce meaningful hypotheses, signaling an innovative step towards employing LLMs for scientific research in Astronomy.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 15 of its 29 references that are in the map. First posted on arXiv 20 Jun 2023.

Builds on

15 of 29 references.

References · 15

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  8. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 938
  9. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
  10. 2021Compacter: Efficient Low-Rank Hypercomplex Adapter Layerscited by 460
  11. 2021Meta-learning via Language Model In-context Tuningcited by 164
  12. 2021On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptationcited by 147
3 more
  1. 2022A Feasibility Study of Answer-Agnostic Question Generation for Educationcited by 6
  2. 2015ADS: The Next Generation Search Platformcited by 5
  3. 2021From Data Processes to Data Products: Knowledge Infrastructures in Astronomycited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 5; 2026: 2.

11 papers.

  1. 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 93
  2. 2023AstroLLaMA: Towards Specialized Foundation Models in Astronomycited by 41
  3. 202534 Examples of LLM Applications in Materials Science and Chemistry: Towards Automation, Assistants, Agents, and Accelerated Scientific Discoverycited by 9
  4. 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 9
  5. 2024Reflections from the 2024 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistrycited by 8
  6. 2024Designing an Evaluation Framework for Large Language Models in Astronomy Researchcited by 3
  7. 2025A Survey of Large Language Models in Discipline-specific Research: Challenges, Methods and Opportunitiescited by 2
  8. 2024Mitigating Interpretation Bias in Rock Records with Large Language Models: Insights from Paleoenvironmental Analysiscited by 1
  9. 2025Evaluating Retrieval-Augmented Generation Agents for Autonomous Scientific Discovery in Astrophysicscited by 1
  10. 2026Grounding LLMs in Scientific Discovery via Embodied Actionscited by 0
  11. 2026DN-Hypo-Pipeline: An AI-Driven Workflow for Generating Hypotheses using Large Language Models and Scientific Explanationscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Large Language Models Achieve Gold Medal Performance at the International Olympiad on Astronomy & Astrophysics (IOAA)
  2. 2025Encoding and Understanding Astrophysical Information in Large Language Model-Generated Summaries
  3. 2025Radio Astronomy in the Era of Vision-Language Models: Prompt Sensitivity and Adaptation
  4. 2025AstroMLab 4: Benchmark-Topping Performance in Astronomy Q&A with a 70B-Parameter Domain-Specialized Reasoning Model
  5. 2026Reconstructing Implicit Scientific Knowledge: Evaluating LLM Agents through End-to-End Reproduction of Astronomy
  6. 2026Taramandal-GPT: Enhancing Astrodynamics Problem-Solving with Knowledge Retrieval and Structured Thinking
  7. 2026Rethinking Domain Specialization for Open-Ended Scientific Reasoning in Astronomy Language Models
  8. 2026A systematic evaluation of vision-language models for observational astronomical reasoning tasks