SolarGPT-QA: A Domain-Adaptive Large Language Model for Educational Question Answering in Space Weather and Heliophysics
Not on the map. Why?
Abstract (arXiv)
Solar activity, including solar flares, coronal mass ejections (CMEs), and geomagnetic storms can significantly impact satellites, aviation, power grids, data centers, and space missions. Extreme solar events can cause substantial economic damage with limited advance warning, underscoring the importance of early warning systems, accurate forecasting, and effective education in space science. Although large language models (LLMs) perform well on general tasks, they often lack domain specific knowledge and pedagogical capability to clearly explain complex space science concepts. We introduce SolarGPT-QA, a question answering system based on a domain adapted large language model built on the LLaMA-3 base model. The model is trained using scientific literature and large scale question and answer data generated with GPT-4 and refined using Grok-3 in a student friendly storytelling style. To evaluate response quality, we employ an LLM-as-judge evaluation framework, where a strong reference model assesses generated answers using structured criteria including scientific accuracy, clarity, completeness, and pedagogical effectiveness. Results show that SolarGPT-QA performs strongly relative to general purpose models in zero shot settings and achieves competitive performance compared to instruction tuned models for educational explanations in space weather and heliophysics. Ablation studies indicate that combining domain adaptive pretraining with fine tuning is important for balancing scientific accuracy and educational effectiveness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 69 references that are in the map. First posted on arXiv 17 Jan 2026.
Builds on
30 of 69 references.
References · 30
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
18 more
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
- 2023Instruction Tuning with GPT-4cited by 686
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
- 2023OceanGPT: A Large Language Model for Ocean Science Taskscited by 43
- 2021How to Train Your Flare Prediction Model: Revisiting Robust Sampling of Rare Eventscited by 26
- 2024CLLMate: A Multimodal Benchmark for Weather and Climate Events Forecastingcited by 20
- 2022Tele-Knowledge Pre-training for Fault Analysiscited by 18
- 2024Contrastive Representation Learning for Predicting Solar Flares from Extremely Imbalanced Multivariate Time Series Datacited by 4
- 2025Advancing Hate Speech Detection with Transformers: Insights from the MetaHatecited by 4
- 2024Predictive Insights into LGBTQ+ Minority Stress: A Transductive Exploration of Social Media Discoursecited by 3
- 2024EXCON: Extreme Instance-based Contrastive Representation Learning of Severely Imbalanced Multivariate Time Series for Solar Flare Predictioncited by 2
- 2025Advancing Minority Stress Detection with Transformers: Insights from the Social Media Datasetscited by 2
- 2025Global Cross-Time Attention Fusion for Enhanced Solar Flare Prediction from Multivariate Time Seriescited by 1
Built on by
Not cited yet.