Cognitively Layered Data Synthesis for Domain Adaptation of LLMs to Space Situational Awareness
On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping
Abstract (arXiv)
Large language models (LLMs) demonstrate exceptional performance on general-purpose tasks. however, transferring them to complex engineering domains such as space situational awareness (SSA) remains challenging owing to insufficient structural alignment with mission chains, the absence of higher-order cognitive supervision, and poor correspondence between data quality criteria and engineering specifications. The core bottleneck is the construction of high-quality supervised fine-tuning (SFT) datasets. To this end, we propose BD-FDG (Bloom's Taxonomy-based Domain-specific Fine-tuning Data Generation), a framework that addresses incomplete knowledge coverage, shallow cognitive depth, and limited quality controllability through three mechanisms: structured knowledge organization, cognitively layered question modeling, and automated quality control. The framework uses a knowledge tree to ensure structured corpus coverage, designs a question generation scheme spanning nine categories and six cognitive levels from Remember to Create to produce samples with a continuous difficulty gradient, and applies a multidimensional scoring pipeline to enforce domain rigor and consistency. Using BD-FDG, we construct SSA-SFT, a domain dataset of approximately 230K samples, and fine-tune Qwen3-8B to obtain SSA-LLM-8B. Experiments show that SSA-LLM-8B achieves relative BLEU-1 improvements of 144% (no-think) and 176% (think) on the domain test set and a win rate of 82.21% over the baseline in arena comparisons, while largely preserving general benchmark performance (MMLU-Pro, MATH-500). These results validate SFT data construction driven by cognitive layering as an effective paradigm for complex engineering domains and provide a transferable framework for domain-specific LLM adaptation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 36 of its 51 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
36 of 51 references.
Closest ancestors · 1
Same direction, newest first
- 2025CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks31 Jul
Other references · 35
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2023A Survey of Large Language Modelscited by 2,537
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
23 more
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
- 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
- 2024Phi-4 Technical Reportcited by 675
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2023Textbooks Are All You Needcited by 561
- 2023Scaling Data-Constrained Language Modelscited by 391
- 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
- 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
- 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 354
- 2024Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothingcited by 341
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2024A Survey on Data Selection for Language Modelscited by 230
- 2023Self-Alignment with Instruction Backtranslationcited by 149
- 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 134
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
- 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 47
- 2023Efficient Continual Pre-training for Building Domain Specific Large Language Modelscited by 33
- 2024Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluationcited by 29
- 2025DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AIcited by 22
- 2024How Teachers Can Use Large Language Models and Bloom's Taxonomy to Create Educational Quizzescited by 17
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Explorationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025KnowMap: Efficient Knowledge-Driven Task Adaptation for LLMs
- 2026Taramandal-GPT: Enhancing Astrodynamics Problem-Solving with Knowledge Retrieval and Structured Thinking
- 2026A Systematic Evaluation of Retrieval-Augmented Generation and Language Models for Space Operations
- 2023MarineGPT: Unlocking Secrets of Ocean to the Public
- 2025Think Less, Label Better: Multi-Stage Domain-Grounded Synthetic Data Generation for Fine-Tuning Large Language Models in Telecommunications
- 2026Rethinking Domain Specialization for Open-Ended Scientific Reasoning in Astronomy Language Models
- 2025Agent Fine-tuning through Distillation for Domain-specific LLMs in Microdomains
- 2026SCORE: Specificity, Context Utilization, Robustness, and Relevance for Reference-Free LLM Evaluation