mlsanityData to 7 Oct 2026

Cognitively Layered Data Synthesis for Domain Adaptation of LLMs to Space Situational Awareness

arXiv 2603.09231 ↗First posted 10 Mar 2026cs.AIcited by 0

On the map: Synthetic data and self-improvement for LLMs → Synthetic reasoning data and bootstrapping

Abstract (arXiv)

Large language models (LLMs) demonstrate exceptional performance on general-purpose tasks. however, transferring them to complex engineering domains such as space situational awareness (SSA) remains challenging owing to insufficient structural alignment with mission chains, the absence of higher-order cognitive supervision, and poor correspondence between data quality criteria and engineering specifications. The core bottleneck is the construction of high-quality supervised fine-tuning (SFT) datasets. To this end, we propose BD-FDG (Bloom's Taxonomy-based Domain-specific Fine-tuning Data Generation), a framework that addresses incomplete knowledge coverage, shallow cognitive depth, and limited quality controllability through three mechanisms: structured knowledge organization, cognitively layered question modeling, and automated quality control. The framework uses a knowledge tree to ensure structured corpus coverage, designs a question generation scheme spanning nine categories and six cognitive levels from Remember to Create to produce samples with a continuous difficulty gradient, and applies a multidimensional scoring pipeline to enforce domain rigor and consistency. Using BD-FDG, we construct SSA-SFT, a domain dataset of approximately 230K samples, and fine-tune Qwen3-8B to obtain SSA-LLM-8B. Experiments show that SSA-LLM-8B achieves relative BLEU-1 improvements of 144% (no-think) and 176% (think) on the domain test set and a win rate of 82.21% over the baseline in arena comparisons, while largely preserving general benchmark performance (MMLU-Pro, MATH-500). These results validate SFT data construction driven by cognitive layering as an effective paradigm for complex engineering domains and provide a transferable framework for domain-specific LLM adaptation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Synthetic reasoning data and bootstrapping, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 36 of its 51 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

36 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks31 Jul

Other references · 35

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  7. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  8. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  10. 2023A Survey of Large Language Modelscited by 2,537
  11. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  12. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
23 more
  1. 2023BloombergGPT: A Large Language Model for Financecited by 923
  2. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
  3. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
  4. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
  5. 2024Phi-4 Technical Reportcited by 675
  6. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  7. 2023Textbooks Are All You Needcited by 561
  8. 2023Scaling Data-Constrained Language Modelscited by 391
  9. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  10. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 369
  11. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 354
  12. 2024Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothingcited by 341
  13. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  14. 2024A Survey on Data Selection for Language Modelscited by 230
  15. 2023Self-Alignment with Instruction Backtranslationcited by 149
  16. 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 134
  17. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
  18. 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 47
  19. 2023Efficient Continual Pre-training for Building Domain Specific Large Language Modelscited by 33
  20. 2024Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluationcited by 29
  21. 2025DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AIcited by 22
  22. 2024How Teachers Can Use Large Language Models and Bloom's Taxonomy to Create Educational Quizzescited by 17
  23. 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Explorationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025KnowMap: Efficient Knowledge-Driven Task Adaptation for LLMs
  2. 2026Taramandal-GPT: Enhancing Astrodynamics Problem-Solving with Knowledge Retrieval and Structured Thinking
  3. 2026A Systematic Evaluation of Retrieval-Augmented Generation and Language Models for Space Operations
  4. 2023MarineGPT: Unlocking Secrets of Ocean to the Public
  5. 2025Think Less, Label Better: Multi-Stage Domain-Grounded Synthetic Data Generation for Fine-Tuning Large Language Models in Telecommunications
  6. 2026Rethinking Domain Specialization for Open-Ended Scientific Reasoning in Astronomy Language Models
  7. 2025Agent Fine-tuning through Distillation for Domain-specific LLMs in Microdomains
  8. 2026SCORE: Specificity, Context Utilization, Robustness, and Relevance for Reference-Free LLM Evaluation