Full-Stack Domain Enhancement for Combustion LLMs: Construction and Optimization
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) in the direction of task adaptation and capability enhancement for professional fields demonstrate significant application potential. Nevertheless, for complex physical systems such as combustion science, general-purpose LLMs often generate severe hallucinations due to insufficient domain knowledge and the inability to adhere to physical conservation laws. To address this issue, we propose the first full-stack domain-enhanced LLM workflow tailored for the field of combustion science, which integrates automated domain corpus construction, incremental pre-training, instruction fine-tuning, and verifiable reward-based reinforcement learning. This workflow ensures that the model truly internalizes physical laws rather than merely learning textual statistical patterns. We also release FlameBench, a standardized evaluation benchmark specifically designed for complex reasoning tasks in combustion science. Experimental results demonstrate that the model developed in this work significantly outperforms state-of-the-art general-purpose closed-source models and traditional retrieval-augmented generation methods on combustion science reasoning tasks. This work lays a solid technical and resource foundation for the subsequent development of domain-specific scientific research agents with reliable scientific reasoning capabilities.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 29 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
20 of 29 references.
References · 20
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 765
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
- 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 483
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
8 more
- 2024Simple and Scalable Strategies to Continually Pre-train Large Language Modelscited by 127
- 2024Developing ChemDFM as a large language foundation model for chemistrycited by 52
- 2024D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Modelscited by 41
- 2025Hypothesis Generation for Materials Discovery and Design Using Goal-Driven and Constraint-Guided LLM Agentscited by 30
- 2023Structured Chemistry Reasoning with Large Language Modelscited by 28
- 2025Benchmarking Retrieval-Augmented Generation for Chemistrycited by 20
- 2023A Reliable Knowledge Processing Framework for Combustion Science using Foundation Modelscited by 7
- 2024Guaranteeing Conservation Laws with Projection in Physics-Informed Neural Networkscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A unified foundational framework for knowledge injection and evaluation of Large Language Models in Combustion Science
- 2026Towards LLM-enabled autonomous combustion research: A literature-aware agent for self-corrective modeling workflows
- 2026WildSci: Advancing Scientific Reasoning from In-the-Wild Literature
- 2025Training a Scientific Reasoning Model for Chemistry
- 2025MiST: Understanding the Role of Mid-Stage Scientific Training in Developing Chemical Reasoning Models
- 2025RLDBF: Enhancing LLMs Via Reinforcement Learning With DataBase FeedBack
- 2024Domain-specific ReAct for physics-integrated iterative modeling: A case study of LLM agents for gas path analysis of gas turbines
- 2025Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective