Domain Adaptation of Large Language Models for Polymer-Composite Additive Manufacturing Using Retrieval-Augmented Generation and Fine-Tuning
On the map: Retrieval-augmented generation → Medical and biomedical RAG
Abstract (arXiv)
General-purpose large language models (LLMs) often struggle to generate reliable responses in specialized engineering domains due to limited domain grounding and insufficient exposure to structured technical knowledge. This study investigates practical strategies for adapting a foundation LLM to the additive manufacturing (AM) domain in order to improve answer accuracy, relevance, and usability for expert-level question answering. AM knowledge is distributed across heterogeneous sources such as academic literature, manufacturer documentation, technical standards, and procedural guides. Although general LLMs demonstrate strong linguistic capabilities, they frequently fail to retrieve and contextualize such domain-specific information. Two common approaches to address this limitation are domain-specific fine-tuning and retrieval-augmented generation (RAG). We construct a curated AM corpus and evaluate three configurations based on LLaMA-3-8B: (1) the pretrained baseline model, (2) a RAG system that retrieves relevant document chunks from a vector database, and (3) a model fine-tuned on raw domain text. Performance is evaluated using 200 expert-designed AM questions assessed by mechanical engineering experts for accuracy, relevance, and overall preference. Results show that the RAG model consistently outperforms the baseline. Among the 200 questions, 75.5% of RAG responses are judged more accurate, 85.2% are preferred overall, and 90.8% are rated more relevant than baseline responses. In contrast, fine-tuning on raw AM text reduces performance, producing more accurate answers in only 5.6% of cases and more relevant answers in 32.5% of cases. These results indicate that retrieval-augmented approaches provide a more effective pathway for adapting LLMs to specialized engineering domains than naive fine-tuning on unstructured technical data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 24 of its 32 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
24 of 32 references.
Closest ancestors · 3
Same direction, newest first
- 2024AMGPT: a Large Language Model for Contextual Querying in Additive Manufacturing24 May
- 2024Benchmarking Retrieval-Augmented Generation for Medicine20 Feb
- 2023MechGPT, a language-based strategy for mechanics and materials modeling that connects knowledge across scales, disciplines and modalities16 Oct
Other references · 21
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2017Billion-scale similarity search with GPUscited by 2,497
9 more
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2020Revisiting Few-sample BERT Fine-tuningcited by 238
- 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 90
- 2023Benchmarking large language models for biomedical natural language processing applications and recommendationscited by 78
- 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Reviewcited by 37
- 2025AdditiveLLM: Large Language Models Predict Defects in Additive Manufacturingcited by 5
- 2025The Impact of Fine-tuning Large Language Models on Automated Program Repaircited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Generative retrieval-augmented ontologic graph and multi-agent strategies for interpretive large language model-based materials design
- 2026ManuRAG: Multi-modal Retrieval Augmented Generation for Manufacturing Question Answering (Early Version) ↗
- 2026Mathematical Knowledge Graph-Driven Framework for Equation-Based Predictive and Reliable Additive Manufacturing
- 2026Retrieval Augmented Generation of Literature-derived Polymer Knowledge: The Example of a Biodegradable Polymer Expert System
- 2025Penrose Tiled Low-Rank Compression and Section-Wise Q&A Fine-Tuning: A General Framework for Domain-Specific Large Language Model Adaptation
- 2026STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Models
- 2026Teaching and Evaluating LLMs to Reason About Polymer Design Related Tasks
- 2024Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictions