Domain adaptation of large language models for geotechnical applications
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of large language models (LLMs) is transforming opportunities in geotechnical engineering, where workflows rely on complex, text-rich data. While general-purpose LLMs demonstrate strong reasoning capabilities, their effectiveness in geotechnical applications is constrained by limited exposure to specialized terminology and domain logic. Thus, domain adaptation, tailoring general LLMs for geotechnical use, has become essential. This paper presents the first systematic review of LLM adaptation and application in geotechnical contexts. It critically examines four key adaptation strategies, including prompt engineering, retrieval augmented generation, domain-adaptive pretraining, and fine-tuning, and evaluates their comparative benefits, limitations, and implementation trends. This review synthesizes current applications spanning geological interpretation, subsurface characterization, design analysis, numerical modeling, risk assessment, and geotechnical education. Findings show that domain-adapted LLMs substantially improve reasoning accuracy, automation, and interpretability, yet remain limited by data scarcity, validation challenges, and explainability concerns. Future research directions are also suggested. This review establishes a critical foundation for developing geotechnically literate LLMs and guides researchers and practitioners in advancing the digital transformation of geotechnical engineering.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 59 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
18 of 59 references.
References · 18
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2024The Power of Noise: Redefining Retrieval for RAG Systemscited by 275
- 2023GeoGalactica: A Scientific Large Language Model in Geosciencecited by 32
- 2024Rethinking Scanning Strategies with Vision Mamba in Semantic Segmentation of Remote Sensing Imagery: An Experimental Studycited by 24
- 2025Can ChatGPT implement finite element models for geotechnical engineering applications?cited by 5
- 2023Geotechnical Parrot Tales (GPT): Harnessing Large Language Models in geotechnical engineeringcited by 4
6 more
- 2023Future-proofing geotechnics workflows: accelerating problem-solving with large language modelscited by 4
- 2023Selection of contributing factors for predicting landslide susceptibility using machine learning and deep learning modelscited by 3
- 2024Enhancing Environmental Monitoring through Multispectral Imaging: The WasteMS Dataset for Semantic Segmentation of Lakeside Wastecited by 3
- 2024Classification of Geological Borehole Descriptions Using a Domain Adapted Large Language Modelcited by 2
- 2025Educational impacts of generative artificial intelligence on learning and performance of engineering students in Chinacited by 2
- 2025GeoSim.AI: AI assistants for numerical simulations in geomechanicscited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Geo-Expert: Towards Expert-Level Geological Reasoning via Parameter-Efficient Fine-Tuning
- 2025Prompt to Protection: A Comparative Study of Multimodal LLMs in Construction Hazard Recognition
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilities
- 2025NAACL2025 Tutorial: Adaptation of Large Language Models
- 2025Large model retrieval enhancement framework for construction site risk identification
- 2023ChipNeMo: Domain-Adapted LLMs for Chip Design
- 2024Responsible AI in Construction Safety: Systematic Evaluation of Large Language Models and Prompt Engineering
- 2025Domain Specific Benchmarks for Evaluating Multimodal Large Language Models