# How LLMs Aid in UML Modeling: An Exploratory Study with Novice Analysts

arXiv: https://arxiv.org/abs/2404.17739 · HTML: https://mlsanity.com/paper/2404.17739/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 Apr 2024.

## Built on by (most cited first, 8 of 8)

- [ModiGen: A Large Language Model-Based Workflow for Multi-Task Modelica Code Generation](https://mlsanity.com/paper/2503.18460/) (2025)
- [On the Utility of Domain Modeling Assistance with Large Language Models](https://mlsanity.com/paper/2410.12577/) (2024)
- [MermaidSeqBench: An Evaluation Benchmark for NL-to-Mermaid Sequence Diagram Generation](https://mlsanity.com/paper/2511.14967/) (2025)
- [Assessing LLMs for Front-end Software Architecture Knowledge](https://mlsanity.com/paper/2502.19518/) (2025)
- [Leveraging Large Language Models for Use Case Model Generation from Software Requirements](https://mlsanity.com/paper/2511.09231/) (2025)
- [NOMAD: A Multi-Agent LLM System for UML Class Diagram Generation from Natural Language Requirements](https://mlsanity.com/paper/2511.22409/) (2025)
- [The importance of visual modelling languages in generative software engineering](https://mlsanity.com/paper/2411.17976/) (2024)
- [Automated Feedback on Student-Generated UML and ER Diagrams Using Large Language Models](https://mlsanity.com/paper/2507.23470/) (2025)

## Abstract (arXiv)

Since the emergence of GPT-3, Large Language Models (LLMs) have caught the eyes of researchers, practitioners, and educators in the field of software engineering. However, there has been relatively little investigation regarding the performance of LLMs in assisting with requirements analysis and UML modeling. This paper explores how LLMs can assist novice analysts in creating three types of typical UML models: use case models, class diagrams, and sequence diagrams. For this purpose, we designed the modeling tasks of these three UML models for 45 undergraduate students who participated in a requirements modeling course, with the help of LLMs. By analyzing their project reports, we found that LLMs can assist undergraduate students as novice analysts in UML modeling tasks, but LLMs also have shortcomings and limitations that should be considered when using them.