mlsanityData to 7 Oct 2026

Towards Automatic Support of Software Model Evolution with Large Language~Models

arXiv 2312.12404 ↗First posted 19 Dec 2023cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modeling structure and behavior of software systems plays a crucial role, in various areas of software engineering. As with other software engineering artifacts, software models are subject to evolution. Supporting modelers in evolving models by model completion facilities and providing high-level edit operations such as frequently occurring editing patterns is still an open problem. Recently, large language models (i.e., generative neural networks) have garnered significant attention in various research areas, including software engineering. In this paper, we explore the potential of large language models in supporting the evolution of software models in software engineering. We propose an approach that utilizes large language models for model completion and discovering editing patterns in model histories of software systems. Through controlled experiments using simulated model repositories, we conduct an evaluation of the potential of large language models for these two tasks. We have found that large language models are indeed a promising technology for supporting software model evolution, and that it is worth investigating further in the area of software model evolution.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 75 references that are in the map. First posted on arXiv 19 Dec 2023.

Builds on

14 of 75 references.

References · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2022A Systematic Evaluation of Large Language Models of Codecited by 360
  4. 2022A Short Tutorial on The Weisfeiler-Lehman Test And Its Variantscited by 52
  5. 2022What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Codecited by 50
  6. 2021Applying CodeBERT for Automated Program Repair of Java Simple Bugscited by 44
  7. 2021Choose Your Programming Copilot: A Comparison of the Program Synthesis Performance of GitHub Copilot and Genetic Programmingcited by 24
  8. 2021An Empirical Study on the Usage of Transformer Models for Code Completioncited by 22
  9. 2021Interpreting Language Models Through Knowledge Graph Extractioncited by 14
  10. 2021Recommending Metamodel Concepts during Modeling Activities with Pre-Trained Language Modelscited by 7
  11. 2021SLGPT: Using Transfer Learning to Directly Generate Simulink Model Files and Find Bugs in the Simulink Toolchaincited by 4
  12. 2021Learning Domain-Specific Edit Operations from Model Repositories with Frequent Subgraph Miningcited by 2
2 more
  1. 2015Systematically Deriving Domain-Specific Transformation Languagescited by 1
  2. 2022Can Language Models Capture Graph Semantics? From Graphs to Language Model and Vice-Versacited by 1

Built on by

Not cited yet.