The importance of visual modelling languages in generative software engineering
Not on the map. Why?
Abstract (arXiv)
Multimodal GPTs represent a watershed in the interplay between Software Engineering and Generative Artificial Intelligence. GPT-4 accepts image and text inputs, rather than simply natural language. We investigate relevant use cases stemming from these enhanced capabilities of GPT-4. To the best of our knowledge, no other work has investigated similar use cases involving Software Engineering tasks carried out via multimodal GPTs prompted with a mix of diagrams and natural language.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 27 Nov 2024.
Builds on
25 of 37 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2022PAL: Program-aided Language Modelscited by 652
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 399
13 more
- 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 289
- 2021Generated Knowledge Prompting for Commonsense Reasoningcited by 214
- 2023ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generationcited by 168
- 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 95
- 2023Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)cited by 72
- 2023ChatGPT Prompt Patterns for Improving Code Quality, Refactoring, Requirements Elicitation, and Software Designcited by 66
- 2023Advancing Requirements Engineering through Generative AI: Assessing the Role of LLMscited by 42
- 2023Is AI the better programming partner? Human-Human Pair Programming vs. Human-AI pAIr Programmingcited by 20
- 2024Experimenting a New Programming Practice with LLMscited by 17
- 2023Large Language Models Based Automatic Synthesis of Software Specificationscited by 13
- 2024From Image to UML: First Results of Image Based UML Diagram Generation Using LLMscited by 11
- 2024How LLMs Aid in UML Modeling: An Exploratory Study with Novice Analystscited by 8
- 2017Sketches and Diagrams in Practicecited by 5
Built on by
Citing papers per year: 2025: 1.
1 paper.