Many bioinformatics programming tasks can be automated with ChatGPT
Not on the map. Why?
Abstract (arXiv)
Computer programming is a fundamental tool for life scientists, allowing them to carry out many essential research tasks. However, despite a variety of educational efforts, learning to write code can be a challenging endeavor for both researchers and students in life science disciplines. Recent advances in artificial intelligence have made it possible to translate human-language prompts to functional code, raising questions about whether these technologies can aid (or replace) life scientists' efforts to write code. Using 184 programming exercises from an introductory-bioinformatics course, we evaluated the extent to which one such model -- OpenAI's ChatGPT -- can successfully complete basic- to moderate-level programming tasks. On its first attempt, ChatGPT solved 139 (75.5%) of the exercises. For the remaining exercises, we provided natural-language feedback to the model, prompting it to try different approaches. Within 7 or fewer attempts, ChatGPT solved 179 (97.3%) of the exercises. These findings have important implications for life-sciences research and education. For many programming tasks, researchers no longer need to write code from scratch. Instead, machine-learning models may produce usable solutions. Instructors may need to adapt their pedagogical approaches and assessment techniques to account for these new capabilities that are available to the general public.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Mar 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 7; 2024: 3; 2025: 2.
12 papers.
- 2023The Robots are Here: Navigating the Generative AI Revolution in Computing Educationcited by 86
- 2023CodeHelp: Using Large Language Models with Guardrails for Scalable Support in Programming Classescited by 72
- 2023Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Coursescited by 39
- 2023Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectivescited by 16
- 2024Large Language Models in Computer Science Education: A Systematic Literature Reviewcited by 13
- 2024ELEMENTAL: Interactive Learning from Demonstrations and Vision-Language Models for Reward Design in Roboticscited by 8
- 2023Humans are Still Better than ChatGPT: Case of the IEEEXtreme Competitioncited by 5
- 2023Exploring the Potential of Large Language Models in Generating Code-Tracing Questions for Introductory Programming Coursescited by 3
- 2023GenSpectrum Chat: Data Exploration in Public Health Using Large Language Modelscited by 2
- 2024An investigation into the scientific landscape of the conversational and generative artificial intelligence, and human-chatbot interaction in education and researchcited by 0
- 2025BioPars: A Pretrained Biomedical Large Language Model for Persian Biomedical Text Miningcited by 0
- 2025Generative Artificial Intelligence in Bioinformatics: A Systematic Review of Models, Applications, and Methodological Advancescited by 0
- 2025Generative Artificial Intelligence in Bioinformatics: A Systematic Review of Models, Applications, and Methodological Advances5 Nov 2025
- 2025BioPars: A Pretrained Biomedical Large Language Model for Persian Biomedical Text Mining12 Jun 2025
- 2024ELEMENTAL: Interactive Learning from Demonstrations and Vision-Language Models for Reward Design in Robotics27 Nov 2024
- 2024Large Language Models in Computer Science Education: A Systematic Literature Review21 Oct 2024
- 2024An investigation into the scientific landscape of the conversational and generative artificial intelligence, and human-chatbot interaction in education and research15 Jun 2024
- 2023Exploring the Potential of Large Language Models in Generating Code-Tracing Questions for Introductory Programming Courses23 Oct 2023
- 2023The Robots are Here: Navigating the Generative AI Revolution in Computing Education1 Oct 2023
- 2023CodeHelp: Using Large Language Models with Guardrails for Scalable Support in Programming Classes14 Aug 2023
- 2023Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectives30 Jun 2023
- 2023Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses15 Jun 2023
- 2023GenSpectrum Chat: Data Exploration in Public Health Using Large Language Models23 May 2023
- 2023Humans are Still Better than ChatGPT: Case of the IEEEXtreme Competition10 May 2023