Requirements Engineering for Machine Learning: Perspectives from Data Scientists
Not on the map. Why?
Abstract (arXiv)
Machine learning (ML) is used increasingly in real-world applications. In this paper, we describe our ongoing endeavor to define characteristics and challenges unique to Requirements Engineering (RE) for ML-based systems. As a first step, we interviewed four data scientists to understand how ML experts approach elicitation, specification, and assurance of requirements and expectations. The results show that changes in the development paradigm, i.e., from coding to training, also demands changes in RE. We conclude that development of ML systems demands requirements engineers to: (1) understand ML performance measures to state good functional requirements, (2) be aware of new quality requirements such as explainability, freedom from discrimination, or specific legal requirements, and (3) integrate ML specifics in the RE process. Our study provides a first contribution towards an RE methodology for ML systems.
Key facts. Cited by 49 papers in the map (data through 13 Oct 2026). First posted on arXiv 13 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 14; 2023: 12; 2024: 6; 2025: 4; 2026: 3.
49 papers.
Sort:
By area:
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
- 2021Software Engineering for AI-Based Systems: A Surveycited by 68
- 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
- 2022Evaluation Gaps in Machine Learning Practicecited by 48
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
- 2022Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineeringcited by 20
- 2023A Synthesis of Green Architectural Tactics for ML-Enabled Systemscited by 17
- 2022Ergo, SMIRK is Safe: A Safety Case for a Machine Learning Component in a Pedestrian Automatic Emergency Brake Systemcited by 14
- 2022Management of Machine Learning Lifecycle Artifacts: A Surveycited by 13
- 2023SoK: Pragmatic Assessment of Machine Learning for Network Intrusion Detectioncited by 13
- 2022If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Componentscited by 11
- 2022Towards a Roadmap on Software Engineering for Responsible AIcited by 9
37 more
- 2023Beyond Testers' Biases: Guiding Model Testing with Knowledge Bases using LLMscited by 9
- 2022Quality issues in Machine Learning Software Systemscited by 7
- 2022Requirements Engineering for Machine Learning: A Review and Reflectioncited by 7
- 2023Tailoring Requirements Engineering for Responsible AIcited by 7
- 2023Requirements Engineering Framework for Human-centered Artificial Intelligence Software Systemscited by 7
- 2021Exploring the Assessment List for Trustworthy AI in the Context of Advanced Driver-Assistance Systemscited by 6
- 2024How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directionscited by 5
- 2021Quality Assurance Challenges for Machine Learning Software Applications During Software Development Life Cycle Phasescited by 4
- 2021Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebarscited by 4
- 2022A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systemscited by 4
- 2023An investigation of challenges encountered when specifying training data and runtime monitors for safety critical ML applicationscited by 4
- 2023Automotive Perception Software Development: An Empirical Investigation into Data, Annotation, and Ecosystem Challengescited by 4
- 2021Safety Case Templates for Autonomous Systemscited by 3
- 2021Test Automation with Grad-CAM Heatmaps -- A Future Pipe Segment in MLOps for Vision AI?cited by 3
- 2021Towards Risk Modeling for Collaborative AIcited by 3
- 2021Pairing Conceptual Modeling with Machine Learningcited by 3
- 2022Setting AI in context: A case study on defining the context and operational design domain for automated drivingcited by 3
- 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communicationscited by 3
- 2022RESAM: Requirements Elicitation and Specification for Deep-Learning Anomaly Models with Applications to UAV Flight Controllerscited by 3
- 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
- 2024Naming the Pain in Machine Learning-Enabled Systems Engineeringcited by 3
- 2024Innovating for Tomorrow: The Convergence of SE and Green AIcited by 3
- 2022Towards Perspective-Based Specification of Machine Learning-Enabled Systemscited by 2
- 2023MLTEing Models: Negotiating, Evaluating, and Documenting Model and System Qualitiescited by 2
- 2024Dealing with Data for RE: Mitigating Challenges while using NLP and Generative AIcited by 2
- 2025RBT4DNN: Requirements-based Testing of Neural Networkscited by 2
- 2021FedDICE: A ransomware spread detection in a distributed integrated clinical environment using federated learning and SDN based mitigationcited by 1
- 2022Guiding the retraining of convolutional neural networks against adversarial inputscited by 1
- 2025Towards Requirements Engineering for RAG Systemscited by 1
- 2026An Interactive Agent for Requirement-Driven Candidate Sourcingcited by 1
- 2023Best Practices for Machine Learning Systems: An Industrial Framework for Analysis and Optimizationcited by 0
- 2023Quality Issues in Machine Learning Software Systemscited by 0
- 2024Towards Scenario- and Capability-Driven Dataset Development and Evaluation: An Approach in the Context of Mapless Automated Drivingcited by 0
- 2025A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practicecited by 0
- 2025Data Requirement Goal Modeling for Machine Learning Systemscited by 0
- 2026Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AIcited by 0
- 2026Integrating High-Level Requirements to Low-Level Tests with Machine-Readable V&V Specificationscited by 0
- 2026An Interactive Agent for Requirement-Driven Candidate Sourcing24 Aug 2026
- 2026Integrating High-Level Requirements to Low-Level Tests with Machine-Readable V&V Specifications20 Jul 2026
- 2026Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AI19 Jul 2026
- 2025Towards Requirements Engineering for RAG Systems12 May 2025
- 2025Data Requirement Goal Modeling for Machine Learning Systems10 Apr 2025
- 2025RBT4DNN: Requirements-based Testing of Neural Networks3 Apr 2025
- 2025A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice1 Mar 2025
- 2024How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directions11 Sep 2024
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future5 Aug 2024
- 2024Innovating for Tomorrow: The Convergence of SE and Green AI26 Jun 2024
- 2024Naming the Pain in Machine Learning-Enabled Systems Engineering20 May 2024
- 2024Towards Scenario- and Capability-Driven Dataset Development and Evaluation: An Approach in the Context of Mapless Automated Driving30 Apr 2024
37 more
- 2024Dealing with Data for RE: Mitigating Challenges while using NLP and Generative AI26 Feb 2024
- 2023A Synthesis of Green Architectural Tactics for ML-Enabled Systems15 Dec 2023
- 2023The Value-Sensitive Conversational Agent Co-Design Framework18 Oct 2023
- 2023Beyond Testers' Biases: Guiding Model Testing with Knowledge Bases using LLMs14 Oct 2023
- 2023Quality Issues in Machine Learning Software Systems26 Jun 2023
- 2023Best Practices for Machine Learning Systems: An Industrial Framework for Analysis and Optimization9 Jun 2023
- 2023SoK: Pragmatic Assessment of Machine Learning for Network Intrusion Detection30 Apr 2023
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitioners31 Mar 2023
- 2023Automotive Perception Software Development: An Empirical Investigation into Data, Annotation, and Ecosystem Challenges10 Mar 2023
- 2023Requirements Engineering Framework for Human-centered Artificial Intelligence Software Systems6 Mar 2023
- 2023MLTEing Models: Negotiating, Evaluating, and Documenting Model and System Qualities3 Mar 2023
- 2023Tailoring Requirements Engineering for Responsible AI21 Feb 2023
- 2023An investigation of challenges encountered when specifying training data and runtime monitors for safety critical ML applications31 Jan 2023
- 2022A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systems27 Dec 2022
- 2022Management of Machine Learning Lifecycle Artifacts: A Survey21 Oct 2022
- 2022Requirements Engineering for Machine Learning: A Review and Reflection3 Oct 2022
- 2022Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineering12 Sep 2022
- 2022Quality issues in Machine Learning Software Systems18 Aug 2022
- 2022RESAM: Requirements Elicitation and Specification for Deep-Learning Anomaly Models with Applications to UAV Flight Controllers18 Jul 2022
- 2022Guiding the retraining of convolutional neural networks against adversarial inputs8 Jul 2022
- 2022Towards Perspective-Based Specification of Machine Learning-Enabled Systems20 Jun 2022
- 2022Evaluation Gaps in Machine Learning Practice11 May 2022
- 2022Ergo, SMIRK is Safe: A Safety Case for a Machine Learning Component in a Pedestrian Automatic Emergency Brake System16 Apr 2022
- 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communications30 Mar 2022
- 2022Towards a Roadmap on Software Engineering for Responsible AI9 Mar 2022
- 2022If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Components8 Feb 2022
- 2022Setting AI in context: A case study on defining the context and operational design domain for automated driving27 Jan 2022
- 2021Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebars28 Nov 2021
- 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Process19 Oct 2021
- 2021Pairing Conceptual Modeling with Machine Learning27 Jun 2021
- 2021FedDICE: A ransomware spread detection in a distributed integrated clinical environment using federated learning and SDN based mitigation9 Jun 2021
- 2021Software Engineering for AI-Based Systems: A Survey5 May 2021
- 2021Quality Assurance Challenges for Machine Learning Software Applications During Software Development Life Cycle Phases3 May 2021
- 2021Towards Risk Modeling for Collaborative AI12 Mar 2021
- 2021Exploring the Assessment List for Trustworthy AI in the Context of Advanced Driver-Assistance Systems4 Mar 2021
- 2021Test Automation with Grad-CAM Heatmaps -- A Future Pipe Segment in MLOps for Vision AI?2 Mar 2021
- 2021Safety Case Templates for Autonomous Systems29 Jan 2021
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
- 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
- 2026An Interactive Agent for Requirement-Driven Candidate Sourcingcited by 1
- 2026Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AIcited by 0
- 2026An Interactive Agent for Requirement-Driven Candidate Sourcing24 Aug 2026
- 2026Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AI19 Jul 2026
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future5 Aug 2024
- 2023The Value-Sensitive Conversational Agent Co-Design Framework18 Oct 2023
- 2025Towards Requirements Engineering for RAG Systemscited by 1
- 2025Towards Requirements Engineering for RAG Systems12 May 2025
- 2021Software Engineering for AI-Based Systems: A Surveycited by 68
- 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
- 2022Evaluation Gaps in Machine Learning Practicecited by 48
- 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
- 2022Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineeringcited by 20
- 2023A Synthesis of Green Architectural Tactics for ML-Enabled Systemscited by 17
- 2022Ergo, SMIRK is Safe: A Safety Case for a Machine Learning Component in a Pedestrian Automatic Emergency Brake Systemcited by 14
- 2022Management of Machine Learning Lifecycle Artifacts: A Surveycited by 13
- 2023SoK: Pragmatic Assessment of Machine Learning for Network Intrusion Detectioncited by 13
- 2022If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Componentscited by 11
- 2022Towards a Roadmap on Software Engineering for Responsible AIcited by 9
- 2023Beyond Testers' Biases: Guiding Model Testing with Knowledge Bases using LLMscited by 9
12 most cited of 44 All 44 (JSON)
- 2026Integrating High-Level Requirements to Low-Level Tests with Machine-Readable V&V Specifications20 Jul 2026
- 2025Data Requirement Goal Modeling for Machine Learning Systems10 Apr 2025
- 2025RBT4DNN: Requirements-based Testing of Neural Networks3 Apr 2025
- 2025A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice1 Mar 2025
- 2024How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directions11 Sep 2024
- 2024Innovating for Tomorrow: The Convergence of SE and Green AI26 Jun 2024
- 2024Naming the Pain in Machine Learning-Enabled Systems Engineering20 May 2024
- 2024Towards Scenario- and Capability-Driven Dataset Development and Evaluation: An Approach in the Context of Mapless Automated Driving30 Apr 2024
- 2024Dealing with Data for RE: Mitigating Challenges while using NLP and Generative AI26 Feb 2024
- 2023A Synthesis of Green Architectural Tactics for ML-Enabled Systems15 Dec 2023
- 2023Beyond Testers' Biases: Guiding Model Testing with Knowledge Bases using LLMs14 Oct 2023
- 2023Quality Issues in Machine Learning Software Systems26 Jun 2023
12 newest of 44 All 44 (JSON)