mlsanityData to 13 Oct 2026

Requirements Engineering for Machine Learning: Perspectives from Data Scientists

arXiv 1908.04674 ↗First posted 13 Aug 2019cs.LG cs.SEcited by 49

Not on the map. Why?

Abstract (arXiv)

Machine learning (ML) is used increasingly in real-world applications. In this paper, we describe our ongoing endeavor to define characteristics and challenges unique to Requirements Engineering (RE) for ML-based systems. As a first step, we interviewed four data scientists to understand how ML experts approach elicitation, specification, and assurance of requirements and expectations. The results show that changes in the development paradigm, i.e., from coding to training, also demands changes in RE. We conclude that development of ML systems demands requirements engineers to: (1) understand ML performance measures to state good functional requirements, (2) be aware of new quality requirements such as explainability, freedom from discrimination, or specific legal requirements, and (3) integrate ML specifics in the RE process. Our study provides a first contribution towards an RE methodology for ML systems.

Key facts. Cited by 49 papers in the map (data through 13 Oct 2026). First posted on arXiv 13 Aug 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2021: 10; 2022: 14; 2023: 12; 2024: 6; 2025: 4; 2026: 3.

49 papers.

Sort:

By area:

  1. 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 86
  2. 2021Software Engineering for AI-Based Systems: A Surveycited by 68
  3. 2021Collaboration Challenges in Building ML-Enabled Systems: Communication, Documentation, Engineering, and Processcited by 56
  4. 2022Evaluation Gaps in Machine Learning Practicecited by 48
  5. 2023A Meta-Summary of Challenges in Building Products with ML Components -- Collecting Experiences from 4758+ Practitionerscited by 22
  6. 2022Responsible AI Pattern Catalogue: A Collection of Best Practices for AI Governance and Engineeringcited by 20
  7. 2023A Synthesis of Green Architectural Tactics for ML-Enabled Systemscited by 17
  8. 2022Ergo, SMIRK is Safe: A Safety Case for a Machine Learning Component in a Pedestrian Automatic Emergency Brake Systemcited by 14
  9. 2022Management of Machine Learning Lifecycle Artifacts: A Surveycited by 13
  10. 2023SoK: Pragmatic Assessment of Machine Learning for Network Intrusion Detectioncited by 13
  11. 2022If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Componentscited by 11
  12. 2022Towards a Roadmap on Software Engineering for Responsible AIcited by 9
37 more
  1. 2023Beyond Testers' Biases: Guiding Model Testing with Knowledge Bases using LLMscited by 9
  2. 2022Quality issues in Machine Learning Software Systemscited by 7
  3. 2022Requirements Engineering for Machine Learning: A Review and Reflectioncited by 7
  4. 2023Tailoring Requirements Engineering for Responsible AIcited by 7
  5. 2023Requirements Engineering Framework for Human-centered Artificial Intelligence Software Systemscited by 7
  6. 2021Exploring the Assessment List for Trustworthy AI in the Context of Advanced Driver-Assistance Systemscited by 6
  7. 2024How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directionscited by 5
  8. 2021Quality Assurance Challenges for Machine Learning Software Applications During Software Development Life Cycle Phasescited by 4
  9. 2021Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebarscited by 4
  10. 2022A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systemscited by 4
  11. 2023An investigation of challenges encountered when specifying training data and runtime monitors for safety critical ML applicationscited by 4
  12. 2023Automotive Perception Software Development: An Empirical Investigation into Data, Annotation, and Ecosystem Challengescited by 4
  13. 2021Safety Case Templates for Autonomous Systemscited by 3
  14. 2021Test Automation with Grad-CAM Heatmaps -- A Future Pipe Segment in MLOps for Vision AI?cited by 3
  15. 2021Towards Risk Modeling for Collaborative AIcited by 3
  16. 2021Pairing Conceptual Modeling with Machine Learningcited by 3
  17. 2022Setting AI in context: A case study on defining the context and operational design domain for automated drivingcited by 3
  18. 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communicationscited by 3
  19. 2022RESAM: Requirements Elicitation and Specification for Deep-Learning Anomaly Models with Applications to UAV Flight Controllerscited by 3
  20. 2023The Value-Sensitive Conversational Agent Co-Design Frameworkcited by 3
  21. 2024Naming the Pain in Machine Learning-Enabled Systems Engineeringcited by 3
  22. 2024Innovating for Tomorrow: The Convergence of SE and Green AIcited by 3
  23. 2022Towards Perspective-Based Specification of Machine Learning-Enabled Systemscited by 2
  24. 2023MLTEing Models: Negotiating, Evaluating, and Documenting Model and System Qualitiescited by 2
  25. 2024Dealing with Data for RE: Mitigating Challenges while using NLP and Generative AIcited by 2
  26. 2025RBT4DNN: Requirements-based Testing of Neural Networkscited by 2
  27. 2021FedDICE: A ransomware spread detection in a distributed integrated clinical environment using federated learning and SDN based mitigationcited by 1
  28. 2022Guiding the retraining of convolutional neural networks against adversarial inputscited by 1
  29. 2025Towards Requirements Engineering for RAG Systemscited by 1
  30. 2026An Interactive Agent for Requirement-Driven Candidate Sourcingcited by 1
  31. 2023Best Practices for Machine Learning Systems: An Industrial Framework for Analysis and Optimizationcited by 0
  32. 2023Quality Issues in Machine Learning Software Systemscited by 0
  33. 2024Towards Scenario- and Capability-Driven Dataset Development and Evaluation: An Approach in the Context of Mapless Automated Drivingcited by 0
  34. 2025A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practicecited by 0
  35. 2025Data Requirement Goal Modeling for Machine Learning Systemscited by 0
  36. 2026Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AIcited by 0
  37. 2026Integrating High-Level Requirements to Low-Level Tests with Machine-Readable V&V Specificationscited by 0