Requirements Engineering for ML-Enabled Systems: Status Quo and Problems
2024 (English)In: ACM International Conference Proceeding Series, Association for Computing Machinery (ACM), 2024, p. 697-699Conference paper, Published paper (Refereed)
Abstract [en]
Machine Learning (ML) systems are increasingly common in companies seeking to improve products and processes. While literature suggests that Requirements Engineering (RE) can address challenges in ML-enabled systems, most empirical studies are isolated and lack generalizability. The goal of this dissertation is to enhance the empirical evidence on the intersection of RE and ML-enabled systems. For this purpose, we conducted an international survey with 188 respondents from 25 countries, using statistical and qualitative analyses to explore RE practices and challenges in ML projects. Our key findings include: (i) project leaders and data scientists primarily handle RE activities, (ii) interactive Notebooks are the dominant documentation format, (iii) data quality, model reliability, and explainability are the main non-functional requirements, (iv) challenges when developing such systems include managing customer expectations and aligning requirements with data, and (v) the main problems practitioners face are related to lack of business domain understanding, unclear goals and requirements, and low customer engagement. These results give us a wider picture of the adopted practices and the challenges in industrial scenarios. We put forward the need to adapt further and disseminate RE-related practices for engineering high-quality ML-enabled systems.
Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2024. p. 697-699
Keywords [en]
Machine Learning, Requirements Engineering, Survey, Data reliability, Empirical studies, Engineering challenges, Engineering learning, International survey, Machine learning systems, Machine-learning, Qualitative analysis, Requirement engineering, Status quo, System status
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-27443DOI: 10.1145/3701625.3701697ISI: 001447433100070Scopus ID: 2-s2.0-85216246463ISBN: 9798400717772 (print)OAI: oai:DiVA.org:bth-27443DiVA, id: diva2:1936445
Conference
23rd Brazilian Symposium on Software Quality, SBQS2024, Salvador, Nov 5-8, 2024
2025-02-112025-02-112025-09-30Bibliographically approved