Identifying concerns when specifying machine learning-enabled systems: A perspective-based approach
2024 (English)In: Journal of Systems and Software, ISSN 0164-1212, E-ISSN 1873-1228, Vol. 213, article id 112053Article in journal (Refereed) Published
Abstract [en]
Engineering successful machine learning (ML)-enabled systems poses various challenges from both a theoretical and a practical side. Among those challenges are how to effectively address unrealistic expectations of ML capabilities from customers, managers and even other team members, and how to connect business value to engineering and data science activities composed by interdisciplinary teams. In this paper, we present PerSpecML, a perspective-based approach for specifying ML-enabled systems that helps practitioners identify which attributes, including ML and non-ML components, are important to contribute to the overall system's quality. The approach involves analyzing 60 concerns related to 28 tasks that practitioners typically face in ML projects, grouping them into five perspectives: system objectives, user experience, infrastructure, model, and data. Together, these perspectives serve to mediate the communication between business owners, domain experts, designers, software and ML engineers, and data scientists. The creation of PerSpecML involved a series of formative evaluations conducted in different contexts: (i) in academia, (ii) with industry representatives, and (iii) in two real industrial case studies. As a result of the diverse validations and continuous improvements, PerSpecML stands as a promising approach, poised to positively impact the specification of ML-enabled systems, particularly helping to reveal key components that would have been otherwise missed without using PerSpecML. Editor's note: Open Science material was validated by the Journal of Systems and Software Open Science Board. © 2024 Elsevier Inc.
Place, publisher, year, edition, pages
Elsevier, 2024. Vol. 213, article id 112053
Keywords [en]
Case study, Machine learning-enabled systems, Requirements engineering, Technology transfer, Engineering education, Human resource management, Business value, Case-studies, Customer managers, Learning capabilities, Machine learning-enabled system, Machine-learning, Open science, Requirement engineering, Science activities, Team members, Machine learning
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-26129DOI: 10.1016/j.jss.2024.112053ISI: 001234407600001Scopus ID: 2-s2.0-85190070620OAI: oai:DiVA.org:bth-26129DiVA, id: diva2:1853669
2024-04-232024-04-232024-06-18Bibliographically approved