Open this publication in new window or tab >>Show others...
2025 (English)In: Empirical Software Engineering, ISSN 1382-3256, E-ISSN 1573-7616, Vol. 30, no 3, article id 79Article in journal (Refereed) Published
Abstract [en]
Context: Organizations opt for continuous delivery of incremental updates to deal with uncertainty and minimize waste. However, applying continuous engineering (CSE) practices requires a continuous feedback loop with input from customers and end-users.
Challenges: It becomes increasingly challenging to apply traditional requirements elicitation and validation techniques with ever-shrinking software delivery cycles. At the same time, frequent deliveries generate an abundance of usage data and telemetry informing engineering teams of end-user behavior. The literature describing how practitioners work with user feedback in CSE, is limited.
Objectives: We aim to explore the state of practice related to utilization of user feedback in CSE. Specifically, what practices are used, how, and the shortcomings of these practices.
Method: We conduct a qualitative survey and report analysis from 21 interviews in 13 product development companies. We apply thematic and cross-case analysis to interpret the data. Results: Based on our earlier work we suggest a conceptual model of how user feedback is utilized in CSE. We further report the identified challenges with the continuous collection and analysis of user feedback and identify implications for practice.
Conclusions: Companies use a combination of qualitative and quantitative methods to infer end-user preferences. At the same time, continuous collection, analysis, interpretation, and use of data in decisions are problematic. The challenges pertain to selecting the right metrics and analysis techniques, resource allocation, and difficulties in accessing vaguely defined user groups. Our advice to practitioners in CSE is to ensure sufficient resources and effort for interpretation of the feedback, which can be facilitated by telemetry dashboards.
Place, publisher, year, edition, pages
Springer, 2025
Keywords
Continuous experimentation, Continuous software engineering, Data-driven product development, Software product, User feedback, Resource allocation, Continuous software engineerings, Data driven, End-users, Incremental updates, Software products, State of practise, Uncertainty, Product development
National Category
Software Engineering
Identifiers
urn:nbn:se:bth-27662 (URN)10.1007/s10664-024-10557-2 (DOI)001439386100001 ()2-s2.0-86000339541 (Scopus ID)
Funder
Knowledge Foundation, 20180010The Research Council of NorwayKnowledge Foundation
2025-03-212025-03-212025-09-30Bibliographically approved