The impact of a proposal for innovation measurement in the software industry
2020 (English)In: International Symposium on Empirical Software Engineering and Measurement, IEEE Computer Society, 2020, article id 3422163Conference paper, Published paper (Refereed)
Abstract [en]
Background: Measuring an organization's capability to innovate and assessing its innovation output and performance is a challenging task. Previously, a comprehensive model and a suite of measurements to support this task were proposed. Aims: In the current paper, seven years since the publication of the paper titled Towards innovation measurement in the software industry, we have reflected on the impact of thework. Method:We have mainly relied on quantitative and qualitative analysis of the citations of the paper using an established classification schema. Results: We found that the article has had a significant scientific impact (indicated by the number of citations), i.e., (1) cited in literature from both software engineering and other fields, (2) cited in grey literature and peerreviewed literature, and (3) substantial citations in literature not published in the English language. However, we consider a majority of the citations in the peer-reviewed literature (75 out of 116) as neutral, i.e., they have not used the innovation measurement paper in any substantial way. All in all, 38 out of 116 have used, modified or based their work on the definitions, measurements or the model proposed in the article. This analysis revealed a significant weakness of the citing work, i.e., among the citing papers, we found only two explicit comparisons to the innovation measurement proposal, and we found no papers that identify weaknesses of said proposal. Conclusions: This work highlights the need for being cautious of relying solely on the number of citations for understanding impact, and the need for further improving and supporting the peer-review process to identify unwarranted citations in papers. © 2020 IEEE Computer Society. All rights reserved.
Place, publisher, year, edition, pages
IEEE Computer Society, 2020. article id 3422163
Series
nternational Symposium on Empirical Software Engineering and Measurement, ISSN 1949-3770, E-ISSN 1949-3789
Keywords [en]
Citation analysis, Impact, Innovation, Measurement, Relevance, Capability to innovate, Comprehensive model, English languages, Grey literature, Innovation measurements, Peer-review process, Quantitative and qualitative analysis, Software industry, Software engineering
National Category
Information Studies Software Engineering
Identifiers
URN: urn:nbn:se:bth-20755DOI: 10.1145/3382494.3422163Scopus ID: 2-s2.0-85095827943ISBN: 9781450375801 (print)OAI: oai:DiVA.org:bth-20755DiVA, id: diva2:1502628
Conference
14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2020, Virtual, Online, Italy, 5 October 2020 through 7 October 2020
Note
open acess
2020-11-202020-11-202023-03-24Bibliographically approved