A Multivariate Characterization and Detection of Software Performance AntipatternsShow others and affiliations
2021 (English)In: ICPE 2021 - Proceedings of the ACM/SPEC International Conference on Performance Engineering, Association for Computing Machinery, Inc , 2021, p. 61-72Conference paper, Published paper (Refereed)
Abstract [en]
Context. Software Performance Antipatterns (SPAs) research has focused on algorithms for the characterization, detection, and solution of antipatterns. However, existing algorithms are based on the analysis of runtime behavior to detect trends on several monitored variables (e.g., response time, CPU utilization, and number of threads) using pre-defined thresholds. Objective. In this paper, we introduce a new approach for SPA characterization and detection designed to support continuous integration/delivery/deployment (CI/CDD) pipelines, with the goal of addressing the lack of computationally efficient algorithms. Method. Our approach includes SPA statistical characterization using a multivariate analysis approach of load testing experimental results to identify the services that have the largest impact on system scalability. More specifically, we introduce a layered decomposition approach that implements statistical analysis based on response time to characterize load testing experimental results. A distance function is used to match experimental results to SPAs. Results. We have instantiated the introduced methodology by applying it to a large complex telecom system. We were able to automatically identify the top five services that are scalability choke points. In addition, we were able to automatically identify one SPA. We have validated the engineering aspects of our methodology and the expected benefits by means of a domain experts' survey. Conclusion. We contribute to the state-of-The-Art by introducing a novel approach to support computationally efficient SPA characterization and detection in large complex systems using performance testing results. We have compared the computational efficiency of the proposed approach with state-of-The-Art heuristics. We have found that the approach introduced in this paper grows linearly, which is a significant improvement over existing techniques. © 2021 ACM.
Place, publisher, year, edition, pages
Association for Computing Machinery, Inc , 2021. p. 61-72
Keywords [en]
multivariate analysis, software performance antipattern characterization, software performance antipattern detection, Computational efficiency, Response time (computer systems), Scalability, Computationally efficient, Continuous integrations, Decomposition approach, Engineering aspects, Large complex systems, Multivariate analysis approaches, Software performance, Statistical characterization, Multivariant analysis
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-21383DOI: 10.1145/3427921.3450246ISI: 000744413800007Scopus ID: 2-s2.0-85104556333ISBN: 9781450381949 (print)OAI: oai:DiVA.org:bth-21383DiVA, id: diva2:1553044
Conference
2021 ACM/SPEC International Conference on Performance Engineering, ICPE 2021, Virtual, Online, France; 19 April 2021 through 21 April 2021
Funder
EU, Horizon 2020, 825040
Note
open access
2021-05-072021-05-072022-02-11Bibliographically approved