Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Scalability testing automation using multivariate characterization and detection of software performance antipatterns
eSulab Solutions, USA.
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.ORCID iD: 0000-0002-7220-9570
Gran Sasso Science Institute, ITA.
Free University of Bozen-Bolzano, ITA.
Show others and affiliations
2022 (English)In: Journal of Systems and Software, ISSN 0164-1212, E-ISSN 1873-1228, Vol. 193, article id 111446Article in journal (Refereed) Published
Abstract [en]

Context: Software Performance Antipatterns (SPAs) research has focused on algorithms for their characterization, detection, and solution. Existing algorithms are based on the analysis of runtime behavior to detect trends on several monitored variables, such as system response time and CPU utilization. However, the lack of computationally efficient methods currently limits their integration into modern agile practices to detect SPAs in large scale systems. Objective: In this paper, we extended our previously proposed approach for the automated SPA characterization and detection designed to support continuous integration/delivery/deployment (CI/CDD) pipelines, with the goal of addressing the lack of computationally efficient algorithms. Method: We introduce a machine learning-based approach to improve the detection of SPA and interpretation of approach's results. The approach is complemented with a simulation-based methodology to analyze different architectural alternatives and measure the precision and recall of our approach. Our approach includes SPA statistical characterization using a multivariate analysis of load testing experimental results to identify the services that have the largest impact on system scalability. Results: To show the effectiveness of our approach, we have applied it to a large complex telecom system at Ericsson. We have built a simulation model of the Ericsson system and we have evaluated the introduced methodology by using simulation-based SPA injection. For this system, we are able to automatically identify the top five services that represent scalability choke points. We applied two machine learning algorithms for the automated detection of SPA. Conclusion: We contributed to the state-of-the-art by introducing a novel approach to support computationally efficient SPA characterization and detection that has been applied to a large complex system using performance testing data. We have compared the computational efficiency of the proposed approach with state-of-the-art heuristics. We have found that the approach introduced in this paper grows linearly, which is a significant improvement over existing techniques. © 2022 Elsevier Inc.

Place, publisher, year, edition, pages
Elsevier, 2022. Vol. 193, article id 111446
Keywords [en]
Characterization, Detection, Multivariate analysis, Software Performance Antipatterns, Automation, Computational efficiency, Large scale systems, Learning algorithms, Load testing, Machine learning, Multivariant analysis, Software testing, Anti-patterns, Computationally efficient, Ericsson, Multi variate analysis, Software performance, Software performance antipattern, State of the art, Testing automation, Scalability
National Category
Computer Systems
Identifiers
URN: urn:nbn:se:bth-23535DOI: 10.1016/j.jss.2022.111446ISI: 000967989300011Scopus ID: 2-s2.0-85135348448OAI: oai:DiVA.org:bth-23535DiVA, id: diva2:1687058
Available from: 2022-08-12 Created: 2022-08-12 Last updated: 2023-05-08Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Britto, Ricardo

Search in DiVA

By author/editor
Britto, Ricardo
By organisation
Department of Software Engineering
In the same journal
Journal of Systems and Software
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 183 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf