Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Comparing Static and Dynamic Synchronization of GUI-based tests: An Industrial study
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.
2024 (English)Independent thesis Advanced level (degree of Master (One Year)), 12 credits / 18 HE creditsStudent thesis
Abstract [en]

Background. Speed is getting more and more critical in modern Software Engineering to be able to respond to users’ expectations of product development. One practice that takes a significant amount of time in the process of releasing software to the customers is testing. It is a clear trend that organizations are increasing the amount of test automation compared to manual testing. However, manual testing is still prominent in GUI-based testing due to challenges interacting with a GUI from test scripts. One of the most prominent challenges is synchronizing test script execution with the system under test. Objectives. This research aims to compare static and dynamic synchronization of GUI-based tests. This comparison will be conducted by replicating an existing Selenium test suite using static synchronization to Playwright, which will use dynamic synchronization and run the test suites against a web-based application. These test suites will then be used to compare the two types of synchronization from the perspective of test execution efficiency, test output correctness, and maintenance cost.Methods. The research methodology we chose is experiment. We have chosen Selenium to represent static synchronization and Playwright to represent dynamic synchronization. We used an existing test suite in Selenium that was translated into Playwright. There are a total of 81 tests in the test suite. The test suites were used to compare test scripts that use static and dynamic synchronization from the perspective of test execution efficiency, test output correctness, and maintenance cost.Results. The data collected from the experiments shows that execution efficiency for test scripts using dynamic synchronization is significantly faster than static synchronization. A mean difference between the test suites showed a decrease of 87%. For defect identification, ten defects where used and both test suites managed to identify all of them, resulting in no difference could be found. Test maintenance cost was found that test scripts using dynamic synchronization had a positive effect with an average of 60% less time spent on maintenance.Conclusions. Based on the result, we found that test scripts using dynamic synchronization improved execution efficiency and maintenance costs without sacrificing the test output correctness.

Place, publisher, year, edition, pages
2024. , p. 50
Keywords [en]
GUI testing, Synchronization, Test automation, Playwright, Selenium
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-25953OAI: oai:DiVA.org:bth-25953DiVA, id: diva2:1835799
Subject / course
PA2592 Research Methods and Master's Thesis (60 credits) in Software Engineering for Professionals
Educational program
PAASA Master's Programme in Software Engineering 60,0 hp
Presentation
2023-12-12, 15:00 (English)
Supervisors
Examiners
Available from: 2024-02-14 Created: 2024-02-07 Last updated: 2024-02-14Bibliographically approved

Open Access in DiVA

Comparing Static and Dynamic Synchronization of GUI-based tests: An Industrial study(300 kB)197 downloads
File information
File name FULLTEXT02.pdfFile size 300 kBChecksum SHA-512
5365cbc9af745aec8bdd75bc6191c8324334b55629f92613f4153f8cde2ca72d5f717ad0d5e325a0b8ddaf15f3370923d1b88308b7311b80dd4f402484fe4aa9
Type fulltextMimetype application/pdf

By organisation
Department of Software Engineering
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 197 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 596 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf