Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
We Tried and Failed: An Experience Report on a Collaborative Workflow for GUI-based Testing
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.ORCID iD: 0000-0002-2916-4020
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.ORCID iD: 0000-0001-7526-3727
2023 (English)In: Proceedings - 2023 IEEE 16th International Conference on Software Testing, Verification and Validation Workshops, ICSTW, Institute of Electrical and Electronics Engineers (IEEE), 2023, p. 1-9Conference paper, Published paper (Refereed)
Abstract [en]

Modern software development is a team-based effort supported by tools, processes, and practices. One integral part is automated testing, where developers incorporate automated tests on multiple levels of system abstraction, from low-level unit tests to high-level system tests and Graphical User Interface (GUI) tests. Furthermore, the common practices of code reviews allow collaboration on artifacts based on discussions that improve the artifact's quality and to share information within the team. However, the characteristics of GUI-based tests, due to the level of abstraction and visual elements, introduce additional requirements and complexities compared to code or lower-level test code review, delimiting the practice benefits.The objective of this work is to propose a tool-supported workflow that enables active collaboration among stakeholders and improves the efficiency and effectiveness of team-based development of GUI-based tests.To evaluate the workflow, and show proof of concept, a technical demonstrator for merging of GUI-based tests was to be developed. However, during its development, we encountered several unforeseen challenges that forced us to halt its development. We report the negative results from this development and the main challenges we encountered, as well as the rationale and the decisions we took towards this workflow.In conclusion, this work presents a negative research result on a failed attempt to propose a tool-supported workflow that enables active collaboration on GUI-based tests. The outcome and learnings of this work are intended to guide future research and prevent researchers from falling into the same pitfalls we did. © 2023 IEEE.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2023. p. 1-9
Series
IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW, ISSN 2159-4848
Keywords [en]
automated testing, collaborative testing, collaborative workflow, GUI testing, model-based testing, Abstracting, Automation, Model checking, Software design, Software testing, Code review, Experience report, Graphical user interface testing, Integral part, Interface testings, Model based testing, Work-flows, Graphical user interfaces
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-25204DOI: 10.1109/ICSTW58534.2023.00015ISI: 001009223100001Scopus ID: 2-s2.0-85163117973ISBN: 9798350333350 (print)OAI: oai:DiVA.org:bth-25204DiVA, id: diva2:1785863
Conference
16th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2023, Dublin, 16 April through 20 April 2023
Part of project
SERT- Software Engineering ReThought, Knowledge Foundation
Funder
Knowledge Foundation, 20180010Available from: 2023-08-06 Created: 2023-08-06 Last updated: 2023-09-21Bibliographically approved
In thesis
1. Towards Collaborative GUI-based Testing
Open this publication in new window or tab >>Towards Collaborative GUI-based Testing
2023 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Context:Contemporary software development is a socio-technical activity requiring extensive collaboration among individuals with diverse expertise.

Software testing is an integral part of software development that also depends on various expertise.

GUI-based testing allows assessing a system’s GUI and its behavior through its graphical user interface.

Collaborative practices in software development, like code reviews, not only improve software quality but also promote knowledge exchange within teams.

Similar benefits could be extended to other areas of software engineering, such as GUI-based testing.

However, collaborative practices for GUI-based testing necessitate a unique approach since general software development practices, perceivably, can not be directly transferred to software testing.

Goal:This thesis contributes towards a tool-supported approach enabling collaborative GUI-based testing.

Our distinct goals are (1) to identify processes and guidelines to enable collaboration on GUI-based testing artifacts and (2) to operationalize tool support to aid this collaboration.

Method:We conducted a systematic literature review identifying code review guidelines for GUI-based testing.

Further, we conducted a controlled experiment to assess the efficiency and potential usability issues of Augmented Testing.

Results:We provided guidelines for reviewing GUI-based testing artifacts, which aid contributors and reviewers during code reviews.

We further provide empirical evidence that Augmented Testing is not only an efficient approach to GUI-based testing but also usable for non-technical users, making it a promising subject for further research in collaborative GUI-based testing.

Conclusion:Code review guidelines aid collaboration through discussions, and a suitable testing approach can serve as a platform to operationalize collaboration.

Collaborative GUI-based testing has the potential to improve the efficiency and effectiveness of such testing.

Place, publisher, year, edition, pages
Karlskrona, Sweden: Blekinge Tekniska Högskola, 2023
Series
Blekinge Institute of Technology Licentiate Dissertation Series, ISSN 1650-2140 ; 2023:10
Keywords
software testing, GUI testing, GUI-based testing, collaborative testing, code review
National Category
Software Engineering
Research subject
Systems Engineering
Identifiers
urn:nbn:se:bth-25392 (URN)978-91-7295-469-4 (ISBN)
Presentation
2023-11-01, J1630 + Zoom, BTH, Karlskrona, 13:00 (English)
Opponent
Supervisors
Available from: 2023-09-18 Created: 2023-09-18 Last updated: 2023-12-05Bibliographically approved

Open Access in DiVA

fulltext(827 kB)225 downloads
File information
File name FULLTEXT01.pdfFile size 827 kBChecksum SHA-512
2adbc5a02965b7a9527578dfeca5bb6db3ad84597416ba9670dbe05b3464af89a76fae1708805790d0d46c09c2f4e9970b51b00a43618c93d4ffb808da02a40c
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Bauer, AndreasAlégroth, Emil

Search in DiVA

By author/editor
Bauer, AndreasAlégroth, Emil
By organisation
Department of Software Engineering
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 230 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 285 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf