Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Differences between approaches to visual regression testing
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.
2025 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

Background: Testing is an important part of developing a software project, and when the project is under continuous development, regression testing is an important part of that testing. Regression testing the logic of the software project is not that different from normal testing of the logic. Making sure that there are no unintended changes or visual faults in the UI is more complicated, and that is where visual regression testing can be used.

Objectives: The objective of this thesis is to document different approaches to visual regression testing. This includes documenting the most supported approaches to visual regression testing and their strengths and weaknesses. As well as testing how well these approaches would hold up to real-world use.

Methods: To accomplish this, two different literature reviews and an experiment were conducted. The first literature review is to determine which approaches are the most supported both in academia and in the industry. The second literary review is to determine the strengths and weaknesses of the most supported approaches. The experiment then consists of testing tools representing each approach on websites in high contrast mode to determine how many visual faults they can detect compared to manual detection.

Results. The two literature reviews resulted in the identification of three different approaches: Pixel to pixel comparison, AI comparison, and DOM comparison, with strengths and weaknesses for each, such as “Pixel to pixel comparisons” and DOM comparisons weakness in returning false positives. While one of AI comparison strengths was its reduced number of false positives. The result from the experiment was that none of the tools performed as well as manual detection, with both Pixel to pixel comparison and AI comparison returning a lot of false positives, while DOMcomparison did not identify a single fault.

Conclusions. The conclusion for this thesis is that the different approaches are best used in different projects based on the environment, and that DOM comparison is not suitable for visual regression testing on websites in high contrast mode.

Place, publisher, year, edition, pages
2025. , p. 27
Keywords [en]
Visual regression testing, Pixel to pixel comparison, AI comparison, DOMcomparison, high contrast mode
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:bth-28160OAI: oai:DiVA.org:bth-28160DiVA, id: diva2:1974002
Subject / course
PA1445 Kandidatkurs i Programvaruteknik
Educational program
PAGPT Software Engineering
Supervisors
Examiners
Available from: 2025-06-23 Created: 2025-06-20 Last updated: 2025-09-30Bibliographically approved

Open Access in DiVA

No full text in DiVA

Search in DiVA

By author/editor
Askenmalm, Albert
By organisation
Department of Software Engineering
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 175 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf