Background: Test reports play a crucial role in software development as they not only report the current quality of the software but also guide development by presenting tasks and areas of improvement that can be added to the backlogs. Test reports act as a communication medium between different stakeholders and thus aid in overall decision-making processes. In the landscape of software testing, GUI tests stand out as a crucial component. Whether executed manually or automated, GUI tests meticulously scrutinize the appearance, functionality and usability of the interface thus ensuring a seamless user experience. It’s imperative to recognize the significance of test reports in this context. These reports serve as a conduit for communicating the results of GUI tests to developers and other stakeholders, providing valuable insights into the software’s performance and usability. In this research we design and evaluate the GUI test reports, leveraging the Scout software testing tool as our platform.

Objectives: This research aims to unify different GUI testing metrics while addressing the gaps in existing test reporting approaches for GUI based testing. While test reporting is well established for other types of testing such as unit, integration and performance testing, there is limited research on reporting techniques specificallyfor GUI testing. This research will explore different GUI test reporting techniques and methods to understand their effectiveness and usability in presenting and analyzing GUI test results. Test reports will be designed keeping in view the needs of key stakeholders such as developers, testers and users.

Methods: Literature review and Quasi-experiment were chosen to meet the goals of this research. Literature Review is conducted to explore past research on GUI test metrics to identify most effective and highly utilized metrics to be included in a GUI test report. Following the literature review, selected high valued metrics have been extracted from the Scout tool and created a GUI test report with these metrics and corresponding visualizations. Then experimentation methodology was used to evaluate the generated GUI test report by conducting interviews with seasoned testers and summarizing their feedback.

Results: Results strongly indicate that the test reports generated based on test metrics extracted from literature review would be of significant value in the industry. Overall the research achieves its aim of improving existing GUI test reports by adding most crucial test metrics and increasing the level of generalization they provide.

Conclusions: Generalized GUI test report generation with inclusion of crucial metrics. Evaluated these test reports by conducting a quasi-experimentation. Feedback from seasoned testers are positive along with some future scope of improvements.