AI-Based Synthetic Users for Early-Stage UI/UX Validation
2026 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE credits
Student thesis
Abstract [en]
User Experience (UX) validation is an important step in digital product design, yet traditional human-led testing is often too resource-heavy to conduct during the early conceptual design phases. While "Shift-Left" economics heavily prefer early validation, existing automated solutions either rely on coded environments or utilize fully autonomous AI agents that generate machine-readable, unexplainable feedback, leading to a lack of designer trust. This thesis addressed these limitations by exploring how Generative Artificial Intelligence (GenAI) could be utilized to conduct early-stage usability testing. The aim was to design and evaluate an AI-based synthetic user framework capable of evaluating static UI/UX prototypes while prioritizing behavioral realism and designer trust over total autonomous scale. Following a Design Science Research (DSR) methodology, the artifact was iteratively developed over three prototype phases. Essentially, this prototype was developed not as a means initself but as a means to an end; i.e., it served as an exploratory framework to determine the extent to which GenAI can reliably execute UX validation. To prevent the Large Language Model (LLM) from defaulting to a generic technical assistant, the framework utilized parameter-free optimization. Specifically, advanced prompt engineering architectures (Intent, Domain, and Demand constraints combined with Chain-of-Thought) were combined with the 15-facet BFI-2 psychometric framework to force the AI to simulate subjective human traits and output actionable cognitive friction. Evaluation with a single domain expert, who also collaborated in the framework’s design, suggested that while synthetic users can successfully identify valid usability issues and build designer trust through transparent reasoning, they still show an inherent "rationality bias" and cannot fully replicate human unpredictability. The findings concluded that GenAI shows high potential as an early-stage, human-in-the-loop decision-support tool, but must complement rather than replace real human testing.
Place, publisher, year, edition, pages
2026. , p. 114
Keywords [en]
Synthetic users; UI/UX validation; Generative AI; Human-in-the-loop; Design Science Research
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-29575OAI: oai:DiVA.org:bth-29575DiVA, id: diva2:2063638
External cooperation
Strawberry Planet
Subject / course
Degree Project in Master of Science in Engineering 30,0 hp
Educational program
PAAMJ Master of Science in Engineering: Software Engineering 300,0 hp
Supervisors
Examiners
2026-06-222026-05-292026-06-22Bibliographically approved