Open this publication in new window or tab >>2025 (English)In: International Symposium on Empirical Software Engineering and Measurement, IEEE Computer Society, 2025, p. 505-507Conference paper, Published paper (Refereed)
Abstract [en]
Background: As Large Language Models (LLMs) reshape software development across industries, they also reshape the associated threat landscape. Traditional threat modeling methods, which assume predictable system behavior, struggle to accommodate the inherent nondeterminism of LLMs. Paradoxically, LLMs themselves offer capabilities, such as pattern recognition, natural language understanding, and semi-structured reasoning, that can support the automation of threat elicitation and mitigation.
Aims: This research project, ThreMoLIA, aims to design, develop, and empirically evaluate a threat modeling tool that leverages LLMs to assist practitioners in identifying and analyzing security threats in LLM-integrated applications (LIAs).
Method: To this end, we apply a mixed-methods exploratory case study to define and validate threat modeling metrics, and a comparative case study to evaluate the ThreMoLIA tool against existing threat modeling practices.
Results: The current prototype of the ThreMoLIA tool uses cloud or local models. We have established, and partiallyvalidated, a measurement framework and a benchmark for the tool evaluation.
Conclusions: The project is conducted in close collaboration with industry and contributes to the ESEM community by advancing Security-by-Design practices and sharing reproducible artifacts such as metrics, benchmarks, and threat models.
Place, publisher, year, edition, pages
IEEE Computer Society, 2025
Series
International Symposium on Empirical Software Engineering and Measurement, ISSN 1949-3770, E-ISSN 1949-3789
Keywords
AI4SE, SE4AI, Secure Software Engineering, Security-by-Design, Threat Modeling, Application programs, Modeling languages, Pattern recognition, Integrated applications, Language model, Model method, Non Determinism, System behaviors, Software design
National Category
Software Engineering
Identifiers
urn:nbn:se:bth-29288 (URN)10.1109/ESEM64174.2025.00068 (DOI)2-s2.0-105032676580 (Scopus ID)9798331591472 (ISBN)
Conference
2025 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2025, Honolulu, Oct 2-3, 2025
2026-03-272026-03-272026-03-27Bibliographically approved