Change search
Link to record
Permanent link

Direct link
Publications (4 of 4) Show all publications
Moyon, F., Angermeir, F., Mendez, D., Gorschek, T., Voggenreiter, M. & Bonvin, P.-L. (2026). Aligning security compliance and DevOps: a longitudinal study. Journal of Systems and Software, 234, Article ID 112718.
Open this publication in new window or tab >>Aligning security compliance and DevOps: a longitudinal study
Show others...
2026 (English)In: Journal of Systems and Software, ISSN 0164-1212, E-ISSN 1873-1228, Vol. 234, article id 112718Article in journal (Refereed) Published
Abstract [en]

Companies adopt agile methodologies and DevOps to facilitate efficient development and deployment of software-intensive products. This, in turn, introduces challenges in relation to security standard compliance traditionally following a more linear workflow. This is especially a challenge for the engineering of products and services associated with critical infrastructures. To support companies in their transition towards DevOps, this paper presents an adaptation of DevOps according to security regulations and standards. We report on our longitudinal study at Siemens AG, consisting of several individual sub-studies in the inception, validation, and initial adoption of our framework based on RefA as well as the implications for practice. RefA is a prescriptive model of a security compliant DevOps lifecycle based on the IEC 62443-4-1 standard. The overall framework is aimed at professionals, not only security experts, being able to use it on implementing DevOps processes while remaining compliant with security norms. We demonstrate how RefA facilitates the transfer of security compliance knowledge to product development teams. This knowledge transfer supports the agility aim of ensuring that cross-functional teams have all the skills needed to deliver the compliant products.

Place, publisher, year, edition, pages
Elsevier, 2026
Keywords
DevSecOps, DevOps, Continuous security compliance, Continuous software engineering, Security standards compliance, Secure software engineering
National Category
Software Engineering
Identifiers
urn:nbn:se:bth-29024 (URN)10.1016/j.jss.2025.112718 (DOI)001642456100001 ()2-s2.0-105024862156 (Scopus ID)
Available from: 2026-01-02 Created: 2026-01-02 Last updated: 2026-01-02Bibliographically approved
Elahidoost, P., Villamizar, H., Angermeir, F., Streit, J., Mendez, D., Unterkalmsteiner, M. & Gorschek, T. (2026). Investigating automated change analysis in FinTech regulations. Information and Software Technology, 195, Article ID 108144.
Open this publication in new window or tab >>Investigating automated change analysis in FinTech regulations
Show others...
2026 (English)In: Information and Software Technology, ISSN 0950-5849, E-ISSN 1873-6025, Vol. 195, article id 108144Article in journal (Refereed) Published
Abstract [en]

Context: Software systems in regulated domains must continually adapt to legal changes, yet practitioners often handle updates manually with limited support, making compliance work costly and error prone. Recent advances in LLMs prompt the question of how automation can reliably assist this process.

Objectives: We aim to (1) characterize the nature of regulatory changes and derive a systematic taxonomy, (2) understand through the lens of practitioners where automation is most useful, and (3) assess the feasibility of using LLMs for detecting and classifying regulatory changes.

Method: We conducted a mixed-methods study grounded in the German social security (DEÜV) in collaboration with practitioners from a FinTech company. First, we developed a taxonomy of regulatory changes through manual document analysis of four Regulatory Implementation Specifications (RIS), followed by a workshop and expert interviews. Second, we validated the taxonomy and elicited challenges through semi-structured practitioner interviews. Third, we built a gold-standard dataset of 93 annotated change instances and evaluated seven state-of-the-art LLMs within an automated detection and classification pipeline.

Results: The taxonomy defines five change scopes and four optional context dimensions. Practitioners found it intuitive and useful for filtering relevant changes, particularly Data and Field updates, but reported challenges such as tight deadlines, legal ambiguity, limited traceability, and overlapping categories. In automation, proprietary LLMs performed best, while performance dropped on narrative or weakly structured documents, highlighting sensitivity to document format.

Conclusion: The proposed taxonomy provides a practical lens for organizing regulatory change information, and LLMs can support the identification and classification of recurring, structurally explicit changes. Their limitations on context-dependent and infrequent categories suggest that automation should complement, rather than replace, expert assessment, motivating future work on human-in-the-loop compliance tooling across broader regulatory ecosystems. 

Place, publisher, year, edition, pages
Elsevier, 2026
Keywords
Large language models, Regulatory change, Regulatory compliance, Requirements engineering, Automation, FinTech, Information retrieval, Information retrieval systems, Taxonomies, Change analysis, Error prones, Language model, Large language model, Mixed method, Requirement engineering, Social Security, Software-systems, Through the lens
National Category
Software Engineering
Identifiers
urn:nbn:se:bth-29416 (URN)10.1016/j.infsof.2026.108144 (DOI)001740885600001 ()2-s2.0-105035031200 (Scopus ID)
Available from: 2026-04-17 Created: 2026-04-17 Last updated: 2026-04-28Bibliographically approved
Bauer, A., Angermeir, F., Alégroth, E. & Anglert, S. (2025). The Prevalence of Code Review Guidelines for GUI-Based Testing in Open-Source. Information and Software Technology
Open this publication in new window or tab >>The Prevalence of Code Review Guidelines for GUI-Based Testing in Open-Source
2025 (English)In: Information and Software Technology, ISSN 0950-5849, E-ISSN 1873-6025Article in journal (Other academic) Submitted
Abstract [en]

Context: Code review has become a core practice in collaborative software engineering, helping ensure code quality, detecting potential bugs, and supporting communication among developers. Prior research has shown that code review practices differ between production and test code, suggesting that established code review guidelines may fall short in the context of test and GUI-based test code. Particularly, GUI-based testing lacks adequate support during the code review process. To address this, we proposed a set of code review guidelines specifically designed for reviewing GUI-based test files, which, however, have not yet been empirically evaluated, limiting their practical relevance. 

Objective: This study empirically assesses the extent to which code review comments on GUI-based tests align (explicitly or implicitly) with the concerns captured by the proposed guidelines, and uses the findings to refine the guideline set.

Method: To achieve this, we sampled code review comments discussing GUI-based test files across 100 open-source projects and manually analyzed 1000 pull requests to determine to what extent the reviewers' comments align with the proposed guidelines.

Results: Review comments aligned with the proposed guidelines in 808 of 1000 pull requests. We found empirical evidence for 25 of the 33 guidelines. The most frequently observed guideline concerns the correct use of testing techniques and exception handling, particularly regarding locators, explicit waits, and timeout behavior.

Conclusion: The observed alignment suggests that the proposed guidelines capture concerns articulated in practice, indicating practical relevance for GUI-based test reviews. This represents an initial step towards providing empirical validation of the proposed guidelines, highlighting their potential value in enhancing the quality of GUI-based test reviews.

National Category
Software Engineering
Research subject
Software Engineering
Identifiers
urn:nbn:se:bth-28725 (URN)10.2139/ssrn.5547512 (DOI)
Available from: 2025-10-06 Created: 2025-10-06 Last updated: 2025-10-16Bibliographically approved
Angermeir, F., Fischbach, J., Moyón, F. & Mendez, D. (2024). Towards Automated Continuous Security Compliance. In: Proceedings of the 18th ACM/IEEE international symposium on empirical software engineering and measurement, ESEM 2024: . Paper presented at 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2024, Barcelona, Oct 24-25, 2024 (pp. 440-446). IEEE Computer Society
Open this publication in new window or tab >>Towards Automated Continuous Security Compliance
2024 (English)In: Proceedings of the 18th ACM/IEEE international symposium on empirical software engineering and measurement, ESEM 2024, IEEE Computer Society, 2024, p. 440-446Conference paper, Published paper (Refereed)
Abstract [en]

Context: Continuous Software Engineering is increasingly adopted in highly regulated domains, raising the need for continuous compliance. Adherence to especially security regulations - a major concern in highly regulated domains - renders Continuous Security Compliance of high relevance to industry and research.

Problem: One key barrier to adopting continuous software engineering in the industry is the resource-intensive and error-prone nature of traditional manual security compliance activities. Automation promises to be advantageous. However, continuous security compliance is under-researched, precluding an effective adoption.

Contribution: We have initiated a long-term research project with our industry partner to address these issues. In this manuscript, we make three contributions: (1) We provide a precise definition of the term continuous security compliance aligning with the state-of-art, (2) elaborate a preliminary overview of challenges in the field of automated continuous security compliance through a tertiary literature study, and (3) present a research roadmap to address those challenges via automated continuous security compliance. 

Place, publisher, year, edition, pages
IEEE Computer Society, 2024
Series
International Symposium on Empirical Software Engineering and Measurement, ISSN 1949-3770, E-ISSN 1949-3789
Keywords
Continuous Compliance, Continuous Security Compliance, Continuous Software Engineering, Security Challenges, Security Compliance, Continuous software engineerings, Error prones, Literature studies, Precise definition, Security regulations, Industrial research
National Category
Software Engineering
Identifiers
urn:nbn:se:bth-27254 (URN)10.1145/3674805.3690748 (DOI)001537915200042 ()2-s2.0-85210589352 (Scopus ID)9798400710476 (ISBN)
Conference
18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2024, Barcelona, Oct 24-25, 2024
Available from: 2024-12-17 Created: 2024-12-17 Last updated: 2025-09-30Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-7903-8236

Search in DiVA

Show all publications