From Requirements to Test Cases: An NLP-Based Approach for High-Performance ECU Test Case Automation
2025 (English)In: ICHMS 2025 - 5th IEEE International Conference on Human-Machine Systems: AI and Large Language Models: Transforming Human-Machine Interactions, Institute of Electrical and Electronics Engineers (IEEE), 2025, p. 122-127Conference paper, Published paper (Refereed)
Abstract [en]
Automating test case specification generation is vital for improving the efficiency and accuracy of software testing, particularly in complex systems like high-performance Electronic Control Units (ECUs). This study investigates the use of Natural Language Processing (NLP) techniques, including Rule-Based Information Extraction and Named Entity Recognition (NER), to transform natural language requirements into structured test case specifications. A dataset of 400 feature element documents from the Polarion tool was used to evaluate both approaches for extracting key elements such as signal names and values. The results reveal that the Rule-Based method outperforms the NER method, achieving 95% accuracy for more straightforward requirements with single signals, while the NER method, leveraging SVM and other machine learning algorithms, achieved 77.3% accuracy but struggled with complex scenarios. Statistical analysis confirmed that the Rule-Based approach significantly enhances efficiency and accuracy compared to manual methods. This research highlights the potential of NLP-driven automation in improving quality assurance, reducing manual effort, and expediting test case generation, with future work focused on refining NER and hybrid models to handle greater complexity.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025. p. 122-127
Keywords [en]
Control systems, Data accuracy, Information retrieval, Large scale systems, Learning algorithms, Learning systems, Machine learning, Quality assurance, Software quality, Software testing, Specifications, Electronics control unit, Language processing, Named entity recognition, Natural languages, Performance, Recognition methods, Specification generations, Test case, Test case specifications, Unit tests, Automation
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:bth-28783DOI: 10.1109/ICHMS65439.2025.11154348Scopus ID: 2-s2.0-105017719093ISBN: 9798331521646 (print)OAI: oai:DiVA.org:bth-28783DiVA, id: diva2:2007126
Conference
5th IEEE International Conference on Human-Machine Systems, ICHMS 2025, Abu Dhabi, May 26-28, 2025
2025-10-172025-10-172025-10-17Bibliographically approved