Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
An initial industrial evaluation of interactive search-based testing for embedded software
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.
2015 (English)In: Applied Soft Computing, ISSN 1568-4946, E-ISSN 1872-9681, Vol. 29, 26-39 p.Article in journal (Refereed) Published
Abstract [en]

Search-based software testing promises the ability to generate and evaluate large numbers of test cases at minimal cost. From an industrial perspective, this could enable an increase in product quality without a matching increase in the time and effort required to do so. Search-based software testing, however, is a set of quite complex techniques and approaches that do not immediately translate into a process for use with most companies. For example, even if engineers receive the proper education and training in these new approaches, it can be hard to develop a general fitness function that covers all contingencies. Furthermore, in industrial practice, the knowledge and experience of domain specialists are often key for effective testing and thus for the overall quality of the final software system. But it is not clear how such domain expertise can be utilized in a search-based system. This paper presents an interactive search-based software testing (ISBST) system designed to operate in an industrial setting and with the explicit aim of requiring only limited expertise in software testing. It uses SBST to search for test cases for an industrial software module, while also allowing domain specialists to use their experience and intuition to interactively guide the search. In addition to presenting the system, this paper reports on an evaluation of the system in a company developing a framework for embedded software controllers. A sequence of workshops provided regular feedback and validation for the design and improvement of the ISBST system. Once developed, the ISBST system was evaluated by four electrical and system engineers from the company (the ’domain specialists’ in this context) used the system to develop test cases for a commonly used controller module. As well as evaluating the utility of the ISBST system, the study generated interaction data that were used in subsequent laboratory experimentation to validate the underlying search-based algorithm in the presence of realistic, but repeatable, interactions. The results validate the importance that automated software testing tools in general, and search-based tools, in particular, can leverage input from domain specialists while generating tests. Furthermore, the evaluation highlighted benefits of using such an approach to explore areas that the current testing practices do not cover or cover insufficiently. © 2014 Elsevier B.V. All rights reserved.

Place, publisher, year, edition, pages
2015. Vol. 29, 26-39 p.
Keyword [en]
Ability testing; Automatic test pattern generation; Embedded software; Personnel training; Search engines; Software engineering, Automated software testing; Education and training; Industrial experience; Interactive search; Knowledge and experience; Search-based algorithms; Search-based software testing; User-centered, Software testing
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-718DOI: 10.1016/j.asoc.2014.12.025ISI: 000350648100003Scopus ID: 2-s2.0-84920672523OAI: oai:DiVA.org:bth-718DiVA: diva2:815609
Available from: 2015-06-01 Created: 2015-05-28 Last updated: 2017-08-30Bibliographically approved
In thesis
1. Interactive Search-Based Software Testing: Development, Evaluation, and Deployment
Open this publication in new window or tab >>Interactive Search-Based Software Testing: Development, Evaluation, and Deployment
2017 (English)Doctoral thesis, comprehensive summary (Other academic)
Place, publisher, year, edition, pages
Karlskrona: Blekinge Tekniska Högskola, 2017. 235 p.
Series
Blekinge Institute of Technology Doctoral Dissertation Series, ISSN 1653-2090 ; 8
Keyword
Interactive Search-Based Software Testing, Search-Based Software Testing, Search-Based Software Engineering, Industrial Validation
National Category
Computer Systems
Identifiers
urn:nbn:se:bth-15083 (URN)978-91-7295-341-3 (ISBN)
Public defence
2017-10-04, G340, Karlskrona, 13:15 (English)
Opponent
Supervisors
Available from: 2017-08-31 Created: 2017-08-30 Last updated: 2017-11-01Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Authority records BETA

Marculescu, BogdanFeldt, RobertTorkar, RichardPoulding, Simon

Search in DiVA

By author/editor
Marculescu, BogdanFeldt, RobertTorkar, RichardPoulding, Simon
By organisation
Department of Software Engineering
In the same journal
Applied Soft Computing
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 134 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf