Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Testing highly complex system of systems: An industrial case study
Blekinge Institute of Technology, School of Computing.ORCID iD: 0000-0001-7266-5632
Blekinge Institute of Technology, School of Computing.ORCID iD: 0000-0002-1532-8223
2012 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Systems of systems (SoS) are highly complex and are integrated on multiple levels (unit, component, system, system of systems). Many of the characteristics of SoS (such as operational and managerial independence, integration of system into system of systems, SoS comprised of complex systems) make their development and testing challenging. Contribution: This paper provides an understanding of SoS testing in large-scale industry settings with respect to challenges and how to address them. Method: The research method used is case study research. As data collection methods we used interviews, documentation, and fault slippage data. Results: We identified challenges related to SoS with respect to fault slippage, test turn-around time, and test maintainability. We also classified the testing challenges to general testing challenges, challenges amplified by SoS, and challenges that are SoS specific. Interestingly, the interviewees agreed on the challenges, even though we sampled them with diversity in mind, which meant that the number of interviews conducted was sufficient to answer our research questions. We also identified solution proposals to the challenges that were categorized under four classes of developer quality assurance, function test, testing in all levels, and requirements engineering and communication. Conclusion: We conclude that although over half of the challenges we identified can be categorized as general testing challenges still SoS systems have their unique and amplified challenges stemming from SoS characteristics. Furthermore, it was found that interviews and fault slippage data indicated that different areas in the software process should be improved, which indicates that using only one of these methods would have led to an incomplete picture of the challenges in the case company.

Place, publisher, year, edition, pages
Lund: ACM/IEEE , 2012.
Keywords [en]
Case study, Software test, System of systems
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-7124DOI: 10.1145/2372251.2372290Local ID: oai:bth.se:forskinfo2DB633624B58FCC1C1257AC900484353OAI: oai:DiVA.org:bth-7124DiVA, id: diva2:834706
Conference
6th ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM
Available from: 2012-12-03 Created: 2012-12-03 Last updated: 2021-06-11Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Ali, Nauman BinPetersen, Kai

Search in DiVA

By author/editor
Ali, Nauman BinPetersen, Kai
By organisation
School of Computing
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 668 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf