Survey Research in Software Engineering: Problems and Mitigation Strategies
2019 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 7, p. 24703-24718Article in journal (Refereed) Published
Abstract [en]
Background: The need for empirical investigations in software engineering is growing. Many researchers nowadays, conduct and validate their solutions using empirical research. The Survey is an empirical method which enables researchers to collect data from a large population. The main aim of the survey is to generalize the findings.
Aims: In this study, we aim to identify the problems researchers face during survey design and mitigation strategies.
Method: A literature review, as well as semi-structured interviews with nine software engineering researchers, were conducted to elicit their views on problems and mitigation strategies. The researchers are all focused on empirical software engineering.
Results: We identified 24 problems and 65 strategies, structured according to the survey research process. The most commonly discussed problem was sampling, in particular, the ability to obtain a sufficiently large sample. To improve survey instrument design, evaluation and execution recommendations for question formulation and survey pre-testing were given. The importance of involving multiple researchers in the analysis of survey results was stressed.
Conclusions: The elicited problems and strategies may serve researchers during the design of their studies. However, it was observed that some strategies were conflicting. This shows that it is important to conduct a trade-off analysis between strategies.
Place, publisher, year, edition, pages
IEEE, 2019. Vol. 7, p. 24703-24718
Keywords [en]
Empirical software engineering, surveys
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-17250DOI: 10.1109/ACCESS.2018.2881041ISI: 000460836000001OAI: oai:DiVA.org:bth-17250DiVA, id: diva2:1262468
Note
open access
2018-11-122018-11-122021-06-11Bibliographically approved