Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Experiences from Using Snowballing and Database Searches in Systematic Literature Studies
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering. (SERL Sweden)ORCID iD: 0000-0002-6215-1774
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering. (SERL Sweden)ORCID iD: 0000-0003-0460-5253
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering. (SERL Sweden)ORCID iD: 0000-0002-1532-8223
2015 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Background: Systematic literature studies are commonly used in software engineering. There are two main ways of conducting the searches for these type of studies; they are snowballing and database searches. In snowballing, the reference list (backward snowballing - BSB) and citations (forward snowballing - FSB) of relevant papers are reviewed to identify new papers whereas in a database search, different databases are searched using predefined search strings to identify new papers. Objective: Snowballing has not been in use as extensively as database search. Hence it is important to evaluate its efficiency and reliability when being used as a search strategy in literature studies. Moreover, it is important to compare it to database searches. Method: In this paper, we applied snowballing in a literature study, and reflected on the outcome. We also compared database search with backward and forward snowballing. Database search and snowballing were conducted independently by different researchers. The searches of our literature study were compared with respect to the efficiency and reliability of the findings. Results: Out of the total number of papers found, snowballing identified 83% of the papers in comparison to 46% of the papers for the database search. Snowballing failed to identify a few relevant papers, which potentially could have been addressed by identifying a more comprehensive start set. Conclusion: The efficiency of snowballing is comparable to database search. It can potentially be more reliable than a database search however, the reliability is highly dependent on the creation of a suitable start set.

Place, publisher, year, edition, pages
ACM Press, 2015. Vol. Article No. 17
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-11371DOI: 10.1145/2745802.2745818ISBN: 978-1-4503-3350-4 (print)OAI: oai:DiVA.org:bth-11371DiVA, id: diva2:891278
Conference
Proceedings 19th International Conference on Evaluation and Assessment in Software Engineering (EASE 2015), Nanjing, China
Funder
Knowledge Foundation, 20140218Available from: 2016-01-06 Created: 2016-01-06 Last updated: 2022-09-16Bibliographically approved
In thesis
1. Towards decision-making to choose among different component origins
Open this publication in new window or tab >>Towards decision-making to choose among different component origins
2016 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Context: The amount of software in solutions provided in various domains is continuously growing. These solutions are a mix of hardware and software solutions, often referred to as software-intensive systems. Companies seek to improve the software development process to avoid delays or cost overruns related to the software development.  

Objective: The overall goal of this thesis is to improve the software development/building process to provide timely, high quality and cost efficient solutions. The objective is to select the origin of the components (in-house, outsource, components off-the-shelf (COTS) or open source software (OSS)) that facilitates the improvement. The system can be built of components from one origin or a combination of two or more (or even all) origins. Selecting a proper origin for a component is important to get the most out of a component and to optimize the development. 

Method: It is necessary to investigate the component origins to make decisions to select among different origins. We conducted a case study to explore the existing challenges in software development.  The next step was to identify factors that influence the choice to select among different component origins through a systematic literature review using a snowballing (SB) strategy and a database (DB) search. Furthermore, a Bayesian synthesis process is proposed to integrate the evidence from literature into practice.  

Results: The results of this thesis indicate that the context of software-intensive systems such as domain regulations hinder the software development improvement. In addition to in-house development, alternative component origins (outsourcing, COTS, and OSS) are being used for software development. Several factors such as time, cost and license implications influence the selection of component origins. Solutions have been proposed to support the decision-making. However, these solutions consider only a subset of factors identified in the literature.   

Conclusions: Each component origin has some advantages and disadvantages. Depending on the scenario, one component origin is more suitable than the others. It is important to investigate the different scenarios and suitability of the component origins, which is recognized as future work of this thesis. In addition, the future work is aimed at providing models to support the decision-making process.

Place, publisher, year, edition, pages
Karlskrona: Blekinge Tekniska Högskola, 2016. p. 156
Series
Blekinge Institute of Technology Licentiate Dissertation Series, ISSN 1650-2140 ; 2016:01
Keywords
Component-based software development, component origin, decision-making, snowballing, database search, Bayesian synthesis
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering Other Electrical Engineering, Electronic Engineering, Information Engineering Software Engineering
Identifiers
urn:nbn:se:bth-11653 (URN)978-91-7295-323-9 (ISBN)
Presentation
2016-04-13, J1650, Blekinge Tekniska Högskola, Karlskrona, 13:15 (English)
Opponent
Supervisors
Available from: 2016-02-24 Created: 2016-02-24 Last updated: 2022-09-16Bibliographically approved
2. Decision-making support for choosing among different component origins.
Open this publication in new window or tab >>Decision-making support for choosing among different component origins.
2018 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Context: The amount of software in solutions provided in various domains is continuously growing. These solutions are a mix of hardware and software solutions, often referred to as software-intensive systems. Companies seek alternatives to improve the software development process to avoid delays or cost overruns related to software development. Component origins such as in-house, outsourcing, Components OffThe-Shelf (COTS) or Open Source Software (OSS) are gaining popularity, therefore, leading to the decision to choose among component origins. Objective: The overall goal of this thesis is to support decisionmaking for selecting component origins. Following a decision-making process including all the key decision-making activities is crucial in making decisions. Therefore, the objective of the thesis is to support the decision-makers to create a decision-making process based on their context. In addition, the objective is to improve the decision-making process by incorporating research results and decision-makers’ opinion and knowledge in practice. Method: We identified the factors that influence the choice to select among different component origins through a systematic literature review using an Snowballing (SB) strategy and a Database (DB) search. We extended the investigation and conducted a case survey of 22 cases. Using design science, we developed solutions including a process-line to support decision-makers, a Bayesian synthesis process to integrate the evidence from literature into practice and a Knowledge Translation (KT) framework to facilitate the implementation of research results in practice. Results: In-house development and alternative component origins (outsourcing, COTS, and OSS) are being used for software development. Several factors such as time, cost and license implications influence the selection of component origins. Solutions have been proposed to support the decision-making. However, these solutions consider only a subset of factors identified in the literature. According to the case survey, the solutions proposed in literature are not aligned with practice.Inpractice,thedecisionsaremostlybasedonopinions.Thedesign objective to support decision-makers with the decision-making process is identified. Therefore, we propose a process-line to address the designobjective.Inaddition,tomakethedecision-makingmoreinformediwe propose a KT framework incorporating Bayesian synthesis to help decision-makers make evidence-informed decisions. Conclusions: The decision to choose among component origins is case dependent. To support the decision-making process, the flexibility and customization of the solution based on the context are important. Therefore, the process-line proposed in the thesis is not prescriptive rather it is customizable to the context. In addition, to facilitate evidence-based decision-making, we provide an application of the KT framework that allows decision-makers to consider research results in addition to their own opinions and knowledge.

Place, publisher, year, edition, pages
Karlskrona: Blekinge Tekniska Högskola, 2018. p. 288
Series
Blekinge Institute of Technology Doctoral Dissertation Series, ISSN 1653-2090 ; 5
Keywords
Component-based software development, component origin, decision-making, snowballing, database search, process-line, Bayesian synthesis and knowledge translation
National Category
Software Engineering
Identifiers
urn:nbn:se:bth-15969 (URN)978-91-7295-351-2 (ISBN)
Public defence
2018-05-08, J1650, Blekinge Institute of Technology – Campus Gräsvik, Karlskrona, 09:30 (English)
Opponent
Available from: 2018-03-26 Created: 2018-03-20 Last updated: 2022-09-16Bibliographically approved

Open Access in DiVA

fulltext(812 kB)2549 downloads
File information
File name FULLTEXT01.pdfFile size 812 kBChecksum SHA-512
dba12947705409975adc507411027e2d43d10b0cde10c96e56f025461446b851026e282e5b26fc0c7f7874ec61d733289fb410bff2feee576f526027f4b9a1ad
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Badampudi, DeepikaWohlin, ClaesPetersen, Kai

Search in DiVA

By author/editor
Badampudi, DeepikaWohlin, ClaesPetersen, Kai
By organisation
Department of Software Engineering
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 2998 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 2846 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf