Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Successful combination of database search and snowballing for identification of primary studies in systematic literature studies
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.ORCID iD: 0000-0003-0460-5253
Pontifical Catholic University of Rio de Janeiro, BRA.
Federal Technological University of Paraná, BRA.
Blekinge Institute of Technology, Faculty of Computing, Department of Computer Science.ORCID iD: 0000-0003-0449-5322
2022 (English)In: Information and Software Technology, ISSN 0950-5849, E-ISSN 1873-6025, Vol. 147, article id 106908Article in journal (Refereed) Published
Abstract [en]

Background: A good search strategy is essential for a successful systematic literature study. Historically, database searches have been the norm, which was later complemented with snowball searches. Our conjecture is that we can perform even better searches if combining these two search approaches, referred to as a hybrid search strategy. Objective: Our main objective was to compare and evaluate a hybrid search strategy. Furthermore, we compared four alternative hybrid search strategies to assess whether we could identify more cost-efficient ways of searching for relevant primary studies. Methods: To compare and evaluate the hybrid search strategy, we replicated the search procedure in a systematic literature review (SLR) on industry–academia collaboration in software engineering. The SLR used a more “traditional” approach to searching for relevant articles for an SLR, while our replication was executed using a hybrid search strategy. Results: In our evaluation, the hybrid search strategy was superior in identifying relevant primary studies. It identified 30% more primary studies and even more studies when focusing only on peer-reviewed articles. To embrace individual viewpoints when assessing research articles and minimise the risk of missing primary studies, we introduced two new concepts, wild cards and borderline articles, when performing systematic literature studies. Conclusions: The hybrid search strategy is a strong contender for being used when performing systematic literature studies. Furthermore, alternative hybrid search strategies may be viable if selected wisely in relation to the start set for snowballing. Finally, the two new concepts were judged as essential to cater for different individual judgements and to minimise the risk of excluding primary studies that ought to be included. © 2022 The Authors

Place, publisher, year, edition, pages
Elsevier, 2022. Vol. 147, article id 106908
Keywords [en]
Hybrid search, Scopus, Snowballing, Systematic literature reviews, Information retrieval, Risk assessment, Cost-efficient, Database searches, Hybrid search strategies, Literature studies, Search procedures, Search strategies, Systematic literature review, Search engines
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-22852DOI: 10.1016/j.infsof.2022.106908ISI: 000912894400002Scopus ID: 2-s2.0-85127808772OAI: oai:DiVA.org:bth-22852DiVA, id: diva2:1653665
Note

open access

Available from: 2022-04-22 Created: 2022-04-22 Last updated: 2023-12-04Bibliographically approved

Open Access in DiVA

fulltext(1272 kB)465 downloads
File information
File name FULLTEXT01.pdfFile size 1272 kBChecksum SHA-512
261a258b3f930934dcc015554c00593008d02bfd5e37ec1ad2fb3bec9f5a74249e8f91d95507330855d52465ae2a4833c34cda4741601103b41820ce34a6a81d
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Wohlin, ClaesMendes, Emilia

Search in DiVA

By author/editor
Wohlin, ClaesMendes, Emilia
By organisation
Department of Software EngineeringDepartment of Computer Science
In the same journal
Information and Software Technology
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 465 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 295 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf