Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
On the performance of hybrid search strategies for systematic literature reviews in software engineering
Fluminense Federal University, BRA.
Fluminense Federal University, BRA.
Fluminense Federal University, BRA.
Pontifical Catholic University of Rio de Janeiro (PUC-Rio), BRA.
Show others and affiliations
2020 (English)In: Information and Software Technology, ISSN 0950-5849, E-ISSN 1873-6025, Vol. 123, article id 106294Article in journal (Refereed) Published
Abstract [en]

Context: When conducting a Systematic Literature Review (SLR), researchers usually face the challenge of designing a search strategy that appropriately balances result quality and review effort. Using digital library (or database) searches or snowballing alone may not be enough to achieve high-quality results. On the other hand, using both digital library searches and snowballing together may increase the overall review effort. Objective: The goal of this research is to propose and evaluate hybrid search strategies that selectively combine database searches with snowballing. Method: We propose four hybrid search strategies combining database searches in digital libraries with iterative, parallel, or sequential backward and forward snowballing. We simulated the strategies over three existing SLRs in SE that adopted both database searches and snowballing. We compared the outcome of digital library searches, snowballing, and hybrid strategies using precision, recall, and F-measure to investigate the performance of each strategy. Results: Our results show that, for the analyzed SLRs, combining database searches from the Scopus digital library with parallel or sequential snowballing achieved the most appropriate balance of precision and recall. Conclusion: We put forward that, depending on the goals of the SLR and the available resources, using a hybrid search strategy involving a representative digital library and parallel or sequential snowballing tends to represent an appropriate alternative to be used when searching for evidence in SLRs. © 2020 Elsevier B.V.

Place, publisher, year, edition, pages
Elsevier B.V. , 2020. Vol. 123, article id 106294
Keywords [en]
Database Search, Search Strategy, Snowballing, Software Engineering, Systematic literature review, Database systems, Information retrieval, Iterative methods, Search engines, Software quality, Database searches, Hybrid search strategies, Hybrid strategies, Precision and recall, Search strategies, Systematic literature review (SLR), Digital libraries
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-19405DOI: 10.1016/j.infsof.2020.106294Scopus ID: 2-s2.0-85082688364OAI: oai:DiVA.org:bth-19405DiVA, id: diva2:1427630
Available from: 2020-04-30 Created: 2020-04-30 Last updated: 2020-05-04Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records BETA

Mendes, EmiliaWohlin, Claes

Search in DiVA

By author/editor
Mendes, EmiliaWohlin, Claes
By organisation
Department of Software EngineeringDepartment of Computer Science
In the same journal
Information and Software Technology
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 9 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf