CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Another Systematic Review? A Critical Analysis of Systematic Literature Reviews on Agile Effort and Cost Estimation
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.ORCID iD: 0000-0002-9494-8059
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.ORCID iD: 0000-0001-7266-5632
2025 (English)In: International Symposium on Empirical Software Engineering and Measurement, IEEE Computer Society, 2025, p. 23-32Conference paper, Published paper (Refereed)
Abstract [en]

Background: Systematic literature reviews (SLRs) have become prevalent in software engineering research. Several researchers may conduct SLRs on similar topics without a prospective register for SLR protocols. However, even ignoring these unavoidable duplications of effort in the simultaneous conduct of SLRs, the proliferation of overlapping and often repetitive SLRs indicates that researchers are not extensively checking for existing SLRs on a topic. Given how effort-intensive it is to design, conduct, and report an SLR, the situation is less than ideal for software engineering research.

Aim: To understand how authors justify additional SLRs on a topic.

Method: To illustrate the issue and develop suggestions for improvement to address this issue, we have intentionally picked a sufficiently narrow but well-researched topic, i.e., effort estimation in Agile software development. We identify common justification patterns through a qualitative content analysis of 18 published SLRs. We further consider the citation data, publication years, publication venues, and the quality of the SLRs when interpreting the results.

Results: The common justification patterns include authors claiming gaps in coverage, methodological limitations in prior studies, temporal obsolescence of previous SLRs, or rapid technological and methodological advancements necessitating updated syntheses.

Conclusion: Our in-depth analysis of SLRs on a fairly narrow topic provides insights into SLRs in software engineering in general. By emphasizing the need for identifying existing SLRs and for justifying the undertaking of further SLRs, both in design and review guidelines and as a policy of conferences and journals, we can reduce the likelihood of duplication of effort and increase the rate of progress in the field. 

Place, publisher, year, edition, pages
IEEE Computer Society, 2025. p. 23-32
Series
International Symposium on Empirical Software Engineering and Measurement, ISSN 1949-3770, E-ISSN 1949-3789
Keywords [en]
agile, cost estimation, effort estimation, need for a review, systematic reviews, Agile manufacturing systems, Cost benefit analysis, Cost engineering, Engineering research, Obsolescence, Publishing, Software design, Agile software development, Cost estimations, Critical analysis, Prospectives, Software engineering research, Systematic literature review, Systematic Review, Cost estimating
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-29289DOI: 10.1109/ESEM64174.2025.00051Scopus ID: 2-s2.0-105032704584ISBN: 9798331591472 (print)OAI: oai:DiVA.org:bth-29289DiVA, id: diva2:2049115
Conference
2025 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2025, Honolulu, Oct 2-3, 2025
Part of project
GIST – Gaining actionable Insights from Software Testing, Knowledge Foundation
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile CommunicationsKnowledge Foundation, 20220235Available from: 2026-03-27 Created: 2026-03-27 Last updated: 2026-03-31Bibliographically approved

Open Access in DiVA

fulltext(439 kB)17 downloads
File information
File name FULLTEXT01.pdfFile size 439 kBChecksum SHA-512
8dae0e9fe909db5d8ccdfd5582aa8bdf6edfdee9c1c9e1ce425696b7efdba0881fb5397c8588d65888d2584d31a276ebaf019ddb93b94610019b752926647f15
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Edison, HenryAli, Nauman bin

Search in DiVA

By author/editor
Edison, HenryAli, Nauman bin
By organisation
Department of Software Engineering
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 379 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf