Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The Impact of AI-generated Code on Web Development: A Comparative Study of ChatGPT and GitHub Copilot
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.
2023 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

Background. Machine learning and artificial intelligence are advancing faster than ever, code generation is becoming a hot topic and is starting to gain traction in the industry. This creates the question, is it possible to create a complete website from scratch using only code generated by AI?

Objectives. To determine whether it is possible to create complete websites from start to finish with the code-generating tools. The tools in question are OpenAI’s ChatGPT and GitHub’s Copilot.

Methods. A design-based research was conducted where two tools were evaluated for the task of recreating a wireframe as closely as possible in terms of efficiency, accuracy, maintainability, and ease of use. The code was then analyzedboth manually with a code review and using the tools SonarQube, ESLint, and Pylint.

Results. The experiment resulted in that both tools delivered code that was similar in quality, both tools managed to create the websites according to wireframe with minor styling differences. We found that it is easier to create a website from scratch using OpenAI's ChatGPT than it is with GitHub's Copilot even though it uses OpenAI's Codex model which focuses on code generation.

Conclusion. Code-generating AI is not advanced enough to create systems from scratch in a time-efficient way without introducing bugs and security risks.

Place, publisher, year, edition, pages
2023.
Keywords [en]
ChatGPT, Copilot, Ethics, GPT-3, Codex
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-24801OAI: oai:DiVA.org:bth-24801DiVA, id: diva2:1769082
Subject / course
PA1445 Kandidatkurs i Programvaruteknik
Educational program
PAGWE Web Programming
Presentation
2023-05-30, C245, Valhallavägen 1, Karlskrona, 14:45 (English)
Supervisors
Examiners
Available from: 2023-06-20 Created: 2023-06-16 Last updated: 2023-06-20Bibliographically approved

Open Access in DiVA

fulltext(2774 kB)1272 downloads
File information
File name FULLTEXT01.pdfFile size 2774 kBChecksum SHA-512
9f11d474808e2f53d363bd5a38724fa92455c5519b41cc3b1b5952a7d1cf8aeb6c14e5dea6b30ba32b8d3b28359da38b46c49fe0796a3d356bb02df2a6fafcc2
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Fajkovic, EdvinRundberg, Erik
By organisation
Department of Software Engineering
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 1272 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 5121 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf