The Impact of AI-generated Code on Web Development: A Comparative Study of ChatGPT and GitHub Copilot
2023 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE credits
Student thesis
Abstract [en]
Background. Machine learning and artificial intelligence are advancing faster than ever, code generation is becoming a hot topic and is starting to gain traction in the industry. This creates the question, is it possible to create a complete website from scratch using only code generated by AI?
Objectives. To determine whether it is possible to create complete websites from start to finish with the code-generating tools. The tools in question are OpenAI’s ChatGPT and GitHub’s Copilot.
Methods. A design-based research was conducted where two tools were evaluated for the task of recreating a wireframe as closely as possible in terms of efficiency, accuracy, maintainability, and ease of use. The code was then analyzedboth manually with a code review and using the tools SonarQube, ESLint, and Pylint.
Results. The experiment resulted in that both tools delivered code that was similar in quality, both tools managed to create the websites according to wireframe with minor styling differences. We found that it is easier to create a website from scratch using OpenAI's ChatGPT than it is with GitHub's Copilot even though it uses OpenAI's Codex model which focuses on code generation.
Conclusion. Code-generating AI is not advanced enough to create systems from scratch in a time-efficient way without introducing bugs and security risks.
Place, publisher, year, edition, pages
2023.
Keywords [en]
ChatGPT, Copilot, Ethics, GPT-3, Codex
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-24801OAI: oai:DiVA.org:bth-24801DiVA, id: diva2:1769082
Subject / course
PA1445 Kandidatkurs i Programvaruteknik
Educational program
PAGWE Web Programming
Presentation
2023-05-30, C245, Valhallavägen 1, Karlskrona, 14:45 (English)
Supervisors
Examiners
2023-06-202023-06-162023-06-20Bibliographically approved