Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Performance Evaluation of Machine Learning Models for Sonar-based Mine Detection: A Comparative Study on Original and Noisy Augmented Dataset
Blekinge Institute of Technology, Faculty of Computing, Department of Computer Science.
Blekinge Institute of Technology, Faculty of Computing, Department of Computer Science.
2024 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesisAlternative title
Prestandautvärdering av maskininlärningsmodeller för ekolodsbaserad mindetektering : En jämförande studie av original och bullriga utökade datauppsättningar (Swedish)
Abstract [en]

Background: Submarines are crucial in modern naval warfare rely on sonar technology for underwater object detection, particularly mines and rocks to avoid collision. Machine learning (ML) enhances this process by automating object classification, improving accuracy and efficiency. This thesis investigates the impact of Gaussian mixture noise on ML model performance, comparing algorithms like LightGBM, MLP, Random Forest, and KNN in detecting the objects are either mines or rocks.

Objectives: We aim to evaluate the performance of machine learning algorithms, including LightGBM, MLP, Random Forest, and KNN with optimal k-value, for classifying underwater objects using sonar frequencies. Our study involves a comparative analysis of algorithm effectiveness on both original and modified datasets, augmented with Gaussian mixture noise, to assess their robustness and reliability.

Method: In this thesis, our approach was experimental, to fulfill our thesis objectives and answer key research questions. We introduced Gaussian noise and generated synthetic values using Gaussian Mixture Models to create a modified dataset. Subsequently, we evaluated four machine learning algorithms LightGBM, MLP, Random Forest, and KNN– on both the modified and unmodified datasets. Our assessment of algorithm performance criteria such as accuracy, precision, and recall.

Results: In this chapter, we compare the performance of various machine learning methodsLightGBM, MLP, Random Forest, and KNN on both original and modified datasets, evaluating accuracy, precision, and recall. KNN demonstrates consistency in noise, achieving 85.71% accuracy on the modified dataset and 90.47% on the unmodified dataset, with the highest precision and recall scores (85.58%) for the modified dataset. Conversely, MLP excels on the unmodified dataset, with 92.85% accuracy, 92.10% precision, and 94.23% recall, but experiences performance drops on the modified dataset (accuracy: 76.19%, precision: 76.88%, recall: 76.88%).

Conclusion: In conclusion, our thesis evaluated machine learning algorithms LightGBM, MLP, Random Forest, and KNN for mine detection via sonar systems. Notably, KNN exhibited robustness to noise, achieving the highest accuracy, particularly on the modified dataset. This highlights KNN’s reliability in noisy environments, enhancing its suitability for real-world mine detection applications.

Place, publisher, year, edition, pages
2024. , p. 38
Keywords [en]
KNN, LightGBM, Random Forest, MLP, Gaussian Noise
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:bth-26664OAI: oai:DiVA.org:bth-26664DiVA, id: diva2:1881781
Subject / course
DV1478 Bachelor Thesis in Computer Science
Educational program
DVGDT Bachelor Qualification Plan in Computer Science 60.0 hp
Supervisors
Examiners
Available from: 2024-08-06 Created: 2024-07-03 Last updated: 2024-08-06Bibliographically approved

Open Access in DiVA

fulltext(670 kB)109 downloads
File information
File name FULLTEXT01.pdfFile size 670 kBChecksum SHA-512
fe3085478f8db1fd690225712852aff0f4c78b62a523e14d9243960275b3d441453e445c08c4d552050dce930d8f1297a6f4c3b3158f4d86ca7926c78b05ba10
Type fulltextMimetype application/pdf

By organisation
Department of Computer Science
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 109 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 487 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf