Multispectral Image Registration and Sensor Calibration for Low-Altitude Agricultural Drones
2024 (English)In: International Geoscience and Remote Sensing Symposium (IGARSS), Institute of Electrical and Electronics Engineers (IEEE), 2024, p. 6209-6213Conference paper, Published paper (Refereed)
Abstract [en]
This paper presents a crucial multispectral image registration and sensor calibration method for an agricultural application. The multispectral images are obtained using a special drone equipped with multiple cameras flying at low altitudes. However, the distance between lenses, the lens distortions and the low-altitude flights lead to a lack of alignment in the built-in normalized difference vegetation index (NDVI). This lack of alignment results in a very poor performance in further analysis, especially for image segmentation and target detection to distinguish crops from invasive plants. In this work, we point out the importance of reducing this misalignment. To do so, the near-infrared and red sensors are first calibrated to remove the lens distortions. Then, the corresponding keypoints are utilized to calculate the transformation matrix and to minimize the back-projection error. The registered near-infrared and red images are then used to compute NDVI. The experimental results show higher alignment and F1-score of 0.73 which is a significant improvement in the performance of a trained deep neural network using NDVI in the detection of invasive plants. This is particularly a challenging task as the invasive plants resemble the desired crops. © 2024 IEEE.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024. p. 6209-6213
Series
IEEE International Geoscience and Remote Sensing Symposium proceedings, ISSN 2153-6996, E-ISSN 2153-7003
Keywords [en]
Multispectral image registration, near-infrared image, normalized difference vegetation index (NDVI), sensor calibration, unmanned aerial vehicles, Aircraft detection, Drones, Image enhancement, Image registration, Image segmentation, Aerial vehicle, Images registration, Invasive plants, Multispectral images, Near- infrared images, Normalized difference vegetation index, Unmanned aerial vehicle, Deep neural networks
National Category
Computer graphics and computer vision
Identifiers
URN: urn:nbn:se:bth-27104DOI: 10.1109/IGARSS53475.2024.10642360Scopus ID: 2-s2.0-85208505152OAI: oai:DiVA.org:bth-27104DiVA, id: diva2:1913990
Conference
IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2024, Athens, July 7-12, 2024
2024-11-182024-11-182025-02-07Bibliographically approved