Title: Exploring the necessity of mosaicking for underwater imagery semantic segmentation using deep learning
Authors: Buskus, Kazimieras
Vaiciukynas, Evaldas
Medelyte, Saule
Siaulys, Andrius
Citation: Journal of WSCG. 2022, vol. 30, no. 1-2, p. 26-33.
Issue Date: 2022
Publisher: Václav Skala - UNION Agency
Document type: článek
article
URI: http://hdl.handle.net/11025/49391
ISSN: 1213-6972 (print)
1213-6964 (on-line)
Keywords: podvodní snímky;mozaikování;sémantická segmentace;hluboké učení;PSPNet;ResNet;Baltské moře
Keywords in different language: underwater imagery;mosaicking;semantic segmentation;deep learning;PSPNet;ResNet;Baltic sea
Abstract in different language: Deep learning applications are attracting considerable interest nowadays and image analysis pipelines are no exception. Benthic studies often rely on the subjective evaluation of video material recorded using underwater drones. The demand for automatic image segmentation and quantitative evaluation arises due to the large volume of video data collected. This study performed a semantic segmentation task by training the PSPNet architecture with ResNet-34 backbone for 50 epochs using imagery prepared by simply extracting a few video frames or stitch- ing a multitude of frames into a large 2D mosaic. Mosaicking is a particularly resource-intensive step, therefore, the possibility to skip such preprocessing would result in a more rapid analysis. The effect on the resulting seg- mentation quality was investigated by estimating the seabed coverage of three classes (Furcellaria lumbricalis, Mytilus edulis trossulus, and boulders) in a video material obtained from the Baltic Sea. Segmentation success, measured by intersection over union, varied between 0.56 and 0.84, usually slightly better for frames than for the mosaic overall. Absolute differences in estimated coverage were negligible (mosaic vs. frames): 0.24% vs. 1.26% for furcellaria, 0.44% vs. 2.46% for mytilus, and 4.02% vs. 2.06% for boulders. Due to the differences between predicted coverage and the mosaic-based ground truth being in an acceptable range, the findings suggest that the mosaicking step could be safely skipped in favor of a few equally spaced sample frames.
Rights: © Václav Skala - UNION Agency
Appears in Collections:Volume 30, Number 1-2 (2021)

Files in This Item:
File Description SizeFormat 
A31-full.pdfPlný text5,9 MBAdobe PDFView/Open


Please use this identifier to cite or link to this item: http://hdl.handle.net/11025/49391

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.