Title: | Exploring the necessity of mosaicking for underwater imagery semantic segmentation using deep learning |
Authors: | Buskus, Kazimieras Vaiciukynas, Evaldas Medelyte, Saule Siaulys, Andrius |
Citation: | Journal of WSCG. 2022, vol. 30, no. 1-2, p. 26-33. |
Issue Date: | 2022 |
Publisher: | Václav Skala - UNION Agency |
Document type: | článek article |
URI: | http://hdl.handle.net/11025/49391 |
ISSN: | 1213-6972 (print) 1213-6964 (on-line) |
Keywords: | podvodní snímky;mozaikování;sémantická segmentace;hluboké učení;PSPNet;ResNet;Baltské moře |
Keywords in different language: | underwater imagery;mosaicking;semantic segmentation;deep learning;PSPNet;ResNet;Baltic sea |
Abstract in different language: | Deep learning applications are attracting considerable interest nowadays and image analysis pipelines are no exception. Benthic studies often rely on the subjective evaluation of video material recorded using underwater drones. The demand for automatic image segmentation and quantitative evaluation arises due to the large volume of video data collected. This study performed a semantic segmentation task by training the PSPNet architecture with ResNet-34 backbone for 50 epochs using imagery prepared by simply extracting a few video frames or stitch- ing a multitude of frames into a large 2D mosaic. Mosaicking is a particularly resource-intensive step, therefore, the possibility to skip such preprocessing would result in a more rapid analysis. The effect on the resulting seg- mentation quality was investigated by estimating the seabed coverage of three classes (Furcellaria lumbricalis, Mytilus edulis trossulus, and boulders) in a video material obtained from the Baltic Sea. Segmentation success, measured by intersection over union, varied between 0.56 and 0.84, usually slightly better for frames than for the mosaic overall. Absolute differences in estimated coverage were negligible (mosaic vs. frames): 0.24% vs. 1.26% for furcellaria, 0.44% vs. 2.46% for mytilus, and 4.02% vs. 2.06% for boulders. Due to the differences between predicted coverage and the mosaic-based ground truth being in an acceptable range, the findings suggest that the mosaicking step could be safely skipped in favor of a few equally spaced sample frames. |
Rights: | © Václav Skala - UNION Agency |
Appears in Collections: | Volume 30, Number 1-2 (2021) |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
A31-full.pdf | Plný text | 5,9 MB | Adobe PDF | View/Open |
Please use this identifier to cite or link to this item:
http://hdl.handle.net/11025/49391
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.