Title: A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile Devices
Authors: Debski, R.
Schmitt, O.
Trenz, P.
Reimann, M.
Döllner, J.
Trapp, M.
Semmo, A.
Pasewaldt, S.
Citation: Journal of WSCG. 2023, vol. 31, no. 1-2, p. 80-90.
Issue Date: 2023
Publisher: Václav Skala - UNION Agency
Document type: článek
article
URI: http://hdl.handle.net/11025/54287
ISSN: 1213 – 6972 (hard copy)
1213 – 6980 (CD-ROM)
1213 – 6964 (on-line)
Keywords: stylizace videa;mobilní zpracování;lidský pohyb;zobrazující dynamiku;video efekty
Keywords in different language: video stylization;mobile processing;human motion;depicting dynamics;video effects
Abstract in different language: This paper presents a framework and mobile video editing app for interactive artistic augmentation of human motion in videos. While creating motion effects with industry-standard software is time-intensive and requires expertise, and popular video ef fect apps have limited customization options, our approach enables a multitude of art-directable, highly customizable motion effects. We propose a graph-based video processing framework that uses mobile-optimized machine learning models for hu man segmentation and pose estimation to augment RGB video data, enabling the rendering and animation of content-adaptive graphical elements that highlight and emphasize motion. Our modular framework architecture enables effect designers to create diverse motion effects that include body pose-based effects such as glow stick or light trail effects, silhouette-based effects such as halos and outlines, and layer-based effects that provide depth perception and enable interaction with virtual objects
Rights: © Václav Skala - UNION Agency
Appears in Collections:Volume 31, Number 1-2 (2023)

Files in This Item:
File Description SizeFormat 
!_2023-Journal_WSCG-90-100.pdfPlný text3,74 MBAdobe PDFView/Open


Please use this identifier to cite or link to this item: http://hdl.handle.net/11025/54287

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.