Název: End-to-End Move Prediction System for Indoor Rock Climbing: Beta Caller
Autoři: Cardenas, Kevin
Semwal, Sudhanshu
Maher, James
Citace zdrojového dokumentu: Journal of WSCG. 2024, vol. 32, no. 1-2, p. 13-20.
Datum vydání: 2024
Nakladatel: Václav Skala - UNION Agency
Typ dokumentu: článek
article
URI: http://hdl.handle.net/11025/57340
ISSN: 1213 – 6972
1213 – 6980 (CD-ROM)
1213 – 6964 (on-line)
Klíčová slova: umělá inteligence;počítačové vidění;interakce člověka s počítačem;detekce objektu;odhad pozice;predikce lidského pohybu;horolezectví
Klíčová slova v dalším jazyce: artificial intelligence;computer vision;human computer interaction;object detection;pose estimation;human motion prediction;rock climbing
Abstrakt v dalším jazyce: We developed Beta Caller, an end-to-end system supporting the sport of rock climbing for climbers with visual impairment. Beta Caller provides real-time, audible instructions containing a prediction for the climber’s next move while they are actively climbing a rock wall. This system leverages computer vision techniques to collect key information about the climber’s environment, enabling Beta Caller to make move predictions on climbing walls it has never encountered before. Neural networks are used to predict where the climber should move next, based on information provided by the computer vision models. The predicted move is translated into a verbal message guiding the climber to the next hold and then transmitted via wireless headphones using a text-to-speech model. This novel idea makes one of the fastest growing sports in the world even more appealing and approachable to climbers with visual impairment, however, this tool can be utilized by all climbers to improve their climbing skills. Beta Caller achieved 80.08% accuracy predicting which limb the climber should move next and, when predicting the location of the next hold, Beta Caller achieved a bounding box error of only 6.79%. These results pioneer a strong foundation shaping the future landscape of rock climbing prediction tools for visually impaired climbers
Práva: © Václav Skala - UNION Agency
© Václav Skala - UNION Agency
Vyskytuje se v kolekcích:Volume 32, number 1-2 (2024)

Soubory připojené k záznamu:
Soubor Popis VelikostFormát 
A61-2024.pdfPlný text7,24 MBAdobe PDFZobrazit/otevřít


Použijte tento identifikátor k citaci nebo jako odkaz na tento záznam: http://hdl.handle.net/11025/57340

Všechny záznamy v DSpace jsou chráněny autorskými právy, všechna práva vyhrazena.