Název: | End-to-End Move Prediction System for Indoor Rock Climbing: Beta Caller |
Autoři: | Cardenas, Kevin Semwal, Sudhanshu Maher, James |
Citace zdrojového dokumentu: | Journal of WSCG. 2024, vol. 32, no. 1-2, p. 13-20. |
Datum vydání: | 2024 |
Nakladatel: | Václav Skala - UNION Agency |
Typ dokumentu: | článek article |
URI: | http://hdl.handle.net/11025/57340 |
ISSN: | 1213 – 6972 1213 – 6980 (CD-ROM) 1213 – 6964 (on-line) |
Klíčová slova: | umělá inteligence;počítačové vidění;interakce člověka s počítačem;detekce objektu;odhad pozice;predikce lidského pohybu;horolezectví |
Klíčová slova v dalším jazyce: | artificial intelligence;computer vision;human computer interaction;object detection;pose estimation;human motion prediction;rock climbing |
Abstrakt v dalším jazyce: | We developed Beta Caller, an end-to-end system supporting the sport of rock climbing for climbers with visual impairment. Beta Caller provides real-time, audible instructions containing a prediction for the climber’s next move while they are actively climbing a rock wall. This system leverages computer vision techniques to collect key information about the climber’s environment, enabling Beta Caller to make move predictions on climbing walls it has never encountered before. Neural networks are used to predict where the climber should move next, based on information provided by the computer vision models. The predicted move is translated into a verbal message guiding the climber to the next hold and then transmitted via wireless headphones using a text-to-speech model. This novel idea makes one of the fastest growing sports in the world even more appealing and approachable to climbers with visual impairment, however, this tool can be utilized by all climbers to improve their climbing skills. Beta Caller achieved 80.08% accuracy predicting which limb the climber should move next and, when predicting the location of the next hold, Beta Caller achieved a bounding box error of only 6.79%. These results pioneer a strong foundation shaping the future landscape of rock climbing prediction tools for visually impaired climbers |
Práva: | © Václav Skala - UNION Agency © Václav Skala - UNION Agency |
Vyskytuje se v kolekcích: | Volume 32, number 1-2 (2024) |
Soubory připojené k záznamu:
Soubor | Popis | Velikost | Formát | |
---|---|---|---|---|
A61-2024.pdf | Plný text | 7,24 MB | Adobe PDF | Zobrazit/otevřít |
Použijte tento identifikátor k citaci nebo jako odkaz na tento záznam:
http://hdl.handle.net/11025/57340
Všechny záznamy v DSpace jsou chráněny autorskými právy, všechna práva vyhrazena.