Abstract

QUINTERO, Christian  and  ROA, Diego. Musical approach through a gestural interpretation. TecnoL. [online]. 2022, vol.25, n.53, e202.  Epub Aug 05, 2022. ISSN 0123-7799.  https://doi.org/10.22430/22565337.2131.

This article describes a virtual environment of an interactive computer system that can interpret hand gestures as pitches in a tonal scale. The methodology implemented here is based on a quantitative approach with three data collection stages: sequence of gestures, Curwen’s hand signs, and approximation to reality. This study was divided into three general stages conceptualization, design and implementation, and evaluation, to expand the scope of hand gesture recognition. The Kodály method implemented in this paper, which was adapted in Colombia, uses hand gesture to help students better understand musical concepts. The evaluation was conducted with a population sample of 15 users in each data collection stage. The results show that users adapted quickly to hand gesture recognition and its relationship with musical notes. Times and errors obtained in the tests were used to measure aspects of execution. A set of hand gestures was adapted to a virtual environment where users can play melodica by gestural interpretation, which showed that gesture recognition can help music instruction. Finally, users achieved a high level of understanding thanks to the use of natural hand movements, and it was a meaningful process for them because it was their first experience with a hand gesture recognition.

Keywords : Gesture recognition; interactive systems; virtual environments; natural languages.

        · abstract in Spanish     · text in Spanish     · Spanish ( pdf )