A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
Relationships Between Audio and Movement Features, and Perceived Emotions in Musical Performance (2023)
Thompson, M. R., Mendoza, J. I., Luck, G., & Vuoskoski, J. K. (2023). Relationships Between Audio and Movement Features, and Perceived Emotions in Musical Performance. Music and Science, 6. https://doi.org/10.1177/20592043231177871
JYU-tekijät tai -toimittajat
Julkaisun tiedot
Julkaisun kaikki tekijät tai toimittajat: Thompson, Marc R.; Mendoza, Juan Ignacio; Luck, Geoff; Vuoskoski, Jonna K.
Lehti tai sarja: Music and Science
ISSN: 2059-2043
eISSN: 2059-2043
Julkaisuvuosi: 2023
Volyymi: 6
Kustantaja: SAGE Publications
Julkaisumaa: Britannia
Julkaisun kieli: englanti
DOI: https://doi.org/10.1177/20592043231177871
Julkaisun avoin saatavuus: Avoimesti saatavilla
Julkaisukanavan avoin saatavuus: Kokonaan avoin julkaisukanava
Julkaisu on rinnakkaistallennettu (JYX): https://jyx.jyu.fi/handle/123456789/88184
Tiivistelmä
A core aspect of musical performance is communicating emotional and expressive intentions to the audience. Recognition of the musician's intentions is constructed from a combination of visual and auditory performance cues, as well as compositional features. The current study attempted to quantify these contributions by measuring relationships between ratings of perceived emotion, and motion and auditory performance features. A pianist and violinist with advanced degrees in music performance individually performed four short western tonal pieces. The musicians were tasked with performing the pieces while invoking different expressive intentions: sad, happy, angry, and as a control, deadpan. To examine how different expressive intentions influenced performance behavior, the musicians’ body movements were tracked using optical motion capture and rendered into point-light animations. Participants rated perceived emotions (happiness, sadness, tenderness, anger) in audio-only, video-only, and audiovisual rating conditions. We first explored how compositional aspects of the music and performers’ expressive intentions contributed to ratings across the three viewing conditions. Through a series of analyses of variance, we found that participants successfully decoded the performers’ expressive intentions based on visual information alone and auditory information alone. In the rating conditions in which audio was present, compositional aspects had a stronger effect on participant ratings than performers’ expressive intentions. Next, we quantified relationships between the ratings and both motion and auditory performance features. Of the features investigated, musical mode had the greatest impact on ratings. Additionally, perceived emotion ratings were more consistent among responders in conditions with audio than without. These results suggest that, in music performance, auditory information is conceptualized by most responders in a similar way, while visual information might be open to a variety of interpretations.
YSO-asiasanat: liikkeenkaappaus; musiikki; havaitseminen; tunteet; esitykset; musiikkiesitykset; musiikin esittäminen
Vapaat asiasanat: motion capture; music; perception; emotions; performance; embodiment
Liittyvät organisaatiot
OKM-raportointi: Kyllä
VIRTA-lähetysvuosi: 2023
JUFO-taso: 1
