Sensing Your Vocals: Exploring the Activity of Vocal Cord Muscles for Pitch Assessment Using Electromyography and Ultrasonography

要旨

Vocal training is difficult because the muscles that control pitch, resonance, and phonation are internal and invisible to learners. This paper investigates how Electromyography (EMG) and ultrasonic imaging (UI) can make these muscles observable for training purposes. We report three studies. First, we analyze the EMG and UI data from 16 singers (beginners, experienced \& professionals), revealing differences among three vocal groups of the muscle control proficiency. Second, we use the collected data to create a system that visualizes an expert's muscle activity as reference. This system is tested in a user study with 12 novices, showing that EMG highlighted muscle activation nuances, while UI provided insights into vocal cord length and dynamics. Third, to compare our approach to traditional methods (audio analysis and coach instructions), we conducted a focus group study with 15 experienced singers. Our results suggest that EMG is promising for improving vocal skill development and enhancing feedback systems. We conclude the paper with a detailed comparison of the analyzed modalities (EMG, UI and traditional methods), resulting in recommendations to improve vocal muscle training systems.

受賞
Honorable Mention
著者
Kanyu Chen
Graduate School of Media Design, Yokohama, Kanagawa, Japan
Rebecca Panskus
Ruhr University Bochum, Bochum, Germany
Erwin Wu
Tokyo Institute of Technology, Tokyo, Japan
Yichen Peng
Institute of Science Tokyo, Tokyo, Japan
Daichi Saito
Tokyo Institute of Technology, Tokyo, Japan
Emiko Kamiyama
graduate school media design, TOKYO, Japan
Ruiteng Li
Waseda University , Tokyo, Japan
Chen-Chieh Liao
Institute of Science Tokyo, Tokyo, Japan
Karola Marky
Ruhr University Bochum, Bochum, Germany
Kato Akira
Keio University, Yokohama, Kanagawa, Japan
Hideki Koike
Tokyo Institute of Technology, Tokyo, Japan
Kai Kunze
Keio University Graduate School of Media Design, Yokohama, Japan

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: Music to My Ears

P1 - Room 132
7 件の発表
2026-04-17 20:15:00
2026-04-17 21:45:00