SoleCoach: Sole Pressure and IMU-based MLLMs for Skill Coaching

要旨

In sports training, individualized skill assessment and feedback are essential for athletes to master complex movements and enhance performance. Existing approaches for generating coaching comments primarily rely on externally captured pose information, which limits their applicability in outdoor sports such as skiing that involve large-scale movement. To address this challenge, we propose a method for presenting athletes' postures and generating coaching feedback solely based on foot pressure and IMU data collected from insole sensors. In our approach, a large language model directly interprets foot pressure signals to provide actionable coaching, thereby supporting independent practice. Through model evaluation and user studies, we demonstrate that the proposed method generates expert-level feedback and outperforms pose-based approaches. Furthermore, the user study shows that the feedback helps athletes identify body parts requiring correction and enhances their motivation for training.

受賞
Honorable Mention
著者
Toshihiro Hirano
Institute of Science Tokyo, Tokyo, Japan
Hitoshi Yoshihara
Institute of Science Tokyo, Tokyo, Japan
Yichen Peng
Institute of Science Tokyo, Tokyo, Japan
Chen-Chieh Liao
Institute of Science Tokyo, Tokyo, Japan
Erwin Wu
Institute of Science Tokyo, Tokyo, Japan
Hideki Koike
Institute of Science Tokyo, Tokyo, Japan

会議: CHI 2026

ACM CHI Conference on Human Factors in Computing Systems

セッション: Sports technologies

P1 - Room 130
7 件の発表
2026-04-16 20:15:00
2026-04-16 21:45:00