FIP: Endowing Robust Motion Capture on Daily Garment by Fusing Flex and Inertial Sensors

要旨

What if our clothes could capture our body motion accurately? This paper introduces Flexible Inertial Poser (FIP), a novel motion-capturing system using daily garments with two elbow-attached flex sensors and four Inertial Measurement Units (IMUs). To address the inevitable sensor displacements in loose wearables which degrade joint tracking accuracy significantly, we identify the distinct characteristics of the flex and inertial sensor displacements and develop a Displacement Latent Diffusion Model and a Physics-informed Calibrator to compensate for sensor displacements based on such observations, resulting in a substantial improvement in motion capture accuracy. We also introduce a Pose Fusion Predictor to enhance multimodal sensor fusion. Extensive experiments demonstrate that our method achieves robust performance across varying body shapes and motions, significantly outperforming SOTA IMU approaches with a 19.5% improvement in angular error, a 26.4% improvement in elbow angular error, and a 30.1% improvement in positional error. FIP opens up opportunities for ubiquitous human-computer interactions and diverse interactive applications such as Metaverse, rehabilitation, and fitness analysis. Our project page can be seen at https://fangjw-0722.github.io/FIP.github.io/

著者
Ruonan Zheng
Xiamen University, Xiamen, China
Jiawei Fang
Xiamen University, Xiamen, China
Yuan Yao
School of Informatics, Xiamen University, Xiamen, Fujian, China
Xiaoxia Gao
Xiamen University, Xiamen, Fujian, China
Chengxu Zuo
school of imformatics, Xiamen, Fujian, China
Shihui Guo
Software School, Xiamen, Fujian, China
Yiyue Luo
University of Washington, Seattle, Washington, United States
DOI

10.1145/3706598.3714140

論文URL

https://dl.acm.org/doi/10.1145/3706598.3714140

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: Sensing and Haptics

Annex Hall F204
7 件の発表
2025-04-30 18:00:00
2025-04-30 19:30:00
日本語まとめ
読み込み中…