Improving Viewing Experiences of First-Person Shooter Gameplays with Automatically-Generated Motion Effects


In recent times, millions of people enjoy watching video gameplays at an eSports stadium or home. We seek a method that improves gameplay spectator or viewer experiences by presenting multisensory stimuli. Using a motion chair, we provide the motion effects automatically generated from the audiovisual stream to the viewers watching a first-person shooter (FPS) gameplay. The motion effects express the game character’s movement and gunfire action. We describe algorithms for the computation of such motion effects developed using computer vision techniques and deep learning. By a user study, we demonstrate that our method of providing motion effects significantly improves the viewing experiences of FPS gameplay. The contributions of this paper are with the motion synthesis algorithms integrated for FPS games and the empirical evidence for the benefits of experiencing multisensory gameplays.

Gyeore Yun
POSTECH, Pohang, Korea, Republic of
Hyoseung Lee
POSTECH, Pohang, Gyeongsangbuk-do, Korea, Republic of
Sangyoon Han
Pohang University of Science and Technology (POSTECH), Pohang, Korea, Republic of
Seungmoon Choi
Pohang University of Science and Technology (POSTECH), Pohang, Gyeongbuk, Korea, Republic of




会議: CHI 2021

The ACM CHI Conference on Human Factors in Computing Systems (

セッション: eSports, Streaming, Social Play

[A] Paper Room 06, 2021-05-10 17:00:00~2021-05-10 19:00:00 / [B] Paper Room 06, 2021-05-11 01:00:00~2021-05-11 03:00:00 / [C] Paper Room 06, 2021-05-11 09:00:00~2021-05-11 11:00:00
Paper Room 06
12 件の発表
2021-05-10 17:00:00
2021-05-10 19:00:00