Select or Suggest? Reinforcement Learning-based Method for High-Accuracy Target Selection on Touchscreens

要旨

Suggesting multiple target candidates based on touch input is a possible option for high-accuracy target selection on small touchscreen devices. But it can become overwhelming if suggestions are triggered too often. To address this, we propose SATS, a Suggestion-based Accurate Target Selection method, where target selection is formulated as a sequential decision problem. The objective is to maximize the utility: the negative time cost for the entire target selection procedure. The SATS decision process is dictated by a policy generated using reinforcement learning. It automatically decides when to provide suggestions and when to directly select the target. Our user studies show that SATS reduced error rate and selection time over Shift~\cite{vogel2007shift}, a magnification-based method, and MUCS, a suggestion-based alternative that optimizes the utility for the current selection. SATS also significantly reduced error rate over BayesianCommand~\cite{zhu2020using}, which directly selects targets based on posteriors, with only a minor increase in selection time.

著者
Zhi Li
Stony Brook University, Stony Brook, New York, United States
Maozheng Zhao
Stony Brook University, Stony Brook, New York, United States
Dibyendu Das
Stony Brook University, Stony Brook, New York, United States
HANG ZHAO
Stony Brook University, Stony Brook, New York, United States
Yan Ma
Stony Brook University, Stony Brook, New York, United States
Wanyu Liu
IRCAM Centre Pompidou, Paris, France
Michel Beaudouin-Lafon
Université Paris-Saclay, Orsay, France
Fusheng Wang
Stony Brook University, Stony Brook, New York, United States
IV Ramakrishnan
Stony Brook University, Stony Brook, New York, United States
Xiaojun Bi
Stony Brook University, Stony Brook, New York, United States
論文URL

https://dl.acm.org/doi/abs/10.1145/3491102.3517472

動画

会議: CHI 2022

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2022.acm.org/)

セッション: Intelligent Interaction Techniques

293
5 件の発表
2022-05-03 18:00:00
2022-05-03 19:15:00