Models & measurement

Paper session

会議の名前
CHI 2020
Modeling the Endpoint Uncertainty in Crossing-based Moving Target Selection
要旨

Modeling the endpoint uncertainty of moving target selection with crossing is essential to understand factors such as speed-accuracy trade-off and interaction efficiency in crossing-based user interfaces with dynamic contents. However, there have been few studies looking into this research topic in the HCI field. This paper presents a Quaternary-Gaussian model to quantitatively measure the endpoint uncertainty in crossing-based moving target selection. To validate this model, we conducted an experiment with discrete crossing tasks on five factors, i.e., initial distance, size, speed, orientation, and moving direction. Results showed that our model fit the data of ? and ? accurately with adjusted R2 of 0.883 and 0.920. We also demonstrated the validity of our model in predicting error rates in crossing-based moving target selection. We concluded with a set of implications for future designs.

受賞
Honorable Mention
キーワード
Crossing-based Selection
Moving Target Selection
Endpoint Distribution
Error Rate
著者
Jin Huang
Institute of Software, Chinese Academy of Sciences & University of Chinese Academy of Sciences, Beijin, China
Feng Tian
Institute of Software, Chinese Academy of Sciences & University of Chinese Academy of Sciences, Beijing, China
Xiangmin Fan
Institute of Software, Chinese Academy of Sciences & University of Chinese Academy of Sciences, Beijing, China
Huawei Tu
La Trobe University, Melbourne, VIC, Australia
Hao Zhang
Institute of Software, Chinese Academy of Sciences & University of Chinese Academy of Sciences, Beijing, China
Xiaolan Peng
Institute of Software, Chinese Academy of Sciences & University of Chinese Academy of Sciences, Beijing, China
Hongan Wang
Institute of Software, Chinese Academy of Sciences & University of Chinese Academy of Sciences, Beijing, China
DOI

10.1145/3313831.3376336

論文URL

https://doi.org/10.1145/3313831.3376336

How Relevant is Hick's Law for HCI?
要旨

Hick's law is a key quantitative law in Psychology that relates reaction time to the logarithm of the number of stimulus-response alternatives in a task. Its application to HCI is controversial: Some believe that the law does not apply to HCI tasks, others regard it as the cornerstone of interface design. The law, however, is often misunderstood. We review the choice-reaction time literature and argue that: (1) Hick's law speaks against, not for, the popular principle that 'less is better'; (2) logarithmic growth of observed temporal data is not necessarily interpretable in terms of Hick's law; (3) the stimulus-response paradigm is rarely relevant to HCI tasks, where choice-reaction time can often be assumed to be constant; and (4) for user interface design, a detailed examination of the effects on choice-reaction time of psychological processes such as visual search and decision making is more fruitful than a mere reference to Hick's law.

キーワード
Hick's law
The Hick-Hyman law
Stimulus-response
Choice reaction time
Information
Uncertainty
Logarithm
Convexity
著者
Wanyu Liu
IRCAM Centre Pompidou; Télécom Paris, Institut Polytechnique de Paris; Université Paris-Saclay, Paris, France
Julien Gori
LRI, Univ. Paris-Sud, CNRS, Inria, Université Paris-Saclay; Télécom Paris, Institut Polytechnique de Paris, Orsay, France
Olivier Rioul
Télécom Paris, Institut Polytechnique de Paris, Palaiseau, France
Michel Beaudouin-Lafon
Université Paris-Saclay, CNRS, Inria, Laboratoire de Recherche en Informatique, Orsay, France
Yves Guiard
Université Paris-Saclay; Télécom Paris, Institut Polytechnique de Paris, Orsay, France
DOI

10.1145/3313831.3376878

論文URL

https://doi.org/10.1145/3313831.3376878

COGAM: Measuring and Moderating Cognitive Load in Machine Learning Model Explanations
要旨

Interpretable machine learning models trade -off accuracy for simplicity to make explanations more readable and easier to comprehend. Drawing from cognitive psychology theories in graph comprehension, we formalize readability as visual cognitive chunks to measure and moderate the cognitive load in explanation visualizations. We present Cognitive-GAM (COGAM) to generate explanations with desired cognitive load and accuracy by combining the expressive nonlinear generalized additive models (GAM) with simpler sparse linear models. We calibrated visual cognitive chunks with reading time in a user study, characterized the trade-off between cognitive load and accuracy for four datasets in simulation studies, and evaluated COGAM against baselines with users. We found that COGAM can decrease cognitive load without decreasing accuracy and/or increase accuracy without increasing cognitive load. Our framework and empirical measurement instruments for cognitive load will enable more rigorous assessment of the human interpretability of explainable AI.

キーワード
explanations
explainable artificial intelligence
cognitive load
visual explanations
generalized additive models
著者
Ashraf Abdul
National University of Singapore, Singapore, Singapore
Christian von der Weth
National University of Singapore, Singapore, Singapore
Mohan Kankanhalli
National University of Singapore, Singapore, Singapore
Brian Y. Lim
National University of Singapore, Singapore, Singapore
DOI

10.1145/3313831.3376615

論文URL

https://doi.org/10.1145/3313831.3376615

動画
A Literature Review of Quantitative Persona Creation
要旨

Quantitative persona creation (QPC) has tremendous potential, as HCI researchers and practitioners can leverage user data from online analytics and digital media platforms to better understand their users and customers. However, there is a lack of a systematic overview of the QPC methods and progress made, with no standard methodology or known best practices. To address this gap, we review 49 QPC research articles from 2005 to 2019. Results indicate three stages of QPC research: Emergence, Diversification, and Sophistication. Sharing resources, such as datasets, code, and algorithms, is crucial to achieving the next stage (Maturity). For practitioners, we provide guiding questions for assessing QPC readiness in organizations.

キーワード
Personas
literature review
quantitative persona creation
著者
Joni Salminen
Qatar Computing Research Institute, Hamad Bin Khalifa University & University of Turku, Doha, Qatar
Kathleen Guan
Georgetown University, Washington, DC, USA
Soon-Gyo Jung
Qatar Computing Research Institute, Hamad Bin Khalifa University, Doha, Qatar
Shammur A. Chowdhury
Qatar Computing Research Institute, Hamad Bin Khalifa University, Doha, Qatar
Bernard J. Jansen
Qatar Computing Research Institute, Hamad Bin Khalifa University, Doha, Qatar
DOI

10.1145/3313831.3376502

論文URL

https://doi.org/10.1145/3313831.3376502

Predicting and Diagnosing User Engagement with Mobile UI Animation via a Data-Driven Approach
要旨

Animation, a common design element in user interfaces (UI), can impact user engagement (UE) with mobile applications. To avoid impairing UE due to improper design of animation, designers rely on resource-intensive evaluation methods like user studies or expert reviews. To alleviate this burden, we propose a data-driven approach to assisting designers in examining UE issues with their animation designs. We first crowdsource UE assessments of mobile UI animations. Based on the collected data, we then build a novel deep learning model that captures both spatial and temporal features of animations to predict their UE levels. Evaluations show that our model achieves a reasonable accuracy. We further leverage the animation feature encoded by our model and a sample set of expert reviews to derive potential UE issues of a particular animation. Finally, we develop a proof-of-concept tool and evaluate its potential usage in actual design practices with experts

キーワード
Mobile UI Animation
User Engagement
Data-Driven Approach
著者
Ziming Wu
Hong Kong University of Science and Technology, Hong Kong, China
Yulun Jiang
Wuhan University, Wuhan, China
Yiding Liu
Hong Kong University of Science and Technology, Hong Kong, China
Xiaojuan Ma
Hong Kong University of Science and Technology, Hong Kong, China
DOI

10.1145/3313831.3376324

論文URL

https://doi.org/10.1145/3313831.3376324