𝜇EMAs allow participants to answer a short survey quickly with a tap on a smartwatch screen or a brief speech input. The short interaction time and low cognitive burden enable researchers to collect self-reports at high frequency (once every 5-15 minutes) while maintaining participant engagement. Systems with single input modality, however, may carry different contextual biases that could affect compliance. We combined two input modalities to create a multimodal-𝜇EMA system, allowing participants to choose between speech or touch input to self-report. To investigate system usability, we conducted a 7-day field study where we asked 20 participants to label their posture and/or physical activity once every five minutes throughout their waking day. Despite the intense prompting interval, participants responded to 72.4% of the prompts. We found participants gravitated towards different modalities based on personal preferences and contextual states, highlighting the need to consider these factors when designing context-aware multimodal 𝜇EMA systems.
https://dl.acm.org/doi/10.1145/3706598.3714086
The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)