Metamorpheus: Interactive, Affective, and Creative Dream Narration Through Metaphorical Visual Storytelling

要旨

Human emotions are essentially molded by lived experiences, from which we construct personalised meaning. The engagement in such meaning-making process has been practiced as an intervention in various psychotherapies to promote wellness. Nevertheless, to support recollecting and recounting lived experiences in everyday life remains under explored in HCI. It also remains unknown how technologies such as generative AI models can facilitate the meaning making process, and ultimately support affective mindfulness. In this paper we present Metamorpheus, an affective interface that engages users in a creative visual storytelling of emotional experiences during dreams. Metamorpheus arranges the storyline based on a dream's emotional arc, and provokes self-reflection through the creation of metaphorical images and text depictions. The system provides metaphor suggestions, and generates visual metaphors and text depictions using generative AI models, while users can apply generations to recolour and re-arrange the interface to be visually affective. Our experience-centred evaluation manifests that, by interacting with Metamorpheus, users can recall their dreams in vivid detail, through which they relive and reflect upon their experiences in a meaningful way.

著者
Qian Wan
City University of Hong Kong, Hong Kong, China
Xin Feng
Harvard University Graduate School of Design, Cambridge, Massachusetts, United States
Yining Bei
Massachusetts Institute of Technology, Cambridge, Massachusetts, United States
Zhiqi Gao
Nankai University, Tianjin, China
Zhicong Lu
City University of Hong Kong, Hong Kong, China
論文URL

https://doi.org/10.1145/3613904.3642410

動画

会議: CHI 2024

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2024.acm.org/)

セッション: Creative Practices, Arts and AI

311
5 件の発表
2024-05-14 18:00:00
2024-05-14 19:20:00