注目の論文一覧

各カテゴリ上位30論文までを表示しています

ACM CHI Conference on Human Factors in Computing Systems

4
Memory Printer: Exploring Everyday Reminiscing by Combining Slow Design with Generative AI-based Image Creation
Zhou Fang (Eindhoven University of Technology, Eindhoven, Netherlands)Janet Yi-Ching Huang (Eindhoven University of Technology, Eindhoven, Netherlands)
Generative Artificial Intelligence (GAI) offers new opportunities for reconstructing these unrecorded memory scenes, yet existing web-based tools undermine users' sense of agency through disengaging and unpredictable interactions. In this work, we advance three design arguments about how slow, tangible interaction can reshape human–AI relationships by making temporality, embodied agency, and generative processes experientially legible. We instantiate these arguments by presenting Memory Printer, a tangible design exemplar that combines silk-screen printing metaphors with text-to-image generation. The design features layered reconstruction that decomposes image generation into incremental steps, a physical wooden scraper enabling embodied control over image revelation, and built-in printing that produces tangible photos. We examine these arguments through a comparative study with 24 participants, exploring how participants engage with, interpret, and respond to this interaction stance. The study surfaces both opportunities—such as vivid memory evocation, heightened sense of control, and creative exploration—and critical tensions, including risks of false memory formation, algorithmic bias, and data privacy. Together, these findings articulate important boundaries for deploying generative AI in emotionally sensitive contexts.
4
ViSTAR: Virtual Skill Training with Augmented Reality with 3D Avatars and LLM coaching agent
Chunggi Lee (Harvard University, Cambridge, Massachusetts, United States)Hayato Saiki (University of Tsukuba, Tsukuba, Japan)Tica Lin (Dolby Laboratories, Atlanta, Georgia, United States)EIJI IKEDA (University of Tsukuba, Tsukuba, Japan)Kenji Suzuki (University of Tsukuba, Tsukuba, Japan)Chen Zhu-Tian (University of Minnesota-Twin Cities, Minneapolis, Minnesota, United States)Hanspeter Pfister (Harvard University, Cambridge, Massachusetts, United States)
We present ViSTAR, a Virtual Skill Training system in AR that supports self-guided basketball skill practice, with feedback on balance, posture, and timing. From a formative study with basketball players and coaches, the system addresses three challenges: understanding skills, identifying errors, and correcting mistakes. ViSTAR follows the Behavioral Skills Training (BST) framework—instruction, modeling, rehearsal, and feedback. It provides feedback through visual overlays, rhythm and timing cues, and an AI-powered coaching agent using 3D motion reconstruction. We generate verbal feedback by analyzing spatio-temporal joint data and mapping features to natural-language coaching cues via a Large Language Model (LLM). A key novelty is this feedback generation: motion features become concise coaching insights. In two studies (N=16), participants generally preferred our AI-generated feedback to coach feedback and reported that ViSTAR helped them notice posture and balance issues and refine movements beyond self-observation.
3
Digital Proxemics as Measures of Social Interaction in Hybrid XR
Iain William. McLean (University of Glasgow, Glasgow, United Kingdom)Andreea Caragea (University of Glasgow, Glasgow, United Kingdom)Ross Johnstone (University of Glasgow, Glasgow, United Kingdom)Despoina Vasiliki Sampatakou (University of Glasgow, Glasgow, United Kingdom)Kieran Waugh (University of Glasgow, Glasgow, United Kingdom)Julie R.. Williamson (University of Glasgow, Glasgow, United Kingdom)
Hybrid meetings are the new reality, yet they lack the richness of face-to-face interaction. In shared spaces, virtual or physical, interaction relies on more than words: proximity, non-verbal cues, and subtle movements all shape communication. Proximity captures how close we stand, where we face, and how we move around others. This paper investigates how proxemics in dyad and triad conversations translate across physical and virtual contexts. We conducted a study with 24 participants in four groups, completing social tasks under four conditions: face-to-face, co-located XR, remote XR, and hybrid XR. Our instrumentation of physical and virtual environments enables direct comparison. The work contributes a rich open dataset of 2.3 million rows across 32 columns, supporting comparative and replicable analysis. This is the first study to compare proxemics across face-to-face, co-located XR, remote XR, and hybrid XR, offering a foundation for understanding how social space translates across contexts.
3
Eyes on Many: Evaluating Gaze, Hand, and Voice for Multi-Object Selection in Extended Reality
Mohammad Raihanul Bashar (Concordia University, Montreal, Quebec, Canada)Aunnoy K Mutasim (Simon Fraser University, Vancouver, British Columbia, Canada)Ken Pfeuffer (Aarhus University, Aarhus, Denmark)Anil Ufuk Batmaz (Concordia University, Montreal, Quebec, Canada)
Interacting with multiple objects simultaneously makes us fast. A pre-step to this interaction is to select the objects, i.e., multi-object selection, which is enabled through two steps: (1) toggling multi-selection mode --- mode-switching --- and then (2) selecting all the intended objects --- subselection. In extended reality (XR), each step can be performed with the eyes, hands, and voice. To examine how design choices affect user performance, we evaluated four mode-switching (\Semipinch, \Fullpinch, \Doublepinch, and \Voice) and three subselection techniques (Gaze+Dwell, Gaze+Pinch, and Gaze+Voice) in a user study. Results revealed that while \Doublepinch paired with Gaze+Pinch yielded the highest overall performance, \Semipinch achieved the lowest performance. Although \Voice-based mode-switching showed benefits, Gaze+Voice subselection was less favored, as the required repetitive vocal commands were perceived as tedious. Overall, these findings provide empirical insights and inform design recommendations for multi-selection techniques in XR.
3
EyeXRciser: Guiding Eye Exercises without Task Interruption in Virtual Workspaces
Hongyue Xu (Tohoku University, Sendai, Japan)Kazuyuki Fujita (Tohoku University, Sendai, Miyagi, Japan)Yi Li (TU Wien, Vienna, Austria)Benjamin Tag (University of New South Wales, Sydney, New South Wales, Australia)Guanghan Zhao (Tohoku University, Sendai, Japan)Yoshifumi Kitamura (Tohoku University, Sendai, Japan)
Eye strain presents a significant challenge in human-information interaction in virtual reality (VR), as prolonged exposure contributes to various eye problems. This study introduces a new gaze redirection method called EyeXRciser, which passively activates eye movements to help prevent eye muscle stiffness during VR reading. This method achieves gaze redirection by slowly shifting the relative position of the text window within the user’s field of view through a head-bound coordinate system. We implemented our method with two different redirection speeds (i.e., unnoticeable speed at 0.03 $rad/s$; noticeable speed at 0.12 rad/s) and conducted a user study (N=24) comparing with a baseline using a fixed text window. Results show that both our methods successfully minimized the decline in accommodative ability caused by prolonged reading, without negatively impacting reading comprehension. Results also show that the unnoticeable redirection speed produced less subjective discomfort, eye fatigue, and reading distraction than the noticeable speed.
3
Escape From Human: An Interview Study of Social VR Players Practicing Self-Expression Through Avatars that Self-Identify as “Non-Human”
Shuto Takashita (The University of Tokyo, Tokyo, Japan)Yuji Hatada (The University of Tokyo, Tokyo, Japan)Takuji Narumi (The University of Tokyo, Tokyo, Japan)Masahiko Inami (The University of Tokyo, Tokyo, Japan)
In social virtual reality (VR) platforms, players can embody "non-human" avatars, which are representations whose appearance or skeletal structure diverge from typical human characteristics. This capability fosters the emergence of distinctive cultures of social interaction. This paper reports on interviews with users who employ such avatars, investigating (1) motivations for their adoption, (2) their impact on social interactions, and (3) challenges encountered when employing them in social contexts. Our findings reveal that users adopt "non-human" avatars both to escape the expectations and norms associated with the human body—thereby enabling more relaxed social communication—and to gain access to new forms of embodied experience and creative self-expression. The study also provides empirical evidence and discussion on the cultures of social interaction mediated by alternative embodiments, changes in bodily perception resulting from prolonged use, functional and social challenges related to avatar use, and the design strategies and etiquette practices developed to overcome them.
3
Dialogues with AI Reduce Beliefs in Misinformation but Build No Lasting Discernment Skills
Anku Rani (Massachusetts Institute of Technology, Cambridge, Massachusetts, United States)Valdemar Danry (MIT, CAMBRIDGE, Massachusetts, United States)Paul Pu Liang (Massachusetts Institute of Technology, Cambridge, Massachusetts, United States)Andrew Lippman (Massachusetts Institute of Technology, Cambridge, Massachusetts, United States)Pattie Maes (MIT , Cambridge, Massachusetts, United States)
Given the growing prevalence of fake information, including increasingly realistic AI-generated news, there is an urgent need to train people to better evaluate and detect misinformation. While interactions with AI have been shown to durably reduce people's beliefs in false information, it is unclear whether these interactions also teach people the skills to discern false information themselves. We conducted a month-long study where 67 participants classified news headline-image pairs as real or fake, discussed their assessments with an AI system, followed by an unassisted evaluation of unseen news items to measure accuracy before, during, and after AI assistance. While AI assistance produced immediate improvements during AI-assisted sessions (+21\% average), participants' unassisted performance on new items declined significantly by 15.3\% in week 4 compared to week 0. These results indicate that while AI may help immediately, it may ultimately degrade long-term misinformation detection abilities.
3
Proactive AI as a Catalyst for Creativity? Balancing Human Agency and AI Contribution in Collaborative Story Writing
Yiwen Yin (Tsinghua University, Beijing, China)Mingze Wu (Institute for Human-centered AI, Stanford, California, United States)Ruijie Huang (Beijing University of Posts and Telecommunications, beijing, China)Xin Tong (University of Michigan Ann Arbor, Ann Arbor, Michigan, United States)Junyu Zhou (University of Science and Technology of China, Hefei, China)Chun Yu (Tsinghua University, Beijing, China)Yuanchun Shi (Tsinghua University, Beijing, China)
Large Language Models (LLMs) hold promise in supporting creative writing, yet the role of proactive AI in collaborative writing remains underexplored due to concerns around human agency and disruption. To investigate effective strategies for proactive AI support, we conducted a Wizard-of-Oz study simulating two suggestion styles: intrusive suggestions (next-sentence completions) and non-intrusive suggestions (exploratory proposals), where participants completed two story outlining tasks under each style, receiving real-time proactive suggestions from a human wizard acting as the AI. Both quantitative and qualitative results show that proactive AI can enhance creativity and accelerate writing. However, we observed a trade-off between AI involvement and perceived human agency. This trade-off was moderated by how strongly AI stimulated users—greater inspiration led to stronger perceived agency even under high AI involvement. Based on wizards' behavior, we offer guidance on suggestion style and timing to better balance creativity and agency for future proactive AI writing systems.
3
Interpretive Cultures: Resonance, randomness, and negotiated meaning for AI-assisted tarot divination
Matthew Kieran. Prock (The University of Michigan, Ann Arbor, Michigan, United States)Ziv Epstein (MIT , Cambridge, Massachusetts, United States)Hope Schroeder (MIT, Cambridge, Massachusetts, United States)Amy Smith (Queen Mary University London, London, United Kingdom)Cassandra Lee (MIT, Cambridge, Massachusetts, United States)Vana Goblot (Goldsmiths, University of London, London, United Kingdom)Farnaz Jahanbakhsh (University of Michigan, Ann Arbor, Michigan, United States)
While generative AI tools are increasingly adopted for creative and analytical tasks, their role in interpretive practices,where meaning is subjective, plural, and non-causal, remains poorly understood. This paper examines AI-assisted tarot reading, a divinatory practice in which users pose a query, draw cards through a randomized process, and ask AI systems to interpret the resulting symbols. Drawing on interviews with tarot practitioners and Hartmut Rosa's Theory of Resonance, we investigate how users seek, negotiate, and evaluate resonant interpretations in a context where no causal relationship exists between the query and the data being interpreted. We identify distinct ways practitioners incorporate AI into their interpretive workflows, including using AI to navigate uncertainty and self-doubt, explore alternative perspectives, and streamline or extend existing divinatory practices. Based on these findings, we offer design recommendations for AI systems that support interpretive meaning-making without collapsing ambiguity or foreclosing user agency.
3
More Than a Dictionary: How AI Scaffolds the Journey from Digital Outsider to Insider
Yao Xiao (Academy of Information & Art design, Beijing, China)Qi Xin (Tsinghua University, Beijing, China)Angela Chulei. Tang (Institute for Creative New Media & Performing Arts(IMPA), Tsinghua University, Beijing, Beijing, China)Zhihao Yao (Tsinghua University, Beijing, Beijing, China)Shujie Yang (University of Michigan, Ann Arbor, Michigan, United States)Zhigang Wang (Academy of Arts & Design, Beijing, China)
Online communities often develop shared symbolic vocabularies that strengthen insider bonds but implicitly marginalize newcomers. On Chinese platforms, this dynamic is exemplified by “absurd language,” a style distinguished by irony, exaggeration, and local memes. While this form of expression fosters in-group intimacy, it creates significant cultural barriers for “Sino-digital non-natives.” This study investigates how AI can mediate cultural integration beyond mere translation. We developed an AI mediator integrating Chain-of-Thought (CoT) and Retrieval-Augmented Generation (RAG) to scaffold this journey. A mixed-methods evaluation (N=14) demonstrates significant improvements in comprehension accuracy over a baseline LLM. Crucially, our qualitative analysis reveals a novel five-stage model of cultural integration. This model charts the user's journey from peripheral observation to confident participation, detailing the AI's evolving role from “expert guide” to “creative collaborator.” Our findings illuminate the dynamics of agency and trust, offering a framework for designing AI as a catalyst for community integration.
2
When Plants Play: Rethinking Plant Materiality in Digital Games
Yoonji Lee (Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea, Republic of)Chang Hee Lee (KAIST (Korea Advanced Institute of Science and Technology), Daejoen, Korea, Republic of)
Plants are rarely positioned as active participants in digital games, serving as decorative elements or passive sensors. We present Plant.play(), a plant–digital game system that positions a living plant as the sole player in a pet-simulation game. Using bioelectrical signals, environmental data, and circadian rhythms, the plant autonomously performs caregiving actions while humans engage as observers. A workshop with five game experts informed the system's design, which was then implemented and deployed in a four-day exhibition. Observational fieldwork and interviews with twelve visitors revealed how people initially sought control, then gradually shifted toward interpreting the plant's slow, unpredictable, and impartial behaviors as meaningful play. Participants formed emotional connections with both the plant and the virtual pet, extending these reflections to their relationships with nonhuman beings. Our findings contribute empirical insights into interpretive engagement with nonhuman actors and offer design considerations for future plant–digital game systems that embrace materiality, perceived agency, and more-than-human perspectives.
2
Emotion Through Motion: How Shape-Changing Jewelry Conveys Emotions
Anke Brocker (RWTH Aachen University, Aachen, Germany)Felix Kasteel (RWTH Aachen University, Aachen, Germany)Sören Schröder (RWTH Aachen University, Aachen, Germany)Heiko Mueller (OFFIS, Oldenburg, Germany)Jürgen Steimle (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany)Jan Borchers (RWTH Aachen University, Aachen, Germany)
Shape-changing wearables are known to convey emotions to wearers and observers, and jewelry is commonly worn for self-expression and to be seen by others. But how do individual shape change parameters impact the emotions communicated? In a first study, participants observed a shape-changing necklace; the second included wearing it. The necklace uses pneumatic finger actuators; fabrication details are provided. We systematically varied motion type, speed, amplitude and repetition, and exterior material to analyze emotions using Russell's circumplex model. Additionally, we asked users what they associated with each shape change. We found some surprising relationships between shape change parameters and the valence and arousal levels of emotions wearers and observers perceived. Symmetrical actuations were recognized more accurately and received higher valence and arousal ratings. Interestingly, even when wearers, who only felt motions, misidentified them, their ratings matched those from observers. Our findings support creating shape-changing interfaces that communicate emotions more precisely.
2
A Meat-Summer Night's Dream: A Tangible Design Fiction Exploration of Eating Biohybrid Flying Robots
Ziming Wang (Chalmers University of Technology, Gothenburg, Sweden)Yiqian Wu (Chalmers University of Technology, Gothenburg, Sweden)Qingxiao Zheng (University at Buffalo, Buffalo, New York, United States)Shihan Zhang (alter+ (Alter Plus), San Francisco, California, United States)Ned Barker (King's College London, London, United Kingdom)Morten Fjeld (Chalmers University of Technology, Gothenburg, Sweden)
\textit{What if future dining involved eating robots?} We explore this question through a playful and poetic experiential dinner theater: a tangible design fiction staged as a 2052 Paris restaurant where diners consume a biohybrid flying robot in place of the banned delicacy of ortolan bunting. Moving beyond textual or visual speculation, our “dinner-in-the-drama” combined performance, ritual, and multisensory immersion to provoke reflection on sustainability, ethics, and cultural identity. Six participants from creative industries engaged as diners and role-players, responding with curiosity, discomfort, and philosophical debate. They imagined biohybrids as both plausible and unsettling—raising questions of sentience, symbolism, and technology adoption that extend beyond conventional sustainability framings of synthetic meat. Our contributions to HCI are threefold: (i) a speculative artifact that stages robots as food, (ii) empirical insights into how people negotiate cultural and ethical boundaries in post-natural eating, and (iii) a methodological advance in embodied, multisensory design fiction.
2
Beyond Links: Exploring Visual Representations of Multi-View Relations in Mixed Reality
Weizhou Luo (TUD Dresden University of Technology, Dresden, Germany)Rufat Rzayev (TUD Dresden University of Technology, Dresden, Germany)Benjamin Russig (TUD Dresden University of Technology, Dresden, Germany)Sivanon Visutarporn (TUD Dresden University of Technology, Dresden, Germany)Marc Satkowski (Fraunhofer Institute for Process Engineering and Packaging IVV, Dresden, Germany)Stefan Gumhold (TUD Dresden University of Technology, Dresden, Germany)Raimund Dachselt (TUD Dresden University of Technology, Dresden, Germany)
This paper investigates associations, explicit representations of relations between multiple views in Mixed Reality (MR). While research on 2D desktop environments offers extensive recommendations for communicating relations between multiple views, MR environments lack such systematic guidance, necessitating adapted solutions that consider their spatial affordances. To address this gap, we systematically explored association techniques in existing research. Building on established 2D multi-view literature and refining insights from prior design principles, we developed a codebook to describe view relations and their representations. Applying it to a corpus of 44 immersive multi-view approaches, we identified recurring design strategies and synthesized them into a design space of visual association techniques adapted for immersive contexts. Based on a lightweight prototyping framework, we validate the utility of the design space through three envisioning scenarios, demonstrating how associations can support exploration, coordination, and sensemaking in MR applications. Our results inform the design of MR multi-view environments.
2
SketchDynamics: Exploring Free-Form Sketches for Dynamic Intent Expression in Animation Generation
Boyu Li (The Hong Kong University of Science and Technology, Hong Kong SAR, China)Lin-Ping Yuan (The Hong Kong University of Science and Technology, Hong Kong SAR, China)Zeyu Wang (The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China)Hongbo Fu (Hong Kong University of Science and Technology, Hong Kong, China)
Sketching provides an intuitive way to convey dynamic intent in animation authoring (i.e., how elements change over time and space), making it a natural medium for automatic content creation. Yet existing approaches often constrain sketches to fixed command tokens or predefined visual forms, overlooking their free-form nature and the central role of humans in shaping intention. To address this, we introduce an interaction paradigm where users convey dynamic intent to a vision–language model via free-form sketching, instantiated here in a sketch storyboard to motion graphics workflow. We implement an interface and improve it through a three-stage study with 24 participants. The study shows how sketches convey motion with minimal input, how their inherent ambiguity requires users to be involved for clarification, and how sketches can visually guide video refinement. Our findings reveal the potential of sketch–AI interaction to bridge the gap between intention and outcome, and demonstrate its applicability to 3D animation and video generation.
2
The People's Gaze: Co-Designing and Refining Gaze Gestures with Users and Experts
Yaxiong Lei (University of St Andrews, St Andrews, United Kingdom)Xinya Gong (University of St Andrews, Fife, United Kingdom)Shijing He (King's College London, London, United Kingdom)Yafei Wang (Dalian Maritime University, Dalian, Liaoning, China)Mohamed Khamis (University of Glasgow, Glasgow, United Kingdom)Juan Ye (University of St Andrews, St Andrews, United Kingdom)
As eye-tracking becomes increasingly common in modern mobile devices, the potential for hands-free, gaze-based interaction grows, but current gesture sets are largely expert-designed and often misaligned with how users naturally move their eyes. To address this gap, we introduce a two-phase methodology for developing intuitive gaze gestures. First, four co-design workshops with 20 non-expert participants generated 102 initial concepts. Next, four gaze interaction experts reviewed and refined these into a set of 32 gestures. We found that non-experts, after a brief introduction, intuitively anchor gestures in familiar metaphors and develop a compositional grammar; i.e., activation (dwell) + action (gaze gesture or blink), to ensure intentionality and mitigate the classic Midas Touch problem. Experts prioritized gestures that are ergonomically sound, aligned with natural saccades, and reliably distinguishable. The resulting user-grounded, expert-validated gesture set, along with actionable design principles, provides a foundation for developing intuitive, hands-free interfaces for gaze-enabled devices.
2
LLooM: Weaving Stories and Probing Experiences of Language Technologies
Kimberley Paradis (University of Edinburgh, Edinburgh, United Kingdom)Lachlan D. Urquhart (University of Edinburgh, Edinburgh , United Kingdom)Tara Capel (University of Edinburgh, Edinburgh, United Kingdom)
This paper presents LLooM, a probe designed to capture situated, temporal, and contradictory experiences with language technologies such as voice assistants, chatbots, and LLMs. The design of LLooM draws on work in probes, feminist HCI, and storytelling to invite participants to write stories about their encounters with language technologies on fabric strips and weave them into looms. Through a public, researcher-facilitated, and collective participant deployment with 56 participants, LLooM enabled participants to share diverse perspectives on language technologies. This methodological approach makes two contributions to probe design in HCI: enabling participants to reshape the methodological assumptions underlying research and allowing participants' visible contributions to become provocations that support collaborative meaning-making across diverse experiences.
2
VisceroHaptics: Investigating the Effects of Gut-based Audio-Haptic Feedback on Gastric Feelings and Gastric Interoceptive Behavior
Mia Huong Nguyen (National University of Singapore, Singapore, Singapore)Moritz Alexander. Messerschmidt (National University of Singapore, Singapore, Singapore)Jochen Huber (Furtwangen University, Tuttlingen, Germany)Suranga Nanayakkara (School of Computing, National University of Singapore, Singapore, Singapore)
Gastric interoception influences eating behavior and emotions, making its modulation valuable for healthcare and human-computer-interaction applications. However, whether gastric interoception can be modulated noninvasively in humans remains unclear. While previous research indicates that abdominal-sound-driven haptic feedback resembles gut sensations, its impact on gastric feelings and gastric interoceptive behavior is unknown. We conducted three experiments totalling 55 participants to investigate how gut-sound-driven audio-haptic feedback applied to the stomach (1) affects user's feelings (2) influences perception of hunger and satiety levels and (3) influences gastric interoceptive behavior, quantified with Water Load Test-II. Results revealed that audio-haptic feedback patterns (a) induced the feelings of hunger, fullness, thirst, stomach upset, (b) increased hunger level, and (c) significantly increased volumes of ingested water. This work provides the first evidence that audio-haptic stimulation can alter gastric interoceptive behavior, motivating the use of noninvasive methods to influence users' feelings and behaviors in future applications.
2
Embedded vs. Situated: An Evaluation of AR Facial Training Feedback
Avinash Ajit Nargund (University of California Santa Barbara, Santa Barbara, California, United States)Andrea M.. Park (University of California San Francisco, San Francisco, California, United States)Tobias Höllerer (University of California, Santa Barbara, Santa Barbara, California, United States)Misha Sra (University of California, Santa Barbara, Santa Barbara, California, United States)
While augmented reality (AR) research demonstrates benefits of embedded visualizations for gross motor training, its applicability to facial exercises remains under-explored. Providing effective real-time feedback for facial muscle training presents unique design challenges, given the complexity of facial musculature. We developed three AR feedback approaches varying in spatial relationship to the user: situated (screen-fixed), proxy-embedded (on a mannequin), and fully embedded (overlaid on the user's face). In a within-subjects study (N=24), we measured exercise accuracy, cognitive load, and user preference during facial training tasks. The embedded feedback reduced cognitive load and received higher preference ratings, while the situated feedback enabled more precise corrections and higher accuracy. Qualitative analysis revealed a key design tension: embedded feedback improved experience but created self-consciousness and interpretive difficulty. We distill these insights into design considerations addressing the trade-offs for facial training systems, with implications for rehabilitation, performance training, and motor skill acquisition.
2
A Systematic Review of User Experiments on the Effects of Dark Patterns
Brennan Schaffner (Georgetown University, Washington, District of Columbia, United States)Luis Heysen (University of Chicago, Chicago, Illinois, United States)Marshini Chetty (University of Chicago, Chicago, Illinois, United States)
Deceptive/Manipulative Patterns (DMP) are interface designs, also known as "dark patterns," that manipulate user behavior. While considerable attention has been paid to their ethical and legal implications, empirical evidence about their real-world effects remains diffuse. This review synthesizes up-to-date experimental studies, focusing on works that quantify how (or whether) DMPs influence users. We also aggregate findings on interventions aimed at reducing DMP effects. Our synthesis highlights the experimental agreement that DMPs do significantly alter user behavior (with large variance in effect size) and that external interventions have been mostly unsuccessful in mitigating their effects. Lastly, we show that significant correlations between DMP effects and personal characteristics (e.g., age or political affiliation) are uncommon, indicating DMPs similarly affected nearly all populations tested. By summarizing the experimental evidence, we clarify the effects of DMPs, highlight gaps and tensions in the existing experimental literature, and help inform ongoing research and policy directions.
2
NatureCapture: Transforming Real-World Nature into Shared VR Experiences for Deepened Human-Nature Connection
Yidan Zhang (School of Computer Science and Engineering, Southeast University, Nanjing, China)Yazhen Wu (School of Computer Science and Engineering, Southeast University, Nanjing, China)Yang Wang (School of Cyber Science and Engineering, Southeast University, Nanjing, China)Zhuying Li (Southeast University, Nanjing, China)
Urbanization has limited people’s daily exposure to nature, reducing nature connection and overall well-being. Although virtual reality (VR) offers an alternative access to nature-like environments, it often lacks authenticity and connection to physical experiences. We present NatureCapture, a multi-user system that bridges real-world and virtual nature engagement by allowing users to capture real-world natural elements and collaboratively integrate them as interactive 3D models into a shared VR nature space. A two-week within-subjects study indicated that NatureCapture promoted nature connectedness, emotional regulation, and social closeness. Interviews further revealed that NatureCapture supported immersive and extended interactions with nature, promoted reciprocal engagement in virtual and real environments, and strengthened nature interaction through socially mediated engagement. Our work highlights the potential of user-driven real-to-3D transformation to preserve physical encounters with nature, combining the spatial flexibility and interactivity of VR. Such cross-environment paradigm offers a novel approach for sustaining human-nature connection in technologically mediated life.
2
FretFlow: Adaptive Haptics for Rhythm and Articulation in Guitar Learning
Xin Shu (Newcastle University, Newcastle Upon Tyne, United Kingdom)Lei Shi (Newcastle University, Newcastle upon Tyne, United Kingdom)Yiran Lin (McGill University, Montreal, Quebec, Canada)Yan Zeng (Stuart Weitzman School of Design, Philadelphia, Pennsylvania, United States)Tingting Luo (Virginia Polytechnic Institute and State University, Blacksburg, Virginia, United States)Justice Ou (UIUC, Champion, Illinois, United States)Mohamad Eid (New York University Abu Dhabi, Abu Dhabi, --- Select One ---, United Arab Emirates)Xinhuan Shu (Newcastle University, Newcastle Upon Tyne, United Kingdom)
Rhythm and articulation are essential for expressive guitar performance. Existing tools provide basic beat cues, whereas beginners often struggle to align with these cues when playing complex techniques, such as strumming and muting. Informed by a formative study with five instructors and grounded in embodied learning theories, we present FretFlow, a haptic vest-based tool that simulates common instructional practices to guide learners through physical interactions like tapping. The key to FretFlow is its design space that maps rhythmic and articulation patterns in various playing techniques to distinct haptic patterns, enabling authoring of haptic scores. FretFlow further dynamically adapts haptic intensity based on learners' real-time performance accuracy, accompanied by multimodal guidance across haptic, visual, and audio channels. We iteratively refined haptic designs across two rounds with 46 participants, followed by a two-week user study with 20 beginners. Results show that FretFlow improves learners’ rhythmic accuracy and expressive performance.
2
Meme, Myself and AR: Exploring Memes Sharing in Face-to-face Conversation using Augmented Reality
Yanni Mei (TU Darmstadt, Darmstadt, Germany)Samuel Wendt (Technical University Darmstadt, Darmstadt, Hesse, Germany)Florian Müller (TU Darmstadt, Darmstadt, Germany)Jan Gugenheimer (TU-Darmstadt, Darmstadt, Germany)
Internet memes are central to online communication, yet their visual humor is often lost in face-to-face (F2F) conversations. Augmented reality (AR) offers new ways to bring memes into F2F interactions, but it is unclear how memes can be integrated into F2F conversations using AR, and how they impact conversational dynamics. We surveyed meme users (N=29) to understand motivations and challenges in visualising memes in F2F conversations. With these insights, we developed an AR meme-sharing prototype and invited 12 pairs of friends to design AR visualizations for their memes and use them in conversations. Our analysis reveals two AR-unique visualizations: merging memes with one's body (The-Meme-On-Me) and situating oneself in meme environment (Me-In-The-Meme). We observed two integration patterns: using speech as setup before a meme punchline, and showing memes simultaneously with speech to amplify humor. We report users’ reactions toward AR memes, showing how it enables playful social interaction.
2
Animated Public Furniture as an Interaction Mediator: Engaging Passersby In-the-Wild with Robotic Benches
Xinyan Yu (School of Architecture, Design and Planning, The University of Sydney, Sydney, NSW, Australia)Marius Hoggenmüller (School of Architecture, Design and Planning, The University of Sydney, Sydney, NSW, Australia)Xin Lu (The University of Sydney, Sydney, Australia)Ozan Balcı (KU Leuven, Leuven, Belgium)Martin Tomitsch (University of Technology Sydney, Sydney, NSW, Australia)Andrew Vande Moere (KU Leuven, Leuven, Belgium)Alex Binh Vinh Duc Nguyen (KU Leuven, Leuven, Belgium)
Urban HCI investigates how digital technologies shape human behaviour within the social, spatial, temporal dynamics of public space. Meanwhile, robotic furniture research demonstrates how the purposeful animation of mundane utilitarian elements can influence human behaviour in everyday contexts. Taken together, these strands highlight an untapped opportunity to investigate how animated public furniture could mediate social interaction in urban environments. In this paper, we present the design process and in-the-wild study of mobile robotic benches that reconfigure with a semi-outdoor public space. Our findings show that the gestural performance of the benches manifested three affordances perceived by passersby, they activated engagement as robots, redistributed engagement as spatial elements, and settled engagement as infrastructure. We proposed an Affordance Transition Model (ATM) describing how robotic furniture could proactively facilitate transition between these affordances to engage passersby. Our study bridges robotic furniture and urban HCI to activate human experience with the built environment purposefully.
2
Belt and whistles - adding lower body collision awareness for MR experiences
Diar Karim (University of Birmingham, Birmingham, United Kingdom)Devika Mukherjee (University of Birmingham, Birmingham, United Kingdom)Daniele Giunchi (University of Birmingham, Birmingham, United Kingdom)Massimiliano Di Luca (University of Birmingham, Birmingham, United Kingdom)Dr. Eyal Ofek (University of Birmingham, Birmingham, United Kingdom)
Users of Virtual Reality (VR) primarily sense their environment through audiovisual cues. The lack of haptic feedback on their body can make them unaware of virtual obstacles outside their field of view. This lack of sensing can cause the user to unknowingly penetrate virtual objects, breaking the scene’s plausibility and disrupting the experience of other users in the same virtual space. We propose a haptic belt that increases the user’s scene awareness by rendering signals of collisions and proximity to virtual objects around the user. In a user study, we show that the belt improves spatial awareness both in a fast, high-stress scenario where the user's attention is limited and during a relaxed experience where the belt is the only source of information. The belt enables users to move closer to obstacles while reducing unintended collisions
2
Gaze and Speech in Multimodal Human-Computer Interaction: A Scoping Review
Anam Ahmad Khan (KAIST, Daejeon, Korea, Republic of)Florian Weidner (Glasgow University, Glasgow, United Kingdom)Jungwoo Rhee (KAIST, Daejeon, Korea, Republic of)Yasmeen Abdrabou (Technical University of Munich , München, Germany)Andrea Bianchi (KAIST, Daejeon, Korea, Republic of)Eduardo Velloso (The University of Sydney, Sydney, New South Wales, Australia)Hans Gellersen (Lancaster University, Lancaster, United Kingdom)Joshua Newn (RMIT University, Melbourne, VIC, Australia)
Multimodal interaction has long promised to make interfaces more intuitive and effective by combining complementary inputs. Among these, gaze and speech form a compelling pairing: gaze provides rapid spatial grounding, while speech conveys rich semantic information. Together, they offer rich cues for understanding user behaviour and intent. Yet despite decades of exploration, the research remains fragmented, making this synthesis timely as these inputs mature and are integrated into consumer-ready devices. This scoping review examined 103 studies published between 1991 and 2025, organised into \emph{explicit}, where users intentionally provide gaze and speech, and \emph{implicit}, where systems leverage users' natural behaviours to support interaction. Across both, we identified recurring ways for combining gaze and speech to resolve ambiguity, ground references, and support adaptivity. We contribute a synthesis of research on their combined use while highlighting challenges of temporal alignment, fusion and privacy, offering guidance for future research toward richer multimodal human-computer interaction.
2
Sci-Fi Spark: A Human-AI Co-Creation System for Science Fiction Ideation
Zhaojun Jiang (Zhejiang University, Hangzhou, Zhejiang, China)Wengteng Cheang (Zhejiang University, Hangzhou, China)Xuanpei Xu (Zhejiang university, Hangzhou, Zhejiang, China)Haoyu Zuo (Imperial College London, London, United Kingdom)Chunyuan Zheng (Zhejiang University, Hangzhou, China)Liuqing Chen (Zhejiang University, Hangzhou, China)
In science fiction writing, ideation demands both novelty to construct fictional worlds and consistency to maintain internal and temporal logic within those worlds. While large language models (LLMs) are increasingly adopted as co-creators, generated ideas often lack surprise and struggle to maintain consistency. Moreover, current interaction paradigms of human-AI co-creation systems fail to support the fragmented and iterative nature of science fiction ideation. To address these challenges, we introduce Sci-Fi Spark, a human-AI co-creation system to support inspiration and organization in the ideation phase. The system features an Ideation Canvas for visualizing relationships between fragmented ideas, a Novelty Generator that applies computational creativity strategies to produce novel worldbuilding inspirations, and a Consistency Generator to produce context-aware storyline suggestions. A technical evaluation and a user study with writers show that Sci-Fi Spark enhances both novelty and consistency, while enabling iterative co-ideation with LLMs.
2
TF-Shell: Facilitating Physical Deformation with Iterative and Shape Memory Thermoforming for 3D Printing
Donghyeon Ko (School of ICT Convergence, University of Ulsan, Ulsan, Korea, Republic of)Myeongseong Kim (KIST, Seoul, Korea, Republic of)Yoonji Kim (Chung-Ang University, Seoul, Korea, Republic of)Woohun Lee (KAIST, Daejeon, Korea, Republic of)
Prototyping with 3D printing depends heavily on virtual modeling, which requires expertise and often leads to scale mismatches and inefficient iteration. Physical deformation through heating is possible but challenging, as heating is difficult to control and deformation remains complex. We introduce TF-Shell, a thermoformable shell that enables repeatable, localized thermoforming of 3D-printed prototypes. Leveraging shape-memory properties, TF-Shell allows 3D-printed objects to achieve volumetric deformation, restoration, and shape memorization within the physical prototyping process. With customizable features, it can be embedded into free-form models through a design tool. A user study shows that TF-Shell provides intuitive, convenient physical modification and expands iteration beyond virtual modeling. Technical evaluations confirm its thermoformability and repeatability, establishing TF-Shell as a practical approach for integrating physical deformation into 3D printing workflows.
2
XSynth: GenAI-Empowered Shared Mental Model Building for Conceptual Design Collaboration in Extended Reality
Yaning Li (Northeastern University , Boston, Massachusetts, United States)Shumin Li (Politecnico di Milano , Milan, Italy)Ziyao He (Northeastern University, Boston, Massachusetts, United States)Dakuo Wang (Northeastern University, Boston, Massachusetts, United States)
Effective conceptual design collaboration requires teams to build shared mental models (SMMs). Although Extended Reality (XR) technologies support design collaboration, they often lack structured cognition support for such alignment. To address this, we conducted this research within the sandbox of automotive design, and firstly identified key cognitive challenges in its collaboration. We then developed XSynth, a GenAI-powered XR system grounded in Concept–Knowledge Theory. XSynth scaffolds designers’ reasoning, externalizes individual mental models as knowledge graphs, and merges them into a unified graph to facilitate SMMs building. We evaluated XSynth in a within-subject experiment containing 10 design teams (N=30) using mixed-method approach. Results showed that XSynth significantly reduced workload, enhanced creativity support, strengthened perceived SMMs, and improved design performance. This research contributes to HCI by introducing the design and implementation of a theory-grounded, GenAI-powered, XR-based cognition support tool. It also offers empirical evidence into the effectiveness of XSynth, and design implications for future cognition support tools in collaborative settings.
2
skCAD: A Design Tool for Solid Knitting with Automatic Pattern Generation
Yuichi Hirose (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)Maria Larsson (University of Tokyo, Tokyo, Japan)Takeo Igarashi (The University of Tokyo, Tokyo, Japan)
Solid knitting is a fabrication technique for producing dense 3D volumes through knitting. Designing such objects is difficult because yarn paths must remain continuous—formed from one (or a few) yarn(s)—while handling increases and decreases across three dimensions. To address this challenge, we introduce skCAD, a block-based design tool that allows users to compose 3D forms by stacking rectangular blocks, which are then automatically converted into solid-knitting patterns. To build skCAD, we also standardized a grammar of solid knitting that formalizes stitch and row operations, making it possible to construct patterns beyond basic shapes. Our tool and grammar enable the creation of complex solid-knitted objects, and help those interested to learn and explore this technique. We evaluated the system in a workshop with knitters, yielding insights into design needs and directions for future development.
2
Connected Material Experiences using Bimanual Vibrotactile Crosstalk in Virtual Reality
Nihar Sabnis (Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany)André Zenner (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany)Erik Peralta Løvaas (Max Planck Institute for Informatics, Saarbrücken, Germany)Marco Weiss (University of Saarland, Saarbrücken , Saarland, Germany)Andrea Bianchi (KAIST, Daejeon, Korea, Republic of)Paul Strohmeier (Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbrücken, Germany)
Perceiving material properties such as elasticity, flexibility, and torsion is inherently bimanual, as we rely on the relative motion of our hands to form a unified sense of materiality. Yet, most vibrotactile material rendering approaches are limited to a single hand or finger. While prior work has explored bimanual haptic interfaces, most depend on specialized hardware for specific interactions. In this paper, we demonstrate design strategies to support bimanual material exploration through motion-coupled vibrotactile feedback. Our technique introduces variable crosstalk between the controllers' vibration to evoke connectedness, making two unconnected devices feel as though they manipulate a single object. The technique generalizes motion-coupled feedback approaches beyond previous single-point explorations. Through two user studies, we show that this approach (1) significantly enhances perceived connectedness and (2) conveys distinct material qualities such as elasticity and torsion. Finally, we present \textit{Dvihastīya}, an authoring tool for designing connected bimanual experiences in virtual reality.
2
AR-Cues Change Users’ Strategy for Dealing with Deferrable Interruptions
Kilian L. Bahnsen (Julius-Maximilians-Universität Würzburg, Würzburg, Germany)Tobias Grundgeiger (Julius-Maximilians-Universität Würzburg, Würzburg, Germany)
When given the opportunity, people tend to try to reach coarse breakpoints for work interruptions. Coarse breakpoints are frequently associated with less effort when resuming the task. We investigated how supporting task resumption with augmented reality (AR)-cues affects this behavior. In a mixed factorial experiment, 50 participants performed a physical sorting task that included deferrable interruptions with varying distances to a coarse breakpoint, either with or without an AR-cue indicating the next correct step after interruption. Participants with AR-cue accepted interruptions at fine breakpoints more frequently than those without a cue, except when the coarse breakpoint was one step away, and reported less stress. Our findings indicate that AR-cues attenuate but do not eliminate the need for specific task resumption strategies, such as reaching a coarse breakpoint, and reduce the stress. Considering AR-cues for task resumption may be particularly beneficial for time-critical interruptions and fast-paced work environments.
2
Haptic Representation Method for Material Properties utilizing Pseudo-weight Shifting
Masaharu Hirose (The University of Tokyo, Tokyo, Japan)Masahiko Inami (University of Tokyo, Tokyo, Japan)
Force cues contribute significantly to the perception of material properties. Building on this principle, we propose a novel method that represents material properties utilizing pseudo-attraction force. Our method generates this perceived force in response to user motion, with a compact interface that produces asymmetric vibrations. This force sensation induces a perceived weight shift (Pseudo-weight shift), creating the perception of internal dynamics to convey the physical presence of a virtual object. System evaluations confirmed that the method produces a sensation equivalent to the inertial force of a 17.7 g mass. Furthermore, a large-scale user study and psychophysical experiment revealed that our method enables parametric control of perceived material properties, particularly viscosity, by modulating the vibration profile. This approach demonstrates that perceived force effectively substitutes for physical force, enabling vivid material representation through a compact interface and simple design. This expands the design space for expressive handheld haptics.
2
HistoryPalette: Supporting Exploration and Reuse of Past Alternatives in Image Generation and Editing
Karim Benharrak (University of California, Berkeley, Berkeley, California, United States)Amy Pavel (University of California, Berkeley, Berkeley, California, United States)
Creative tasks require creators to iteratively produce, select, and discard potentially useful ideas. Now, creativity tools include generative AI features (e.g., Photoshop Generative Fill) that increase the number of alternatives creators consider through rapid experiments with prompts and random generations. Creators use tedious manual systems for organizing their prior ideas by saving file versions or hiding layers, but they lack the support they want for reusing prior alternatives in personal work or in communication with others. We present HistoryPalette, a system that supports exploration and reuse of prior designs in generative image creation and editing. Using HistoryPalette, creators and their collaborators explore a "palette" of prior design alternatives organized by spatial position, topic category, and creation time. HistoryPalette enables creators to quickly preview and reuse their prior work. In creative professional and client collaborator user studies, participants generated and edited images by exploring and reusing past design alternatives with HistoryPalette.
2
Reminiscences of Futures (RoF): Designing and Studying Encounters with Embodied, AI-Generated Future Selves
Jiwon Lee (KAIST, Daejeon, Korea, Republic of)Yewon Kim (KAIST, Daejeon, Korea, Republic of)Chang-Min Kim (Sungkyunkwan University, Seoul, Korea, Republic of)Suhyun Lim (Korea Advanced Institute of Science and Technology, Daejeon, Daejeon, Korea, Republic of)Chang Hyun Park (KAIST, Daejeon, Korea, Republic of)Subin Cho (Korea Advanced Institute of Science and Technology, Daejeon, Korea, Republic of)Tek-Jin Nam (KAIST, Daejeon, Korea, Republic of)
AI-generated future selves have been explored for self-reflection and counseling, yet most remain confined to chat, voice, or diary formats. We introduce RoF (Reminiscences of Futures), a system that enables users to encounter and converse with embodied future selves. It synthesizes voice and appearance from personal data and generates three projections of the user ten years ahead, situated within a tunnel-like installation that evokes a time-slip experience. We report the design process, stepwise judgements, and a formative study with six parent–child pairs that informed design strategies. We also present a week-long user study with fifteen participants. Participants perceived RoF as an emotionally rich experience, reporting shifts in their attitudes toward the future and deeper reflection on their present identity and life. We discuss the implications of interacting with future selves for fostering reflection and preparing positively for the future, as well as ethical issues, such as self-replication using AI.
2
Investigating Single-Handed Microgesture Scrolling Techniques
Suliac Lavenant (Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 CRIStAL, Lille, France)Alix Goguey (Univ. Grenoble Alpes, CNRS, Grenoble INP, LIG, Grenoble, France)Sylvain Malacria (Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 CRIStAL, Lille, France)Laurence Nigay (Univ. Grenoble Alpes, CNRS, Grenoble INP, LIG, Grenoble, France)Thomas Pietrzak (Univ. Lille, CNRS, Inria, Centrale Lille, UMR 9189 CRIStAL, Lille, France)
Scrolling is ubiquitous in our daily computing experience. We explore how single-handed microgestures can be used for scrolling. Based on an analysis of the basic components necessary for scrolling, we selected 3 microgestures: Tap, Hold and Drag. Considering both rate and position controls, we designed 4 microgesture-based scrolling techniques adapted to these 3 microgestures. We contrasted these 4 techniques in a laboratory experiment with 24 participants who performed 2 tasks: a reciprocal selection task, where participants scrolled the view to reach and select a target; and a counting task, where participants scrolled the view to count image occurrences. Our results suggest that the technique based on Drag microgestures with rate control is the most effective for scrolling operations, regardless of the task. This work demonstrates that microgestures, with their advantages for frequent everyday tasks, offer a promising approach to continuous and efficient scrolling control.
2
When a Robot Communicates Through Air: Contextual Interpretations of Wind and Olfactory Cues
Chaeeun Noh (Chungnam National University, Daejeon, Korea, Republic of)Jaejeung Kim (Chungnam National University, Daejeon, Korea, Republic of)
This study explores how nonverbal, sensory cues—olfactory and wind—can serve as subtle channels for behavioral guidance in mobile human-robot interaction. As multimodal interaction becomes increasingly integral to HRI, implicit communication remains underexplored, particularly through non-visual and non-auditory modalities. To address this gap, we conducted a Wizard-of-Oz study with 35 participants who experienced three types of stimuli—strong wind, weak wind, and olfactory cues—across six contextual scenarios. Our findings show that such sensory cues can induce affective interpretations ranging from support to surveillance, depending on the context. Olfactory cues generally evoked more positive impressions and a greater sense of care than wind, while wind cues were perceived as more directive and intrusive in comparison. These results suggest that scent and wind offer promising potential as ambient, affective, and non-intrusive notification channels for future human-robot interaction systems.
2
From Answer Engines to Learning Partners: A Dual-ZPD Design Framework for AI-Supported Learning
Reinhard Klein (University of Bonn, Bonn, Germany)Daria Benden (University of Bonn, Bonn, Germany)Alexander Schier (Uni Bonn, Bonn, Germany)David Stotko (University of Bonn, Bonn, Germany)Fani Lauermann (University of Bonn, Bonn, Germany)
Generative AI's function as a frictionless "answer engine" creates a paradox in educational HCI: the very tools that can enhance intellect may also weaken it by allowing users to circumvent crucial cognitive processes. This risks creating a "hollowed mind"---knowledge that is broad but superficial, and a user experience that diminishes learner agency. The convenience of cognitive offloading introduces a motivational challenge that traditional cognitive scaffolding cannot address. We argue that designing genuine human-AI partnerships in learning requires moving beyond cognitive support to motivation-aware scaffolding. This paper provides a toolkit for building motivation-aware AI systems. At its core is the Dual Zone of Proximal Development (DZPD), a conceptual framework building on foundational work in educational psychology. We introduce an overarching design principle, concrete design principles, illustrative archetypes, and examples of measurable indicators. These conceptual tools offer essential guidance for the next wave of empirical HCI research in education.
2
User-reconfigured Haptics: Combining User-Reconfiguration and Visual Manipulations to Enhance Dynamic Passive Haptic Experiences for VR
Xinrong Wang (Saarland Informatics Campus (DFKI), Saarbrücken, Germany)Yu Jiang (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany)Martin Schmitz (University of Koblenz, Koblenz, Germany)Jürgen Steimle (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany)Antonio Krueger (DFKI, Saarbrücken, Germany)Donald Degraen (University of Canterbury, Christchurch, New Zealand)
Virtual Reality (VR) depends on haptic feedback to create immersive experiences. Traditional passive proxies align physical props with their virtual counterparts but remain limited in scalability and expressiveness, or require bulky actuators to support reconfiguration. We introduce User-reconfigured Haptics, an approach that utilizes implicit user actions to reconfigure haptic interfaces to extend the gamut of VR haptic experiences. Modular 3D-printed cells are assembled into dynamic interfaces that express diverse haptic properties such as softness and weight. By masking physical reconfigurations with visual (re)mapping, user actions unnoticeably change haptic properties, resulting in user-driven, dynamic haptic experiences. User studies show that our design can provide distinguishable haptic experiences and is perceived as realistic and enjoyable in a VR task. We further showcase four applications: a fishing rod that changes weight and flexibility, a dynamic desktop of pressable buttons, a glove with adjustable squeezing, and a crossbow with variable pulling resistance.
2
AirForce: Personal Fabrication of Large-Scale, Load-Bearing Animatronics Structures from a Single Tube
Lukas Rambold (Hasso Plattner Institute, Potsdam, Germany)Robert Kovacs (Hasso Plattner Institute, Potsdam, Germany)Min Deng (Hasso Plattner Institute, Potsdam, Germany)Antonius Naumann (Hasso Plattner Institute, Potsdam, Germany)Konrad C. V.. Gerlach (Hasso Plattner Institute, Potsdam, Germany)Horatio Montero. Hamkins (Hasso-Plattner-Institute, Potsdam, Germany)Helena Lendowski (Hasso-Plattner-Institute, Potsdam, Germany)Chiao Fang (Hasso Plattner Institute, Potsdam, Germany)Shohei Katakura (Hasso Plattner Institute, Potsdam, Germany)Conrad Lempert (Hasso Plattner Institute, Potsdam, Germany)Muhammad Abdullah (Hasso Plattner Institute, Potsdam, Germany)Patrick Baudisch (Hasso Plattner Institute, Potsdam, Germany)
We present a fabrication system called AirForce that allows users to create large-scale, load-bearing animated structures from a single inflatable tube. AirForce builds on the personal fabrication of animated truss structures, based on which it replaces not only the static elements with tube, but also introduces tube-based actuators that integrate with that same tube. This ‘single-tube’ design affords efficient single-person assembly, excellent power-to-weight ratio, easy transport and setup, and 100% material reuse. We show three variants of actuators: buckling actuators for pushing, muscle actuators for pulling, and telescoping actuators for large forces. Our blender plugin enables users to place actuators in structures and export instructions for efficient fabrication. We demonstrate a 6DOF motion platform that lifts humans and an 8m high animatronic T-rex that animates with 3DOF, enabled by custom hardware components. In our technical evaluation, the three actuators delivered 480N, 1420N, and 2330N peak forces, respectively.
2
HiFiGaze: Improving Eye Tracking Accuracy Using Screen Content Knowledge
Taejun Kim (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)Vimal Mollyn (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)Riku Arakawa (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)Chris Harrison (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)
We present a new and accurate approach for gaze estimation on consumer computing devices. We take advantage of continued strides in the quality of user-facing cameras found in e.g., smartphones, laptops, and desktops — 4K or greater in high-end devices — such that it is now possible to capture the 2D reflection of a device's screen in the user's eyes. This alone is insufficient for accurate gaze tracking due to the near-infinite variety of screen content. Crucially, however, the device knows what is being displayed on its own screen — in this work, we show this information allows for robust segmentation of the reflection, the location and size of which encodes the user's screen-relative gaze target. We explore several strategies to leverage this useful signal, quantifying performance in a user study. Our best performing model reduces mean tracking error by ~18% compared to a baseline appearance-based model. A supplemental study reveals an additional 10-20% improvement if the gaze-tracking camera is located at the bottom of the device.
2
LiqMetCraft: A Toolkit for Creating Papercraft with Embedded Electronics By Directly Cutting and Folding Liquid-Metal-Dyed Paper-like Fabric
Qi Zhang (School of Creative Media, City University of Hong Kong, Hong Kong, China)Shuwen Jiang (City University of Hong Kong, Hong Kong, China)Zeshui Li (School of Creative Media, Hong Kong, Hong Kong, China)Yong Lyu (Hong Kong Productivity Council, Hong Kong, China)TIANDE MO (Hong Kong Productivity Council, Hong Kong, China)Kening Zhu (City University of Hong Kong, HongKong, China)
Creating interactive papercrafts often involves the processes of craft making (e.g., folding, cutting, gluing, etc.) and fabricating the embedded functional circuitry. These two processes are usually separated in the current practice, making the workflow laborious and affecting the in-paper circuit stability. To address the issue of the separated crafting and circuiting processes, we present LiqMetCraft, a toolkit for creating electronics-embedded papercrafts through an integrated process. The toolkit allows users to construct the craft structure by folding and cutting, and forms the circuit traces simultaneously. This is achieved with liquid-metal-dyed paper-like fabric which partially becomes conductive due to the cutting/folding-induced pressure while the unpressed parts of the paper remain insulated. The toolkit consists of software interfaces for papercraft design and hardware components, mainly the liquid-metal-dyed paper-like fabrics and other off-the-shelf components, for physical prototyping. The user studies shows that the participants quickly learned the toolkit and found the integrated process of circuit assembly and shape formation to be engaging and inspiring.
2
WELDAR: Augmenting Live Hands-On Training with In-Situ Guidance for Novice Learners
Chuhan(Franklin) Xu (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)Lia Sparingga. Purnamasari (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)Zhenfang Chen (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)Daragh Byrne (Carnegie Mellon University, Pittsburgh, Pennsylvania, United States)Dina EL-Zanfaly (Carnegie Mellon University, PITTSBURGH , Pennsylvania, United States)
Extended Reality (XR) systems for physical skill training have largely emphasized simulation rather than real-time in-situ instruction. We present WeldAR, an Augmented Reality (AR) system with five learning modules that overlays real-time guidance during live welding using a headset integrated into a welding helmet and a torch attachment. We conducted an in-situ within-subjects study with 24 novices, comparing AR guidance to video instruction for live welding across practice and unassisted tests. AR improved performance in both assisted practice and unassisted tests, primarily driven by gains in travel speed and work angle. By offering real-time feedback on four performance measures, AR supported novices in carrying embodied knowledge into independent tasks. Our contributions include: (1) WeldAR for in-situ physical skill training; (2) empirical evidence that AR enhances composite welding performance and key physical skills; and (3) implications for the development of AR systems that support in-situ, embodied skill training in welding and related trades.
2
Screen-Directed Stretching: Supporting Ergonomic Neck Stretching in XR Workspaces
Ryo Sasaki (Tohoku University, Sendai, Miyagi, Japan)Kazuyuki Fujita (Tohoku University, Sendai, Miyagi, Japan)Yudai Tanaka (Tohoku University, Sendai, Miyagi, Japan)Ryo Takahara (TATAMI inc., Kawasaki, Kanagawa, Japan)Kumpei Ogawa (Tohoku University, Sendai, Japan)Yoshifumi Kitamura (Tohoku University, Sendai, Miyagi, Japan)
Habitual static stretching is recommended in many ergonomics guidelines, but continuing this habit remains challenging to workers. We address two factors causing this difficulty: most workers lack an understanding of the appropriate mechanisms of stretching, and stretching sessions require the interruption of ongoing tasks. We propose Screen-Directed Stretching, a novel technique that supports neck stretching in extended reality (XR) workspaces without interrupting work. Our technique temporarily repositions the virtual screen that the user is focusing on, guiding them to rotate their head in yaw, pitch, and roll directions and to maintain a posture for a specific duration, thus facilitating muscle extension. Through two preliminary user studies, we developed a prototype that seamlessly switches the screen's coordinate system between world-bound and body-bound frames of reference, balancing practical workability and good stretching guidance. A user study (N=16) demonstrates that our technique effectively induces stretching movements while minimizing loss of task efficiency.
2
Uniquely Shaped Spaces: Object-Driven Algorithmic Shelf Design and Fabrication
Deanna Gelosi (University of Colorado, Boulder, Boulder, Colorado, United States)Michael L.. Rivera (University of Colorado Boulder, Boulder, Colorado, United States)Laura Devendorf (University of Colorado Boulder, Boulder, Colorado, United States)
Most shelving relies on rectangular compartments that ignore the contours of the objects they hold. We present Uniquely Shaped Spaces, an object-driven algorithmic tool for custom shelving generation. The workflow arranges users' object silhouettes with simulated annealing, grows walls via cellular automata to carve fitted voids, and outputs fabrication files with joinery for laser cutting. We designed the system so that objects, our algorithm, and users share authorship, and studied how this configuration played out with five participants as they designed shelves in guided workshops and then lived with the fabricated pieces. Our findings show how participants navigated object geometry, algorithmic search, and fabrication limits by curating, tweaking, and appropriating algorithmic proposals, and how the resulting shelves supported reflection and storytelling. These results point toward object-driven fabrication systems that foreground objects as generative constraints and explicitly support negotiation within constraint-driven workflows.
2
``Control Is a Trajectory, Not a Point'': Conceptualizing Control in Human-AI Co-Creativity
Alayt Issak (Northeastern University, Boston, Massachusetts, United States)Jeba Rezwana (Towson University, Towson, Maryland, United States)Casper Harteveld (Northeastern University, Boston, Massachusetts, United States)
Control is a critical yet underexplored concept in human-AI co-creativity and more broadly human-AI collaboration, where AI systems are expected to act as collaborative partners with creative autonomy. Existing frameworks for characterizing control remain limited and often fall short in capturing the tensions and complexities of co-creation dynamics. In this paper, we examine how experts conceptualize control and expect human-AI control dynamics by leveraging a recent framework on characterizing control as our theoretical probe. We conduct a semi-structured focus group study with nine experts in HCI, co-creativity, and AI. Our findings reveal that control is widely viewed as a dynamic, context-dependent construct that should adapt across different phases of co-creation, domains, and levels of trust in AI. Drawing on our findings, we propose a conceptualization of control along with actionable design implications for designing such AI systems. This work contributes to the literature on Human-AI collaboration, Computational Creativity, and HCI, advancing our understanding of control in co-creative human-AI partnerships.
2
Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight
Jingyu Tang (University of Notre Dame, Notre Dame, Indiana, United States)Chaoran Chen (University of Notre Dame, Notre Dame, Indiana, United States)Jiawen Li (University of Michigan, Ann Arbor, Michigan, United States)Zhiping Zhang (Northeastern University, Boston, Massachusetts, United States)Bingcan Guo (University of Washington, Seattle, Washington, United States)Ibrahim Khalilov (Johns Hopkins, Baltimore, Maryland, United States)Simret Araya. Gebreegziabher (University of Notre Dame, Notre Dame, Indiana, United States)Bingsheng Yao (Northeastern University, Boston, Massachusetts, United States)Dakuo Wang (Northeastern University, Boston, Massachusetts, United States)Yanfang Ye (University of Notre Dame, Notre Dame, Indiana, United States)Tianshi Li (Northeastern University, Boston, Massachusetts, United States)Ziang Xiao (Johns Hopkins University, Baltimore, Maryland, United States)Yaxing Yao (Johns Hopkins University , Baltimore, Maryland, United States)Toby Jia-Jun. Li (University of Notre Dame, Notre Dame, Indiana, United States)
The dark patterns, deceptive interface designs manipulating user behaviors, have been extensively studied for their effects on human decision-making and autonomy. Yet, with the rising prominence of LLM-powered GUI agents that automate tasks from high-level intents, understanding how dark patterns affect agents is increasingly important. We present a two-phase empirical study examining how agents, human participants, and human-AI teams respond to 16 types of dark patterns across diverse scenarios. Phase 1 highlights that agents often fail to recognize dark patterns, and even when aware, prioritize task completion over protective action. Phase 2 revealed divergent failure modes: humans succumb due to cognitive shortcuts and habitual compliance, while agents falter from procedural blind spots. Human oversight improved avoidance but introduced costs such as attentional tunneling and cognitive load. Our findings show neither humans nor agents are uniformly resilient, and collaboration introduces new vulnerabilities, suggesting design needs for transparency, adjustable autonomy, and oversight.
2
When Play Hurts: Understanding Common Barriers in Movement-Based Games
Sebastian Cmentowski (Eindhoven University of Technology, Eindhoven, Netherlands)Sukran Karaosmanoglu (Universität Hamburg, Hamburg, Germany)Frank Steinicke (Universität Hamburg, Hamburg, Germany)Regina Bernhaupt (Eindhoven University of Technology, Eindhoven, Netherlands)
Exergames promise enjoyable physical activity through gameplay, yet players often face barriers that undermine engagement, safety, and retention. To date, knowledge about which barriers are encountered by end-users of commercial exergames and which mitigation strategies are used is limited. To address this gap, we conducted an online survey with 174 participants and provide a comprehensive organization of 60 reported barriers across six categories: physical, mental, social, environmental, technological, and game design. Key barriers include space limitations, social discomfort, addictive gameplay, and injuries. Our analysis reveals that while players try to mitigate barriers through ad-hoc strategies, issues like embarrassment, addiction, and harassment remain difficult to overcome. These findings highlight the need for more adaptive game designs, including dynamic spatial adjustments, personalized pacing mechanisms, and supportive social features. This work advances the understanding of exergame barriers and their impact and offers actionable insights for designing more inclusive and resilient movement-based games.
2
Sketching vs. AI Prompt Based Design Intent Evolution in Undergraduate Students: an Exploratory Study
Vanessa Sattele (National Autonomous University of Mexico (UNAM), Mexico City, Mexico)Juan Carlos Ortiz (National Autonomous University of Mexico (UNAM), Mexico City, Mexico)
The use of AI in product design during early creative phases raises questions about its long-term consequences. Concerns are that extended AI use might inhibit creative cognitive processes, especially in novice designers. The aim of this study is to contribute to ongoing research in creative cognition and creative support tools such as AI in design. We conducted an exploratory study with 61 undergraduate students to analyze design exploration in sketching versus AI concept generation. The results indicate that AI groups produced a higher quantity and variation of total ideas (including text-based ideas), while sketch groups generated more image-based ideas. It was inconclusive whether the final image concepts from both AI and sketch groups were more creative. Additionally, homogenization effects were observed in the AI groups. Moreover, while the evolution of the design intent was evident in students who sketched, the focus in AI groups appeared to shift towards the tool (AI), which we analyzed as different design space exploration (DSE) prompting styles.
2
Personal Validation Effect in LLMs: Positive AI Responses Bias Perceptions of Validity, Reliability, Personalization, and Usefulness of Fictitious Predictions
Pat Pataranutaporn (Massachusetts Institute of Technology, Boston, Massachusetts, United States)Eunhae Lee (MIT Media Lab, Cambridge, Massachusetts, United States)Judith Amores (MIT, Cambridge, Massachusetts, United States)Pattie Maes (MIT , Cambridge, Massachusetts, United States)
Large Language Models (LLMs) are becoming increasingly ubiquitous in daily life, impacting decision-making across various domains. A substantial body of prior work has shown that individuals tend to evaluate positive predictions more favorably than negative ones---a phenomenon often referred to as the personal validation effect---across various non-AI prediction sources. Building on this foundation, we extend this well-established psychological effect to the context of LLM-based predictions, examining how prediction valence influences users’ perceptions when the source is an AI system. We investigate how positive AI-generated responses affect perceived validity, personalization, reliability, and usefulness of chatbot predictions, even when those predictions are fictitious and pre-scripted. In a study of 238 participants, positive predictions were perceived as significantly more valid (36% increase), personalized (42% increase), reliable (27% increase), and useful (22% increase) than negative predictions. These findings demonstrate that the personal validation effect persists in interactions with LLMs and underscore the substantial role of prediction valence in shaping user perceptions, with important implications for the design and deployment of AI systems across diverse applications.