Expressive Machines

会議の名前
CHI 2025
GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communication
要旨

This work investigates the integration of generative visual aids in human-robot task communication. We developed GenComUI, a system powered by large language models (LLMs) that dynamically generates contextual visual aids—such as map annotations, path indicators, and animations—to support verbal task communication and facilitate the generation of customized task programs for the robot. This system was informed by a formative study that examined how humans use external visual tools to assist verbal communication in spatial tasks. To evaluate its effectiveness, we conducted a user experiment (n = 20) comparing GenComUI with a voice-only baseline. The results demonstrate that generative visual aids, through both qualitative and quantitative analysis, enhance verbal task communication by providing continuous visual feedback, thus promoting natural and effective human-robot communication. Additionally, the study offers a set of design implications, emphasizing how dynamically generated visual aids can serve as an effective communication medium in human-robot interaction. These findings underscore the potential of generative visual aids to inform the design of more intuitive and effective human-robot communication, particularly for complex communication scenarios in human-robot interaction and LLM-based end-user development.

著者
Yate Ge
Tongji University, Shanghai, China
Meiying Li
Tongji University, Shanghai, China
Xipeng Huang
College of Design and Innovation, Tongji University, Shanghai, China
Yuanda Hu
Tongji University, Shanghai, China
Qi Wang
Tongji University, Shanghai, China
Xiaohua Sun
Southern University of Science and Technology, Shenzhen, Guangdong, China
Weiwei Guo
Tongji University, Shanghai, China
DOI

10.1145/3706598.3714238

論文URL

https://dl.acm.org/doi/10.1145/3706598.3714238

動画
A Taxonomy of Linguistic Expressions That Contribute To Anthropomorphism of Language Technologies
要旨

Recent attention to anthropomorphism---the attribution of human-like qualities to non-human objects or entities---of language technologies like LLMs has sparked renewed discussions about potential negative impacts of anthropomorphism. To productively discuss the impacts of this anthropomorphism and in what contexts it is appropriate, we need a shared vocabulary for the vast variety of ways that language can be anthropomorphic. In this work, we draw on existing literature and analyze empirical cases of user interactions with language technologies to develop a taxonomy of textual expressions that can contribute to anthropomorphism. We highlight challenges and tensions involved in understanding linguistic anthropomorphism, such as how all language is fundamentally human and how efforts to characterize and shift perceptions of humanness in machines can also dehumanize certain humans. We discuss ways that our taxonomy supports more precise and effective discussions of and decisions about anthropomorphism of language technologies.

著者
Alicia DeVrio
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Myra Cheng
Stanford University, Stanford, California, United States
Lisa Egede
Carnegie Mellon University, Pittsburgh, Pennsylvania, United States
Alexandra Olteanu
Microsoft Research, Montreal, Quebec, Canada
Su Lin Blodgett
Microsoft Research, Montreal, Quebec, Canada
DOI

10.1145/3706598.3714038

論文URL

https://dl.acm.org/doi/10.1145/3706598.3714038

動画
PlantPal: Leveraging Precision Agriculture Robots to Facilitate Remote Engagement in Urban Gardening
要旨

Urban gardening is widely recognized for its numerous health and environmental benefits. However, the lack of suitable garden spaces, demanding daily schedules and limited gardening expertise present major roadblocks for citizens looking to engage in urban gardening. While prior research has explored smart home solutions to support urban gardeners, these approaches currently do not fully address these practical barriers. In this paper, we present PlantPal, a system that enables the cultivation of garden spaces irrespective of one's location, expertise level, or time constraints. PlantPal enables the shared operation of a precision agriculture robot (PAR) that is equipped with garden tools and a multi-camera system. Insights from a 3-week deployment (N=18) indicate that PlantPal facilitated the integration of gardening tasks into daily routines, fostered a sense of connection with one's field, and provided an engaging experience despite the remote setting. We contribute design considerations for future robot-assisted urban gardening concepts.

著者
Albin Zeqiri
Ulm University, Ulm, Germany
Julian Britten
Ulm University, Ulm, Germany
Clara Schramm
University of Ulm, Ulm, Germany
Pascal Jansen
Ulm University, Ulm, Baden-Württemberg, Germany
Michael Rietzler
Institute of Mediainformatics, Ulm, Germany
Enrico Rukzio
University of Ulm, Ulm, Germany
DOI

10.1145/3706598.3713180

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713180

動画
Living Alongside Areca: Exploring Human Experiences with Things Expressing Thoughts and Emotions
要旨

Technological advancements such as LLMs have enabled everyday things to use language, fostering increased anthropomorphism during interactions. This study employs material speculation to investigate how people experience things that express their thoughts, emotions, and intentions. We utilized Areca, an air purifier capable of keeping a diary, and placed it in the everyday spaces of eight participants over three weeks. Weekly interviews were conducted to capture participants’ evolving interactions with Areca, concluding with a session collaboratively speculating on the future of everyday things. Our findings indicate that things expressing thoughts, emotions, and intentions can be perceived as possessing agency beyond mere functionality. While some participants exhibited emotional engagement with Areca over time, responses varied, including moments of detachment. We conclude with design implications for HCI designers, offering insights into how emerging technologies may shape human-thing relationships in complex ways.

著者
Hyungjun Cho
KAIST, Daejeon, Korea, Republic of
Tek-Jin Nam
KAIST, Daejeon, Korea, Republic of
DOI

10.1145/3706598.3713228

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713228

動画
Firefighting with Drone Assistance: User Needs and Design Considerations for Thailand
要旨

Drones are increasingly being deployed to assist firefighting crews in their missions, with the technology being chosen based on availability, rather than aligned with their specific needs. This phenomenon is exacerbated in the Global South, where infrastructure is scarce and where specific processes and user needs have to be adequately mapped to successfully introduce new technologies. We conducted semi-structured interviews with firefighting professionals (N=15) from Thailand, covering their prior experience with drones, challenges they encounter in their job, and how they envision this technology could better support them in the future. Our findings describe users’ technological needs and their expectations in terms of interaction and collaboration with drones. We identified specific challenges in Thailand that hinder the deployment of drone technology, including mismatches in technical and financial decisions. Furthermore, participants advocated for sharing physical systems between fire departments. We conclude with design considerations for drones in resource-limited firefighting contexts.

著者
Chandhawat BOONYARD
Fédération ENAC ISAE-SUPAERO ONERA, Université de Toulouse, Toulouse, France
Christophe Jouffrais
CNRS, Singapore, Singapore
Jessica R.. Cauchard
Ben Gurion University of the Negev, Be'er Sheva, Israel
Anke M.. Brock
Fédération ENAC ISAE-SUPAERO ONERA, Université de Toulouse, Toulouse, France
DOI

10.1145/3706598.3714172

論文URL

https://dl.acm.org/doi/10.1145/3706598.3714172

動画
Non-Natural Interaction Design
要旨

Natural interactions, such as those based on gesture input, feel intuitive, familiar, and well-suited to user abilities in context, and have been supported by extensive research. Contrary to the conventional mainstream, we advocate for non-natural interaction design as a transformative process that results in highly effective interactions by deliberately deviating from user intuition and expectations of physical-world naturalness or the context in which innate human modalities, such as gestures used for interaction and communication, are applied-departing from the established notion of the "natural," yet prioritizing usability. To this end, we offer four perspectives on the relationship between natural and non-natural design, and explore three prototypes addressing gesture-based interactions with digital content in the physical environment, on the user's body, and through digital devices, to challenge assumptions in natural design. Lastly, we provide a formalization of non-natural interaction, along with design principles to guide future developments.

著者
Radu-Daniel Vatavu
Ștefan cel Mare University of Suceava, Suceava, Romania
DOI

10.1145/3706598.3713459

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713459

動画
Acceptability, Acceptance and Adoption of Telepresence Robots in Museums: The Museum Professionals' Perspectives
要旨

Telepresence robots have the potential to change our experiences in galleries and museums, allowing for a range of hybrid interactions for visitors and museum professionals, improving accessibility, offering activities or information, and providing a range of practical use cases (e.g. the robots augmenting museum exhibits). We present the results of 3 qualitative studies conducted in the UK exploring the acceptability (1 - interviews with museum professionals with no previous exposure to telepresence), acceptance (2 – focus groups for initial exposure to telepresence robots), and adoption (3 – interviews with museum professionals with long-term exposure to robots) of telepresence robots in museums. Our results identified opportunities and barriers focusing on the unique perspective of museum professionals and showed how priorities of museums shift and change according to their exposure to different technologies. We proposed a set of practical guidelines for future telepresence robots in museums, including design implications, potential applications, and integration strategies.

著者
Harriet R. Cameron
University of Nottingham, Nottingham, United Kingdom
Gisela Reyes-Cruz
University of Nottingham, Nottingham, United Kingdom
Anna-Maria Piskopani
University of Nottingham, Nottingham, United Kingdom
Pepita Barnard
University of Nottingham, Nottingham, United Kingdom
Andriana Boudouraki
University of Nottingham, Nottingham , United Kingdom
Praminda Caleb-Solly
University of Nottingham, Nottingham, Nottinghamshire, United Kingdom
Simon D. Castle-Green
University of Nottingham, Nottingham, United Kingdom
Joel E. Fischer
University of Nottingham, Nottingham, United Kingdom
Richard Hyde
University of Nottingham, Nottingham, United Kingdom
Ayse Kucukyilmaz
University of Nottingham, Nottingham, United Kingdom
Horia A.. Maior
University of Nottingham, Nottingham, Nottinghamshire, United Kingdom
DOI

10.1145/3706598.3713533

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713533

動画