Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade


Media architecture exploits interactive technology to encourage passers-by to engage with an architectural environment. Whereas most media architecture installations focus on visual stimulation, we developed a permanent media facade that rhythmically knocks xylophone blocks embedded beneath 11 window sills, according to the human actions constantly traced via an overhead camera. In an attempt to overcome its apparent limitations in engaging passers-by more enduringly and purposefully, our study investigates the impact of feedforward learning, a constructive interaction method that instructs passers-by about the results of their actions. Based on a comparative (n=25) and a one-month in-the-wild (n=1877) study, we propose how feedforward learning could empower passers-by to understand the interaction of more abstract types of media architecture, and how particular quantitative indicators capturing this learning could predict how enduringly and purposefully a passer-might engage. We believe these contributions could inspire more creative integrations of non-visual modalities in future public interactive interventions.

Alex Binh Vinh Duc Nguyen
KU Leuven, Leuven, Belgium
Jihae Han
KU Leuven, Leuven, Belgium
Maarten Houben
Eindhoven University of Technology, Eindhoven, Netherlands
Yssmin Bayoumi
KU Leuven, Leuven, Belgium
Andrew Vande Moere
KU Leuven, Leuven, Belgium



会議: CHI 2023

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2023.acm.org/)

セッション: Designing and Understanding Embodied Experiences

Hall C
5 件の発表
2023-04-24 20:10:00
2023-04-24 21:35:00