Lyric App Framework: A Web-based Framework for Developing Interactive Lyric-driven Musical Applications

要旨

Lyric videos have become a popular medium to convey lyrical content to listeners, but they present the same content whenever they are played and cannot adapt to listeners' preferences. Lyric apps, as we name them, are a new form of lyric-driven visual art that can render different lyrical content depending on user interaction and address the limitations of static media. To open up this novel design space for programmers and musicians, we present Lyric App Framework, a web-based framework for building interactive graphical applications that play musical pieces and show lyrics synchronized with playback. We designed the framework to provide a streamlined development experience for building production-ready lyric apps with creative coding libraries of choice. We held programming contests twice and collected 52 examples of lyric apps, enabling us to reveal eight representative categories, confirm the framework's effectiveness, and report lessons learned.

受賞
Honorable Mention
著者
Jun Kato
National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Japan
Masataka Goto
National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Japan
論文URL

https://doi.org/10.1145/3544548.3580931

動画

会議: CHI 2023

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2023.acm.org/)

セッション: Creative Applications

Room Y07 + Y08
6 件の発表
2023-04-27 18:00:00
2023-04-27 19:30:00