Art der Publikation: Beitrag in Sammelwerk

SoundsRide: Affordance-Synchronized Music Mixing for In-Car Audio Augmented Reality (Best Paper Award)

Autor(en):

Kari, Mohamed; Grosse-Puppendahl, Tobias; Jagaciak, Alexander; Bethge, David; Schütte, Reinhard; Holz, Christian

Titel des Sammelbands:

The 34th Annual ACM Symposium on User Interface Software and Technology

Seiten:

118-133

Verlag:

Association for Computing Machinery

Ort(e):

New York, NY, USA

Veröffentlichung:

2021

ISBN:

9781450386357

Schlagworte:

auditory augmented reality, sound affordances, context-adaptive music

Digital Object Identifier (DOI):

doi:10.1145/3472749.3474739

Zitation:

Download BibTeX

Kurzfassung

Music is a central instrument in video gaming to attune a player’s attention to the current atmosphere and increase their immersion in the game. We transfer the idea of scene-adaptive music to car drives and propose SoundsRide, an in-car audio augmented reality system that mixes music in real-time synchronized with sound affordances along the ride. After exploring the design space of affordance-synchronized music, we design SoundsRide to temporally and spatially align high-contrast events on the route, e.g., highway entrances or tunnel exits, with high-contrast events in music, e.g., song transitions or beat drops, for any recorded and annotated GPS trajectory by a three-step procedure. In real-time, SoundsRide 1) estimates temporal distances to events on the route, 2) fuses these novel estimates with previous estimates in a cost-aware music-mixing plan, and 3) if necessary, re-computes an updated mix to be propagated to the audio output. To minimize user-noticeable updates to the mix, SoundsRide fuses new distance information with a filtering procedure that chooses the best updating strategy given the last music-mixing plan, the novel distance estimations, and the system parameterization. We technically evaluate SoundsRide and conduct a user evaluation with 8 participants to gain insights into how users perceive SoundsRide in terms of mixing, affordances, and synchronicity. We find that SoundsRide can create captivating music experiences and positively as well as negatively influence subjectively perceived driving safety, depending on the mix and user.