WipeOut
A virtual gallery explorer with dynamic 3D sound reproduction.
A study project by Alexander Leo, Michael Wöß and Paul Fleck, 4th semester, 2020
Supervising lecturer: Prof. Thorsten Greiner
WipeOut is an interactive, virtual art gallery that allows users to discover various works of art for themselves by swiping on a computer or Android tablet. Rather than being limited to the visual impressions of the images, WipeOut allows you to experience these works as three-dimensional soundscapes.
A menu presents the user with a selection of seven artworks in miniature form, from which they can choose one
select it and then reveal it in full size using a brush tool, bringing out all the details of the image. Alongside the artwork itself, the individual elements of the sound design also come to the fore and, once all has been wiped away, create a three-dimensional soundscape. The sounds are hidden at specific points within the image and must first be wiped away in order to be heard.
The individual Ambisonics sound designs were created specifically for the respective artworks and reflect the impressions and feelings that our group members experienced whilst viewing these works.
The software for WipeOut consists of various instances of Max MSP and Processing, each of which performs different tasks.
In this case, Max MSP primarily serves as a hub for processing the audio files. Processing acts as an interaction interface and uses OSC to send dynamic control data to Max MSP for audio processing, tailored to the performance. The Processing application is also available as a handy app for Android tablets.
Using so-called overlays, individual channels can be assigned to different areas of the image, each with fixed RGB values; when these areas are wiped clear, the sound from these channels becomes louder or quieter depending on how much of the respective area is revealed. Among other things, this control value can also be used to control the position or movement of the respective sound source within the room. The overlays are not visible when in use.
With its integrated artworks and sound designs, “WipeOut” is also well suited to live performance. The direct interplay between acoustic and visual elements in “WipeOut” encourages independent exploration and experimentation.