An immersive, multi-sensory augmented reality beat maker. This project was inspired by my love of creating electronic music and offers participants an opportunity to use their body to trigger, loop and remix audio and visual elements. Winner of the Adobe Creative award.
For this Advanced Interaction Design capstone unit, I was to develop an interaction based on the topic of 'Ludic Design', that is, "showing spontaneous and undirected playfulness". Drawing on my love for electronic music, I wanted to create an immersive environment where participants could use their body to create sounds and manipulate the audio output. The result was this installation titled 'Sketch Lab'. Sketch Lab uses node-based programming to connect and control Ableton music production software, Kinect motion tracking camera and TouchOSC iPad interface. By tracking the body’s positioning and using Python commands, the various audio and visual loops are triggered. Please watch the below videos for demonstration of the installation.