Interactive Art Portfolio | Son Et Lumière
Son Et Lumière - 2009
Concieved as the second half of a collaboration with London painter Claire Undy, Son Et Lumière is an exploration of the psychological link between sound and visuals in a mixed reality environment.
At it's core Son Et Lumière is a software system designed to synthesise 'sound' from a static visual image. However the system involves 3D motion tacking and can approximate where a users current visual focus is and synthesise the sound of that portion of the image.
The system uses 2 cameras and the programming framework Max/MSP to track the users head position within 3D space. Because the position of the users head doesn't determine where a user is looking a spotlight feedback system is used to grab the users attention and further increase the accuracy of the system.
Son Et Lumière is designed to run as a standalone installation system and has error detection capability as well as the ability to for the video tracking to self configure.
The system is available for use in further collaboration projects, please send requests via the Contact page.