Francesco Mariano Italian composer and musician, graduated in double bass and electronic music at the Conservatory, deepened his studies on multimodal and interactive systems working on software such as Max MSP / Jitter, combining the use of audio, video and sensors.
In this work, the hand or body movements detected by the webcam guide the stereophonic position of the sound, the speed of reproduction of an audio file and the amplitude of the signal. Based on the detected movements, the algorithm written by Francesco Mariano transforms the data detected by the movement into data to be used to modify the audio parameters. It is an interesting audiovisual interaction between man and machine, full of interesting developments and applications.
Direct contact :
The sample video can be seen on YouTube: