The Implacable (2016)
Interactive Vision System
Computer Vision / Musical Instrument / Open SourceThe Implacable is a digital computer vision device that translates somatic movement into sound. Using a camera and fiducial markers (sound tattoos), the system tracks the trajectory of bodies or objects in space to generate MIDI information in real-time.
Originally developed for live performances of the avant-garde music project Pla, the device dissolves the barrier between performer and spectator. It functions as a technological prosthesis that allows the audience to intuitively intervene in the musical improvisation through body movement, without requiring prior instrumental training.
“Sound tattoos are graphic symbols that function as keys. When 'The Implacable' detects their unique combination, it triggers programmable soundscapes. The person wearing these images physically intervenes in the sonic construction of the piece.”
Technically, the system employs computer vision algorithms to track reference markers at high speed. The interface visualizes movement across the X, Y, and Z axes within its field of view, converting spatial coordinates into sonic control parameters.
In its performance configuration, cameras are arranged around the musicians, each connected to an instance of the device triggering different synthesizers. The resulting music is the product of a real-time symbiosis between traditional instruments and the spontaneous choreography of the audience.
Concept & Software Development: Isaías Herrera
Associated Musical Project: Pla (Desierto Eléctrico)
Technology: Open Source Computer Vision (OpenCV), MIDI Protocol