I’ve been thinking a lot about how much of our body could become an instrument.

This started as an experiment using Mediapipe in TouchDesigner to track my head movement and overlay a reactive skull. When I open my mouth, it triggers laser beams. But the lasers aren’t just visuals, they’re connected to @vcvrack through OSC to control sound in real time.

I also track the distance between my fingers to control pitch and waveform, and added reactive rings above the skull that pulse with pitch data.

Performing with my mouth open the whole time was… surprisingly exhausting 😂
But it worked, and I had a lot of fun making it.

It took some serious trial and error to get the tracking and OSC sync working right, but I learned so much in the process. Definitely one of my favorite weird setups so far.