Real Time Body Tracking MIDI Controller

Hello everybody! I created a new virtual MIDI controller with webcam and full body tracking (head, body, face, hands).

You can test a live version here (no installation required): Body Tracking MIDI Application Guide – Real Time Webcam Tracking Midi Interfaces

The script I made can track the whole body in real time (head, body, hands, face), through the webcam. It then sends MIDI notes and commands through a virtual MIDI port to VCV Rack.

Everything runs into the browser, no installation required.

I’m looking for collaborations.

If you like to create patches for VCV Rack and you want to create some patches to use with my midi interfaces, please reply to this topic or contact me here: Contact me – Real Time Webcam Tracking Midi Interfaces

Thank you!

5 Likes

Amazing, i did some basic tests with Media Pipe → Touchdesigner → VCV. This is much better