Launching today
gesture.live
Play live electronic music with your hands using your webcam
21 followers
Play live electronic music with your hands using your webcam
21 followers
Play live electronic music with your hands over a webcam. Chords, bass, drums and effects, performed through gestures.
gesture.live
Shoutout to indecisiveeric.com/gesture-synth, which went viral a few weeks ago on Instagram. It allows users to use both hands to perform chords.
gesture.live is an exploration on how to take this gesture synth further. I am using the same chord language, but am compressing it to one hand, so the other hand is free to play melodies, add drum/bass patterns and control effects.
The question that decides this is whether note-ons are quantised. Webcam hand tracking is 30fps on a good day, so there's 30ms of jitter before the audio thread even hears you, and you start feeling timing errors well under that. Snapping to a 16th grid makes it playable but you lose pushing and laying back, which is most of what makes a part sound human. Freeing the second hand by compressing chords into one is the right call either way.