Music shaped by motion
The play experience uses your left hand to select scale degrees and your right hand to shape chord quality, octave, volume, and filter tone. Sound is generated with browser audio, so the camera gesture and the synth response remain part of the same live interaction.
Built for the browser
Hand landmarks are detected in the browser with MediaPipe Tasks Vision. The instrument uses the Web Audio API for synthesis and the MediaDevices API for camera access. Gesture Synth does not require an account, installation, or microphone permission.
Camera access begins only after you choose to start the game. See the full details in the Gesture Synth Privacy Policy.
Copyright and credits
Original Gesture Synth interface copy, project-specific visual design, code, and musical adaptations are protected where applicable. Third-party software, browser APIs, and source materials remain subject to their own licenses and terms.
The homepage score preview adapts a short motif from J. S. Bach's Invention No. 1, BWV 772. The underlying composition is in the public domain; the Gesture Synth sequence is a simplified project adaptation and does not reproduce the Mutopia Project engraving.
Hand tracking is powered by Google's MediaPipe Tasks Vision library and model resources. Browser audio and camera access rely on standard Web Audio and MediaDevices APIs.
For a copyright or attribution question, email raythunder.work@gmail.com.