About

About Gesture Synth

Gesture Synth is an independent browser music game that turns webcam-tracked hand gestures into chords, tone, filter, volume, and octave changes.

Music shaped by motion

The play experience uses your left hand to select scale degrees and your right hand to shape chord quality, octave, volume, and filter tone. Sound is generated with browser audio, so the camera gesture and the synth response remain part of the same live interaction.

Built for the browser

Hand landmarks are detected in the browser with MediaPipe Tasks Vision. The instrument uses the Web Audio API for synthesis and the MediaDevices API for camera access. Gesture Synth does not require an account, installation, or microphone permission.

Camera access begins only after you choose to start the game. See the full details in the Gesture Synth Privacy Policy.

Why this project exists

Gesture Synth explores a simple idea: a browser can become a musical instrument without asking people to learn a dedicated hardware controller first. The project keeps the gesture vocabulary intentionally small so a player can move from seeing a camera image to hearing a chord with as little setup as possible.

You can explore chord changes without reading a score: choose a scale degree, listen to the harmony, and change one control at a time. The guides explain the hand shapes and controls, while the blog offers practice sequences and camera-setup advice for getting started.

Who maintains Gesture Synth

Gesture Synth is an independent browser-music project maintained by its developer and publisher. Product questions, privacy concerns, and corrections can be sent directly to the project through the contact page. No account is needed to play or to read the guides.

Blog articles are published by the Gesture Synth Team and link back to this page. If a guide is inaccurate, a browser behavior has changed, or an attribution needs correction, please use the contact address below so the relevant page can be reviewed and updated.

Editorial and correction policy

If a gesture description does not match what you see, include the page address, your browser, and the action you tried when reporting it. A written description is enough; you do not need to send a camera recording. Browser support and permission behavior can differ between devices.

Corrections can be sent to contact@gesturesynth.org. Please identify the passage or image involved so the issue can be checked in context.

Camera access and your choices

Opening the site does not start your camera. On the play page, choose Start playing to use hand tracking, or choose the no-camera option to try chords with touch, a mouse, or a keyboard. In that practice mode, press and hold a degree card or a number key from 1 to 7 to hear a chord, then release it to stop.

When you choose camera play, your browser asks for video access without microphone access. Camera frames are processed locally in your browser to detect hand landmarks; Gesture Synth does not upload, record, or store your camera video. Leaving the play page stops the camera stream. You can also revoke access through your browser's site-permission settings.

Local camera processing does not mean the site makes no network requests. Hand tracking downloads MediaPipe runtime files and a model from external providers. Production pages also use Google Analytics and load the AdSense script; those services have separate data practices described in the Privacy Policy. Camera frames are not included in those resource, analytics, or advertising requests.

For camera play, keep both hands and wrists visible and leave room between them. Tracking can miss a finger when hands overlap or leave the frame; brighter, even lighting and a plain background can help. Gesture Synth is an experimental instrument, so recognition and audio response depend on your device, browser, and setup. The no-camera option lets you explore the same chord degrees if tracking is unavailable.

Read the webcam privacy guide for the camera data flow, or open the instrument to choose how you want to play.