Music shaped by motion
The play experience uses your left hand to select scale degrees and your right hand to shape chord quality, octave, volume, and filter tone. Sound is generated with browser audio, so the camera gesture and the synth response remain part of the same live interaction.
Built for the browser
Hand landmarks are detected in the browser with MediaPipe Tasks Vision. The instrument uses the Web Audio API for synthesis and the MediaDevices API for camera access. Gesture Synth does not require an account, installation, or microphone permission.
Camera access begins only after you choose to start the game. See the full details in the Gesture Synth Privacy Policy.
Why this project exists
Gesture Synth explores a simple idea: a browser can become a musical instrument without asking people to learn a dedicated hardware controller first. The project keeps the gesture vocabulary intentionally small so a player can move from seeing a camera image to hearing a chord with as little setup as possible.
The guides and blog are written around the same product rather than around unrelated search terms. They document the controls, explain the browser technology behind them, and record practical problems that appear while using webcam hand tracking in ordinary lighting and browser conditions.
Who maintains Gesture Synth
Gesture Synth is an independent browser-music project maintained by its developer and publisher. Product changes, tutorials, privacy notes, and troubleshooting guidance are updated together so the documentation stays aligned with the behavior of the live application.
Blog articles are published by the Gesture Synth Team and link back to this page. If a guide is inaccurate, a browser behavior has changed, or an attribution needs correction, please use the contact address below so the relevant page can be reviewed and updated.
Editorial and correction policy
Product documentation is based on the controls and implementation available on Gesture Synth at the time of publication. Technical explanations distinguish between behavior implemented by this project and behavior provided by browser APIs or third-party libraries. The site does not publish automatically generated song pages or keyword-only pages simply to expand the index.
Corrections can be sent to raythunder.work@gmail.com. Substantive corrections are applied to the relevant page rather than hidden in a separate notice.
How guides are produced
A guide starts from a behavior that exists in the product: a gesture mapping, a browser permission step, a troubleshooting pattern, or a technical boundary that users need to understand. Pages are organized around a single task so the browser-compatibility guide does not duplicate the chord reference, and the chord reference does not pretend to be a privacy document.
Examples use the actual I-VII degree system and controls implemented by Gesture Synth. General music-theory concepts are used to explain those controls, while product-specific claims are checked against the current application behavior. When the application changes, affected documentation should be revised and its modified date updated rather than publishing a new keyword variant of the same article.
This approach also keeps advertising separate from editorial decisions. Future ads may support eligible content pages, but they do not determine which gestures, troubleshooting steps, or technical conclusions are documented. The interactive play page remains focused on the instrument itself.
New content is added when it answers a distinct product question, such as browser compatibility, unstable hand tracking, song-to-degree mapping, or webcam privacy. Existing pages are expanded when a subject belongs there instead of creating multiple near-duplicate URLs. This keeps the site useful as documentation first and avoids turning small keyword variations into separate pages with little independent value.
Each published page should remain useful even when read without the rest of the site.
Copyright and credits
Original Gesture Synth interface copy, project-specific visual design, code, and musical adaptations are protected where applicable. Third-party software, browser APIs, and source materials remain subject to their own licenses and terms.
The homepage score preview adapts a short motif from J. S. Bach's Invention No. 1, BWV 772. The underlying composition is in the public domain; the Gesture Synth sequence is a simplified project adaptation and does not reproduce the Mutopia Project engraving.
Hand tracking is powered by Google's MediaPipe Tasks Vision library and model resources. Browser audio and camera access rely on standard Web Audio and MediaDevices APIs.
For a copyright or attribution question, email raythunder.work@gmail.com.