What it does
Open Source Hands is the code behind a set of small browser games played with hand gestures in front of a webcam. It is written to be read by coding agents: an AGENTS.md entry point, a playbook for making a hand-controlled game, and a hand-gestures skill for Claude Code.
The core is a dependency-free TypeScript gesture kit on top of Google's MediaPipe Hand Landmarker. It turns the tracked hand points into steady game input: 20 held poses such as fist, point and thumbs up, 16 motions such as swipes, circles, pinch taps and throws, five two-hand gestures such as clap and zoom, and continuous values like pinch strength and palm position, with smoothing so gestures don't flicker.
A three.js starter game includes the camera prompt, a mouse and touch fallback, a bot that plays through the real gesture engine and tests, so an agent can check its work without a webcam. Everything runs in the browser and the video stays on the player's device.
Features
- 20 hand poses, 16 motions and 5 two-hand gestures as game input
- three.js starter game with mouse and touch fallback
- Synthetic hands and a bot player for testing without a webcam
- Playbook for designing and checking hand-controlled games
- Runs in the browser; video stays on the device
Limits
- Browser games only, and the camera needs https or localhost
- Skill files are added by hand; other agents follow AGENTS.md instead
- A new, small project first published in November 2026