← back

AirBoard

Hands-free mouse and keyboard from hand tracking

Python · MediaPipecode ↗

A keyboard without keys which uses OpenCV to locate finger locations to and MediaPipe to predict key presses.

key

As of now, machine learning is not involved, but I plan to add it in the future to improve its accuracy.

Keypress Detection

image

The keyboard can be completely removed after calibration.

joint

Calibration

Calibrator.py can be used to form an array of coordinates, each associated with a key.

demo