Gesturio

The main goal of this project is to create an app for learning sign language (particularly dactil alphabet) in a game form. This work can as well be considered as just an application of the algorithm of static gestures recognition.

There are lots of other uses of this algorithm. For example, in magic games the player can be given the opportunity to cast a spell as a sequential combination of different gestures (as in my favourite game Magica), or perform various operations on the object using just gestures and without any need to open a context menu.

The app currently supports two languages (American and Russian) and one experimental mode with various assumed gestures such as: Like, Dislike, Lizard etc. While in a SandBox mode user can as well add his own gesture.

Also available on Github pages

The source code and the installation instruction can be found in official repository

Also available as a single library gesturio.js

Dear C# developers, this library needs your help to be rewritten on C# =)

Some information about the recognition method.

In conclusion it's worth mentioning that precision of gesture recognition depends on the quality of gesture capture done by LeapMotion controller. The current level of quality of gesture capture is enough for successful recognition of the majority of gestures. But there are some gestures that are difficult to recognition (distinguish the gesture meaning "S" from the gesture "A" or the gesture "V" from "K", "M", "N").