Home  |  Centre for Mathematical Sciences  |  LTH  |  LU

A System For Real Time Gesture Recognition

Björn Samvik and Daniel Persson

One of the most intuitive and common communication forms for human beings are gestures of different kind. We use them all the time often without even noticing. In this thesis classification of gestures and recognition of hands using a camera are discussed.

To find and track the hand the Viola-Jones detector is used. The time series of the trajectories are transformed to angular space which results in scale and translation invariance. These series are then used to classify the gesture to a set of templates using dynamic time warping.

A new method using Viola-Jones detector combined with RAMOSAC which is a feature tracker working with SIFT/SURF features is also tried and evaluated in an attempt to lower the detection error rate and to achieve more robustness to pose variations.

The tests show that the system works well but is limited to the lighting and environment for which the algorithms are trained. The performance is real time on a normal PC and has the potential to be optimized to run on a mobile platform.

Publications

Daniel Persson and Björn Samvik, A System for Real Time Gesture Recognition, Master's thesis, Lund University 2009.

Source code and other material can be found at the Gesturize trac-page where you can find our mail addresses.

Related work

Petter Strandmark's master thesis which covers the RAMOSAC method in more detail.

 

Questions: webmaster
Senast uppdaterad: 2009-04-29

Demo of RAMOSAC.
Viola Jones test 1.
Viola Jones test 2.
Centre for Mathematical Sciences, Box 118, SE-22100, Lund. Telefon: 046-222 00 00 (vx)