next up previous contents
Next: 1.4.2 Generalised Gesture Recognition Up: 1.4 Potential Applications Previous: 1.4 Potential Applications

1.4.1 Inverse mapping from Auslan to English for dictionary use

This is perhaps the application that would be easiest to build from this thesis. A user would put on an instrumented glove and make a sign that they wanted to know the meaning of. The software would then find the closest set of matching signs. The user could then examine the meaning of the word, in English, or perhaps it could be explained in terms of Auslan itselfgif. There are currently a variety of methods for indexing signs, but they are usually not as intuitive as making the sign itselfgif.

This would be viable, since it uses discrete signs, and a high error rate is not a large problem, since several candidate signs can be returned. Furthermore, the algorithms discussed here can both be expanded to return multiple valuesgif.

The only problem with this is that it requires that GRASP be able to adapt to new signers -- ie be able to successfully recognise signs by people other than those on whom it was trained.



waleed@cse.unsw.edu.au