next up previous
Next: ARCHITECTURE AND IMPLEMENTATION Up: EXAMPLE LEARNING TASKS Previous: CYLINDER-BELL-FUNNEL

AUSLAN SIGN RECOGNITION

The goal for this learning task is to classify a subset of Auslan (Australian sign language, the language of the Australian Deaf community) signs. Instances of the signs were collected using an instrumented glovegif. The domain consists of eight channels: x (left/right), y (up/down), and z (away/towards the body) position, wrist roll (whether the palm is facing up or down), thumb, fore, middle and ring finger bend. This information is updated approximately 23 times a second. Thus each frame consists of the value of these eight channels at an instant in time. The signs were collected one at a time starting and ending at a fixed point (a closed fist at the side of the body). The average number of frames per sign was 51, but varied from 30 frames up to 102 frames.

Figure 3 shows two signs from the Auslan domain. The top part shows the gloss (dictionary definition) of the sign from the Auslan dictionary [Johnston, 1989]. The lower part shows some of the rules extracted by TClass.



Mohammed Waleed Kadous
Wed May 19 20:21:38 EST 1999