3D Visual Sign Language Translator
We wanted to create a device which could work as a visual sign-language translator. On the fingertips of a glove we placed 4 different color leds. These leds can be recognized by an OpenGL code.
Authors: Tobias Boreas, Melissa Coleman and Michel Mercera

Goals

We wanted to create a device which could work as a sign-language translator. On the fingertips of a glove we placed 4 different color leds. These leds can be recognized by an OpenGL code. So we can connect commands to the colors recognized by the OpenGL system. We connected speech-synthesis to the different led-colors.

Novelty

When implemented properly it could be used as a realtime translator, so a smooth conversation between a hearing-impaired person(with more handiness in sign-language) and non-hearing impaired person is possible. But that's not all the handLed can be used to control any device you want: sending midi-data to your synth, or commanding your OS are some of many possibilities.

Challenges

The main challenge was to get the openGL system to recognize the different LED-color, as these colors vary with the change of light outside. Also colors from clothes can interfere with the "color grabbing".

Media Lab Overview
LIACS Homepage
MM Conf
ACM Multimedia
ACM ICMR
IAPR ICPR
Science Direct
IEEE Library
LIACS Publications
ACM Digital Library