[Wearable] SignLanguageGlove translates sign language to text and speech

Leave a Comment
A student at the University of London has developed a wearable glove which aims to give voice to the hearing and speech impaired people. The idea is to analyze the sign language made from hand gestures (by the person wearing the glove) and convert it to visual text and audible dialogue. The text can then be displayed on a screen, and the dialogue can be played on a music system or a smartphone.

SignLanguageGlove

A related app is also being developed. It will translate the text in the language of reader's choice in real-time.

The developer's vision was to improve communication between persons with disabilities. This is the outcome of that vision.

How does it work?


Internal circuitry of the SignLanguageGlove

The electronic circuit on the glove is made up of five flex sensors, an accelerometer, a microcontroller board, and a four digit graphic numerical display.

Each flex sensor corresponds to one finger of the hand. It is used for detecting bends and curvatures, and then reporting the values to a serial monitor. The attached accelerometer detects the orientation of the hand.

All the hardware is controlled by a software that identifies the output values of the sensors and the accelerometer, and matches them with a series of statements that determine what letters to display on the screen. This was the first prototype.


The second version was faster and more robust, and featured compact hardware. The displayed text was also scrollable.

The third prototype features a text-to-speech chip.

The device has now grabbed attention of various companies who want to put it into production. It is expected to cost somewhere around $385.

0 comments:

Post a Comment