SMART HAND GLOVES TRANSLATION FOR

DEAF/DUMB PEOPLE
Date:

11/17/19

Da Nang University of Technology

Nguyen Van Hung

Email: hung.nguyen.5625@gmail.com

1
 Purpose

The purpose of this proposal is to provide our product: Smart gloves that help deaf/dumb
people to communicate with ordinary people by translate sign language into text and speech.

Introduction

Nowadays, communication plays an important role in everyone's daily life. However, millions of
people around the world are born deaf or dumb, so it is difficult to communicate with ordinary
people because they both use different languages. Therefore, to make deaf and dumb people
more advantageous for daily communication, we propose a smart glove for them, it will help to
convert the hand symbols they use to communicate into characters, letters, and numbers, and
converted it into speech, thus narrowing the distance between them and ordinary people.

Problem Statement

Sign language is the language used by deaf and dumb people. This language is a combination of
shape and parts of the body including the face and hands that the user makes.

The problem is to develop a system that successfully recognizes sign language, analyzes and
converts them into audio.

Proposal Solution

The method we propose is that developing sign language in gloves would be a multifaceted
process. Gloves will include 3 main systems: sensor system, processing system, and output
system.

 Sensor system: The sensor system includes three main components: the flex sensor
circuits, the contact sensor circuits, and the gyroscope. Each type of sensor will provide
specific information for the processor to identify and discern the gestures and
movements of each finger.
 Processing system: The signals from the sensor system will be encoded into analog
signals for processing. The system will encrypt each movement and look up the
datasheet learned from the beginning to look up for each movement.

2
  Output system: After the signal is recognized, the output signal will be transmitted via
smartphone via Bluetooth, after that the content of the movements will be printed on
the phone screen and will also be converted into sound via speakerphone.

Figure 1: The overall system

We divided the system into two parts: Hardware categories and software categories.

Hardware categories:

This part will include the sensor system, the circuit board, and the glove material.

 Finger Position Sensing: We use flexes sensor to measure the finger flexion and
movement, and connect it with a matching resistor, shared voltage, and ground. This
system will help us to determine exactly the position of the finger and send it to another
system to analyze. This information will be transmitted as an analog signal.
 Stand Alone Arduino UNO: This is the microprocessor of the glove, this chip will
substitute for all the components, such as wire or circuit elements because we want to
design a glove that easy to use, easy to carry and portable.

Software categories: Software programs that can read and transmits information during the
process. We use MATLAB code and Arduino code to create a program that can take the analog
signal from the sensors and determine the gesture, after that it will learn and compare with
libraries embedded before. After all, it will transmit the information into the screen on the
smartphone via Bluetooth, and also export it as speech. This progress is done through an
Android app.

3
 Budget

Name Price
Bluetooth module 95.000đ
Flex sensor 240.000đ
PCB 120.000đ
Gyroscope 70.000đ
Other components 80.000đ
Total 605.000đ

Schedule

Task Date of tasks (by weeks)

1. Research, making plans x x
and ideas
2. Hardware Development x x x
3. Software Development x x
4. Testing and fixing errors x x

5. Complete, assembly the x x x

product
27 3 8 9 5 27
Dec Jan Feb

Conclusion

We have had certain success in creating products to meet the communication needs of the deaf
and dumb people. We hope this product can be a part of their communication. In the future,
we hope we can improve our products, even more, to make our users more convenient.
Through this proposal, we hope the product will be highly appreciated so we have the
opportunity to create more products that will benefit everyone in the future.

4
 References

1. D. Quick. (2012, July 12). “Sign language-to-speech translating gloves take out Microsoft
Imagine
Cup 2012” [Online]. Available: http://www.gizmag.com/enabletalk-sign-language-
gloves/23268/
[Accessed: April 11, 2016]
2. D. Quick. (2012, July 12). “Sign language-to-speech translating gloves take out Microsoft
Imagine
Cup 2012” [Online]. Available: http://www.gizmag.com/enabletalk-sign-language-
gloves/23268/
[Accessed: April 11, 2016]
3. J. Kramer, P. Lindener, W. George. (1991, September 10). “Communication system for deaf,
deafblind, or non-vocal individuals using instrumented glove” U.S. Patent 5047952, Sept.,
10, 1991
4. J. Kramer, P. Lindener, W. George. (1991, September 10). “Communication system for deaf,
deafblind, or non-vocal individuals using instrumented glove” U.S. Patent 5047952, Sept.,
10, 1991