A Project Synopsis

On

“ARTIFICIAL EYE FOR VISUALLY IMPAIRED

PATIENTS”
Submitted in partial fulfillment of the requirement
for the award of the degree of

Bachelor of Technology
in

Electrical and Electronics Engineering

Submitted By
NAME ROLL NO.

ANURAG SHUKLA 1613321024

ASHOK KUMAR 1613321028

VIPUL RASTOGI 1613321168

Under the guidance

MR. ANURAG VERMA

DEPARTMENT OF ELECTRICAL AND ELECTRONICS ENGINEERING

NOIDA INSTITUTE OF ENGINEERING AND TECHNOLOGY

GREATER NOIDA
 PROBLEM STATEMENT

According to the World Health Organization (WHO), globally, it is estimated that

approximately 1.3 billion people live with some form of vision impairment. In which distance
vision, 188.5 million people have a mild vision impairment, 217 million have moderate to
severe vision impairment, and 36 million people are blind. The biggest challenge for a
person, especially the one with the complete loss of vision, is to navigate around places.
Blind and visually impaired people have a tough time finding good reading materials in
accessible formats. Nowadays the availability of tools to help visually impaired people are
very less and also expensive too. So, It is necessary to build a system that helps visually
impaired people which is more economical and accessible to everyone. In everyday life,
many problems can be solved through computer vision solutions. In the period of new
technology like Artificial Intelligence (AI), machine learning can help to make a better
system. Due to its powerful machine learning models and a huge database of images, not only
it quickly classifies images into thousands of categories but also detects individual objects.

WHY THE PARTICULAR TOPIC IS CHOSEN?

Companies like Microsoft, Google, NavCog, Horus, AIServe, and MyEye are working on
software projects combining vision aids and artificial intelligence. One of the more exciting
aspects about artificial intelligence use for the visually impaired community is that the more
the user wears them, the more helpful these devices will become for everyday life. You learn
the device; the device learns you. It’s like memory foam, but for vision!

Reasons behind why we chosen this, are following below:

 To provide a better system to the visually impaired or blind patients, which help them
in reading, recognizing the object, etc.
 To integrate new technology like Artificial Intelligence (AI), Machine learning, etc.
with the existing system with more reliability.
 The increasing access to artificial-intelligence-based vision-assist devices has the
potential to take life to new heights.
 With the use of existing tools like Google Cloud Vision, Google to text Speech
(gTTs) which enhance the system.
 OBJECTIVES AND SCOPES

Google Cloud’s Vision API offers powerful pre-trained machine learning models through
REST and RPC APIs. Assign labels to images and quickly classify them into millions of
predefined categories. Detect objects and faces, read printed and handwritten text, and build
valuable metadata into your image catalog.

METHODOLOGY

Fig. 1 (Block diagram)

Fig. 1 explaining the process of the system.

At first, when the button is pressed, it captures an image of the object through the camera
which is connected to it and sends it to Google Cloud. Then Google’s Cloud Vision API
uses artificial intelligence and provides relevant results of what the object can be. The output
is then converted into audio format through Google’s Text-to-Speech (gTTS). And finally,
the converted audio is played using VLC.

Following setting is required to develop the system:-

o Setting up Google Cloud:-

First, we will be needing a Google Cloud Account. So, we create a new Google Cloud
Account using our existing Google Account and fill in the required information and
proceed.
o Setup capping API (Application Program Interface) Usage:-
Depending on the API, you can explicitly cap requests in a variety of ways including
requests per day, requests per 100 seconds and requests per 100 seconds per user.
o Enabling the API:-
For enabling the API we first create a project and register our application for cloud vision
API in the Google Cloud Platform.
o Getting the JSON file:-
We will need a JSON key to authenticate our Raspberry Pi to use it with our Google
Cloud Account. On your APIs & Services Dashboard, we have to click on Credentials
from the panel on the left side. Then click on Create credentials, and choose Service
account key. We have to choose JSON as the key type, and click create. Now, we have to
move the downloaded JSON key to our Raspberry Pi’s Home Directory.
/home/pi

REQUIRED HARDWARE

The following are the list of required hardware:-

o A Raspberry Pi (I am Using Pi3 Model B)

o A microSD card with Raspbian Installed
o A USB Webcam
o A Speaker
o A 4-Pin Button
o 2 Male to Female Jumper Wires
o A Breadboard

CONTRIBUTION

o It provide a better system to the visually impaired or blind patients, which help them in
reading, recognizing the object, etc.
o It increasing access to artificial-intelligence-based vision-assist devices that has the
potential to take life to new heights.
o With the use of existing tools like Google Cloud Vision, Google to text Speech (gTTs) it
enhance the system reliability.
 LIMITATIONS

o Creation of this type of system take little bit more cost than available system.
o Sometimes detection problems when camera is not proper working.

GUIDE SIGNATURE
(Gr. No. 24)

REFERENCES

o Lichao Chen, Sudhir Singh, Thomas Kailath and Vwani Roychowdhury. Brain-inspired
automated visual object discovery and detection. Proceedings of the National Academy of
Sciences, 2018
o https://www.afb.org/info/the-human-eye-its-functions-and-visual-impairment/5
o https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment
o http://namantechpro.com/projects/object-detection-module/
o https://www.nature.com/articles/d41586-019-01111-y
o https://focus.masseyeandear.org/3-ways-that-artificial-intelligence-could-fight-eye-disease/
o https://cloud.google.com/vision/?utm_source=google&utm_medium=cpc&utm_campaign=japa
c-IN-all-en-dr-bkwsrmkt-all-super-trial-e-dr-1003987&utm_content=text-ad-none-none-DEV_c-
CRE_300622101094-
ADGP_Hybrid+%7C+AW+SEM+%7C+BKWS+~+T1+%7C+EXA+%7C+ML+%7C+1:1+%7C+IN+%7C+e
n+%7C+Vision+%7C+google+vision+api-KWID_43700037527390191-kwd-
203288731687&userloc_9050497&utm_term=KW_google%20vision%20api&gclid=Cj0KCQjwz8b
sBRC6ARIsAEyNnvpPVAZDpkHGEaF2YCLwJG1WjB3av1vkgihy062nT-
GCCPTFewGUfQUaAtn1EALw_wcB