BY : KASHISH BHATIA & HARPREET SINGH

CONTENTS
What is Blue Eyes Technology..? Origination Of Word.

Techniques Used.
Emotion Mouse. Magic Pointing. Artificial Intelligent Speech Recognition. SUITOR. Eye Tracker. Working & Design.

Advantages & Disadvantages.

Applications. IBM Researches. References Conclusion.

BLUE EYES TECHNOLOGY ..?

It aims at creating computational machines that have

perceptual and sensory ability like those of human beings. It uses camera and microphone to identify user actions and emotions. Due to this the machine can understand what a user wants, where he is looking at and even realize his physical or emotional states. The basic idea behind this technology is to give the computer the human power.

ORIGINATION OF WORD

BLUE

+ EYES = BLUE EYES

-Blue = Bluetooth.. -Eyes = Movement of Eyes..

BLUE in the term stands for Bluetooth , which enables

reliable wireless communication..

EYES because the Eye

and send a lot of interesting and important information for analysation..

Movement enables us to obtain

TECHNIQUES USED

Emotion Mouse.

Manual And Gaze Input Cascaded (MAGIC). Artificial Intelligent Speech Recognition. Simple User Interest Tracker (SUITOR).

The Eye Movement Sensor.

Emotion Mouse
The mouse is loaded with sensors

which read your physiological .To be precise, heart rate is taken by IR sensor on the thumb, temperature is taken using a thermosistor chip and GSR(Galvanic Skin Resistance) is taken through fingertips. You can use these readings to establish baseline emotional states and thus you can identify if someone is getting uptight or becoming exhilarated (nervous or happy).

Manual And Gaze Input Cascaded (MAGIC)

Dynamically redenes the home position of the pointing

cursor. Reduce the cursor movement needed for target selection. Reduce physical effort and fatigue, greater accuracy and naturalness and faster speed than traditional eye gaze system. Two Techniques of MAGIC : 1. Liberal Approach:To warp the cursor to every new object user looks at. 2. Conservative Approach:Does not warp the cursor target until the manual input device has been actuated.

Artificial Intelligent Speech Recognition

User speaks to the computer through microphone. Filtered and fed to ADC (Analog to Digital Converter)

and then stored in RAM. Input words are scanned and matched against internally stored words. Identification causes some action to be taken. Example : Siri in iphone. Can be used : 1. To control weapons by voice commands. 2. By Pilots to give commands to computers by speaking into microphones.

Simple User Interest Tracker (SUITOR)

Finds outs the areas of interests of the user. Help by fetching more information at desktop. Notices where the users eyes focus on the screen. Fills a scrolling ticker on a computer screen with

information related to users task.

For Example : If you are reading a headline ,it will pop

up the story related to that headline in the browser window.

The Eye Movement Sensor (Tracker)

When a single light source

that is off or on the axis with the camera optical axis,the camera is able to detect the light reflected from the interior of the eye When Off axis source generates a dark pupil image. When On axis generates a bright pupil image. Pupil detection is realized by subtracting dark pupil image from bright pupil image. After threshold difference largest connected component is identified as pupil.

WORKING & DESIGN

The major parts of the blue eyes system are : DAU (Data Acquisition Unit). CSU (Central System Unit).

The task of the mobile DAU is to get the data from the user (e.g. through emotion mouse) i.e. raw data and send it to CSU over the wireless connection (bluetooth). CSU maintain the other side of the bluetooth connection, analyse incoming sensor data and decides what exactly user wants,records the conclusion & provide visualization interface and responds to the user.

DAU

CSU

Connection Managermain

ATMEL 8952 Microcontroller Bluetooth Moduleto

communicate with CSU. PCM CODEC used to transmit operators voice and central system sound feedback. UART communication between bluetooth module and microcontroller. Jazz Multisensor:supplies raw digital data regarding eye position. LCD display. LED indicators.

task to perform low-level blue tooth communication. Data Analysisperforms the analysis of the raw sensor data in order to obtain information about operators physiological condition. Data Logger Moduleprovides support for storing the monitored data. Visualization Module provides user interface for the supervisors .

DATA SECURITY
Only registered mobile devices can connect

to the system. Bluetooth connection authentication. Bluetooth connection encryption. Access rights restrictions. Personal and physiological data encryption.

ADVANTAGES
A more natural mental model for the user. Faster than pure manual pointing. Improved subjective speed & reliable. Practical accuracy level & secured. Prevention from dangerous incidents. The reconstruction of the course of operators work. Visual attention monitoring (eye motility analysis). Physiological condition monitoring (pulse rate, blood oxygenation). Operator's position detection (standing, lying). Blue Eyes system can be applied in every working environment requiring permanent operator's attention.

DISADVANTAGES
Doesnt predict nor interfere with

operators thoughts. Cannot force directly the operator to work. Liberal approach is distracting when user is trying to read. Little Expensive.

APPLICATIONS
Control weapon by voice commands. Pilot can give commamds to computers. For making airline & hotel reservations. Can be connected to word processors & instead of writing, simply

dictate. Another application would be in the automobile industry. By simply touching a computer input device such as a mouse, the computer system is designed to be able to determine a person's emotional state. In retailing record and interpret customer movements In automobile industry. In video games. To create Face Responsive Display and Perceptive Environment.

DEVELOPMENTS TILL NOW

POD : The first blue Eye enabled mass production device was

POD, the car manufactured by TOYOTA. It could keep the driver alert and active. It could tell the driver to go slow if he is driving too fast and it could pull over the driver when he feels drowsy.
PONG : IBM released a robot designed for demonstrating the new technology. The Blue Eyes robot is equipped with a computer capable of analyzing a person's glances and other forms of expressions of feelings, before automatically determining the next type of action. PONG is capable of perceiving the person standing in front of it, smiles when the person calls his name, and expresses loneliness when it loses sight of the person.

POD

PONG

IBM RESEARCHES
Blue Eyes technology being developed by the IBM research

center at Alma den lab to make such "Smart" Computers. A new Chinese input system-EASE(Eye-tracking Assisted Selection and Entry) is invented by CCR&HCI team based on gaze tracking technique. In this technology, they build natural cooperation of hand and eye, and remove the tiresome procedure on candidate selection procedure of Chinese input in order to make the Chinese character typing more natural and more efficient. EMOTIONAL MOUSE : -Sensors in the mouse which sense the physiological attributes which are correlated to emotions by simply touching the mouse. BLUE EYE Enabled TELEVISION : -Could become active when the user makes an eye contact.

CONCLUSION
The nineties witnessed quantum leaps interface designing

for improved man machine interactions. The BLUE EYES technology ensures a convenient way of simplifying the life by providing more delicate and user friendly facilities in computing devices. Now the next step is to improve the hardware. Instead of using cumbersome modules to gather information about the user, it will be better to use smaller and less intrusive units. The day is not far when this technology will push its way into your house hold, making you more lazy. It may even reach your hand held mobile device. Any way this is only a technological forecast.

REFERENCES
https://www.research.ibm.com/beijing/projects/project2.html http://techmesa.blogspot.in/2011/09/blue-eyes

technology.html http://www.seminarsonly.com/computer%20science/blue%20ey es.php http://www.seminarslides.com/ppt/blue-eyes-technology/mail/ http://technicalpages.blogspot.in/2008/02/blue-eyestechnology.html http://www.yuvaengineers.com/blue-eyes-maram-b-m-rajeshkumar/ http://www.youtube.com/watch?v=sfhqrTrT-as http://www.slideshare.net/Colloquium/blue-eyes-technology2333478 www.whitepapers.com www.ibmresearchcenter.com

ANY QUERIES.. ?