Blue Eye Technology

Available at www.mindstien.net
 Introduction
Blue eye seeks attentive computation by integrating
perceptual abilities to computers wherein non-obtrusive
sensing technology, such as video cameras and
microphones, are used to identify and observe your
action.
Blue Eyes aims at giving the computers the ability to
sense, recognize and respond to the human
communication of emotion (such as frustration,
confusion, interest, distress, anger and joy).

Available at www.mindstien.net
Types Of Emotional Sensors
For Hand:
Emotion Mouse
Sentic Mouse
For Eyes:
Expression Glasses
For Body:
Conductor Jacket

Available at www.mindstien.net
 Emotion Mouse
Non-invasive method
It can measure heart
rate, temperature, GSR
and other bodily
movements.
It includes a set of
sensors, including
infrared detectors and
temperature sensitive
chips.

Available at www.mindstien.net
Information obtained from emotion
mouse

Behavior
Mouse movements
Button click frequency
Finger pressure
Physiological Information
Heart rate
Skin temp.
Skin Electricity
Electromyographic activity

Available at www.mindstien.net
Prototype

Available at www.mindstien.net
Samples obtained From Emotion mouse

Available at www.mindstien.net
 Sentic Mouse
It is a modified
computer mouse that
includes a directional
pressure sensor for
aiding in recognition of
emotional valence

Available at www.mindstien.net
 Expression Glasses

A wearable device
which allows any
viewer to visualize the
confusion and interest
levels of the wearer

Available at www.mindstien.net
 Experiment
To test the reliability of Emotional Sensors
Ex: Emotion Mouse
6 Participants
4 Physiological Readings
Heart rate
Temperature
Galvanic Skin Response (GSR)
Somatic Movement

Procedure
Conclusion

Available at www.mindstien.net
Human Operator Monitoring
System

It is Based on Blue Eyes Technology.

It provides technical means for monitoring
and recording human operator’s physiological
condition.

Available at www.mindstien.net
 Key Feature

Visual attention monitoring (eye motility analysis)

Physiological condition monitoring (pulse rate, blood
oxy.)
Operator’s position detection (standing, lying, sitting).
Wireless Data Acquisition using Bluetooth
Real-time User defined alarm triggering
Physiological data, operator’s voice and overall view
of the control room recording
Recorded data playback

Available at www.mindstien.net
 System Overview
Blue eyes system monitors the status of the
operator’s visual attention through
measurement of saccadic activity.
The system checks parameters like heart
beat rate and blood oxygenation against
abnormal and triggers user defined alarms.
The system consists of
Mobile measuring device (DAU)
Central System Unit.

Available at www.mindstien.net
System overview
Data Acquisition Unit Central System Unit

Atmel 89C52 Connection Visualization

Bluetooth Bluetooth
microcontroller Manager Module

Jazz Data
Data Analysis
Multisensor Logger

Bluetooth technology provides

means for creating a Personal
Area Network linking the
operators and the central
system.

Available at www.mindstien.net
 Overall System Diagram
Data Acquisition Central System
Unit Unit

8051 family Bluetooth Bluetooth Connection Manager Data Logger

microcontroller device device Module Module

Database
Voice
Physiological interface Data Analysis Visualisation
parameters Module Module

sensor

Figure 1. Overall system diagram

Available at www.mindstien.net
 Data Acquisition unit

Maintains Blue tooth connections

Get information from sensor & send it over
the wireless connection to CSU to be
processed.
To deliver the alarm messages sent from
CSU to operator.
Handle personalized ID Card.

Available at www.mindstien.net
 Data Acquisition Unit
A Microcontroller
Bluetooth module
Small LCD display
EEPROM
PCM codec
Jazz Multisensor interface
Beeper and Led Indicators
Batteries and Voltage Level monitor

Available at www.mindstien.net
DAU - components

microphone
MC 145483
earphone PCM codec

Bluetooth
Jazz Multisensor
module

Beeper Atmel 89C52 UART

microcontroller
LCD display
UART
MAX232
LED indicators
BlueEyes
Data Acquisition Unit
ID card Simple
interface keyboard
ID card

Available at www.mindstien.net
 Jazz Multisensor
Provides DAU with
necessary Physiological
data regarding eye
position, blood
oxygenation etc.
Eye movement measured
using direct infrared
oculographic transducers.
Eye movement sampled at
1 kHz & other parameters
at 250 kHz.
Sensor sends 5.2 kB data
per second.
Available at www.mindstien.net
CSU - features
Connection Central System Unit
management
Data processing Bluetooth
Connection
Manager
Visualization
Module

Visualization Data
Data Analysis
Logger
Data recording

Access
verification
System maintenance

Available at www.mindstien.net
 Application
In every working environment requiring
permanent operator’s attention.
Generic control rooms
Power station
Captain bridge
Flight control centers
Operating theatres – anesthesiologists
Common application
A simpler system version for drivers

Available at www.mindstien.net
 Future Ahead
Can be used in automobiles, remote controls
and telephones.
Can be implemented in computer training or
education programs.
Household devices.

Available at www.mindstien.net
Available at www.mindstien.net