Blue Eyes

Monitoring Human-Operator System

ABSTRACT

Human error is still one of the most frequent causes of catastrophe and ecological disasters. The main
reason is that the monitoring systems concern only the state of
the processes where as human contribution to the overall performance of the system is left unsupervised.
Since the control instruments are automated to a large extent, a human operator becomes a passive
observer of the supervised system, which results in weariness and vigilance drop.

Thus, he may not notice important changes of indications causing financial or ecological consequences
and a threat to human life. It therefore is crucial to assure
that the operator’s conscious brain is involved in an active system supervising over the whole work time
period. It is possible to measure indirectly the level of the operator’s conscious brain involvement using
eye motility analysis.

INTRODUCTION:

What is BlueEyes?

? BLUE EYES is a technology, which aims at creating computational machines that have perceptual and
sensory abilities like those of human beings.
? The basic idea behind this technology is to give computer human power.
? For example, we can understand humans’ emotional state by his facial expressions. If we add these
perceptual abilities to computers, we would enable them to work together with human beings as intimate
partners.
? It provides technical means for monitoring and recording human-operator’s physiological condition.

What is BlueEyes not?

? Doesn’t predict nor interfere with operator’s thoughts.

? Cannot force directly the operator to work.
How was the term blue-eyes coined?
? Blue in this term stands for Bluetooth, which enables reliable wireless communication and the Eyes
because the eye movement enables us to obtain a lot of interesting and important information.

How are blue and eyes related?

? As the idea is to monitor and record operator’s basic physiological parameters, the most important
physiological activity is the movement of eyes.
? For a computer to sense the eye movement, wiring between operator and the system is required.
But, this is a serious limitation of the operator’s mobility and disables his operations in large control
rooms.
? So utilization of wireless technology becomes essential which can be implemented through blue tooth
technology.

Need for blue eyes?

Is it necessary to make computer function what a human brain does?
? Yes, human error is still one of the most frequent causes of catastrophes (calamity) and ecological
disasters, because human contribution to the overall performance of the system is left unsupervised.
? The control instruments within the machine have automated it to large extent, thus Human operator
becomes a passive observer of the supervised system, resulting in weariness and vigilance drop, but the
user needs to active.
But Why?
Is it really needed that a human brain be active?
? He may not notice important changes of indications causing financial or ecological consequences,
which is a threat to human life.
? Thus, it’s crucial that operator’s brain is involved in an active system supervising over the whole work
time period.

What can we do with blue eyes technology?

? It has the ability to gather information about you and interact with you through special techniques like
facial recognition, speech recognition, etc.
? It can even understand your emotions at the touch of the mouse.
? It can verify your identity, feel your presence, and start interacting with you.
? The machine can understand what a user wants, where he is looking at, and even realize his physical or
emotional states.
? It realizes the urgency of the situation through the mouse.
? For instance if you ask the computer to dial to your friend at his office, it understands the situation and
establishes a connection.
? It can reconstruct the course of operator’s work.

Key features of the system:

? Visual attention monitoring (eye motility analysis).
? Physiological condition monitoring (pulse rate, blood oxygenation).
? Operator’s position detection (standing, lying).
? Wireless data acquisition using Bluetooth technology.
? Real-time user-defined alarm triggering.
? Physiological data, operator's voice and overall view of the control room recording
recorded data playback.

How can we give computer the human power?

? It uses non-obtrusive sensing method, employing most modern video cameras and microphones to
identify the users’ actions through the use of imparted sensory abilities.
? The blue eyes system checks the physiological parameters like eye movement, heart beat rate and
blood oxygenation against abnormal and undesirable values and triggers user-defined alarms when
necessary.
? Blue eyes technology requires designing a personal area network linking all the operators and the
supervising system.
? As the operator using his sight and hearing, senses the state of the controlled system, the supervising
system will look after his physiological condition.
? The use of a miniature CMOS camera integrated into the eye movement sensor will enable the system
to calculate the point of gaze and observe what the operator is actually looking at.
? Introducing voice recognition algorithm will facilitate the communication between the operator and
the central system and simplify authorization process.

STRUCTURE:
? Blue eyes system consists of a mobile measuring device called Data Acquisition Unit (DAU) and a
central analytical system called Central System Unit (CSU).

OVERALL SYSTEM DIAGRAM

DATA ACQUISITION UNIT:

? It maintains Bluetooth connections.
? Gets information from the sensor.
? Sends information over the wireless connection.
? Delivers the alarm messages sent from the Central System Unit (CSU) to the operator.
? Handles personalized ID cards.
? Jazz Multisensor:
• It’s an eye movement sensor, to provide necessary physiological data in Data Acquisition Unit (DAU).
• It supplies raw digital data regarding eye position, the level of blood oxygenation acceleration along
horizontal and vertical axes and ambient light intensity.
• Eye movement can be measured using direct infrared oculographic transducers.

JAZZ MULTISENSOR

CENTRAL SYSTEM UNIT:

? Maintains blue tooth connections in the other side.
? Buffers incoming sensor data.
? Performs on-line data analysis.
? Records the conclusion for further exploration.
? Provides visualization interface.
TYPES OF USERS:
? Users belong to three categories:
• Operators
• Supervisors
• System administrators
Operator:
? Operator is a person whose physiological parameters are supervised.
? The operator wears the DAU.
? The only functions offers to the operator are Authorization to the system and receiving alarm alerts.
? Authorization: Operator has to enter his personal PIN into DAU, if PIN is accepted, authorization is
said to be complete.
? Receiving Alerts: This function supplies the operator with the most important alerts about his and his
co-workers’ condition and mobile device state.

Supervisor:
? He is the person responsible for analyzing operators’ condition and performance.
? The supervisor receives tools for inspecting present values of the parameters (on-line browsing) as
well as browsing the results of the long-term analysis (off-line browsing).
System Administrator:
? He is the user that maintains the system.
? The administrator is delivered tools for adding new operators to the database. Defining alarm
conditions.
? Configuring logging tools.
? Creating new analyzer modules.

ADMINISTRATIVE
APPLICATIONS:
? Blue Eyes system can be applied in every working environment requiring permanent operator's
attention.
? At power plant control rooms.
? At captain bridges.
? At flight control centers.
? Professional drivers.

CONCLUSION:
? The wireless link between the sensors worn by the operator and the supervising system makes it
possible to improve overall reliability, safety and assures proper quality of system performance.
? These new possibilities can cover areas such as industry, transportation, military command centers or
operation theaters.
? Researchers are attempting to add more capabilities to computers that will allow them to interact like
humans, recognize human presents, talk, listen, or even guess their feelings.
? It avoids potential threats resulting from human errors, such as weariness, oversight, tiredness.

REFERENCES:
1.Carpenter R. H. S., Movements of the eyes, 2nd edition, Pion Limited, 1988, London.
2.Quinlan J. R., C4.5 programs for machine learning, Morgan Kaufmann Publishers, 1993,San Mateo,
California.