PPT ON

BLUE EYES TECHNOLOGY

BY

K.L.SRINIVASA RAO IV B-Tech ECE (Email id:kannikantis@gmail.com)

G.RAJA IV B-Tech ECE (Email id:gorumuchuraja@gmail.com)

SRI SARATHI INSTITUTE OF ENGINEERING & TECHNOLGY

Nuzvid,Krishna(dist)

BLUE EYES TECHNOLOGY

People take for granted. INTRODUCTION Communication is often described as a two Way Street, but the analogy of a multilane highway would be closer to the truth. People communicate by words and local inflections by subtle bodily movements and nuances of gaze, by touch and gesture, and even by uncontrollable reactions like blushing or falling speechless. By comparison, human - computer interaction is an impoverished affair. The primary interfaces - a keyboard and pointing device - not only force the user to master new techniques but they restrict the range of the interaction, scientist at IBM Research labs around the world are working on a wide range of human computer interaction technologies that are helping to make it easier to get computers to do what we want them to do. Human cognition depends primarily on the ability to perceive, interpret and integrate audio visual and sensory information. Adding extraordinary perceptual abilities to computers would enable computers with human beings as intimate partner. Thus Blue eyes Technology add more capabilities to computer that will allow them to interact like humans, recognize human presence, talk, listen or even guess there feeling. Broadly saying that, Blue eyes are aiming at creating computational machines that have perceptual and sensory abilities like those of Human beings. THE TECHNOLOGY The Blue Eye Technology uses non obtrusive sensing methods, employing most modern video cameras and microphones to identify the user's action through the uses of imparted sensory abilities. The machine can understand what a user wants, where he is looking at, and even realize physical or emotional states. The valance extraction is related to the emotions. *The key features of the system are: Physiological monitoring (eye mobility Analysis). Visual attention condition monitoring (pulse rate, blood Oxygenation) Operator's position detection (standing, lying). Wireless data acquisition using Bluetooth technology Physiological data, operator's voice and overall view of the control room recording recorded data playback. The three studies made by different scientists make an attempt to quantify emotions Peter Lang Explored the use of slides to induce emotion in subjects. He than assigned and arousal coordinates to each picture and mapped them in two dimensional space. Ward Winton, Lois Putnam and Robert Krauss added Heart rate sensors (HR) and galvanic skin conduction detectors (SC) to subject, viewing similar evocative slide.

CONTENTS INTRODUCTION TO BLUE EYES TECHNOLOGY ABSTRACT INTRODUCTION THE BLUE EYES TECHNOLOGY TECHNOLOGY VIDEO CAMERA'S COMPUTER PROJECTS EMOTION MOUSE SUITOR SCROLL POINT MOUSE MAGIC FUTURE APPLICATION ABSTRACT Blue eyes technology was developed by IBM research center at Almaden. It consists of modern video cameras and sensors. Blue eyes Technology is designed to provide computers with clues on how a users "feels". Blue eyes are working on determining a variety of information from user through facial expressions, through eyes, through voice and through its presence. Emotion mouse uses various sensors to get information about the user who is using mouse. SUITOR is a simple user interest tracker, scroll point mouse is designed for the user to scroll the screen up, down, or sideways without having to steal his visual attention away from what he is currently doing, MAGIC is a manual and gaze Input cascaded pointing uses eyes in conjunction with hand to move the cursor on the screen. Animal survival depends on highly developed sensory abilities. Likewise, human cognition depends on highly developed abilities to perceive, integrate, and interpret visual, auditory, and touch information. Without a doubt, computers would be much more powerful if they had even a small fraction of the perceptual ability of animals or humans. Adding such perceptual abilities to computers would enable computers and humans to work together more as partners. Toward this end, the Blue Eyes project aims at creating computational devices with the sort of perceptual abilities that

Winton, Putnam and Krauss correlated their slides pleasantness against the measure HR and SC of the subject. Dr Manfred Clines asked his subjects to remember and relive past emotional experiences while collecting somatic data from his subjects. VIDEO CAMERAS: The basic feature of Blue Eyes Technology is the video camera used is the most advanced and uses very important technology i.e. charges coupled Device Technology EVOLUTION OF CCD :

A charge coupled device (CCD) camera is an apparatus which is designed to convert optical brightness into electrical amplitude signals using a plurality of CCDs, and then reproduce the image of a subject using the electric signals without time restriction. Charge coupled devices or CCDs are arrays of semiconductor gates formed on a substrate of an integrated circuit or chip. The gates of the CCD are operative to individually collect, store and transfer charge. When used in image applications, the charge collected and stored in each gate of the array represents a picture element or pixel of an image. The CCD image sensor includes an image sensing section, which performs photoelectric conversion, and a storage section, which is arranged separate from the image sensing section and temporarily stores charges acquired by the photoelectric conversion. A CCD camera includes a CCD imager IC (integrated circuit) and control circuits typically mounted on a printed wiring assembly. In CCD cameras, either a CCD matrix or one or more CCD lines is/are located in the focal plane behind the optical system. A CCD is normally used for the image pickup device of a digital camera. Image data captured by it is stored in a storage medium such as a compact flash memory or an IC memory card. To monitor the captured image, a display means such as an LCD (liquid crystal display) is generally equipped in the digital still camera. Charge coupled device (CCD) camera systems are configured to capture signals according to many different CCD output formats and pixel configurations. After the image is captured, the energy associated with each pixel is absorbed by the silicon and a reaction takes place that creates an electron hole charge pair. The number of electrons collected at each pixel is linearly dependent on light level and exposure time and non linearly dependent on wavelength. Charge-coupled device (CCD) is an analog shift register, enabling analog signals (electric charges) to be transported through successive stages (capacitors) controlled by a clock signal. Charge coupled devices can be used as a form of memory or for delaying analog, sampled signals. Today, they are most widely used for serializing parallel analog signals, namely in arrays of photoelectric light sensors. This use is so predominant that in common parlance, "CCD" is (erroneously) used as a synonym for a type of image sensor even though, strictly speaking, "CCD" refers solely to the way that the image signal is read out from the chip The capacitor perspective is reflective of the history of the development of the CCD and also is indicative of its general mode of operation, with respect to readout, but attempts aimed at optimization of present CCD designs and structures tend towards consideration of the photodiode as the fundamental collecting unit of the CCD. Under the control of an external circuit, each capacitor can transfer its electric charge to one or other of its neighbors. CCDs are used in digital photography and astronomy particularly in photometry, sensors, medical fluoroscopy, optical and UVspectroscopy and high speed techniques such as lucky imaging.

The charge couple Device (CCD) was Invented in the late 1960 by researchers at Bell Laboratory, originally conceived as a new type of Computer memory circuit, it soon become apparent that the CCD had many other potential applications, including signal processing and imaging. CCD'S being on a thin wafer of silicon processed with a series of steps that define the various functions with the circuit. On each wafer lie several identical devices, or die, each capable of yielding a functional device. Selected die are then cut from the wafer and packed in a carrier for use in a system. Like the engine of a car, the CCD sensor in a digital camera acts as the primary tool to capture an image in its most elementary form. The CCD sensor is like the camera's" Electronic Eye" - collecting light and converting it to charge and subsequently emitting the signal that results in a digital image WORKING: IMAGE CAPTURE: There are different methods by which the image is captured by CCD sensors. But for the Blue Eye Technology the full frame image capture technique is used. It allows more charge capacity better dynamic range, reduced noise and delivery of optical resolution. Full frame CCDS consist of a parallel CCD shift register, a serial register and a signal sensing output amplifier in a full frame CCD, the exposure is controlled by a mechanical shutter or strobe to preserve scene integrity, because a parallel register is used for both scene detection and read out.

FEATURES AND BENEFITS: -Scroll point pointing device glows blue, - Business Black color compliments Net Vista and ThinkPad systems - No mouse pad required - no mechanical ball to get dusty, dirty or stolen, -Integrated Scroll Point pointing device provides excellent horizontal and vertical scrolling. - Includes programmable 3rd button for added functionality. - No mouse pad required! Works on many types of surfaces. No mechanical ball to get dusty, dirty or stolen. - Allows your fingers to rest easily and naturally on the mouse buttons SUITOR: The need of the present scenario is to develop intimate relationship between the computer and humans. And the simple user interest trackers (SUITOR) are a revolutionary approach in this direction. By observing the webpage a netizen is browsing, the suitor can help fetch more related information at his desktop. By simply noticing where the users eyes focus on the computer screen the SUITOR can be more precise eyes focus on the computer screen the SUITOR can be more precise in determining his topic of interest. It can even deliver relevant information to a handheld device SUITOR WORKING: SUITOR fills a scrolling ticker on a computer screen with information related to the users current task. SUITOR knows where you are looking what application you are working and what web pages you may browsing. If we are reading a webpage about something and If we need to read the heading of the ticker, it pops up the story in a Browser window. If we start to read the story it adds related stories to the tickers. That's the whole idea of an attentive system. One that attends to what you are doing, typing, reading. So that it can attend to yours information need. (Ticker is a type of watcher, or a type machine COMPUTER PROJECTS The blue eyes technology proposes various revolutions in computing devices these are explained below: EMOTION MOUSE:

The need of an hour is to design an adaptive smart computer system that could possibly recognize your face gestures, speed and even track your eye. An alternative

approach to gather personal information through touch . A smart computer can gain information about the user through touch via a special mouse and determine his emotional state, which in turn is related to the task user is currently involved in with the computer. Emotional aspect of a person are critical for rational decision making In other words, emotion detection is the best approach to an adaptive computer system by imparting the computer a longitudinal understanding of emotional state of the user, it could adapt a working style that fit's well users requirements. The other physiological measures that may affect the emotions of the user are A) HEART RATE : Heart rate is the frequency at which the heart generates impulses. B) GALVANIC SKIN RESPONSE : In response to an external stimulus (stimulus is anything which excites functional activity in an organ or part), such as touching a sharp points the resistance of skin response. C) GALVANIC SOMATIC ACTIVITY (GSA): The activities of afferent nerves that carry sensory information from the sensors on the skin to the brain is called as galvanic somatic activity. D) BLOOD PRESSURE : This is the pressure exerted by the blood vessel walls usually refers to the pressure within the arteries. Heart rate are measured through a chest strap sensor. GSA samples are taken through the mouse driver. GSR sample through finger tips. Blood pressure through blood pressure sensor (BVP) which the user have to wear. ADVANTAGE: Today, most computer users spend three fourth of their time scrolling through the screen using the input device, mouse, thus using emotion mouse this time is reduced to a larg extend. THE OPERATION: The computer will determine the emotional state the user when he simply touches the mouse. Sensors in the mouse sense the physiological attributes which, intern, are related to the personal emotional state. The changes in the temperature of the fingers also form a reliable measure for prediction of the users emotion. SCROLL POINT MOUSE: IBM'S scroll points mouse is one of the latest example of the products emerging from its activity. The scroll point mouse was originally designed to satisfy the underlying principles of a good user interface. The user interacts with his computer, and computer understands his interests based on what he is doing. The scroll point mouse allows the user to scroll the screen up, down, or sideways, without having to steal his visual attention away from what he is currently doing. The user needs not fiddle with scroll bars or move the window up and down ,nor will he have to divert his attention frequently for doing such acts

OPERATION: The solution which was driven by intensive human factors studies was to put a scrolling joystick on the mouse itself. The saddle shaped control responds to finger pressure exerted forward or backward, as well as left or right. The finger can be easily positioned on imt without looking at the mouse. It is also very efficient because it embodies the concept of rate control. The harder you push the faster the document scroll. The first model came out in 1997 an improved version, with control resolution and continuous scrolling, was shipped at the end of 1999. MAGIC: Another technology termed as magic (manual and gaze input cascaded) pointing used eyes in conjunction with hands. When the user stares at a specific area on the screen and touches the mouse simultaneously the cursor moves automatically to the area that the user is currently looking at with an accuracy of 1.27 cm (0,5 inch). In this the gaze tracking camera follow your eyes, but your fingers have to be involved as well. When you use gaze initiated cursor, you just look at the screen and touch the input device and the cursor moves close to where you are looking and then you make the final adjustment with the input device. In a computer processing apparatus[MAGIC] , frames of image data received from a camera are processed to track the eyes of a user in each image. A 3D computer model of a head is stored, and search regions are defined in the 3D space corresponding to the eyes and eyebrows. For each image, pixels within the projection of the search regions from the 3D space to the 2D image space are sampled to determine a representative intensity value for each of the search regions. Positions for the eyes in the 3D space are then calculated based on the determined values. The 3D computer model and search bands are moved within the 3D space to align the eyes with the calculated eye positions. In this way, when the next image is processed, the search bands project into the image from a head configuration determined from the previous image. This facilitates reliable and accurate eye tracking. ADVANTAGES: BlueEyes system can be applied in every working environment requiring permanent operator's attention: -at power plant, -control rooms, -at captain bridges, -at flight control centers professional drivers. The system consists of a portable measuring unit and a central analytical system. The mobile device is integrated with Blue tooth module providing wireless interface between the operator-worn sensors and the central unit. ID cards assigned to each of the operators and adequate user profiles on the central unit side provide necessary data personalization so that different people can use a single sensor device.

FUTURE APPLICATION: The Massachusetts institute of Technology (MIT) is currently involved in project called 'oxygen' being a personal network composing both hardware and software, oxygen sits atop the global network. Each unit has a small screen, camera, GPS module. Handy 21 mobile phone, infrared detector, handy radio and a network connected device that needs to be programmed as per requirement. This technology is endless ranging from the voice operated lighting system at your house hold to the most advanced aero planes that can communicates with the pilot. In the future ordinary house old appliances such as Refrigerator, Television, Microwave oven, -- may be able to do their jobs when we look at them and speak to them.

REFERENCE 1.Carpenter R. H. S., Movements of theyes, 2 nd edition, Pion Limited, 1988, London .2.Quinlan J. R., C4.5 programs for machine learning, Morgan Kaufmann Publishers, 1993, SanMateo, California. 3.Horo witz P., Hill W., The art of Electronics, Cambrid ge University Press, 1989 4.Bluetooth specificatio n, versio n 1.0B, Bluetooth SIG, 1999. 5.ROK 101 007 Bluetooth Module, Ericsso n Microelectronics, 2000. 6.MC145483 3V 13 -bit Linear PCM Codec -Filter, Motorola Semico nd uctor, 1997. 7.AT89C52 8-bit Microcontroller Datasheet, Atmel .8.ST14C16 memory card IC Datasheet, ST Microelectronics, 1999 .9.Leinecker R. C., Archer T., Visual C++ Bible, IDG Books, 1999 .10.MSDN Library, Microsoft (Visual Studio 6.0) .11.Intel Signal Processing Library Reference Manual. 12.www.cs.put.poznan.pl/achieve/load/CSIDC01Poznan.ppt 13.ndt-equipment-supply.com/.../blue-eyes-monitoringhuman-operator system 14.www.cs.put.poznan.pl/csidc/2001/images/html/en_ jazz .html 15.www.slideshare.net/jainshef/blue-eye-technology