Documente Academic
Documente Profesional
Documente Cultură
TECHNICAL SEMINAR
TECHNICAL SEMINAR
ACKNOWLEDGEMENT
I would like to take this opportunity to place it on record that this Technical Seminar would never have taken shape but for the cooperation extended to us by certain individuals. Sincerely I acknowledge my deep sense of gratitude to Miss. T.M.R.RAJESWARI (Assistant professor) for her constant encouragement, help and valuable suggestions. I would like to express our deep gratitude to the Mr. C. PRAVEEN KUMAR for Head his of Department cooperation of INFORMATION carrying the TECHNOLOGY, timely while
A.SUSHMA
(08U51A1256)
TECHNICAL SEMINAR
TECHNICAL SEMINAR
Introduction:
It is a sense that would give seamless and easy access to Meta information or information that may exist somewhere. The Sixth Sense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the users pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces. Sixth Sense frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer. Initially the device started with a helmet consisting of the camera, projector and colour markers. Later it was converted into a form so that it is easy to use it by wearing around the neck.
TECHNICAL SEMINAR
mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world.
TECHNICAL SEMINAR
CONTENTS
TECHNICAL SEMINAR
CONTENTS
1 2 3 4 5 6 7 8 9 ABSTRACT INTRODUCTION DEVICES TECHNOLOGIES ADVANTAGES APPLICATIONS WAY FORWARD CONCLUSION REFERENCES 3 8 10 12 16 19 23 26 28
TECHNICAL SEMINAR
INTRODUCTION
TECHNICAL SEMINAR
2.Introduction
Although miniaturized versions of computers help us to connect to the digital world even while we are travelling there arent any device as of now which gives a direct link between the digital world and our physical interaction with the real world. Usually the informations are stored traditionally on a paper or a digital storage device. Sixth sense technology helps to bridge this gap between tangible and nontangible world. Sixth Sense device is basically a wearable gestural interface that connects the physical world around us with digital information and lets us use natural hand gestures to interact with this information .The sixth sense technology was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. The sixth sense technology has a Web 4.0 view of human and machine interactions. SixthSense integrates digital information into the physical world and its objects, making the entire world your computer. It can turn any surface into a touch-screen for computing, controlled by simple hand gestures. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs .It also supports multi user and multi touch provisions. Sixth Sense device is a mini-projector coupled with a camera and a cell phonewhich acts as the computer and your connection to the Cloud, all the information stored on the web. The current prototype costs around $350. The Sixth Sense prototype is used to implement several applications that have shown the usefulness, viability and flexibility of the system.
SIXTH SENSE
'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information The hardware components are coupled in a pendant like mobile wearable device. The SixthSense prototype is comprised of a pocket projector, a mirror, colord marker and a camera. The camera, mirror and projector is connected wirelessly to a blue tooth smart phone device that can easily fit into the users pocket. A software then processes the data that is collected by the capturing device and produces analysis. The software that is used in sixth sense device is open source type.
TECHNICAL SEMINAR
DEVICES
10
TECHNICAL SEMINAR
It captures the image of the object in view and track the users hand gesture. The camera recognizes individuals, images, pictures, gestures that user makes with his hand. The camera then sends this data to a smart phone for processing. Basically the camera forms a digital eye which connects to the world of digital information.
Coloured Marker:
There are colour markers placed at the tip of users finger. Marking the users fingers with red, yellow green and blue coloured tape helps the webcam to recognize the hand gestures .The movements and arrangement of these markers are interpreted into gestures that act as a interaction instruction for the projected application interfaces.
Mobile Component:
The Sixth Sense device consists of a web enabled smart phone which process the data send by the camera. The smart phone searches the web and interprets the hand gestures with help of the coloured markers placed at the finger tips.
Projector:
The information that is interpreted through the smart phone can be projected into any surface. The projector projects the visual information enabling surfaces and physical objects to be used as interfaces. The projector itself consists of a battery which have 3 hours of battery life .A tiny LED projector displays the data sent from the smart phone on any surface in view- object, wall or person. The downward facing projector projects the image on to a mirror. Using palm for dialing a number.
Mirror:
The usage of a mirror is important as the projector dangles pointing downwards from the neck. The mirror reflects the image on to a desire surface. Thus finally the digital image is freed from its confines and placed in the physical world. 11
TECHNICAL SEMINAR
TECNOLOGIES
12
TECHNICAL SEMINAR
Gesture Recognition:
It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gesture recognition technique basically focuses on the emotion recognition from the face and hand gesture recognition. Gender recognition technique enables humans to interact with computers in a more direct way without using any
DRK COLLEGE OF ENGINEERING & TECHNOLOGY
13
TECHNICAL SEMINAR
external interfacing devices. It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. Interfaces which solely depends on the gestures requires precise hand pose tracking. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. In the Sixth Sense devices coloured bands are used for this purpose. Once hand pose has been captured the gestures can be recognized using different techniques. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes. This technique has a high accuracy usually showing accuracy of more than 95%. Time dependent neural network will also be used for real time recognition of the gestures.
Computer Vision:
Computer vision is the technology in which machines are able to interpret/extract necessary information from an image. Computer vision technology includes various fields like image processing, image analysis and machine vision. It includes certain aspect of artificial intelligence techniques like pattern recognition. The machines which implement computer vision techniques require image sensors which detect electromagnetic radiation which are usually in the form of ultraviolet rays or light rays. The computer vision find itself applicable in varies field of interest. One such field is bio medical image processing. Its also used in autonomous vehicle like SUVs. The computer vision technique basically includes four processes.
o
Recognition: One of the main task of computer vision technique is to determine whether the particular object contain the useful data or not. Motion Analysis: Motion analysis includes several tasks related to estimation of motion where an image sequence is processed continuously to detect the velocity at each point of the image or in the 3D scene. Scene Reconstruction: Computer vision technique employs several methods to recreate a 3D image from the available images of a scene.
14
TECHNICAL SEMINAR
Image Restoration: The main of aim of this step is to remove noise from an given image. The simplest method involves using simple filters like low pass or median filters. In order to get better quality images more complex methods like Inpainting are used.
15
TECHNICAL SEMINAR
ADVANTAGES
16
TECHNICAL SEMINAR
Cost effective:
The cost incurred for the construction of the sixth sense proto type is quiet low. It was made from parts collected together from common devices. And a typical sixth sense device cost up to $300. The sixth sense devices have not been made in large scale for commercial purpose. Once that happens its almost certain that the device will cost much lower than the current price.
17
TECHNICAL SEMINAR
through recognition of hand gestures is much easier and user friendlier compared to the text user interface or graphical user interface which requires keyboard or mouse.
18
TECHNICAL SEMINAR
APPLICATIONS
19
TECHNICAL SEMINAR
The sixth sense technology finds a lot of application in the modern world. The sixth sense devices bridge the gap by bringing the digital world into the real world and in that process allowing the users to interact with the information without the help of any machine interfaces. Prototypes of the sixth sense device have demonstrated viability, usefulness and flexibility of this new technology. According to the words of its developers the extend of use of this new device is only limited by the imagination of human beings. Some practical applications of the sixth sense technology is given below.
Map Application:
With the help of a map application the user can call upon any map of his/her choice and navigate through them by projecting the map on to any surface .By using the thumb and index fingers movements the user can zoom in, zoom out or pan the selected map.
Taking Pictures:
Another application of sixth sense devices is the implementation of a gestural camera. This camera takes the photo of the location user is looking at by detecting the framing gesture. After taking the desired number of photos we can project them onto any surfaces and then use gestures to sort through those photos and organize and resize them. The user taking making a pose gesture The camera takes the photo of the location.
Drawing Application:
The drawing application allows the user you to draw on any surface by tracking the fingertip movements of the users index finger. The pictures that are drawn by the user can be stored and replaced on any other surface. The user can also shuffle through various pictures and drawing by using the hand gesture movements.
20
TECHNICAL SEMINAR
We can make calls with help of sixth sense device .The sixth sense device is used to project the keypad into your palm and the using that virtual keypad we can make calls to anyone.
Getting Information:
Sixth sense devices can be used for getting various information relating to our everyday life by getting in contact with objects.
Product Information:
Sixth sense technology uses marker technology or image recognition techniques to recognize the objects we pick in our hand and then provide information relating to that product.
Book Information:
By holding and shuffling through the book pages, the sixth sense provides Amazon ratings on that book, other reviews and other relevant things related to the book.
Flight Updates:
With the help of the sixth sense technology it is no longer required to log into any sites for checking the status of the flights. The system will recognize your boarding pass and let you know whether the flight is on time or not.
21
TECHNICAL SEMINAR
With help of face recognition techniques the sixth sense devices are able to provide information about the people when we meet them. The sensor detects the face and checks the data base for the relevant information. The system will then project the relevant information about a person like what they do, where they work, Boarding pass showing current status the information about a person being projected.
22
TECHNICAL SEMINAR
WAY FORWARD
23
TECHNICAL SEMINAR
Mouse less:
Mouse less is a concept which is developed in order to avoid the usage of mouse in computers. It helps to provide a familiarity of the physical mouse without actually requiring a physical mouse. Even though the computer hardware technology has been developed to a greater extent, still there has been no proper substitute for a physical mouse. This new invention aims to remove the requirement of having a physical mouse altogether but still it provides the feeling of a physical mouse that users are familiar with. It basically consists of an Infrared laser beam and an Infrared camera. Both laser and camera are embedded together with the computer. The laser beam module is modified with a line cap and placed such that it creates a plane of IR laser just above the surface the computer sits on. The user cups their hand, as if a physical mouse was present underneath, and the laser beam lights up the hand which is in contact with the surface. The IR camera detects those bright IR blobs using computer vision. The change in the position and arrangements of these blobs are interpreted as mouse cursor movement and mouse clicks.
Third Eye:
Third Eye is a new technique that enables multiple viewers to see different things on a same display screen at the same time. With third Eye, We can have a public sign board where a Japanese tourist sees all the instructions in Japanese and an American in English. - We don't need to have the split screen in games now. Each player can see his/her personal view of the game on the TV screen. - Two people watching TV can watch their favorite channel on a single TV screen. A public display can show secret messages or patterns. - In the same movie theater, people can see different end of a suspense movie.
24
TECHNICAL SEMINAR
Even though there has been a tremendous development of computer aided designing tools, still paper and pencil is the preferred by most of the designers, especially in the earlier stages of designing .The project inktuitive is aimed to combine the process of creation that is inherent in paper and pencil with the power of computing that the digital design tools provide. It also extends the natural work-practice of using physical paper by giving the pen the ability to control the design in physical three-dimensional space, freeing it from its tie to the paper. There always remains an intuition of pen and paper ,but the lines that have been drawn are be captured and translated into shapes in the digital world. The physical paper is augmented with overlaid digital strokes. The platform provides a novel interaction mechanism for drawing and designing using above the surface pen movements. In other words inktuitive can be considered as an intuitive physical design workspace that aims to bridge the gap and bring together the conventional design tools such as paper and pencil with the power and convenience of the digital tools for design.
TaPuma:
TaPuma is the short form of Tangible Public Map. It is another attempt to bring the digital world nearer to the real world by exploring the techniques of sixth sense technology. Key word based search mechanism has vastly influenced and modified the ways in which we search informations. The keyword based search allows the user to filter out the required data from the vast data that are available on search engines such as yahoo and Google. TaPuMa allows people to use their own belongings, the objects they usually carry with them to access relevant and just-in-time information and locations of places from a public map. The project also explores and analyzes the advantages and challenges of this novel interaction mechanism, where real life objects serve as the interface for information acquirement. The broad concept behind the project TaPuMa is Object Amelioration, where the functions of everyday objects can be expanded by using their affordances or functionalities in a variety of different contexts.
25
TECHNICAL SEMINAR
CONCLUSION
26
TECHNICAL SEMINAR
8.CONCLUSION
The sixth sense technology and devices are definitely the way forward. The sixth sense recognizes the objects around us and displays the information relating to those objects in a real time environment. The sixth sense technology allows the user to interact the information through hand gestures. This is a quiet efficient way compared to the text and graphic based user interface. It has the potential to form the transparent user interface for accessing the information around us. . Even though the sixth sense devices are currently in development stages and have not been used in large now, its quiet predictable that this technology have the potential revolutionize the way in which we interacts with the digital world.
27
TECHNICAL SEMINAR
REFERENCES
28
TECHNICAL SEMINAR
9.REFERNCES
1. http://www.ted.com/talks/pranav mystery the thrilling potential of sixthsense technology.html/ 2. http://www.commoncraft.com/augmented-realityvideo/ 3. http://www.arcane-technologies.com/en/ 4. http://en.wikipedia.org/wiki/Augmented_reality/ 5. http://www.rfidjournal.com/ 6. http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.ht ml / 7. http://timesofindia.indiatimes.com/Health__Science/Sixth_sense_giz mo_a_sci-fi_reality/articleshow/4083978.cms / 8. http://www.gesturetek.com/
9 http://www.slideshare.net/renjithravi/sixth-sense-technology
29