Sixth Sense Technology

Transcription

1 Abstract-Sixth sense is a wearable gestural interface device developed by Pranav Mistry, a PhD student in the fluid interfaces group at the MIT media lab. It is similar to telepointer. The sixth sense prototype comprises a pocket projector, a mirror and a camera contained in a pendant like, wearable device. Both the projector and a camera are connected to a mobile computer devices and the user s project. The project projects visual information enabling surface walls and physical objects around us to be used As interfaces, while the camera recognizes and tracks user s hand gestures and physical objects using computer vision based techniques. The software programs process the video steam data captured by the camera and tracks the locations of the coloured marker at the tip of the user s finger. Sixth sense supports multi-touch and multi-user interaction. Sixth Sense Technology Priya 1, Sagun Saxena 2,Priyank Singhal 3 1,2 B.sc(hons,) cs, ccsit, Tmu Assistant professor, ccsit, Tmu Priyahons.95@gmail.com shagunsaxena94@gmail.com which permit us to carry these small size of computing device in our pockets. These computing devices connect us continually to the digital world and most important thing that there is no connection between our interaction with the physical world and our digital device. The information is kept n traditionally on to the paper or digitally on the screen. Sixth sense technology is used to bridge this gap, which brings incorporeal digital information out into corporeal world and permits us to communicate with this information via our natural hand gestures. Keywords: camera, projector, mirror, mobile component, color marker I. INTRODUCTION When something, someone or someplace is encountered, we use our five herbal sense eyes, nose, ears, tongue, and body to recognize the information about it. The information that becomes recognized by those five senses allows us to make decision and based on this. This information can assist to make the right decision. Now a day size of computing device are greatly used II. ORIGIN OF THE NAME Sixth sense technology was developed in 1997 as a head worn device, and in 1998 as a neck worn object but the sixth sense name for this work was not contained the sixth sense to describe such device. Man referred to this wearable computing technology as an affording a "Synthetic Synesthesia of the Sixth Sense", believing that wearable computing and digital information could act in addition to the five 169

2 traditional senses. Ten year later, Pattie Maes, also with MIT media lab, used the term sixth sense in this same context, in a TED talk. Other inventors have used the sixth sense technology to describe new capabilities that augment the traditional five human senses. III. SIXTH SENSE TECHNOLOGY Human takes decisions after acquiring inputs from the sense. But the information which could help making a good decision is a largely available on internet. Although the information can be gathered y connecting devices like computers and mobiles but they are restricted the screen and there is no direct interaction between the tangible physical world and intangible digital world. This sixth sense technology provides us with the freedom of interacting with the digital world with hand gestures. This technology has a wide application in the field of artificial intelligence. This methodology can aid in synthesis of bots that will be able to interact with humans. COMPONENTS 1. Camera 2. Projector 3. Mirror 4. Mobile component 5. Colour marker appropriate computer vision computation. The major functions f the camera can be listed as: captures user s hand movements and gestures(used in reorganization and gestures) Captures the scene in front and objects the user is interacting with(used in reorganization and tracking) Takes of the scene in front when the user performs framing gestures. 2. PROJECTOR The projector is the key output device of the sixth sense system. The project visually augments surfaces, walls and physical object the user s interacting with by projecting digital information and graphical user interfaces. The mobile computing devices provide the projector with the content projected. The projector unit used in prototype runs on a rechargeable battery. 1. CAMERA The camera is a key input device of the sixth sense system. The camera acts as a digital eye of the system. It basically captures the scene the user is looking at. The video stream captured by the camera is passed to mobile computing device which does the 170

3 3. MIRROR The usage of a mirror is important as the projector dangles pointing downwards from the neck, the mirror reflects the image on to a desire surfaces. Thus finally the digital image is freed from its confines and placed in the physical world. interaction instruction for the projected application interfaces. The Sixth Sense Technology Works As Follows: 1. It captures the image of the object in view and tracks the user s hand gestures. 4. MOBILE COMPONENT The sixth sense device consists of a web enabled smart phone which process the data send by the camera. The camera phone searches the web and interprets the hand gestures with help of the coloured markers placed at the finger tips. 2. There are colour markers placed at the tip of users fingers. Marking the user s fingers with red, yellow, green and blue colour tape helps the webcam to recognize the hand gestures. The movements and arrangements of these markers are interpreted into gestures that act as an interaction instruction for the projected application interfaces. 3. The smart phone searches and interprets the coloured markers placed at the finger tips. 4. The information that is interrupted through the smart phone can be projected into any surfaces. 5. COLOR MARKER There are colour markers placed at the tip of user s finger. Marking the user s finger s with red, yellow, green and blue coloured tapes helps the webcam to recognize the hand gestures. The movements and arrangements of these markers are interpreted into gestures that act as a 5. The mirror reflects the image on to a desire surfaces. 171

4 3. Many others applications are reading newspaper, booking, reservation tickets, reading facial expression locating place. IV. Application Fields Of Sixth Sense Technology 1. Making hand as an mobile screen and dialling numbers displaying on hand through finger tips. 4. book; the system can display additional information such as reader's comments. individual pages of a book and display annotation by the user's friend. This demo also suggested the system would be able to handle tilted surface. 6. newspaper articles and project the most recent video on the news event on a blank region of the newspaper. 7. by their appearances and project a word cloud of related information retrieved from the internet on the person's body. V. Future Enhancment 2. Taking pictures by angling yours finger tips to the pictures you want to take. 1. To get rid of color marker. 2. To incorporate camera and projector inside mobile device. 3. To have 3D gesture tracking. CONCLUSION Once the sixth sense technology comes into our life we are able to a see new world 172

5 around us in which all digital devices have much less precedence. Sixth sense recognizes the object around us, displaying information automatically and letting us to access it in any way we need. We must try to take it extra secure and avoid radio waves which are dangerous and could propose brain most cancers to youngsters. The benefit of this technology is transportable, its connectedness between the world and the facts as speech. Its value effectiveness and information can accessed from the system without delay in real time. It could also be said as an open source technology. Within twenty years this technology will bring a drastic change in field of science. REFERENCES [1] Aastha, rashmi, saakshi Bhatia and geeta rani, sensing the six sense technology in international journal of information technology and knowledge management,jan, july 2012,vol.5, no.1, pp [2] Rakesh D. Desale, vandana S.Ahire, A study on wearable gestural interfaces- A six sense technology IN IOSR journal of computer engineering (IOSR-JCE) e-issn : , p- ISSN Vol. 10 Issue 5(mar.-apr.2013),pp [3] Vishmita Yashwant shetty vinyak bhupendr rai, six sense technology In International journal of science of science and research (IJSR) ISSN(Online): Impact factor (2012): volume 3 Issue 12, DECEMBER [4] sense [5] Meenu Rani Dey, rakesh patel, Renuka Bareth, World Become A Genius through Sixth Sense Technology in International Journal of Engineering Sciences & Research technology ISSN: [6] e [7] 173