1

Sinhgad Technical Education Society’sSINGHAD INSTITUTE OF TECHNOLOGY

LONAVALATAL. MAVAL,

DIST: PUNE-410401

ASEMINAR REPORT

ON

“SIXTH SENSE TECHNOLOGY”

SUBMITTED BY:

MUDIT AGARWALUNDER THE GUIDENCE OF

PROF. V.P.TONDE

DEPARTMENT OF INFORMATION TECHNOLOGY

2

SEMINARApproval Sheet

The seminar Entitled

SIXTH SENSE TECHNOLOGY

BYName Exam No.

Is hereby approved in partial fulfillment

For the third year in Information Technology (Term -1).

PROF. V.P.TONDEGUIDE

Department Of Information TechnologySinhgad Institute of Technology, Lonavala.

2010–2011.

3

CERTIFICATE

SIXTH SENSE TECHNOLOGY

This is to certify that the above mentioned

Seminar has been carried out by

Name Exam No.

Students of third year engineering (Term - 1)2010-2011

Department of Information TechnologySinhgad Institute of Technology, Lonavala.

2010–2011.

GUIDE H.O.DPROF. V.P.TONDE PROF. K.J. KARANDE

PRINCIPALDR. S.S. INAMDAR

4

I would like to mention our sincere gratitude towards our principal Dr.S.S.INAMDAR

and H.O.D.Prof. K.J. KARANDE, IT- Department, for giving us opportunity to carry out my

seminar.

I would like to express our heart full gratitude towards my guide, Prof.V.P.TONDE for

his invaluable advice for the successful completion of this dissertation.

I also like to extend my sincere thanks to other staff of the IT - Department for their

invaluable help and support.

Finally I take this opportunity to mention my sincere thanks to one and all those who

helped us directly or indirectly for the completion of our seminar.

MUDIT AGARWAL

ROLL NO:- 34 T.E.I.T

5

Over millions of years to sense the world around us. When encountered something, someone or some place, we use our five natural senses to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. SixthSense bridges this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. ‘SixthSense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.

6

 

Contents1. SEMINAR APPROVAL SHEET2. CERTIFICATE3. ACKNOWLEDGEMENT4. ABSTRACT

TITLE PAGE NO

1. Introduction to the Traditional systems 72. what is sixth sense technology? 8 3 . Sixth Sense Prototype 93.1. Projector 3.2. Camera 3.3. Coloured markers4. Working 125. Applications 15 6. Cost and Availibility 167. Bibliography 17

7

Int r oduction to the Traditional systems

• Information is traditionally confined to paper or digitally to a screen.

• Even though computing devices allows us to carry computers in our pockets, that connects to the digital world continuously, BUT is no link between our digital devices and our interactions with the physical world.

SIT,Lonavala

8

What is Sixth Sense?

SixthSense is a wearable gestural interface device developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. It is similar to Telepointer, a neckworn projector/camera system developed by Media Lab student Steve Mann (which Mann originally referred to as "Synthetic Synesthesia of the Sixth Sense

Sixth Sense Prototype

The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. The software program processes

SIT,Lonavala

9

the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.

The SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. The map application lets the user navigate a map displayed on a nearby surface using hand gestures, similar to gestures supported by Multi-Touch based systems, letting the user zoom in, zoom out or pan using intuitive hand movements. The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger. SixthSense also recognizes user’s freehand gestures (postures). For example, the SixthSense system implements a gestural camera that takes photos of the scene the user is looking at by detecting the ‘framing’ gesture. The user can stop by any surface or wall and flick through the photos he/she has taken. SixthSense also lets the user draw icons or symbols in the air using the movement of the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying glass symbol takes the user to the map application or drawing an ‘@’ symbol lets the user check his mail. The SixthSense system also augments physical objects the user is interacting with by projecting more information about these objects projected on them. For example, a newspaper can show live video news or dynamic information can be provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist projects an analog watch.

SIT,Lonavala

10

Another type of prototypes.

SIT,Lonavala

11

Working

SIT,Lonavala

12

The camera recognizes objects around you instantly, with the micro-projector overlaying the information on any surface, including the object itself or your hand. Then, you can access or manipulate the information using your fingers. Need to make a call? Extend your hand on front of the projector and numbers will appear for you to click. Need to know the time? Draw a circle on your wrist and a watch will appear. Want to take a photo? Just make a square with your fingers, highlighting what you want to frame, and the system will make the photo—which you can later organize with the others using your own hands over the air.while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.

Examples: Sixth Sense analyses what the user sees and visually augments

surfaces or physical objects the user is interacting with.

SIT,Lonavala

13

SIT,Lonavala

14

The user interact with the projected information through natural hand gestures, arm movements, or interaction with the object itself.

WUW projects information onto surfaces, walls, and physical objects around us.

SIT,Lonavala

15

APPLICATIONS

The SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. The map application lets the user navigate a map displayed on a nearby surface using hand gestures, similar to gestures supported by Multi-Touch based systems, letting the user zoom in, zoom out or pan using intuitive hand movements. The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger. SixthSense also recognizes user’s freehand gestures (postures). For example, the SixthSense system implements a gestural camera that takes photos of the scene the user is looking at by detecting the ‘framing’ gesture. The user can stop by any surface or wall and flick through the photos he/she has taken. SixthSense also lets the user draw icons or symbols in the air using the movement of the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying glass symbol takes the user to the map application or drawing an ‘@’ symbol lets the user check his mail. The SixthSense system also augments physical objects the user is interacting with by projecting more information about these objects projected on them. For example, a newspaper can show live video news or dynamic information can be provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist projects an analog watch.

Cost And Availability

SIT,Lonavala

16

The device can be made in current prototype system costs approximately $350 to build.

In Indian currency 17000Rs .

Sixth Sense hardware and software at present works with smartphones.

The software’s source code will be available on an open-source model. AS THE STATEMENT OF IT’S MAKER.

Bibliography

=> www. wikipedia.com=> www.pranavmistry.com

SIT,Lonavala

17

=> www. msn search.com=> www. Alta vista.com =>www.gizmodo.com/5167790/sixth-sense-technology-may-change-how-we-look-at-the-world-forever

SIT,Lonavala