SiiCS - Surface Independent Interactive Computer System

19

description

SiiCS is a wearable and portable device that can convert any surface into an interactive touch screen and users can interact using natural finger gestures. SiiCS can recognize many objects from the real world and extract related information from the internet and either display it on the object itself or speak it out to the user in case of Visually impaired people. SiiCS derives its motivation from MIT Sixth sense technology, Microsoft surface and Nintendo Wii. The difference here is that SiiCS is dedicated to Visually impaired people and handicapped people apart from regular users.SiiCS represents the intersection of the Computer Science most significant concepts like Human Computer Interaction, Surface independent computing, Machine Vision & Object detection, Gestural computing and Text to speech systems. SiiCS is winner of Microsoft Imagine Cup Software Design Accessibility Innovation Award 2010 and is still in the pre beta stage.

Transcript of SiiCS - Surface Independent Interactive Computer System

Page 1: SiiCS - Surface Independent Interactive Computer System
Page 2: SiiCS - Surface Independent Interactive Computer System

1. Virtual world of internet!Extract real time information from the web based on the object detected and project it on the object itself.

2. Physical World!Detect all type of real world physical objects and assist a user to know the object’s description and make optimal decisions.

3. Professional World!Operate computer screen, give presentations, do drawing, check e-mail, read SMS etc. on any surface.

Page 3: SiiCS - Surface Independent Interactive Computer System
Page 4: SiiCS - Surface Independent Interactive Computer System
Page 5: SiiCS - Surface Independent Interactive Computer System

SIICS draw its innovation from the concepts like “The Sixth Sense” developed by MIT Media Lab, “Microsoft Surface” developed by Microsoft Research and “Nintendo Wii” by Nintendo and proposes an inside view of the future of human computer interaction and surface independent touch interactive technologies. SIICS aims at people with disabilities such as low vision, color blindness, blindness, deafness, dumbness and people with total physical disability apart from various other possibilities.

Page 6: SiiCS - Surface Independent Interactive Computer System
Page 7: SiiCS - Surface Independent Interactive Computer System

1. People with disabilities such as low vision, color blindness, blindness, deafness, dumbness and people with total physical disability

2. Students, teachers, scholars and educationists

3. Professionals and Business man to carry out meetings, read emails, power point slide shows on any surface etc.

4. Home users while shopping, checking emails etc.

“The cost of the device is estimated to be about Rs. 15000/. This includes the cost of the hardware i.e. projector and the web camera while I have kept the software free of cost for the end users.”

Page 8: SiiCS - Surface Independent Interactive Computer System

1. Portable, scalable and wearable device

2. Can convert any surface into an interactive touch screen

3. Users can interact with real time data and information using natural finger gestures.

4. Can detect real world objects and project their information from the web onto their surface such as bing search results, wikipedia definition, its amazon rating and popularity etc.

5. Can operate computer screen using a finger in the air, users can draw on any surface, zoom in zoom out things etc.

6. Supports multi user interaction at the same time

Page 9: SiiCS - Surface Independent Interactive Computer System
Page 10: SiiCS - Surface Independent Interactive Computer System

1. Detection of different real world objects and projection of their related information from the web onto their surface such as Bing search results, Wikipedia definition, Amazon rating and popularity etc.

2. Project computer screen on any surface and operate computer mouse using a finger in the air

3. Users can draw on any surface, zoom in/ zoom out/ rotate images on any surface etc. all using natural finger gestures

4. Detection of color of various objects and convey it to user

5. Supports multi user interaction

Page 11: SiiCS - Surface Independent Interactive Computer System

“THE IMAGE REPRESENTS CONTROL OF MOUSE POINTER THROUGH THE SIICS DEVICE”

Page 12: SiiCS - Surface Independent Interactive Computer System

“DETECTION OF AN INHALER AND DISPLAYING ITS DESCRIPTION FROM BING”

Page 13: SiiCS - Surface Independent Interactive Computer System

“DETECTION OF COLOR OF ANY OBJECT (CURRENTLY SUPPORTS BASIC COLORS ONLY)”

Page 14: SiiCS - Surface Independent Interactive Computer System

“THE IMAGE SHOWS THE ACTUAL SCREENSHOT OF THE SCREEN IN THE SIICS SOFTWARE DISPLAYINGAN EXAMPLE OF FREEHAND DRAWING IN 2 DIFFERENT COLORS USING 2 DIFFERENT FINGER CAPS”

Page 15: SiiCS - Surface Independent Interactive Computer System

“THE IMAGE SHOWS THE ACTUAL PHOTOGRAPH SOF SIICS WITH ZOOM IN/ZOOM OUT/IMAGE ROTATION DEMO ON A WALL”

Page 16: SiiCS - Surface Independent Interactive Computer System

1. Read SMS, E-mails and use applications on any surface

2. Play computer games using natural gestures

3. Use the virtual earth and maps application on any surface with zoom in/zoom out features

4. Handwriting recognition that allow the users to type in the air any character while being assisted by the text to speech system

5. Assist the user to recognize specific products(listed in the SIICS database of products) such as medicines, spectacles, ear phones etc. and detect human faces to assist them in daily life

6. Recognize dumb finger language and convert it to speech

7. Wireless connection with mobile devices for computation and communication

Page 17: SiiCS - Surface Independent Interactive Computer System

1. SiiCS is definitely a unique approach towards simplifying real world interactions with computers and presenting the user the right kind of information at right time and at a place where he wants it.

2. SiiCS can be extremely helpful to disabled in a way that it can assist them in doing daily tasks in an easy and simplified manner such as object detection and getting information, color detection, human detection (face), typing in the air etc.

3. SiiCS can be very useful to any kind of user who wants portable computing along with natural interaction with the computers.

4. SiiCS can be deployed with different types of virtual and gaming environments as means of natural human computer interaction device.

5. SiiCS can simplify and fasten everyday computer and non computer tasks and can assist a user to make right and optimal decisions in real time.

Page 18: SiiCS - Surface Independent Interactive Computer System

1. SiiCS presents an insight view of future of Human computer interaction, Natural gesture computing and surface independent computing. The possibilities to deploy in real life are endless. Similar example can be the wide acceptance of Nintendo Wii technology.

2. SiiCS device is built from existing hardware and costs around Rs. 15000/. The device can be built under Rs. 8000/. with low end portable projectors which is pretty good for Indian market.

3. The major release will support windows mobile phone with wireless connectivity as a computational and communicational device easing out a lot of things (As of now, since SiiCS is still in pre beta phase, so one need to carry his/her laptop to use this device on the go).

4. The viability of SiiCS to be deployed in real life is very high because the device is cheap and can be really helpful to different people with different needs and requirements and can be used to develop many different types of innovative applications based on SiiCS.

Page 19: SiiCS - Surface Independent Interactive Computer System