Slide 1

Leveraging Natural User Interface Technologies to Deliver Improved User Experience Tim Huckaby InterKnowlogy Chairman/Founder Actus Interactive Software Founder & CEO Microsoft RD & MVP AAP205

Slide 2

NUI: The Natural User Interface Common Gestures of Touch Physical Object Interaction Virtual Object Interaction Multi-Touch Capable Motion Based Interface Tracking of full-body movement, facial expression, and voice with precision Gesture Capable Multi-array Microphone Uniquely Distinguish Audio & Voices Voice Capable Conscious and non-conscience interfaces Non Invasive Neural Capable

Slide 3

Slide 4

Slide 5

demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP The Heart

Slide 6

video Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP Grey's Anatomy

Slide 7

video Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP Gesture Heart

Slide 8

A little bit about me and why I am here

Slide 9

InterKnowlogy (www.InterKnowlogy.com) Tim Huckaby, Founder/Chairman (TimHuck@InterKnowlogy.com) 13+ year old services firm Custom Application Development focused on building NUI solutions Web, mobile, and desktop windows 7/8, Surface, Windows phone 7, azure, Kinect, Largest Client: Microsoft Actus Interactive Software (www.Actus-Software.com) Tim Huckaby, Founder/CEO (TimHuck@Actus-Software.com) Software Product Company Interactive Kiosk and Active Digital Signage Multi-Touch, Gesture, and Voice Driven Solutions

Slide 10

The Green-Screen

Slide 11

Image courtesy of Computer History Museum

Slide 12

PastFuture (Now)Present 1972: PLATO IV Touch Screen Terminal The Samsung SUR40 for Microsoft Surface Windows 8 - Metro Apple iPad

Slide 13

Inexpensive Touch Capable, Non Proprietary Hardware A Windows OS designed for Multi-Touch A Consistent Multi-Touch API for.NET across all Windows Hardware/Software Platforms Developer Productivity in Touch Capable Apps The Forecast of Multi-Touch Hardware Capability in Every New Computing Device in the Short Term

Slide 14

HP TouchSmart TM2 Rates in Windows as 5.0 Price in October-2010: Starting from: $1499.99* Price in March-2011: Starting from: $799.99* Price Today (HP TouchSmart 320m ): $579.99 About the Windows 7 Computer I am Using Today

Slide 15

HTML 5 Touch Events Spec, Version 2 W3C Editor's Draft 14, November 2011 Defines a set of low-level events that represent one or more points of contact with a touch-sensitive surface Changes of those points with respect to the surface and any DOM elements displayed upon it (e.g. for touch screens) or associated with it (e.g. for drawing tablets without displays). Addresses pen-tablet devices, such as drawing tablets, with consideration toward stylus capabilities. Source: https://dvcs.w3.org/hg/webevents/raw-file/tip/touchevents.html

Slide 16

demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP HTML5 Touch

Slide 17

The Microsoft Surface is expensive because it has 5 cameras looking up that do Object Recognition Based on a byte tag (not a QR code) Object Recognition in Windows The Use Cases are limitless

Slide 18

video Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP Surface Craps

Slide 19

NUI: Games as a Tool for Learning Learning made Fun / Entertaining Proven as a learning tool beyond just Children Computer based Games are a significant part of popular culture Educational Video Game Curriculums MIT, UC Irvine, Minnesota, Mich State, etc.

Slide 20

demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP NASA: Mars Bound

Slide 21

Slide 22

Slide 23

demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP Windows 8: Semantic Zoom Actus Interactive Kiosk Metro

Slide 24

Slide 25

demo Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP Actus Interactive Kiosk Touch-less OR IK PT

Slide 26

The Good News: The Kinect SDK for Windows The Not So Good News: Windows Only Device; K4W does not work on your Xbox; you cannot build apps for 18 million Xbox Kinect owners with it.

Slide 27

Slide 28

High fidelity EG acquisition device No conductive gel, etc. Non-invasive Use Case Examples: Conscious: mind manipulation of objects Conscious: Steering a wheel chair with your mind Non-Conscious: Ranking music First target market: gaming $300!!!

Slide 29

video Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP Emotiv

Slide 30

Slide 31

Slide 32

Summary

Slide 33

video Tim Huckaby Founder / Chairman, InterKnowlogy Founder / CEO, Actus Software Microsoft RD & MVP HoloDesk - Direct 3D Interactions with a Situated See-Through Display

Slide 34

Find Me Later At *Tool Bench Chalk Talk area at DEV track booth. Monday, June 11, between 6:00pm and 7:00pm.

Slide 35

Contact me: Tim Huckaby E-mail: TimHuck@InterKnowlogy.com TimH@Actus-Software.com Phone: Office : 760-444-8640 Mobile : 619 990 9200 Blog: http://team.interknowlogy.com/blogs/timhuckaby FaceBook: http://www.facebook.com/Tim.Huckaby.Carlsbad LinkedIn: http://www.linkedin.com/in/timhuckaby Twitter: @TimHuckaby

Slide 36

Sample Fill

Slide 37

Slide 38

play, fun, entertainment notebook, learning mouselearn, ideasfile, papershare, concepts share, speech bubble thought bubble search, learning coffee, work, office computer monitor luggage, travel badge, registration global, locationthe cloudairplane, travel this way, look here twitterdecorative arrowthis way, arrowBirds of a feather finance, calculator this way, arrowhands-on labsthis way, connect

Slide 39

play, fun, entertainment notebook, learning mouselearn, ideasfile, papershare, concepts share, speech bubble thought bubble search, learning coffee, work, office computer monitor luggage, travel badge, registration global, locationthe cloudairplane, travel twitterdecorative arrowthis way, arrowBirds of a feather finance, calculator this way, arrowhands-on labsthis way, connect this way, look here

Slide 40

Slide 41

Slide for Showing Developers Software Code Use this layout to show software code The font is Consolas, a monospace font The slide doesnt use bullets but levels can be indented using the Increase List Level icon on the Home menu

Slide 42

demo Name Title Group Demo Title

Slide 43

video Video Title

Slide 44

partner Name Title Company Partner Title

Slide 45

customer Name Title Company Customer Title

Slide 46

announcing Announcement Title

Slide 47

title Title

Slide 48

Breakout Sessions (session codes and titles) Hands-on Labs (session codes and titles) Product Demo Stations (demo station title and location) Related Certification Exam Find Me Later At Required Slide *delete this box when your slide is finalized Speakers, please list the Breakout Sessions, Labs, Demo Stations and Certification Exams that relate to your session. Also indicate when they can find you staffing in the TLC.

Slide 49

Resource 1 Resource 2 Resource 3 Resource 4 Required Slide *delete this box when your slide is finalized Track PMs will supply the content for this slide, which will be inserted during the final scrub.

Slide 50

Connect. Share. Discuss. http://northamerica.msteched.com Learning Microsoft Certification & Training Resources www.microsoft.com/learning TechNet Resources for IT Professionals http://microsoft.com/technet Resources for Developers http://microsoft.com/msdn

Slide 51

Required Slide Complete an evaluation on CommNet and enter to win!

Slide 52

Scan the Tag to evaluate this session now on myTechEd Mobile Required Slide *delete this box when your slide is finalized Your MS Tag will be inserted here during the final scrub.

Slide 53

Slide 54