Hacks - Beyond Just Games

JEREMY JOHNSON

DESIGNERUX

DIRECTORof user experience

GAMER

jeremyjohnson@www.jeremyjohnsononline.com

2009

http://www.avenue-films.com/project-natal-the-journey.html

Microsoft's motion-sensor Kinect came out of the company's research lab in Beijing, away from the company's day-to-day business, she notes. "There was a steel umbrella put over it, to keep out the rest of the organization. Then Microsoft Research threw Kinect over the wall to the Xbox group, which created their own steel umbrella to shield it. They added some scaffolding, but this was an innovation that was mostly done in-house. It can happen in a big company. Of course, this is entirely the reverse of the way Office/Windows development happens."boyd argues that the best place "to create steel walls is in businesses outside your core cash cows. The role of a big company is to keep the cash cow rolling, and then build the new."

http://www.fastcompany.com/magazine/162/generation-flux-danah-boyd

“Kinect, which launched slightly over a year ago, has sold an impressive 18 million units worldwide. (At this rate, Kinect will outsell the original Xbox by next year.)”http://www.shacknews.com/article/71904/xbox-360-reaches-66-million-sales-kinect-at-18-million

18 Million

GAMES

http://www.jeremyjohnsononline.com/2011/10/18/gamification-101-refresh-dallas-meeting/

“There’s a lot to learn from games. There are 30 years of design lessons and thousands of products on the market. Games have more concrete lessons to teach application designers about learning, feedback, user motivation and social systems than almost any field of study.”

- Danc

http://www.lostgarden.com/2010/05/wordcamp-2010-why-we-turned-microsoft.html

http://www.officelabs.com/projects/ribbonhero2/Pages/default.aspx

http://www.lostgarden.com/2011/04/what-heck-happened-to-clippy-ribbon.html

http://www.engadget.com/2010/12/09/kinect-finally-fulfills-its-minority-report-destiny-video/

“Kinect Hacks”

http://www.kinecthacks.com/

http://www.youtube.com/user/KinectHacks/featured

http://www.joystiq.com/2012/01/09/kinect-for-windows-leers-at-february-1-launch-date/

“Microsoft chief Steve Ballmer narrowed down the "early 2012" launch window for Kinect on the Windows PC during Microsoft's CES 2012 keynote today: February 1, 2012.”

http://techcrunch.com/2012/01/27/secret-windows-8-weapon-kinect-built-into-your-laptop/

http://www.xbox.com/en-US/Kinect/Kinect-Effect

DESIGNERUX

information architectureinteraction designvisual designusability testing

web appsdesktop apps RIAs

mobile apps touch apps ??

User interaction with technology is going above the glass. You no longer need an explicit tool or even direct manipulation to drive a user interface. With the ability of technology, like the Microsoft Kinect, to see users’ movements in space, gestures are being added to traditional methods in new layers of interaction. Designing for this new layer of interaction requires new thinking about dexterity, ergonomics, and whether someone might feel silly or offensive with certain gestures. We are so involved in this space right now, that we’ve had to move our design technologists’ desks to create enough room for all the hand waving design.http://designmind.frogdesign.com/blog/frogs-2012-technology-trend-predictions.html

Interaction Choreographyby Senior Principal Design Technologist Jared Ficklin

vs

http://www.fastcodesign.com/1665827/microsoft-unleashes-the-kinect-and-promptly-misses-the-point

http://www.fastcodesign.com/1665827/microsoft-unleashes-the-kinect-and-promptly-misses-the-point

“The innovation here is the fluidity of experience and focus on the data, without using traditional user interface conventions of windows and frames. Data becomes the visual elements and controls. Simple gestures and transitions guide the user deeper into content. A truly elegant and unique experience.”http://en.wikipedia.org/wiki/Metro_(design_language)

HACKSKINECT

http://www.thecreatorsproject.com/blog/the-board-of-awesomeness-is-a-kinect-controlled-skateboard

http://www.pocket-lint.com/news/43671/kinect-hack-wiimote-robot-cat

http://venturebeat.com/2011/11/15/microsoft-code-space-kinect/

http://www.kinecthacks.com/kinect-video-manipulation/

http://www.niemanlab.org/2011/08/mirror-mirror-the-new-york-times-wants-to-serve-you-info-as-youre-brushing-your-teeth/

http://mashable.com/2012/01/09/bodymetrics-augmented-reality-shopping/

http://www.etre.com/blog/2012/01/puppet_parade_interactive_kinect_puppets/

http://www.creativeapplications.net/openframeworks/interactive-wall-at-ud-openframeworks-kinect/?utm_source=feed&utm_campaign=rss-mo-more&utm_medium=rss

http://latimesblogs.latimes.com/technology/2012/01/virtual-dressing-room-takes-the-hassle-out-of-taking-off-your-clothes.html

http://www.theverge.com/microsoft/2012/1/11/2700832/kinect-fusion-swivel-facecake-hands-on

http://techcrunch.com/2012/01/16/primesense-demos-a-gesture-based-next-gen-tv-interface

Solar powered house saves energy with Kinect

http://dvice.com/archives/2012/01/solar-powered-h.php

Now, in the name of conserving energy that vision could come true with a solar house designed to use an Xbox Kinect to switch off energy consuming devices with simple movements.

http://dlb-network.com/2012/01/mass-effect-3-kinect-demo/

What now?

“Don’t try to figured out how to cram Kinect into an existing UI paradigm, instead design a UI paradigm that’s from the ground-up intended to exploit the Kinect’s functionality.”

http://www.teehanlax.com/labs/insights-into-kinect-ui/

http://www.useit.com/alertbox/kinect-gesture-ux.html

That there are no universal standards for gestural interactions yet is a problem in its own right, because the UI cannot rely on learned behavior. The Kinect has a few system-wide standards, however, which do help users.http://www.useit.com/alertbox/kinect-gesture-ux.html

http://www.microsoft.com/download/en/details.aspx?id=27978

Explain what the player can do.

Represent what they are doing.

Make it fun to match the two.

Test your implementation.

THE RULES Of KINECT

Things to Think About...Distance and EnvironmentHow far do they need to stand? How far do they think they need to stand? Environment design of the area. Eyesight, size of the UI.

ErgonomicsIs it comfortable? Age? People with disabilities? Common movements vs. uncommon. How long will they interact?

FashionDo they look silly? Will someone of a certain age/race/gender use this? What’s acceptable for an Avatar?

UI PatternsWhat do they know from click and touch interfaces? Is there something more natural? Try and unlearn, and imagine.

3D SpaceIs it close or far away? What do we infer from spatial positioning? Can you get people to interact in 3D space on a 2D screen?

Things to Think About...Screen ResolutionWhat’s the maximum amount of objects you can fit on a screen? What’s the minimum size of an object need to be on the screen?

PrivacyCan you tailor to age? Race? Gender? What is helpful and what is potentially scary? Can you keep a snapshot for marketing purposes?

jeremyjohnson@www.jeremyjohnsononline.com

jeremy@23hd.com

THANKS!