Welcome

Basic Concept

Research Justification

The Project

Implementation

Potential Issues

Future Work

What am going to talk about?

What am I interested in?

Bringing the interactor into the experience

Merging virtual and physical space

Allowing for natural body movement during interaction

Permitting physical objects to beused as interface devices

Exploring tangible interaction

Basic Concept

OK, but why?

Research Justification

Discover new forms of interaction

Exploration of ambient intelligence

Model for future ubiquitous computing applications

Get us out from behind our desks

No more carpel tunnel syndrome!

OK, but why?

Research Justification

But mostly because I think it’s cool!

Swarm: An Augmented Reality Experience

The Project

You reach into a box that appears to have a transparent top. Inside are two colored balls. You grab the balls, one in each hand, which causes colored particles to begin to swarm. The particles are drawn to the balls and move both in front of and behind your hands like magical fireflies, following every gesture that you make.

Form Factor

The Project

How does it work?

Implementation

Augmented Reality

+

Video Chroma Key

The Compositing Process

Implementation

How does it work?

Implementation

Hardware

Box

Projector

Colored Balls

Software

Jitter

Processing

Hardware

Implementation

The Box

Green Rear Wall

Mirror

Lights

Webcam

Inside the Box

Implementation

Software

Implementation

Jitter

Color Detection

Track hand positions

Send data to Proce55ing

Software

Implementation

Proce55ing

Chroma Key

Draw the particles

Recombine the 3 video layers

Primary Concerns

Potential Issues

Processing Power

Distributed Computing

Multiple Computers

WebCam

Camera Angle

Wide Angle Lens

Video

Chroma Key Issues

Where do I go from here?

Future Work

Graphics

Incorporate 3d Animation

Ambient Intelligence

Make the balls “clickable”

Scale

Full body Experiences

FIN

Thank you!