Slides talleres-interacion1

Taller: Llenguatges Audiovisuals i Narrativa Interactiva ‘2011

TALLER: LLENGUATGES AUDIOVISUALS I NARRATIVA INTERACTIVA

Nina Valkanova & Marco Romeo


ABOUT NINA

• Computer scientist and media designer • PhD Candidate at the Interactive Technologies Group• Interested in interaction design for urban media displays • Teaching at the UPF

Taller de Sistemas Interactivos II (2009, 2010, 2011)

• [email protected]://ninavalkanova.comvia the Moodle


ROADMAP

THEORYConcepts of

Audio-Visual Language

THEORYConcepts of

Audio-Visual Language

THEORYHypertextInterfaces

Interactive Narrative

THEORYHypertextInterfaces

Interactive Narrative

WORKSHOPCamera

Interaction

WORKSHOPCamera

Interaction

Blob trackingBlob tracking

PRACTICEApplication of Concepts

from Audio-Visual Language

PRACTICEApplication of Concepts

from Audio-Visual Language

Color trackingColor tracking

FiducialsFiducials


ABOUT THIS CLASS

• Workshop on the creation of camera interactions• Practical exercises• Group work – 2 or 3 people.

– “Pair programming”– Form your group NOW and send US an email with your names TODAY– No FACEBOOK please

• Evaluation - next slide


EVALUATION

• Presence – evaluated individually. 80% presence from practice (Marco) and workshop (Marco and Nina)

• Assignments – evaluated in group• Need to be completed IN CLASS • Submission – via Moodle.


XBOX GAME


COMPUTER VISION

• Creating “seeing” applications• Feeding an application with a series of images

(video, or single image) • Analyzed for something particular (face, light,

color, object)


APPLICATIONS

• Robotics• Surveillance machines• Weapons systems • Games• Touchscreen interfaces• Interactive installations


MINORITY REPORT (2002)


FULL-BODY GAME


M-TOUCH


EXERCISE 1

• Download from the course’s page the document “Processing_OpenCV_JMyron_PSEye.pdf”

• Follow the installation instructions step by step

• Make sure you have step 5. (simple exercise) working


BLOB TRACKING


EXERCISE 2

• Open the BLOBS example of OpenCV and have a look at it

• Using the starting example from step 5. (of the instructions) – make the BLOBS example of the OpenCV library work with the image data obtained from JMyron opencv.copy(img,width,0,0,width,height,0,0,width,height);


EXERCISE 2

• Reminder from exercise 1: this code makes possible that Jmyron image data can be used by OpenCV

m.update(); int[] img = m.image(); loadPixels(); opencv.copy(img,width,0,0,width,height,0,0,width,height); updatePixels();

• Put this piece code in a separate function called JMyron2OpenCV(int w, int h, JMyron buffer)

• In the beginning of this function put the following code, which cleans the OpenCV buffer

int[] cleanPx = new int[w*h];opencv.copy(cleanPx,w,0,0,w,h,0,0,w,h);


EXERCISE 2

• The interesting part: where should you call the function?JMyron2OpenCV


EXERCISE 3

• Control a video using camera interaction:• Extend your blob tracking sketch by the following:– Add a window showing a video playback (similar to

exercise done with Marco; use the Loop video example)– Program an interaction controlling the playback of the

video (stop / play), which uses the number of blobs detected by the camera


FOR NEXT TIME

• Deadline: 1 June 17:00h • Submit to the Moodle a file with the commented code of

“step 5: simple exercise”, explaining each code step• Submit to the Moodle your first blob-tracking sketch

(exercise 2)• Submit to the Moodle a ZIPPED archive containing your

sketch about video interaction and blob-tracking, and the data folder with the video. Use the loop video example. (exercise 3)

Slides talleres-interacion1

Documents

Transcript of Slides talleres-interacion1