REALITY SHOW OR TRUSTABLE IMPOSTORS ? Alex Garcia-Alonso University of the Basque Country.

REALITY SHOW OR TRUSTABLE IMPOSTORS ?

Alex Garcia-AlonsoUniversity of the

Basque Country

Chapel Hill, Oct. 23rd

Outline

• Research environment• Reality show or trustable impostor• Recent research activities• Your input & discussion

http://images.google.com/imgres?imgurl=http://det.bi.ehu.es/~apert/logos/logoUPV_EHU.gif&imgrefurl=http://det.bi.ehu.es/~apert/APERT_engl.htm&h=141&w=142&sz=3&hl=en&start=9&um=1&tbnid=bmeLBYaGt-fXAM:&tbnh=93&tbnw=94&prev=/images%3Fq%3Dehu%26svnum%3D10%26um%3D1%26hl%3Den%26rlz%3D1T4GGLJ_enES225ES225%26sa%3DN


Research environment

• Basque Country– 4 Universities (90,000 students) – 12 Tech research centers (2,200 labor force)



@ CEIT (1982-1995)

• Technological Research Center• App. Mechanics Dpt. : comp. graphics

– FEM : pre- post-processing– Interactive 3D visualization

• Mechanisms analysis• Dynamics …

– Collision analysis (RT mechanisms) …

• Working for different companies– European Space Agency– MDI (Mechanical Dynamics Inc, Ann Arbor MI)

– EADS …



@ Univ. of the Basque Country (1996- )

• Teaching !!!• Technological Research centers

– CEIT (258 Labor staff)

• University of Navarre

– Ikerlan (230 Labor staff)

• MCC Cooperative group 250 companies -- 83,600 labor force

• 44% Basque Country 37% Spain 19% international

– Labein (356 Labor staff)

– Vicomtech– EUVE …

• Spin-offs +VRwww.simtechniques.com

www.landersimulation.com



Research environment

100 milesdiameter

MCC – IkerlanU. of Mondragon

Mondragon

San Sebastian

U. of the Basque Country U. of Navarre

CEIT Vicomtech

Bilbao

Vitoria

EUVE

U. of DeustoLabein



SKILLS research network• CEIT• Labein• Aalborg University• Commissariat à l'Energie Atomique - Laboratoire d'Intégration

des Systèmes et des Technologies (CEA LIST)• DLR - Institute of Robotics and Mechatronics• Fraunhofer Institut für Graphische Datenverarbeitung• HAPTION• KUKA Roboter GmbH• OMG plc• PERCRO, - Italy [coordinator]• Queen's University of Belfast• Simonazzi S.p.A.• Technion - Israel Institute of Technology• UM1 - University Montpellier-1• University of Tampere

Multimodal Interfaces for capturing and Transfer of Skill



ENACTIVE research network• Labein• CEIT• Scuola Superiore Sant'anna,

PERCRO• Queen's University of Belfast

Institut National Polytechnique de Grenoble

• University of Exeter• Lunds Universitet• Université Technologique de

Compiègne• Uppsala Universitet• Institute of Robotik und

Mechatronik• Hasselt University• Faculty of Music, McGill Univ.• University of Minnesota

• Max-Planck Gesellschaft zur Foerderung der Wiss. E.V.

• Université de Genève• Ecole Polytech. Fed.

Lausanne• Università Degli Studi Di

Padova • Sony France• Ecole des Hautes Etudes en

Sciences Sociales• Assoc pour la Création et la

Recherche Outils d'Expression

• Centre National de la Recherche Scientifique

• Université Montpellier-1

Learn by doing



CEIT

Pisa

U. Southern California

Stanford U.

CEIT

Fraunhofer IIS Erlangen



Labein

Queen’s University of Belfast

MIT, Boston

University of Ottawa Labein, Bilbao



Recent activities

• P2P visualization & NURBS (2000-02, U. Basque Country)

• Collisions in mech. Assembly (2001-05, CEIT)

• Occlusion culling (2003-07, CEIT)

• Improving haptic perception (2006---, CEIT)

• Collaborative haptics (04-07, Labein)

• Avatars (04---, Vicomtech)

• Learning Procedural Skills : link IA & VR (07---, U. Basque Country - U. Navarre)



Let us go to the past :1986



Outline




Reality show or trustable impostor

• Applications• Users, costumers• Reality show ?• Impostors : interface contract• Trustable impostors everywhere• Great Expectations

– Consumer haptics– Networked haptics

• Summing up



Applications

• Research– Physic based research – Application oriented research

• Physics and Maths are the basis of research

• Science must also appreciate Applications :– Appraise applied science and engineering !– Steer knowledge to a good application !



Applications : spreadsheets

• David Alan Grier (1979)– “This machine has everything you can find on a

real mainframe: multiprocessing, report generators, Cobol. If it were only a small mainframe, there would be no reason to get it, because it is as slow as bad plumbing. However, it has one piece of software. This, my friend, is a spreadsheet and it is going to change the world. Without spreadsheets, these machines are nothing. With spreadsheets, they are unstoppable.” (source, Computer, sept 2007, pg 6)



Applications & users

• Windows interface metaphor– Xerox– Apple– Users

• Apps target user domains of different size– Specific domains (training, simulation, modeling, … )

– Broad domains (Consumer oriented : games, “desktop” I/F, co-presence, …)

• Always– pleased users are the key for successful

applications



A personal experience : discovering customers

• A sad story : ADAMS/Real -Time Kinematics• 1994 : 3 weeks from CEIT to MDI

– Jeff Cooper (MDI, Mechanical Dynamics Inc, Ann Arbor MI)

• The happy one : ADAMS/Animation– I learnt a new point of view : “customers” (users)– 2-3 K licenses



… (discovering customers)

• Both applications (“products”) were :– Easy of use– Quite good “cost / performance” ratio– So, … why this success difference?

• ADAMS/Animation– conquered users’ expectations



REVIMA (developed at CEIT)

• 2000-04 Collaboration with CEIT– Installed & used successfully– However, it did not replace the space mouse (haptic

competitor) desk is more comfortable– IEEE Computer Graphics & Applications Dec. 2004

– “Minority Report” Steven Spielberg 2002 film

www.donnarosenartists.com artist Dale Rutter

www.ceit.es



Reality Show ?

• Is the realism of visual or haptic rendering the key for success ?

• Who generates the most “realistic” images ?– Sony’s Playstation 3 ? – Microsoft’s Xbox 360 ?– Nintendo´s Wii clearly, doesn’t

• So, why did the Wii succeed ? …..– Why do users enjoy more the Wii ?– The Wii conquered users unconscious wishes– How ?



Impostors lead the Wii to success

• Does the Wii replicates reality ?• Games for the Wii : Trustable Impostors

– An impostor “replaces” something

– Replaces a real : golf club, baseball bat, bowling ball, racket

– Users trust (accept) their behavior



Impostors : replacement restrictions

• There is not an absolute replacement– Impostors can be used to achieve some goals– They do not replace playing grounds– These are not flaws, they are an Interface Contract– Impostors are accepted “as they are”, because they fulfill

users' expectations

Insertar FOTO juego real



Trustable Impostors everywhere

• Real time Computer Graphics: – Fluid flows– Cloth– Faked shadows and reflections– Herd motion– Lighting– Vegetation

• Simulation– Gravity used to fake acceleration



… ( Trustable Impostors everywhere )

• Haptic systems– Deformable environments : body tissue– Comfortable inspection– Pseudo-haptics

• Impostors everywhere :– Models “substitute” (real) entities– Algorithms “substitute” physical laws

• Mathematical formulations

• Heuristics



Interface Contract for haptic systems

• Impostors are conditioned by hardware specifications, models and algorithms.– Stiffness (mechanical apps)– Force limits (weight, tighten, push, ...)– Position precision

• Haptic systems require interface contract– Conditions of use (usability domain)

analyses must be performed !!!– Perception– Skills achievement



90’s Great Expectations : 3D Visualization

• 1991 : Jim Clark (Silicon Graphics)

– “He also made some interesting predictions for the low end. He described the multimedia machine of the future as a device integrating the capabilities of (1) full 3D, interactive, real-time computer graphics, (2) full motion video, (3) image processing capabilities, (4) fully integrated geometric text, and (5) full compact-disc digital sound. He predicts that this will be available in a portable notebook-sized device with motion sensors in the next five to ten years for under $5,000.” (Source: Neville Holmes, Computer, sept 2007, pg 11)



Great expectations : consumer haptics

• A haptic device as spread and affordable as the Wii or the GPU ?– 3 dof seems available– 6 dof and multipoint devices are further away

• Which performance ?– Usability domain

• Which user expectations will they be able to fulfill ?

Which applications should be developed ?



Great expectations : networked haptics

• Feb. 2007 : Sipping beers with Jarek RossignacQ-collaborative haptics ?

That’s OK.But … which is its use ?

A-Mechanical assembly …(Jarek : skeptical glance)

A- feel mutual contact …(Jarek : keen glance)

• Co-presence awareness – Toast, handshake, – Mutual contact …– Feel physical presence in the collaborative working

environment



Reality show AND trustable impostors

• We must discover unconscious users’ expectations– And fulfill them

• “Reality” must be defined by an Interface contract– Users must trust (accept) app. behavior

Conditions of use must be well specified

Perform more perception and skills achievement analyses

• Cheap haptic devices make possible new challenges– May new haptic based metaphors replace the desktop ?– Can haptic devices outperform the mouse ?– Which I/F mechanisms can increase co-presence awareness ?



Outline




Recent activities

• P2P visualization & NURBS (2000-02, U. Basque C.)

• Intell. tutors + 3D visualization (00-05, U. Basque C.)

• Collisions in mech. Assembly (00-04, CEIT)

• (1) Occlusion culling (03-07, CEIT)

• (2) Collaborative haptics (04---, Labein)

• Avatars (04---, Vicomtech)

• (3) Improving haptic perception (06---, CEIT)

• IA & VR : Learning Procedural Skills (06---,

U. Basque C. - U. Navarre)



(1) @ CEIT - Simulation group

Length 5.0 feet (1.5 m)Radius 2.6 feet (0.8 m)

ITP supplies turbines to Rolls-Royce



Multidisciplinar group on haptics

Othersimulations

Haptic response

Collision+ Contact

data

Imagegeneration

Control

USER

2004 : Comp Graphics Forum

2004 : IEEE Comp Graph & APP

2008 : Computer Animation and Virtual Worlds

2008 : IEEE Trans. on Control Systems

Technology

2007 : IEEE Int. Conf. on Robotics and

Automation

Haptic design & building



• Virtual environment– Many objects– Objects not far from eye– Low occlusion

• Cannot use– Conventional LOD– “Background texture” replac.

Improve occ. cull.

Occlusion culling : environment



• Many coherence mechanisms analyzed– Using most of them– Surprisingly stereo (eye2eye) coherence did not improve performance … why ?

• Low occ. scenes 40%– Speed ups achieved

• OC as a LOD mechanism

Occlusion culling : learnt experiences



• OC as a LOD mechanism – image relevance– Occlusion ratio :

• visible pixels / projected pixels

– A new GPU query is required– GPU can be easily extended

Occlusion culling : learnt experiences

Occlusion Ratio schemeif ( Occlusion_Ratio < threshold & visible pixels < 0.15% drawing area )then draw simplified objectelse draw object normally


Chapel Hill, Oct. 23rdHAVE’2007 , Ottawa, Oct. 13-14

(2) @ Labein

• Collaborative Assembly Simulator• Labein (Spain) & Queen’s University Belfast

USER QUEEN’S

USER LABEIN

USER QUEEN’S

USER LABEIN



Learnt experiences

• Collaborative haptics (each user holds one object)

[ Collaborative ≠ Cooperative two users hold the same object ]

– Independent interaction similar to visualization

– Dependent interaction• Collisions co-presence

• Assembly : constraints, network haptic response

– Experiments : Labein - Queen’s U. Belfast– P2P & Scalability



Current research : motion prediction

• Local haptic (not networked)– 5 years ago : 40ms/frame – coll. computing– Where will be the object when the collision

computations are done ?– Free movement vs. contact movement

instabilities ? stiffness dependent ?

– Currently 2-3ms. no relevant

• Collaborative haptics (50-200ms delays)– promising



• Improving haptic perception– Surface discontinuities (edges, holes, thin

elements, …)

oscillations– Surface normal– Penetration– Contact point

(3) @ CEIT



Your input & discussion

Thanks for your attention Muchas gracias Eskerrik asko (Basque language)

DonostiaSaint Sebastian


REALITY SHOW OR TRUSTABLE IMPOSTORS ? Alex Garcia-Alonso University of the Basque Country.

Documents

Transcript of REALITY SHOW OR TRUSTABLE IMPOSTORS ? Alex Garcia-Alonso University of the Basque Country.