Alexis Clay – Sino-French Seminar on Graphics and Image 1/45 Sino-French Seminar on Graphics and...
-
Upload
tracey-lucas -
Category
Documents
-
view
214 -
download
1
Transcript of Alexis Clay – Sino-French Seminar on Graphics and Image 1/45 Sino-French Seminar on Graphics and...
Alexis Clay – Sino-French Seminar on Graphics and Image 1/45
Sino-French Seminar on Graphics and Image
Alexis Clay – Sino-French Seminar on Graphics and Image 2/45
ToC
• ESTIA:– The Engineer School– ESTIA’s role in local development
• LIPSI : ESTIA research– Research axis– The people / National andInternational collaborations– Projects
• Computer Science team– Human Machine Interaction using TUI– Emotion recognition
• Conferences
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 3/45
The ESTIA
CampusCampus
ESTIAEngineer school
Master degree
LIPSI &GRAPHOS
Research Centres
Research
ESTIA ENTREPRENDREYoung companies & projects incubator
Spin off creation
ESTIA-INNOVATION
Centre of technological transfer
ConsultingThe ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 4/45
The Engineer School
• Mecatronic Engineer & Project manager
• International (EI Bilbao, UT Cranfield, ESA…)
• Double degree and 3 languages
The ESTIA – The LIPSI – The Computer Science Team - Conferences
• 50 students in Master degree
Alexis Clay – Sino-French Seminar on Graphics and Image 5/45
ESTIA’s role in local development
• ESTIA is involved in the regional economical development
• Supported by the Chamber of Commerce and Industry
• In order to play a role: Technology-oriented young companies support; Centre of Technological Transfer.
ESTIA entreprendre, ESTIA innovation
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 6/45
Research in ESTIA: LIPSI
• Director: Jean-Roch Guiresse• Scientific director: P. Weil, CNRS
Director of research (member of LaBRI - Bordeaux)
• 14 Assistant Professors, 16 Ph.D students, 1 engineer.
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 7/45
How does LIPSI work?
• For Each project:
– A few people from LIPSI
– Collaboration with other laboratories
– Collaboration with Companies
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 8/45
How does LIPSI work?
Fundamental research…
… always with an industrial partnership linked to an application case.
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 9/45
The LIPSI
Conception engineering
Collaborative Design ProcessesProduct design
Industrial Task oriented Interaction
Robotics, electronics, microtechnologies
Electrical Engineering, Renewable Energies
The ESTIA – The LIPSI – The Computer Science Team - Conferences
A pluridisciplinar Laboratory
Alexis Clay – Sino-French Seminar on Graphics and Image 10/45
LIPSI: The scientific Network
The ESTIA – The LIPSI – The Computer Science Team - Conferences
CLIPSGrenoble
CLIPSGrenoble
NTHU(Taiwan)
NTHU(Taiwan)
Univ. Le HavreUniv. Le Havre
Univ. Mondragon (Spain)
Univ. Mondragon (Spain)
L2EPCentrale Lille
L2EPCentrale Lille
GILCOGrenoble
GILCOGrenoble
ERPI-ENSGSINancy
ERPI-ENSGSINancy LAPS
Bordeaux 1
LAPSBordeaux 1
TIMAGrenoble
TIMAGrenoble
IXL BordeauxIXL Bordeaux
Military School Bruxelles (Belgium)
Military School Bruxelles (Belgium)
ENSAM Eng. SchoolParis
ENSAM Eng. SchoolParis
Centrale IRCCyNNantes
Centrale IRCCyNNantes
Tec. De Monterey,Ciateq (Mexico)
Tec. De Monterey,Ciateq (Mexico)
LIUPPA PauLIUPPA Pau
LaBRI BordeauxLaBRI Bordeaux
LIPSI
Alexis Clay – Sino-French Seminar on Graphics and Image 11/45
Interactive Conception – Reversed integrated
conception• Cut down the product conception cycle• Automation of technical choices in an engineering
and design department
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Characterization – classification – reduction of a space of solutions
Alexis Clay – Sino-French Seminar on Graphics and Image 12/45
Numerical Engineering – Meshless methods
• Build meshless approximation functions that allow the reproduction of C0 functions
• Plane structure calculus• Energy network calculus
Interdisciplinary laboratory gives unexpected applications:
Use of those methods (designed for mechanics) by a Computer scientist to create discontinuities.
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 13/45
Robotics and Embedded Systems
Micro Unmanned Aerial Vehicle
Virtual reality simulator– Control law testing- System behaviour analysis- Virtual Image processing- Real-time acquisition of
theUAV’s absolute position
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 14/45
Intelligent sensors, image processing and
microelectronics
Minicameras, miniaturisation of acquisition circuits and electronic controls (on drones and robots)
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 15/45
Organisational Transform – Cooperative project
conduction
• Product Data Management• Product Life Cycle Management• Collaborative conception• Customer support
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 16/45
Renewable Energies
• EneR-GEA: Renewable Energies – Electrical Engineering and Automatics
• Study of the impact of clean energy systems on an isolated network
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 17/45
The Computer Science Team
IFP (French Petrol
Institute)
University ofPau
LaTEP
ENSAMTrèfle
Bordeaux
AlgoTechUniversity ofBordeaux 1
IXL
Compagnie des Signaux
Ballets de Biarritz (Dance)
University Joseph Fourier
GrenobleCLIPS-IMAG
National Tsing Hua University
IBRLabTaiwan
University of Bordeaux 1
LaBRI
LIPSI
CS Team Collaboration
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 18/45
Simulators
• Garbage Incinerating Factory Simulator
• Fishing and Sailing training Simulator
Alexis Clay – Sino-French Seminar on Graphics and Image 19/45
Human-Machine Interaction for Computer Graphics
Human Machine Interfaces (HMI): – Extend interfaces possibilities– Reduce the cognitive process due to the
interface to manipulate an application
Interface
Physical Software
Functionnalities of the
Application
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 20/45
Human-Machine Interaction for Computer Graphics
TUI: Tangible User InterfacePhysical object designed to reduce the interaction
metaphorFor a given task, in a given environment, a specific
TUI must be designed, tested, evaluated.
Interface
Functionnalities
Interface
Functionnalities
Keyboard and Mouse TUI
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 21/45
Human-Machine Interaction for Computer Graphics
I/O brush: Tangible Media Lab, MIT, 2003.
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 22/45
Human-Machine Interaction for Computer Graphics
HMI for Computer Graphics – Manipulation of visual data
• Complex data (heavy computing) (CAD models, Geological models)
• Large displays• Mobile devices (Tactile
Augmentation)
– Augmented Reality• Capture of real world (body
movement)• Projection of images in inadapted
environment (augmentation of a stage)
(Only Interaction)
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 23/45
Manipulation of 3D CAD models
Tangible User Interface
“The hand” in Euskara
Expérimentation d'un Système Kinésique Utilisable pour l'Assemblage
Tangible User Interface
“The hand” in Euskara
Expérimentation d'un Système Kinésique Utilisable pour l'Assemblage
“The hand” in Euskara
Expérimentation d'un Système Kinésique Utilisable pour l'Assemblage
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 24/45
Manipulation of 3D CAD models
• Task: Assembly in CAD• Problem: GUI hide difficulties to designers relative positioning of two parts accessibility
• Solution: Use props instead of mouse and keyboard to manipulate CAD parts
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 25/45
Manipulation of 3D CAD models
• Specific Tools: context-dependent, task-dependent
• 3D model control– Working environnement– desk/table setting– single/collaborative work– Non-intrusive
Passive TUIs captured by camera
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 26/45
Manipulation of 3D CAD models
ESKUA: results
Interactors for mechanical CAD parts
Plateform for manipulation, acquisition and tracking of
interactors.
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 27/45
Manipulation of 3D CAD models
Alexis Clay – Sino-French Seminar on Graphics and Image 28/45
Manipulation of 3D CAD models
• ESKUA: evaluating the interactors
• Result: functional surfaces
New set of interactors
[ESKUA video]
Alexis Clay – Sino-French Seminar on Graphics and Image 29/45
Manipulation of 3D geological models
GeoTUI
• Task: Validate a model of subsoil• Problem: Complex task because
– Needs geophysicians and geologists collaboration– Pure mental representation
• Tested Solutions by French Petrol Institute (IFP) for first problem :– GUI: inadapted– Immersive Room: too big, expensive, planning problems
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 30/45
• A complex geoscience task– Understand a subsoil you have never seen
• From perpendicular and parallel cuts
From a mapof the place
Manipulation of 3D geological models
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Extracted cutCut after study
Alexis Clay – Sino-French Seminar on Graphics and Image 31/45
Manipulation of 3D geological models
tableComputer
Video-projector Video-camera
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 32/45
Tactile Augmentation of a Mobile Device
TactiMoD
Task: Guide a visitor in a museum tour.Problem: Map requires attention and diverts visitors
from the exhibitionA solution: use of tactile vibration on a mobile
device
• Mobile device: small• As little cognitively demanding as possible• Must not « blind » the user from its environment• User should not have to focus on the device• Must be intuitive: no instructions needed
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 33/45
Tactile Augmentation of a Mobile Device
Hypothesis: “it is possible to lead and to guide someone towards a point of interest by using vibrations coming from a mobile device”
Mobile device augmented by left and right vibration systems; basketball-like grip stripe.
Alexis Clay – Sino-French Seminar on Graphics and Image 34/45
Tactile Augmentation of a Mobile Device
Evaluation of the system:
• guiding people over 2 different paths
• Survey and interview
Hypothesis validated through testing« TactiMod: Dirige et oriente un pieton » 2006. Nadine Couture, Stephanie Minel,
Ubimob’06, September 5-8, Conservatoire National des Arts et Metiers, Paris.
Escalier
Escalier
Terminé
Escalier
Escalier
Terminé
Pathway used for testing
.
Subjects MoyE-
type
Correct Orientation over 13 10.7 1.4
Long Hesitation 2.7 1.4
Short Hesitation 3.3 0.8
Subject re-orientation by tester 2.3 1.3
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 35/45
Ubiquitous Computing
Ubiquitous computing: « Computers » everywhere in the whole environment. Embedded systems.
Communication between all the devices
Wearable Computing
(shoes, fabric, glasses)
Mobile Computing
(Cell phones, PDA)
Personal Computer (laptops, PC)
Ubiquitous Computing (onboard systems: cars, planes, domestic appliance, walls…)
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 36/45
Ubiquitous Computing
TUIs: usable in ubiquitous computing Interest in the crossroad between HMI and ubiquitous
computing
« Emotional computers » (Picard, 95)
HMI Ubiquitous Computing
TUIs Emotion recognition and Synthesis
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 37/45
Emotion Recognition through Gesture Analysis
emotion
• Task: Augmenting a dance show experience by analysing the dancer’s emotion and adding virtual elements onto the stage
• Problem: Recognizing a user’s (dancer’s) emotion
• Solution: Study emotion using user’s (dancer’s) body position and movement
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 38/45
Emotion Recognition through Gesture Analysis
• The emotion Project: use position and gesture to determine a user’s emotion (Dance).
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Etc
…E
tc…
Etc
…E
tc…
Col
labo
rativ
e m
eetin
g co
ntex
tC
olla
bora
tive
mee
ting
cont
ext
Col
labo
rativ
e m
eetin
g co
ntex
tC
olla
bora
tive
mee
ting
cont
ext
pilo
t str
ess
(IT
EC
HS
-
pôle
aér
osp
ace)
pilo
t str
ess
(IT
EC
HS
-
pôle
aér
osp
ace)
pilo
t str
ess
(IT
EC
HS
-
pôle
aér
osp
ace)
pilo
t str
ess
(IT
EC
HS
-
pôle
aér
osp
ace)
Sha
dow
Dan
ceS
hado
wD
ance
Sha
dow
Dan
ceS
hado
wD
ance
emotion
Alexis Clay – Sino-French Seminar on Graphics and Image 39/45
System reactivity
Emotion wise Reactivity
Goal : We consider a system S to which we will add an emotional ability through an emotion system. This will act as a bridge between the user and the system S. The emotional system must:
•Manage to recognize a general emotion through the gesture and body position of the user
•Translate this emotion in order to generate a context wise reaction of the system
Recognition
(sadness)
(joy)
Emotion Recognition through Gesture Analysis
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 40/45
Emotion Recognition through Gesture Analysis
• Application: Augment a dance show– Changing auras according to the emotion expressed by
the dancer
– Large displays on stage– Stereoscopy to make virtual objects/persons appear to the public
– Ballet “The Shadow”– NTHU (Taiwan) Collaboration
The ESTIA – The LIPSI – The Computer Science Team – Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 41/45
Conferences: Virtual Concept
• International meeting on Interactive Design and Manufacturing Methodologies, Tools and Processes
• This year: Meeting in Cancun, Mexico, from November 26th to December 1st
http://www.virtualconcept.estia.fr/2006/
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 42/45
Conferences: ErgoIA
• Ergonomics, human engineering, Artificial Intelligence and HMI
• From October 10th to october 13th in Biarritz, Basque Country, France.
http://www.ergoia.estia.fr/
The ESTIA – The LIPSI – The Computer Science Team - Conferences
Alexis Clay – Sino-French Seminar on Graphics and Image 43/45
Conclusion
• Scientific collaboration on projects: Share the knowledge and know-how on projects that require several skills, joint Ph.D supervision, exchange students
• Coupling Computer graphics and HMI (Tangible Interfaces): navigation using large displays, interaction with 3D objects, images…
Alexis Clay – Sino-French Seminar on Graphics and Image 44/45
Questions?
Alexis Clay – Sino-French Seminar on Graphics and Image 45/45
Thank You!
http://www.virtualconcept.estia.fr/2006/
http://www.ergoia.estia.fr/