Graphics, Vision, HCI
description
Transcript of Graphics, Vision, HCI
![Page 1: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/1.jpg)
Graphics, Vision, HCIGraphics, Vision, HCI
K.P. Chan
Wenping Wang
Li-Yi Wei
Kenneth Wong
Yizhou Yu
![Page 2: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/2.jpg)
Li-Yi WeiLi-Yi Wei
Background
Stanford (95-01), NVIDIA (01-05), MSR (05-11)
Research
Nominal: Graphics, HCI, parallelism
Actual: Computing natural repetitions
(Computer science is about repetitions)
Can work on almost anything + have fun
I tailor projects for individual students (so they also have fun)
![Page 3: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/3.jpg)
Computing natural repetitionsComputing natural repetitions
interactauto
procedural(parametric)
data driven(non-parametric)
parallelrandom
parallelism HCIgraphics
ParallelPoisson
texture synthesisinverse
synthesis
blue noise
motiontexture HDR
edit
elementtexture
revisioncontrol
differentialanalysis
![Page 4: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/4.jpg)
Discrete element textures[Ma et al. SIGGRAPH 2011]Discrete element textures[Ma et al. SIGGRAPH 2011]
exemplar
domain output
synthesis
![Page 5: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/5.jpg)
SIGGRAPHSIGGRAPH
The coolest (& ass kicking) venue in graphics
Each paper can be worth a PhD thesis
(Just in case you don’t know)
HKU has 4 papers in SIGGRAPH 2012 So we are awesome (in addition to have fun)
![Page 6: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/6.jpg)
input
output
![Page 7: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/7.jpg)
input
output
![Page 8: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/8.jpg)
input
output
![Page 9: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/9.jpg)
![Page 10: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/10.jpg)
Yizhou YuYizhou Yu
Background
Berkeley (PhD 2000), UIUC (2000 - 2010)
Research
Graphics, vision, image processing
• Computational Photography
• Computer Animation
• Geometry Processing
• Medical Imaging
• Video Analytics
![Page 11: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/11.jpg)
Deformation transfer for real time cloth animation [SIGGRAPH 2010]Deformation transfer for real time cloth animation [SIGGRAPH 2010]
DeformationTransformer
![Page 12: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/12.jpg)
Motivation• Real-Time Cloth Animation
– Video games, virtual fashion, etc. • The Problem
– Real-time performance on high-resolution models – PDE Integration, Collision resolution.
Final Fantasy XIII Nurien
![Page 13: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/13.jpg)
Overview• Hybrid Approach :
– Simulate low-res cloth on the GPU– Rely on a data-driven model to transform the
low-res simulation into a high-res animation
DeformationTransformer
![Page 14: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/14.jpg)
An Example
High-Res Dress: 27K Triangles, Low-Res Dress: 200 Triangles Frame Rate: 261
![Page 15: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/15.jpg)
Data-Driven Image Color Theme Enhancement [SIGGRAPH Asia 2010]
Photo Reuse: how to edit a photograph to enhance a desired color impression by exploiting prior knowledge extracted from an existing photo collection?
source image nostalgic lively
Waiting for the right season and illumination could be extremely time-consuming!
![Page 16: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/16.jpg)
Our Goal
Image Color Theme Enhancement
Input Image
desolate
lively
![Page 17: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/17.jpg)
Results
Input Images
happy sad
spring in the air peaceful
![Page 18: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/18.jpg)
Wenping WangWenping Wang
Background
Alberta (PhD 1992), Department Head
Research
Computer graphics
Geometry Processing
Computational geometry
Architectural Design
Scientific Visualization
![Page 19: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/19.jpg)
SIGGRAPH 2006
![Page 20: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/20.jpg)
SIGGRAPH 2007
![Page 21: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/21.jpg)
SIGGRAPH 2008
![Page 22: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/22.jpg)
SIGGRAPH 2008
![Page 23: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/23.jpg)
Kwan-Yee Kenneth WongKwan-Yee Kenneth Wong
Background
Cambridge (PhD 2001)
Research
3D modeling
Video surveillance
Image processing
Pattern recognition
…
![Page 24: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/24.jpg)
3D Model ReconstructionRobust recovery of shapes with unknown
topology from the dual space (PAMI 2007)
contour generator
silhouette N
![Page 25: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/25.jpg)
3D Model ReconstructionRobust recovery of shapes with unknown
topology from the dual space (PAMI 2007)
original surface
dual surface
tangent
operation
tangent
operation
original surface
![Page 26: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/26.jpg)
3D Model ReconstructionRobust recovery of shapes with unknown
topology from the dual space (PAMI 2007)
![Page 27: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/27.jpg)
Eye Gaze TrackingReconstruction of display and eyes from a
single image (CVPR 2010)
27
![Page 28: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/28.jpg)
Eye Gaze TrackingReconstruction of display and eyes from a
single image (CVPR 2010)
28
![Page 29: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/29.jpg)
Kwok-Ping ChanKwok-Ping Chan
Background
HKU (PhD 1989)
Research
• To apply various Machine Learning methods on Pattern Recognitions, such as facial expression recognition.
• Study on Cross Domain Learning where the training and the testing domain are not the same.
![Page 30: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/30.jpg)
Facial Expression RecognitionFacial Expression Recognition
Goal: to recognize one of the seven basic facial expressions:
![Page 31: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/31.jpg)
MethodsMethods
• Dynamic Bayesian Network
• Discriminative Hidden Markov Models
• Discriminative Temporal Topic Models
• Given an image sequence of facial expression, we compute the probability of each expression using the above techniques.
![Page 32: Graphics, Vision, HCI](https://reader036.fdocuments.us/reader036/viewer/2022062322/568145b0550346895db2ae62/html5/thumbnails/32.jpg)
Examples: Smile with blinking eyes:Examples: Smile with blinking eyes:
From input, produce output
similar to input
arbitrary size
Key Publication: CVPR 2009