POLITIK DALAM PEMIKIRAN K.H. ABDUL HALIM (1887-1962): IDE ...
Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong,...
-
Upload
brent-henderson -
Category
Documents
-
view
236 -
download
2
Transcript of Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong,...
![Page 1: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/1.jpg)
introduction v4a 1
Chapter 1: Image processing
and computer visionIntroduction
by Prof. K.H. Wong, Computer Science and Engineering
Dept. [email protected]
![Page 2: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/2.jpg)
introduction v4a 2
Content 1) Introduction 2) Camera model 3) edges detection 4) Feature extraction 5) Hough transform for line circle and shape detection 6) Histogram for color equalization 7) Meanshift for motion tracking 8) Stereo vision 9) Pose estimation and Structure From Motion SFM 10) Bundle adjustment for SFM
![Page 3: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/3.jpg)
introduction v4a 3
Image processing
and applications
![Page 4: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/4.jpg)
introduction v4a 4
Introduction Cameras Images
Raw Jpeg
Sensors CMOS CCD
Column (c)
Row (r) Pixel value I(c,r) or I(x,y)=(0->255)
![Page 5: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/5.jpg)
introduction v4a 5
2) Edge detection Features have many applications:
recognition, tracking etc. The most common are
Point edges Shape intensity change positions
Boundary edges Shape intensity changing lines
![Page 6: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/6.jpg)
introduction v4a 6
Sobel Demo
http://www.youtube.com/watch?v=z_a6e30aOXo
![Page 7: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/7.jpg)
introduction v4a 7
Face edges Demo
http://www.youtube.com/watch?v=CDlLe-53a0w
![Page 8: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/8.jpg)
introduction v4a 8
Application of edges Lane detection
http://www.youtube.com/watch?v=Al4DnNkZUeA&feature=related
http://www.youtube.com/watch?v=9F3_6xL8hEY&feature=related
![Page 9: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/9.jpg)
introduction v4a 9
3) Sharpe detection (Hough Transform) Lines Circles Irregular shapes
![Page 10: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/10.jpg)
introduction v4a 10
Rectangular object detection in video Stream using the Generalized Hough
Transform
http://www.youtube.com/watch?v=9r16YiKyaZQ&feature=relatedhttp://www.youtube.com/watch?v=jPEfoi9g0Lw&feature=related
![Page 11: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/11.jpg)
introduction v4a 11
Quadrangle detection application cvpr09 Projector based Hand Held
Display System
http://www.youtube.com/watch?v=YHhQSglmuqY&feature=channel_page
![Page 12: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/12.jpg)
introduction v4a 12
Hough circle detection Using the opencv library
http://www.youtube.com/watch?v=jVQL1DODyUE
![Page 13: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/13.jpg)
introduction v4a 1313
4) Histogram equalization Input: The picture is
poorly shot. Most pixel gray levels are located in a small range.
Output: Use histogram transform to map the marks in ‘r’ domain to ‘S’ domain , so in ‘S’ domain, each S gray level has similar number of pixels.
Input: Low contrast image
Output: High contrast image
S domain
r domain
![Page 14: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/14.jpg)
introduction v4a 1414
4) (continue) Color models Cartesian-coordinate
representation RGB (Red , Green , Blue)
cylindrical-coordinate representation HSV (Hue, saturation, value) HSL (Hue, saturation, Light)
HSV
http://en.wikipedia.org/wiki/HSL_and_HSV#From_HSV
RGB
![Page 15: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/15.jpg)
introduction v4a 15
5) Mean shift (cam-shift)
http://www.youtube.com/watch?v=iBOlbs8i7Og
http://www.youtube.com/watch?v=zjteYlhjm-s&feature=related
![Page 16: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/16.jpg)
introduction v4a 16
Mean shift application Track human movement
http://www.youtube.com/watch?v=I53-SZ1o_c0&feature=related
![Page 17: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/17.jpg)
introduction v4a 17
6) Face detection (optional)
From Viola-Jones, IJCV 2005
![Page 18: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/18.jpg)
introduction v4a 18
Face detection and tracking Face tracking
http://www.youtube.com/watch?v=V7UdYzCMKvw&feature=related
![Page 19: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/19.jpg)
introduction v4a 19
Face tracking applications Face change
http://www.youtube.com/watch?v=i_bZNVmhJ2o
![Page 20: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/20.jpg)
introduction v4a 20
Topics in 3D computer vision
by Prof. K.H. Wong, Computer Science and Engineering
Dept. [email protected]
![Page 21: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/21.jpg)
introduction v4a 21
Motivation Study the 3D vision problems Study how to obtain 3D information from
2D images Study various applications
![Page 22: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/22.jpg)
introduction v4a 22
Applications 3D models from images Game development Robot navigation 3G Mobil phone applications,
Location systems User input
![Page 23: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/23.jpg)
introduction v4a 23
Demo1: 3D reconstruction (see also http://www.cse.cuhk.edu.hk/khwong/demo/index.html)(Click picture to see movie)
Grand Canyon Demo Flask Robot
http://www.youtube.com/watch?v=2KLFRILlOjc
http://www.youtube.com/watch?v=4h1pN2DIs6g
http://www.youtube.com/watch?v=ONx4cyYYyrIhttp://www.youtube.com/watch?v=xgCnV--wf2k
![Page 24: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/24.jpg)
introduction v4a 24
Demo2: augmented reality(Click picture to see movie) Augmented reality demo
http://www.youtube.com/watch?v=zPbgw-ydB9Y
http://www.youtube.com/watch?v=gnnQ_OEtj-Y
![Page 25: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/25.jpg)
introduction v4a 25
Demo3 Projector camera system (PROCAM) Click pictures to see movies
CVPR 09A Projector-based Movable Hand-held Display System
VRCAI09:A Hand-held 3D Display System that facilities direct manipulation of 3D virtual objects
http://www.youtube.com/watch?v=YHhQSglmuqY&feature=channel_page
http://www.youtube.com/watch?v=vVW9QXuKfoQ
![Page 26: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/26.jpg)
introduction v4a 26
Demo 4 Flexible projected surface
http://www.youtube.com/watch?v=isqg8O9a4LE
![Page 27: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/27.jpg)
introduction v4a 27
Demo 5 3-D display without the use of
spectacles.
http://www.youtube.com/watch?v=oyxR_RT4NNc
![Page 28: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/28.jpg)
introduction v4a 28
Demo 6 Spherical projected surface for 3D viewing
without spectacles.
http://www.youtube.com/watch?v=yVDFcZZ8gDo
![Page 29: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/29.jpg)
introduction v4a 29
Demo 7 A KEYSTONE-FREE HAND-HELD MOBILE
PROJECTION
http://www.youtube.com/watch?v=mbl-BpTnbeA
![Page 30: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/30.jpg)
introduction v4a 30
A quick tour of 3D computer vision Image capturing Feature extraction Model reconstruction or pose estimation Application of model and pose obtained
![Page 31: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/31.jpg)
introduction v4a 31
Camera structure Object
CCD1024x768
Focal length= f
f
Yy
Z
![Page 32: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/32.jpg)
introduction v4a 32
Application 1: Model reconstructionseehttp://www.cs.cuhk.hk/~khwong/khwong.html
From a sequence of imagesOf an object
3D Model found
![Page 33: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/33.jpg)
introduction v4a 33
Application 2: Motion tracking
Camera
Body pose and motion tracking--By tracking Images of white dots and compute the 3D motion
X1
X2X3
www.cybercollege.com/tvp026-2.htm
![Page 34: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/34.jpg)
New computer vision products Orcam
(http://www.orcam.com/) Demos: https://www.youtube.com/watch?
v=24yIl8tPvfU https://www.youtube.com/watch?
v=j8lScHO2mM0 Google glass (http://www.google.com/glass/start/) Demo: https://www.youtube.com/watch?v=j8lScHO2mM0
introduction v4a 34
![Page 35: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/35.jpg)
introduction v4a 35
Computer vision (3D)
The mathematics
![Page 36: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/36.jpg)
introduction v4a 36
3D vision processing Projection geometry: Perspective
Geometry Edge detection stereo correspondence
![Page 37: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/37.jpg)
introduction v4a 37
Basic Perspective Geometry
Model M at t=1
c (Image center)
f=focal length
image
Ow (World center)
Y-axis
Z-axis
X-axis
v-axis
u-axis
P=(x,y,z)
P’=(x’,y’,z’)
Old position
New position() ()
()
![Page 38: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/38.jpg)
Motion of camerafrom world to camera coordinates Camera motion (rotation=Rc, translation=Tc) will
cause change of pixel position (x,y), See p156[1]
3
2
1
333231
232221
131211
,
t
t
t
T
rrr
rrr
rrr
R
T
Z
Y
X
R
Z
Y
X
cc
c
w
w
w
c
c
c
c
introduction v4a
38
Cameras v.3d
Yc
Zc
Xc
Xw
Zw
Yw
Rc,Tc
an_y
an_z
an_x
World center
Camera center
![Page 39: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/39.jpg)
introduction v4a 39
3D to 2D projectionPerspective model u=F*X/z v=F*Y/z
FZ
Y
v
World center
F
Thin lensor a pin hole
Virtual Screenor CCD sensor
RealScreenOr CCD sensor
![Page 40: Introduction v4a1 Chapter 1: Image processing and computer vision Introduction by Prof. K.H. Wong, Computer Science and Engineering Dept. CUHK khwong@cse.cuhk.edu.hk.](https://reader033.fdocuments.us/reader033/viewer/2022052509/56649cf85503460f949c8f51/html5/thumbnails/40.jpg)
Summary Image processing and computer vision are
useful in many applications Becoming more and more popular since
every one is carrying cameras in their mobile devices.
We will study the mathematics and algorithms of image processing and vision programming
introduction v4a 40