Augmented Reality
-
Upload
andrey-bibichev -
Category
Technology
-
view
4.150 -
download
1
description
Transcript of Augmented Reality
![Page 1: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/1.jpg)
AUGMENTED REALITYFOR PROGRAMMERS
Andrew Bibichev
2010, September
![Page 2: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/2.jpg)
AR AR
AR
AR
ARAR
AR
AR
AR
AR
AR
![Page 7: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/7.jpg)
![Page 8: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/8.jpg)
![Page 11: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/11.jpg)
![Page 12: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/12.jpg)
![Page 13: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/13.jpg)
![Page 14: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/14.jpg)
![Page 15: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/15.jpg)
VIRTUAL REALITY
Real Life Context
Generated Content
![Page 16: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/16.jpg)
AUGMENTED REALITY
Real Life Context
Generated Content
![Page 17: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/17.jpg)
VR
AR
Real Life Context
Generated Content
![Page 18: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/18.jpg)
INPUTdevice
INNOVATIONS IN
ProcessingOUTPUTdevice
Rendering
AR VR
![Page 19: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/19.jpg)
![Page 20: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/20.jpg)
EARLY 1970s:FIRST ELECTRONIC KEYBOARD
![Page 21: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/21.jpg)
1977: TOUCH SCREEN
![Page 22: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/22.jpg)
1981: Xerox Star mouse
![Page 23: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/23.jpg)
![Page 24: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/24.jpg)
EARLY 1990s: WEBCAM
![Page 25: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/25.jpg)
1995: Genius EasyScroll mouse
![Page 26: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/26.jpg)
![Page 27: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/27.jpg)
2007: multi touch (iPhone)
![Page 28: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/28.jpg)
2007: WII REMOTE (accelerometer)
![Page 29: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/29.jpg)
JUNE, 2009: WII MOTION+ (gyro)
![Page 30: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/30.jpg)
2010: smart phoneswith gyro, accel, GPS, video camera, …
![Page 31: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/31.jpg)
![Page 32: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/32.jpg)
![Page 33: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/33.jpg)
SEP, 2010: SONY MOVE
![Page 34: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/34.jpg)
![Page 36: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/36.jpg)
NOV, 2010: MS KINECT
![Page 38: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/38.jpg)
![Page 39: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/39.jpg)
1984: Apache
![Page 41: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/41.jpg)
![Page 42: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/42.jpg)
![Page 43: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/43.jpg)
Spec. sensors
Cameras
markers
structured light
Z-cameras / Z-sensors
True Optical:several cameras
True Optical:one moving camera
GPS, accelerometer, gyro, magnetic compass
![Page 44: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/44.jpg)
![Page 45: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/45.jpg)
![Page 46: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/46.jpg)
![Page 47: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/47.jpg)
![Page 48: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/48.jpg)
![Page 49: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/49.jpg)
MICROMECHANICAL GYROSCOPE
![Page 50: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/50.jpg)
![Page 51: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/51.jpg)
![Page 52: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/52.jpg)
![Page 53: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/53.jpg)
OUTPUT IS ANGULAR VELOCITY
![Page 54: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/54.jpg)
![Page 55: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/55.jpg)
ERROR ACCUMULATION =>=> DRIFT == LOW-FREQUENCY NOISE
![Page 57: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/57.jpg)
![Page 58: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/58.jpg)
![Page 59: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/59.jpg)
![Page 60: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/60.jpg)
g
a
g-a
Output is (g-a) in coordinate system of device
![Page 61: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/61.jpg)
g
Case: 1d, a 0
x
y
gy
gx
![Page 62: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/62.jpg)
Accelergx, gy
Angle
Gyro
?
Magic==
Kalman Filter
Complementary Filter
![Page 64: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/64.jpg)
Link
C++ implementation
![Page 65: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/65.jpg)
![Page 67: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/67.jpg)
HOW TO CHOOSE VALUE OF COEFF.?
![Page 69: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/69.jpg)
![Page 70: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/70.jpg)
![Page 72: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/72.jpg)
g
drift
![Page 73: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/73.jpg)
![Page 74: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/74.jpg)
![Page 75: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/75.jpg)
g
drift
B
![Page 76: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/76.jpg)
![Page 77: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/77.jpg)
Spec. sensors
Cameras
markers
structured light
Z-cameras / Z-sensors
True Optical:several cameras
True Optical:one moving camera
GPS, accelerometer, gyro, magnetic compass
![Page 78: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/78.jpg)
L
W
H
D
FOV
d
![Page 79: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/79.jpg)
L
W
H
D
FOV
d
![Page 80: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/80.jpg)
![Page 81: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/81.jpg)
![Page 82: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/82.jpg)
![Page 83: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/83.jpg)
HOW TO DETECT MARKER(S) ON IMAGE
Threshold
![Page 84: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/84.jpg)
![Page 86: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/86.jpg)
N CAMERAS X M MARKERS
![Page 87: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/87.jpg)
VICON
![Page 89: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/89.jpg)
OPTITRACK
![Page 90: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/90.jpg)
Spec. sensors
Cameras
markers
structured light
Z-cameras / Z-sensors
True Optical:several cameras
True Optical:one moving camera
GPS, accelerometer, gyro, magnetic compass
![Page 91: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/91.jpg)
![Page 92: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/92.jpg)
![Page 93: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/93.jpg)
MICROSOFT SURFACE
Link
![Page 95: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/95.jpg)
Spec. sensors
Cameras
markers
structured light
Z-cameras / Z-sensors
True Optical:several cameras
True Optical:one moving camera
GPS, accelerometer, gyro, magnetic compass
![Page 96: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/96.jpg)
![Page 97: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/97.jpg)
ROOTS OF NATAL == 3DV ZCAM
Link
![Page 98: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/98.jpg)
![Page 99: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/99.jpg)
![Page 100: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/100.jpg)
![Page 101: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/101.jpg)
![Page 103: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/103.jpg)
Camera input Tiny image
Database nearest neighbors
Blended pose of
nearest neighbors
Link
![Page 105: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/105.jpg)
Spec. sensors
Cameras
markers
structured light
Z-cameras / Z-sensors
True Optical:several cameras
True Optical:one moving camera
GPS, accelerometer, gyro, magnetic compass
![Page 107: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/107.jpg)
![Page 109: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/109.jpg)
IPISOFT DESKTOP MOCAP
![Page 111: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/111.jpg)
Spec. sensors
Cameras
markers
structured light
Z-cameras / Z-sensors
True Optical:several cameras
True Optical:one moving camera
GPS, accelerometer, gyro, magnetic compass
![Page 114: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/114.jpg)
![Page 115: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/115.jpg)
AUGMENTED REALITY REVENUE
0
50
100
150
200
250
300
350
400
2008 2014
millions of USD
Link
![Page 116: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/116.jpg)
![Page 117: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/117.jpg)
robustness сущ.
общ. здоровье; сила; здравомыслие; трудность; эксплуатационная
надёжность; прочность
автом. надёжность
безоп. способность системы восстанавливать работоспособность при
возникновении ошибочных ситуаций
воен. жёсткость; защищённость
выч. устойчивость (к нарушениям исходных
предпосылок); "выносливость"; живучесть; устойчивость к
нарушениям исходных предпосылок
комп. ошибкоустойчивость
контр.кач. прочность (конструкции)
Макаров робастность (оценки в статистике); устойчивость (к
нежелательным, но возможным воздействиям)
матем. корректность (метода)
рбт. грубость (напр. системы управления)
редк. грубость
тех. выносливость (к нежелательным, но возможным
воздействиям); робастность
![Page 118: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/118.jpg)
![Page 119: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/119.jpg)
![Page 120: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/120.jpg)
![Page 121: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/121.jpg)
![Page 122: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/122.jpg)
![Page 125: Augmented Reality](https://reader034.fdocuments.us/reader034/viewer/2022051513/54779caeb4af9fa1378b4933/html5/thumbnails/125.jpg)