Mixed Reality Systems -Lab IV – Augmented Reality- Christoph Anthes.
Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed...
Transcript of Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed...
![Page 1: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/1.jpg)
Introduction to Mixed Reality
Jung Lee
![Page 2: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/2.jpg)
2017/4/17 | # 2
Contents
• Basic Principles of MR
• Application Examples
• MR Devices
• Discussion
![Page 3: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/3.jpg)
2017/4/17 | # 3
Who Am I?
![Page 4: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/4.jpg)
2017/4/17 | # 4
Virtual Reality, VR
• Virtual space with only artificial entities
Inception, 2010
![Page 5: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/5.jpg)
2017/4/17 | # 5
Augmented Reality, AR
• Real world overlapped with virtual entities + interaction among them
Harry Potter & the Order of the Phoenix, 2007
![Page 6: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/6.jpg)
2017/4/17 | # 6
What is Augmented Reality?
![Page 7: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/7.jpg)
2017/4/17 | # 7
What is Augmented Reality?
• Definition by Ronald Azuma, 1997 Real world with virtual entities Interactive in real-time Placed in 3D
Augmented Reality Car
![Page 8: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/8.jpg)
2017/4/17 | # 8
Mixed Reality Continuum
• Combinations of the real and virtual worlds
RealityVirtualReality
AugmentedReality
AugmentedVirtuality
Mixed Reality
![Page 9: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/9.jpg)
2017/4/17 | # 9
MIT Sixth Sense (Pranav Mistry, TED 2009)
• Prototype for the future AR concept
![Page 10: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/10.jpg)
Basic Principles of MR
![Page 11: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/11.jpg)
2017/4/17 | # 11
Basic Principle of VR
• Binocular disparity Difference between images seen from both eyes
![Page 12: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/12.jpg)
2017/4/17 | # 12
![Page 13: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/13.jpg)
2017/4/17 | # 13
Basic Roles of AR Components
• User Observes the AR display and Changes the viewpoint
• System Tracks the user’s viewpoint, Registers the virtual content in the real world, and Presents situated visualization
![Page 14: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/14.jpg)
Application Examples
![Page 15: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/15.jpg)
2017/4/17 | # 15
Virtual Try-On
FXMirror, FXGear
![Page 16: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/16.jpg)
2017/4/17 | # 16
VR Therapy : Arachnophobia
• Realistic movement of a virtual spider Relatively weak immersion into the situation
![Page 17: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/17.jpg)
2017/4/17 | # 17
VR Therapy : PTSD
• Soldiers, fire fighters, policemen, victims of sexual assaults, etc. Repeating the similar situations
![Page 18: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/18.jpg)
2017/4/17 | # 18
Sport Broadcast Visualization
![Page 19: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/19.jpg)
2017/4/17 | # 19
AR Browser
• Superimposes points of interest on a live video
Yelp Monocle
![Page 20: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/20.jpg)
2017/4/17 | # 20
Translation
• Spontaneous translations of text Over the camera image
Google Translate
![Page 21: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/21.jpg)
2017/4/17 | # 21
AR Navigation
i-Navi
![Page 22: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/22.jpg)
2017/4/17 | # 22
Augmented Magazines
![Page 23: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/23.jpg)
2017/4/17 | # 23
AR Game
The Eye of Judgement, SCE Japan Studio, 2007
![Page 24: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/24.jpg)
2017/4/17 | # 24
AR Environment
Illumi Room, Microsoft Research
![Page 25: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/25.jpg)
MR Devices
![Page 26: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/26.jpg)
2017/4/17 | # 26
<VR>HTC Vive
![Page 27: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/27.jpg)
2017/4/17 | # 27
<VR>
Tilt Brush, Google
![Page 28: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/28.jpg)
2017/4/17 | # 28
<VR>Cyberith Virtualizer + Oculus Rift + Wii Mote
![Page 29: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/29.jpg)
2017/4/17 | # 29
Gear VR, Samsung
• Smartphone-based VR HMD*
• Partnership with Oculus
Head tracking Touch-based controller
Google Cardboard
HMD : Head-Mounted Display
![Page 30: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/30.jpg)
2017/4/17 | # 30
Crisis of Samsung in 2016
![Page 31: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/31.jpg)
2017/4/17 | # 31
<VR>Playstation VR (PSVR)
![Page 32: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/32.jpg)
2017/4/17 | # 32
<VR>Summer Lesson for PSVR
![Page 33: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/33.jpg)
2017/4/17 | # 33
<VR>Social VR, Facebook
![Page 34: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/34.jpg)
2017/4/17 | # 34
<VR>
Microsoft ???????, $299 !!!
Coming on Windows 10 Creator's Update
• Free positioning
![Page 35: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/35.jpg)
2017/4/17 | # 35
<AR>
Google Glass
![Page 36: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/36.jpg)
2017/4/17 | # 36
<AR>
META 2
![Page 37: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/37.jpg)
2017/4/17 | # 37
<AR>
HoloLens, Microsoft (Concept)
![Page 38: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/38.jpg)
2017/4/17 | # 38
<AR>
HoloLens, Microsoft (Demo)
![Page 39: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/39.jpg)
2017/4/17 | # 39
<AR>
Magic Leap
![Page 40: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/40.jpg)
2017/4/17 | # 40
<Interface>
Manus VR
![Page 41: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/41.jpg)
2017/4/17 | # 41
<Interface>
Project Soli, Google
![Page 42: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/42.jpg)
2017/4/17 | # 42
<Interface>
MYO, Thalmic Labs
![Page 43: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/43.jpg)
2017/4/17 | # 43
<Interface>
Eye Tribe
![Page 44: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/44.jpg)
2017/4/17 | # 44
<Interface>
KOR-FX
![Page 45: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/45.jpg)
2017/4/17 | # 45
Discussion
• High-quality MR devices are coming …
• Lack of contents & applications VR : entertainment (game, remote experience, …) AR : life assistant (info. provider, virtual surgery, …)
• VR : indoor application• AR : everywhere application
![Page 46: Introduction to Mixed Reality - Kangwonysmoon/courses/2017_1/grad/07.pdf · Introduction to Mixed Reality Jung Lee. 2017/4/17 | # 2 Contents • Basic Principles of MR • Application](https://reader036.fdocuments.us/reader036/viewer/2022062916/5ec6a2760dbd4d54f536c93a/html5/thumbnails/46.jpg)
2017/4/17 | # 46
My Vision
• AR memory palace
• Unified AR framework Ubiquitous
• Everywhere• Anytime
Intuitive• Everyone• Anything