CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... ·...
Transcript of CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... ·...
![Page 1: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/1.jpg)
Parag Chaudhuri, 2017
CS 775Advanced Computer Graphics
Lecture 1: Augmented Reality
![Page 2: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/2.jpg)
Parag Chaudhuri, 2017
What is Augmented Reality?
Example: Cinema
Dawn of the Planet of Apes, Weta Digital, 2014
![Page 3: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/3.jpg)
Parag Chaudhuri, 2017
What is Augmented Reality?
Example: Advertising
National Geographic, 2011
![Page 4: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/4.jpg)
Parag Chaudhuri, 2017
Example: Navigation
ROUTE 66 Maps + Navigation for Android, 2011
What is Augmented Reality?
![Page 5: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/5.jpg)
Parag Chaudhuri, 2017
What is Augmented Reality?Example: Digital Heritage
The Parthenon, SIGGRAPH 2004 Electronic Theater
![Page 6: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/6.jpg)
Parag Chaudhuri, 2017
What is Augmented Reality?
Example: Retail
Virtual Try-On, Zugara.com,
ViewAR, 2012
![Page 7: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/7.jpg)
Parag Chaudhuri, 2017
Example: In the Lab
What is Augmented Reality?
Self Adaptive Animation, Parag Chaudhuri, George Papagiannakis, Nada Magnenat-Thalmann, CGI 2008
![Page 8: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/8.jpg)
Parag Chaudhuri, 2017
Augmented Reality (AR) is a view of the physical, real world environment that is augmented by synthetic, computergenerated elements.
It was coined by Thomas Caudell, in 1990, while working at Boeing.
AR straddles the disciplines of Computer Vision and Computer Graphics as it needs Vision to understand the real world and it needs Graphics to create the synthetic elements to augment it.
What is Augmented Reality?
ARToolkit, Hirokazu Kato, Mark Billinghurst, IWAR 1999
![Page 9: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/9.jpg)
Parag Chaudhuri, 2017
The Real/Virtual Continuum
RealEnvironment
VirtualEnvironmentMixed Reality (MR)
Augmented Reality: A class of displays on the reality-virtuality continuum, Milgram 1994
Mixed Reality (MR)
![Page 10: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/10.jpg)
Parag Chaudhuri, 2017
The Real/Virtual Continuum
RealEnvironment
VirtualEnvironmentMixed Reality (MR)
Tangible User Interfaces (TUI)
Tangible and Modular Input Device for Character Articulation, Jacobson et al., SIGGRAPH 2014
![Page 11: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/11.jpg)
Parag Chaudhuri, 2017
The Real/Virtual Continuum
RealEnvironment
VirtualEnvironmentMixed Reality (MR)
Augmented Reality (AR)
Spatial ARComputer generated information is projected into a user's environment.
Augmented Reality Sandbox, Oliver Kreylos et al., 2013
![Page 12: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/12.jpg)
Parag Chaudhuri, 2017
The Real/Virtual Continuum
RealEnvironment
VirtualEnvironmentMixed Reality (MR)
Augmented Reality (AR)
See-through ARComputer generated information is projected into a user's view of the real environment via a HMD or a screen.
www.ar-door.com2011
![Page 13: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/13.jpg)
Parag Chaudhuri, 2017
The Real/Virtual Continuum
RealEnvironment
VirtualEnvironmentMixed Reality (MR)
Augmented Virtuality (AV)
Elements of the real world added to a virtual environment.
www.arlsura.com2012
![Page 14: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/14.jpg)
Parag Chaudhuri, 2017
The Real/Virtual Continuum
RealEnvironment
VirtualEnvironmentMixed Reality (MR)
VirtualReality (VR)
The virtual environment often completely fills the user's field of view in immersive VR.
Tachi Lab, 2012Oculus Rift, 2013
![Page 15: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/15.jpg)
Parag Chaudhuri, 2017
Ingredients for AR
Life of Pi, Rhythm and Hues,2013
Capture the real world
![Page 16: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/16.jpg)
Parag Chaudhuri, 2017
Ingredients for AR
Life of Pi, Rhythm and Hues,2013
Capture the real world
![Page 17: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/17.jpg)
Parag Chaudhuri, 2017
Ingredients for AR
Life of Pi, Rhythm and Hues,2013
Model the virtual world
Capture the real world
![Page 18: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/18.jpg)
Parag Chaudhuri, 2017
Ingredients for AR
Life of Pi, Rhythm and Hues,2013
Augment
Capture the real world
Model the virtual world
![Page 19: CS 775 Advanced Computer Graphics - cse.iitb.ac.inparagc/teaching/2017/cs775/lectures/01... · Parag Chaudhuri, 2017 Augmented Reality (AR) is a view of the physical, real world environment](https://reader034.fdocuments.us/reader034/viewer/2022051723/5abc200f7f8b9a24028d717c/html5/thumbnails/19.jpg)
Parag Chaudhuri, 2017
Homework● Look up and figure out:
— HoloLens (Microsoft)
— MagicLeap (magicleap.com)
— Vive (HTC), Oculus (Facebook), Gear VR (Samsung), Daydream VR (Google)
● See these:
— https://www.youtube.com/watch?v=Mv_eIRv1Vk4
— https://www.youtube.com/watch?v=x3A8D2f86qw