Finite Element Method AERSP 301 Finite Element Method Jose Palacios July 2008.
Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP,...
Transcript of Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP,...
![Page 1: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/1.jpg)
Introduction to Immersive Display Systems
AERSP, CSE, MATH, BUS 597Fall 2004
George [email protected]
![Page 2: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/2.jpg)
What do we mean by VR?
The phrase virtual reality was coined by Jaron Lanier in the mid 1980s to describe a specific configuration of software and devices – effectively
computerized clothing – and a user’s experiential engagement with computer simulated graphical worlds displayed and interacted therewith.
There are media traditions within which VR can be placed.
At its core, VR can be thought of as the adaptation of computing and media technologies to create systems with formal characteristics that maymore fully engage human perceptual processes in order to enable more experientially
compelling media encounters.
![Page 3: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/3.jpg)
Binocular Disparity and Stereo Vision
http://www.vision3d.com/stereo.html
![Page 4: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/4.jpg)
Stereoscope and Viewmaster
http://www.cinti.net/~vmmasell/http://www.chicagohs.org/fire/media/pic0470.html
![Page 5: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/5.jpg)
Anaglyph and Polarized Passive Stereo
Adapted from: http://unmuseum.mus.pa.us/stereosc.htm
![Page 6: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/6.jpg)
Stereoscopic 3D Cinema Anaglyph (1922) and Polarized (1950s)
Wide Field of View Immersive Projection FormatsCinerama (1953), Cinemascope (1953), VistaVision (1954), Ultra
Panavision (1957),IMAX (1970) and OMNIMAX (1973)
![Page 7: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/7.jpg)
Morton Heilig – Sensorama, 1962“Experience Theater”
http://www.artmuseum.net/w2vr/timeline/Heilig.html
![Page 8: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/8.jpg)
Ivan SutherlandSketchpad, 1963;
The Ultimate Display, 1965;
Head Mounted Display, 1968
http://csilluminated.jbpub.com/biography_visit.cfm?WeblinksID=863&URL=http://www.sun.com/960710/feature3/ivan.html
![Page 9: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/9.jpg)
Myron Krueger – Artificial Reality – 1970s
Responsive, video based, human scale, graphcial environments
Unencumbered, body centered, tracked interfaces
Presages CAVE's and other contemporary surround screen projection-based systems
http://portal.acm.org/citation.cfm?id=317463
![Page 10: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/10.jpg)
HMD and Data Glove - “Virtual Reality” – late 1980sHMD and dataglove
Jaron Lanier, VPL ResearchNASA Ames, VIEW Project, Scott FisherUNC Chapel Hill, GROPE, Fred Brooks
University of Washington, HIT Labhttp://portal.acm.org/citation.cfm?doid=328798
![Page 11: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/11.jpg)
Electronic Visualization Lab – CAVE - 1992
Carolina Cruz-Neira, Dan Sandin, Thomas DeFanti
http://portal.acm.org/citation.cfm?id=166134&coll=GUIDE&dl=GUIDE&CFID=29550332&CFTOKEN=25231313
![Page 12: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/12.jpg)
Penn State Applied Research Laboratory SEALAB
5 sided projection based (four walls + floor) CAVETM like system
http://www.arl.psu.edu/capabilities/ins_sealab_facilities.html
![Page 13: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/13.jpg)
Iowa State’s C6 Virtual Reality Applications Center (VRAC)
http://www.vrac.iastate.edu/c6.php
![Page 14: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/14.jpg)
“Canonical” VR System Attributes
• Wide field of view “immersive” display (projection based or HMD)• Stereoscopic display• User interaction with simulated graphical objects or worlds• Tracked viewer position to allow for richer interaction and viewer
centered projection• Spatial or contextual audio• Tactile or haptic feedback
![Page 15: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/15.jpg)
Virtual Reality Applications DesignUsing interactive, experiential, multimedia simulations toachieve a purpose through the effective use of the computing, display and interactive affordances of the systems at hand
![Page 16: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/16.jpg)
The MIST System (Mentice Medical Simulation AB, Gothenburg, Sweden)
The MIST system's training interface is based on modified laparoscopic instruments. Simple real time 3D computer graphics
accurately track and represent the movements of the virtual instruments within a
virtual operating volume. In this volume, geometric shapes that approximate those
faced during actual operations on organs are displayed on the computer screen and
subsequently manipulated by a surgical trainee via the surgical instrument interface.
http://bmj.bmjjournals.com/cgi/content/full/323/7318/912
![Page 17: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/17.jpg)
MolDRIVE: a VR system for visualization and steering of remotely running real-time MD simulations.
The VR Spring Manipulator is used for particle steering of an atom from MD simulation of a protein and a carbon polymer resp. (right upper image) More about MolDRIVE:
http://visualization.tudelft.nl/~michal/MolDRIVE/egve02_paper/fulll_color_version/screen_dpi/egve02_paper.pdf
![Page 18: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/18.jpg)
Some Obstacles to the Widespread Acceptance of First Generation Projection Based VR Systems
(CAVEs, C2, Immersadesks, etc.)
• Relatively expensive to acquire and maintain• Fragile devices requiring supervision by support staff• Challenging computing environment for many end users• Facilities often are cloistered with limited access for general use• VR workflow often is distinct from other discipline-specific
processes
All of which lead to VR being treated as a separate activity that exists outside of established workflows
![Page 19: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/19.jpg)
The VR Desktop Approach(if we are having difficulty bringing desktop users to VR,
perhaps we can bring VR to desktop users)
Leverage price performance improvements in personal computer graphics to deliver much of the VR experience, affordably and accessibly, given the audience and tasks under consideration
• Affordable cost• Ease of use• Physical accessibility• Within existing workflows
“Lowering the bar and extending the reach”
![Page 20: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/20.jpg)
Immersive Environments Two Screen Hardware Description
“Workstation” class PC (2 x Xeon,2.2 GHz, 2 Gb ram) withWildcat III 6210 graphics card (up to two screens in stereo)
For each projection screen:2 Proxima Ultralight X350 DLP XGA ProjectorCyviz xpo.2 stereo converter6 x 8 foot, rigid rear-projection screen
![Page 21: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/21.jpg)
Two Screen IEL – Spring 2002
![Page 22: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/22.jpg)
Student Defined Multimodal Immersive Presentation Environment
Immersive Information Space in Addition to Immersive Virtual Space
Students use commercial 3D modeling tools and multimedia applications, in conjunction with navigable 3D VR viewers developed locally.
i.e. we are trying to fold VR into the students’ existing workflow and repertoire of digital media tools
![Page 23: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/23.jpg)
ITS/SALA Immersive Environments Lab (IEL) http://gears.aset.psu.edu/viz/facilities/iel
3-screen windows Desktop – 3D VR plus commercial applications support
Clustered, Linux, multi-CPU approach for 3-screen VR application (C++, OpenSG, VRPN, QT) – OpenGL enabled Linux desktop (DMX/Chromium)
Telecollaborative 3D display in conjunction with Access Grid functionality
![Page 24: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/24.jpg)
Immersive Environments Display Configurations
For each projection screen:2 Proxima Ultralight X350 DLP XGA (1024x768) ProjectorCyviz xpo.2 stereo converter6 x 8 foot, rigid rear-projection screen
Switch Switch Switch
Linux Linux Linux
LinuxConsole
WindowsConsole
Users may switch select from 3 video sources for each screen
![Page 25: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/25.jpg)
Two-screen Windows Desktop / Windows Display
For each projection screen:2 Proxima Ultralight X350 DLP XGA (1024x768) ProjectorCyviz xpo.2 stereo converter6 x 8 foot, rigid rear-projection screen
Switch Switch Switch
Linux Linux Linux
LinuxConsole
WindowsConsole
Switch select from 3 video sources for each screen
![Page 26: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/26.jpg)
Linux Console / Three Screen Linux Display
For each projection screen:2 Proxima Ultralight X350 DLP XGA (1024x768) ProjectorCyviz xpo.2 stereo converter6 x 8 foot, rigid rear-projection screen
Switch Switch Switch
Linux Linux
LinuxConsole
WindowsConsole
Switch select from 3 video sources for each screen
Linux
![Page 27: Introduction to Immersive Display · PDF fileIntroduction to Immersive Display Systems AERSP, CSE, MATH, BUS 597 ... multimedia simulations to achieve a purpose through the effective](https://reader033.fdocuments.us/reader033/viewer/2022052608/5a797c0e7f8b9a20368c72f0/html5/thumbnails/27.jpg)
Recent developments in the IEL / Coming Attractions
The bigger picture:
• 3-screen Windows desktop for application compatibility and end-user familiarity
• Clustered, Linux, multi-CPU approach for 3-screen VR applications – application development in process
• Independent video switching for each screen allows selective presentation from multiple computer graphic sources – e.g. Windows console, Linux clustered rendering, external laptops
• Access Grid enabled – telecollaborative, multimodal, immersive workspace
Ongoing application “nuts and bolts”
• Improve handling of complex surfaces and lighting solutions – ongoing workflow evaluation, development and documentation
• Develop data rich models and application workflow for viewing and manipulating the same
• Continue to seek opportunities for useful merging of VR like applications with other building design, analysis and presentation tools as appropriate
• Develop use in other data rich disciplines for which immersive visualization may be beneficial