11/21/02 Visualization Laboratory, Texas A&M University

1

Next Generation Spatially Immersive Visualization Systems

Prof. Frederic I. ParkeVisualization Sciences Program

11/21/02 Visualization Laboratory, Texas A&M University 2

Fully Immersive Characteristics

Wrap around visual ‘immersion’ Possibly multi-sensory

– sight, sound, touch,... Two main types

– spatially immersiveand

– head mounted displays

11/21/02 Visualization Laboratory, Texas A&M University 3

Spatially Immersive Systems

Multiple images projected on surrounding surfaces

Often use stereo images – (active) Sequential images

» Single projector / Shutter glasses

– (passive) Dual stereo images» Two projectors / Polarized filters

May use position tracking

11/21/02 Visualization Laboratory, Texas A&M University 4

Examples - CAVE systems

developed at U. of Illinois

now commercial versions

11/21/02 Visualization Laboratory, Texas A&M University 5

Cave Display Surfaces

up to 6 surfaces of a small room or cubical environment

typically systems use only 3 or 4 walls

11/21/02 Visualization Laboratory, Texas A&M University 6

Immersive Environments

Major Components

– the computational “fabric”

– the display “surfaces”

– user interaction and tracking

11/21/02 Visualization Laboratory, Texas A&M University 7

What is the Next Generation?

New look at the computational fabric

and

New look at the display surfaces

11/21/02 Visualization Laboratory, Texas A&M University 8

Use a ‘Commodity’ Computing Fabric

Benefit from

– cost/performance advantages

– rapid development

– lower cost

11/21/02 Visualization Laboratory, Texas A&M University 9

Commodity Computing Concept

Cluster of commodity computers

Fast network interconnection

Open source operating system (Linux)

11/21/02 Visualization Laboratory, Texas A&M University 10

Visual Computing Clusters

Extended Cluster Concept Use ‘visual’ computing nodes Each computational node has a

graphics processor Each node drives a small facet of the

total display surface

11/21/02 Visualization Laboratory, Texas A&M University 11

Current Technology Visual Computing Node

Dual 3.0 GHz Xeon processors 4 Gbytes memory High-performance graphics processor

– such as nVidia 4400 1 Gbit networking ~$4,500 each

11/21/02 Visualization Laboratory, Texas A&M University 12

‘Next Generation’ Computing Fabric

A 12 to 60 node visual computing cluster

Each node corresponds to one display facet

Plus one control / interface computer

11/21/02 Visualization Laboratory, Texas A&M University 13

Related Work

Tiled Displays/PowerWalls– Princeton– Argonne National Lab– UNC-CH

Multi-Graphics Project– Stanford

11/21/02 Visualization Laboratory, Texas A&M University 14

The ‘Ideal’ Display Surface?

Is probably task specific One concept is a seamless surrounding

sphere with high resolution wrap around images, high update rate, and high complexity modeled environments

11/21/02 Visualization Laboratory, Texas A&M University 15

Display Geometries

We want better geometric approximations

to the ‘ideal’ sphere

The CAVE is a poor approximation

A number of polyhedral configurations are better

11/21/02 Visualization Laboratory, Texas A&M University 16

Polyhedral Display Systems

Multiple display facets Each facet driven from one visual

computing node Low cost per facet High aggregate performance High aggregate resolution

11/21/02 Visualization Laboratory, Texas A&M University 17

One possible configurationa 24 facet polyhedron

Trapezoidal Icositetrahedra

11/21/02 Visualization Laboratory, Texas A&M University 18

24 Facet polyhedral as approximation to a sphere

11/21/02 Visualization Laboratory, Texas A&M University 19

24 Facet projector placement

11/21/02 Visualization Laboratory, Texas A&M University 20

Visual simulation of a 24 facet display structure

11/21/02 Visualization Laboratory, Texas A&M University 21

Simulated cross-sectional view of a

5 meter 24 facet display environment

11/21/02 Visualization Laboratory, Texas A&M University 22

Another possible configurationa 60 faceted polyhedra

Pentagonal Hexcontahedra

11/21/02 Visualization Laboratory, Texas A&M University 23

Objectives

Lower cost Commodity components Reasonable performance Useful and effective Open software

11/21/02 Visualization Laboratory, Texas A&M University 24

Challenges

Software Development Distributed Data Management Display Synchronization / Stereo Display Physical Structure/Environment Suitable Projection Systems Display Calibration

11/21/02 Visualization Laboratory, Texas A&M University 25

Software Development

Adapting existing software packages such as OpenSG, VR Juggler, (CaveLib), …

Developing new local software Support for different display geometries Application development support

11/21/02 Visualization Laboratory, Texas A&M University 26

Stereo Display

Active»time sequential – shutter glasses»requires very tight synchronization

Passive» anaglyphic – red /cyan (one proj)» polarized (two projectors)

11/21/02 Visualization Laboratory, Texas A&M University 27

Physical Structures

Screen frame design»Minimal ‘seams’

Projector placement»Optical folding»Projector mounts»Heat ‘ripples’

Screen material»Optical properties

11/21/02 Visualization Laboratory, Texas A&M University 28

Image Compensation

Geometric correction– off axis & projector distortion

– ‘Image stability’

– explored several approaches Intensity / color correction

11/21/02 Visualization Laboratory, Texas A&M University 29

Budget for a 7 Facet System NSF System

7 x $17.75k = ~$124k plus ~ $36k for a control/interface

computer, interaction devices, networking, sound, installation, etc…

Total ~ $160k

11/21/02 Visualization Laboratory, Texas A&M University 30

24 Facet polyhedral as approximation to a sphere

11/21/02 Visualization Laboratory, Texas A&M University 31

Revised NSF Budget (2005)

For each facet ~ $17.75k– 2 Visual computing nodes ~ $9k– 2 Display projectors ~ $3.5k– Screen and structure ~$3.8k– Misc. components ~$1.45k

11/21/02 Visualization Laboratory, Texas A&M University 32

Project History

~1990 Air Force project @ NYIT ~1998 current concept (w/Ergun) 2000 CRIC funding (~$5k) 2002 TITF funding ($165k) 2005 NSF funding ($500k)

11/21/02 Visualization Laboratory, Texas A&M University 33

3/10 scale physical model using 24 identical facets

11/21/02 Visualization Laboratory, Texas A&M University 34

Finished Prototype

Architecture Building Atrium

~ 5’ diameter

(Mid – 2001)

11/21/02 Visualization Laboratory, Texas A&M University 35

¾ Scale Presentation Prototype

Completed May 2002

11/21/02 Visualization Laboratory, Texas A&M University 36

Half of structure frame

11/21/02 Visualization Laboratory, Texas A&M University 37

Structure with projected images

11/21/02 Visualization Laboratory, Texas A&M University 38

Rear view of 4 screen structure section

11/21/02 Visualization Laboratory, Texas A&M University 39

Operational prototype in use

11/21/02 Visualization Laboratory, Texas A&M University 40

Closer view

11/21/02 Visualization Laboratory, Texas A&M University 41

Project Status

3 screen prototype (3/4 scale)

5 screen prototype (full scale)

7 screen prototype (1/2 scale) Software (2 generations)

– ‘3Dengine’ – ‘Guppy3D’

11/21/02 Visualization Laboratory, Texas A&M University 42

Future Modular Versions

Replace projectors and screens with large flat panel display facets

Create bolt together modules