Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine...

40
Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University. http://www.caip.rutgers.edu/vrlab/ Electrical and Computer Engineering Department

Transcript of Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine...

Page 1: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Welcome to14:332:476 Virtual Reality

Spring 2008

Grigore C. Burdea Ph.D.Director, Human–Machine Interface Laboratory,

CAIP Center, Rutgers University. http://www.caip.rutgers.edu/vrlab/

Electrical and Computer Engineering Department

Page 2: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Class web site:

www.caip.rutgers.edu/vrlab/vrclass

Textbook site:

www.vrtechnology.org

Page 3: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Grading Criteria (476):

Quizzes 10%,

Midterm 45%

Final 45%

Laboratory assignments graded separately

(for 478)

Page 4: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Textbook: Burdea and Coiffet, Virtual Reality Technology, 2nd Edition, Wiley, 2003

Page 5: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Textbook web site: www.vrtechnology.org

Page 6: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Textbook web site: www.vrtechnology.org

Page 7: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Laboratory Hardware

Page 8: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

IntroductionIntroduction

Page 9: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

What is Virtual Reality?

Page 10: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

It is not augmented reality….

Introduction

Page 11: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

What is Virtual Reality?

“A high-end user-computer interface that involves real-time simulation and interaction through multiple sensorial channels.” (vision, sound, touch, smell, taste)”

Introduction

Page 12: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Introduction

Page 13: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Sensorama Simulator, US Patent #3,050,870, 1962

Introduction

Page 14: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

VR Short History

1963+ Ivan Sutherland's doctoral theses: SKETCHPAD: stereo HMD, position tracking, and a graphics engine. 1966+ Tom Furness: display systems for pilots; 1967+ Brooks developed force feedback GROPE system;

Page 15: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Ivan Sutherland’s HMD (1966+)

Introduction

Page 16: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Brooks’s Grope Project (1977)

Introduction

Page 17: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

VR Short History

1977 Sandin and Sayre invent a bend-sensing glove

1979 Raab et al: Polhemus tracking system

1989 Jaron Lanier (VPL) coins the term virtual reality

1994 VR Society formed

Page 18: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

The first complete system was developed by NASA “Virtual Visual Environmental Display” (VIVED early 80s; they prototyped the LCD HMD;

Became “Virtual Interface Environment Workstation” (VIEW) 1989

Introduction

NASA … a pioneer in VR

Page 19: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

NASA VIEW system (1989)

Introduction

Page 20: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

NASA VIEW system (1992)

Introduction

Page 21: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Large simulation and training needs;

Could not send humans to other planets;

Relatively small budgets.

Introduction

Why NASA?

Page 22: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Towards Commercialization…

The first commercial VR systems appeared in the late 80s produced by VPL Co. (California):

The VPL “Data Glove” and

The VPL “Eye Phone” HMD

Introduction

Page 23: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

The VPL DataGlove (1987) cost $8,500

Introduction

Page 24: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

The Matel PowerGlove (1989)

Introduction

Page 25: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

The first commercial VR glove for entertainment –

Mattel Power Glove $50 (1989)

Page 26: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

The Flight Helmet (ca. 1990) weighs 5 lbs

Early HMDs were massive

Page 27: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

…and had poor resolution

Page 28: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Virtual Reality in the early 90s….

Emergence of first commercial Toolkits:

WorldToolKit (Sense8 Co.);

VCToolkit (Division Ltd., UK);

Virtual Reality Toolkit VRT3 (Dimension Ltd./Superscape, UK);

Cyberspace Developer Kit (Autodesk)

Introduction

Page 29: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Introduction

Superscape VRT3 Development System

Page 30: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Virtual Reality in the early 90s….

Emergence of first non-commercial toolkits:

Rend386;

Later Virtual Reality Modeling Language (VRML 1.0);

Later still Java and Java 3D;

Introduction

Page 31: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Introduction

Scene created with Rend386Successor is AVRIL ("A Virtual Reality Interface Library“) C library for creating Created at U. Waterloo, Canadaece.uwaterloo.ca/~broehl/avril.html

Page 32: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Virtual Reality in the early 90s….

PC boards still very slow (7,000 – 35,000 polygons/sec);

First turnkey VR system – Provision 100 (Division Ltd.)

Emergence of faster graphics rendering architectures at UNC Chapel Hill:

“Pixel Planes”;

Later “Pixel Flow”;

Introduction

Page 33: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Introduction

Stride PC graphics accelerator

35,000 polygons/sec;

$26,000 (with two co-processors)/card

Require up to 6 PC slots for stereo version

Page 34: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Introduction

Provision 100 VR turnkey system (Division Ltd., UK)

35,000 polygons/sec;

$64,000 (including texture generator, tracker, 3-D audio, HMD and software)

Page 35: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

IntroductionProvision 100 VR turnkey system (Division Ltd., UK)

Page 36: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Introduction

Pixel Planes 5 VR system (UNC)

~ 1 Million triangles/sec;

Page 37: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Rendering speed comparison SGI vs. PCsxBox 360500 Million poly/sec

2005

Page 38: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

Laboratory VR Station prices (2002)PRODUCT Price/user % of Budget

PC 1.7 GHz

FireGL 2 accelerator

2,347 48

Polhemus 3D tracker

4 receivers

1,823 37

5DT sensing glove

five-sensor version

482 10

Stereo Glasses wired 179 3

Force feedback Joystick 88 2

Java and Java3D - -

VRML - -

Total 4,919 100

Page 39: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

VR Market growth

Page 40: Welcome to 14:332:476 Virtual Reality Spring 2008 Grigore C. Burdea Ph.D. Director, Human–Machine Interface Laboratory, CAIP Center, Rutgers University.

The key elements of a VR System