Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and...

15
TUM, ISMAR2014, 12 th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA : IN teraction- free DI splay CA libration for Optical See-Through Head-Mounted Displays 1/15

Transcript of Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and...

Page 1: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

TUM, ISMAR2014, 12th Sep 2014

Yuta Itoh and Gudrun Klinker

Performance and Sensitivity

Analysis of INDICA:INteraction-free DIsplay CAlibration

for Optical See-Through Head-Mounted Displays

1/15

Page 2: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Non Optical See-Through

Head-Mounted Displays

Optical See-Through OST-HMD

2/15

Page 3: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Consistency issues in OST-HMDs

Temporal

[Zheng ’14] [Didier ’05]

Visual

[Kiyokawa ’01] [Liu ’08] [Lee ’09]

Spatial

[Azuma ’95] [Tuceryan ’00] [Genc ’02]

Social

Image from Google

Glass: Don't Be A

Glasshole | Mashable

3/15

Page 4: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Spatial Consistency of OST-HMDs

Virtual

Real

Not consistent Consistent

4/15

Page 5: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Find a Projection from 3D to 2D

Spatial Calibration of OST-HMD

3D 2D

Projection

HMD Eye

5/15

Page 6: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Manual Method needs user interaction6/15

Page 7: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Manual Method needs user interaction

[Tuceryan ’00] [Genc ’02]

SPAAM

Single Point Active

Alignment Method

3D 2DProjection

HMD Eye

7/15

Page 8: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Automated Method interaction-free

3D 2D

Projection

INDICA INteraction-free

DIsplay CAlibration [Itoh ‘14]

tracks the eyeball center

8/15

Page 9: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Large systematic error

Problem of INDICA

Reprojection Error [pixel]

INDICARepeated

SPAAM

9/15

Page 10: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

INDICA needs intensive precalibration

SPAAM INDICA

0

17DoF*†

DoF*

# of param. How sensitive is

INDICA to the

parameters?

E

S

10/15

* Except for precalibration of the world tracking system

† Full setup

Page 11: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

E.g. screen position

is error prone

Predicted Error of INDICA

E

S

11/15

Page 12: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Observed Error of INDICA Added artificial error

to the real dataE

S

12/15

Page 13: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Is really a pinhole camera?

Human eyes are not simple

• Optical and visual axes

HMD screens are not planer [Owen ‘04]

• Retinal, Light-field

“Eye-HMD” Camera Modeling

Image by Soerfm

Owen ‘04

13/15

Page 14: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

Automated OST-HMD

calibration, INDICA, still

has systematic errors

Sensitivity analysis helps

us to identify the error

sources

Better eye-HMD

modeling is desirable

Summary14/15

Page 15: Performance and Sensitivity Analysis of INDICA · TUM, ISMAR2014, 12th Sep 2014 Yuta Itoh and Gudrun Klinker Performance and Sensitivity Analysis of INDICA: INteraction-free DIsplay

[D04] INDICA Demo

[T08] OST-HMD calibration tutorial

Jens Gurbert and Yut ItohSlides http://stctutorial.icg.tugraz.at/

Any questions?

This project has received funding from the

European Union’s Seventh Framework

Programme for research, technological

development and demonstration under PITN-

GA-2012-316919-EDUSAFE.

15/15