Post on 04-Jan-2016
description
Electrical and Computer Engineering
Smart Goggles
To Chong
Ryan Offir
Matt Ferrante
James Kestyn
Advisor: Dr. Tilman Wolf
Team Wolf
2Electrical and Computer Engineering
Augmented Reality Glasses
Virtually superimpose graphics onto real environment Context-specific information supplied to users real-time
Electrical and Computer Engineering
Gaming
4Electrical and Computer Engineering
Gaming Industry Advancement
5Electrical and Computer Engineering
3D View of our system
Tunnel Creek Board & Battery
Sensor Board
6Electrical and Computer Engineering
Specifications for Augmented Reality
System Refresh Rate: 20 Hz• Human visual frame rate: 10-12 FPS
Location Accuracy σL: ±2 feet• Average Walking Speed = 4.4 ft/s• Average Running Speed = 22 ft/s
Orientation Accuracy σθ: ±5°
Angle Update Speed: 80 deg/s• Captures “typical” human movement
7Electrical and Computer Engineering
Block Diagram
8Electrical and Computer Engineering
Sensing
9Electrical and Computer Engineering
Sensor Board Design
10Electrical and Computer Engineering
Prototyping
Arduino + SparkfunSensors and GPS
11Electrical and Computer Engineering
Technical Challenges – Data Accuracy
0
2
4
6
8
10
12
14
16
18
20
Chart TitleD
eg
rees
Gyroscope Drift Measured Over Five Minutes
Time
12Electrical and Computer Engineering
Technical Challenges – Data Accuracy
-150
-100
-50
0
50
100
150
Accelerometer Angle
Measured Angle
True Angle
De
gre
es
13Electrical and Computer Engineering
Technical Challenges – Data Accuracy
-150
-100
-50
0
50
100
150
Accelerometer Angle
Kalman Filtered Angle
Measured Angle
True Angle
De
gre
es
14Electrical and Computer Engineering
Measuring Kalman Filter Performance
SLOW TURN – 10 degrees per second
15Electrical and Computer Engineering
Measuring Kalman Filter Performance
FAST TURN – 50 degrees per second
16Electrical and Computer Engineering
Computation
17Electrical and Computer Engineering
Technical Challenges – Image Alignment
BAD
GOOD
18Electrical and Computer Engineering
OpenGL
Draws whole environment Call simple functions to update
camera location Example:
OpenGL only changes camera position since environment is already computed
// rotate 45 in z dirglRotatef(45.0f, 0.0f, 0.0f, 1.0f);
model->Draw();glFlush();
19Electrical and Computer Engineering
OpenGL
Camera
// rotate 45 in z dirglRotatef(45.0f, 0.0f, 0.0f, 1.0f);
Camera
Actual View Actual View
20Electrical and Computer Engineering
Display
21Electrical and Computer Engineering
Goggle-Based Display
http://www.microvision.com
22Electrical and Computer Engineering
Pico Projector Displays
• Image -> Electrical Signals• Electrical Signals drive RGB laser light: intensity & information• RGB + Combiner Optic = single modulated light path• Light output + MEMS Scanning Mirror = Image
23Electrical and Computer Engineering
Cost Schedule
Component Price Price per 1000
Sensor board components - GPS $35.00 $27.02 - Gyroscope $12.95 $6.35 - Microcontroller $10.25 $5.72 - Accelerometer/Compass $8.43 $3.97 - Other parts $14.37 $10.00 Total $81.00 $53.06
PCB Manufacturing $450.00 $150.00
Battery $50.00 $25.00
Total $581.00 $228.06
24Electrical and Computer Engineering
Timeline
25Electrical and Computer Engineering
Work in Progress
Developing Kalman Filter Testing/Debugging Sensor Board Developing final application
26Electrical and Computer Engineering
FPR
Final Application: PACMAN Sensor Board
• 3D Filter• Displacement
27Electrical and Computer Engineering
Demo Pictures
Tilt Right Tilt Left
28Electrical and Computer Engineering
Demo Pictures
Tilt Down Tilt Up
29Electrical and Computer Engineering
Demo Video
30Electrical and Computer Engineering
Questions