3 D Visual Avis Project

Solution Vehicles Co. (Shawn P. Boike) Copyright January 2006 The Perfect Warehouse, Inc.

Advanced Visual Imaging SystemAdvanced Visual Imaging System(AVIS) Proof of Concept - (AVIS) Proof of Concept -

OverviewOverview

ObjectiveObjective: : To modify the (Perfect Warehouse’s) Advanced Graphic To modify the (Perfect Warehouse’s) Advanced Graphic System and tailor its functions for the automotive industry for System and tailor its functions for the automotive industry for

displaying very high detail Automotive data bases at 60/Hz that can displaying very high detail Automotive data bases at 60/Hz that can be wearable by the end user.be wearable by the end user.

Ultimate Goal: Built-in to Windscreen/WindshieldUltimate Goal: Built-in to Windscreen/Windshield

ObjectiveObjective: : To Improve Today’s Automotive Industries To Improve Today’s Automotive Industries Graphic Systems for Engineering Simulation, Graphic Systems for Engineering Simulation,

Futurist Instrument Clusters and The Showroom of Futurist Instrument Clusters and The Showroom of with Very High Detail Visual Definition of: 20/20 at with Very High Detail Visual Definition of: 20/20 at

60/Hz.60/Hz.

Copyright January 2006 The Perfect Warehouse, Inc.

Advanced Visual Imaging SystemAdvanced Visual Imaging System(AVIS) Proof of Concept - Overview(AVIS) Proof of Concept - Overview

AGENDAAGENDA•Current Market AnalysisCurrent Market Analysis

•Problem Statement-Current LimitsProblem Statement-Current Limits•AVISAVIS Advanced Technology Advanced Technology

–ApplicationsApplications (CAVE, Instrument Cluster, Showrooms)(CAVE, Instrument Cluster, Showrooms)

•Advantages & Technology ImprovementsAdvantages & Technology Improvements•Cost Cost (Budget Price Estimate “BPE”)(Budget Price Estimate “BPE”) & Integrated Schedule & Integrated Schedule (IS)(IS)

•Risk to Payoff Estimate Risk to Payoff Estimate •Ultimate Future ApplicationUltimate Future Application


Current Simulator Systems Current Simulator Systems (CAVE, ICE Lab…)(CAVE, ICE Lab…) Development Time & Costs (ROM)Development Time & Costs (ROM)

• Auto Industry (CAVE Type)Auto Industry (CAVE Type)– Time: Time: – Costs:Costs:

• Aerospace Industry Simulators Aerospace Industry Simulators Avg.Avg.– Time: Time: – Costs:Costs:

• Future Combat Systems Future Combat Systems (ICE Lab (ICE Lab Type)Type)– Time: Time: – Costs:Costs:

• NASCAR- SimulatorsNASCAR- Simulators– Time: Time: – Costs:Costs:


Current Instrument Clusters Time & Current Instrument Clusters Time & Costs (ROM)Costs (ROM)

• Auto Industry IP ClustersAuto Industry IP Clusters– Time: Time:

– Costs:Costs:

• Aerospace Industry Glass CockpitAerospace Industry Glass Cockpit– Time: Time:

– Costs:Costs:

• Future Combat Systems Future Combat Systems Glass Glass CockpitCockpit

– Time: Time:

– Costs:Costs:

• COTS (Auto Store Off-The-Shelf): COTS (Auto Store Off-The-Shelf):

– Time: Time:

– Costs:Costs:


DATA BASES for Automotive DATA BASES for Automotive IndustryIndustry

• The data bases that this system will run The data bases that this system will run will consist ofwill consist of– In house NURBS CGI renderings and CAD / In house NURBS CGI renderings and CAD /

CAM drawings of vehicles converted to run on CAM drawings of vehicles converted to run on IG through the use of newly developed cross IG through the use of newly developed cross compilerscompilers

– Other off the shelf models we have in stockOther off the shelf models we have in stock


ExamplesExamples of: Off-the-shelf data base models of: Off-the-shelf data base models approx 60,000 textured polygons eachapprox 60,000 textured polygons each

total polygon count over 240,000.total polygon count over 240,000.((LimitationLimitation is: maxes out cots real time capacity is: maxes out cots real time capacity

of 160,000 at 1/60of 160,000 at 1/60thth of a second update rate). of a second update rate).

• HUMMERHUMMER

• CORVETTECORVETTE

• SABBSABB

• CADILLACCADILLAC


OFF THE SHELF – HUMMEROFF THE SHELF – HUMMER60,000 TEXTURED POLYGONS60,000 TEXTURED POLYGONS


OFF THE SHELF - CORVETTEOFF THE SHELF - CORVETTE60,000 TEXTURED POLYGONS60,000 TEXTURED POLYGONS


OFF THE SHELF - SAABOFF THE SHELF - SAAB60,000 TEXTURED POLYGONS60,000 TEXTURED POLYGONS


OFF THE SHELF - CADILLACOFF THE SHELF - CADILLAC60,000 TEXTURED POLYGONS60,000 TEXTURED POLYGONS


4 – 10 MODELS NEEDED4 – 10 MODELS NEEDEDON SHOW ROOM FLOORON SHOW ROOM FLOOR

• These Models Look Good When Viewed From This These Models Look Good When Viewed From This DistanceDistance

• You You Need About Need About 10 Times10 Times The Polygons For 20/20 The Polygons For 20/20 VisionVision Close Up Close Up

• Therefore 600,000 Polygons EachTherefore 600,000 Polygons Each– 2,400,000 Polygons Needed For 4 Models2,400,000 Polygons Needed For 4 Models– Current Off The Shelf (COTS) Needs To Current Off The Shelf (COTS) Needs To Be 15 TimesBe 15 Times

Faster Than It Is Now To Produce Faster Than It Is Now To Produce 4 Models4 Models– 6,000,000 Polygons Will Render 10 Cars In A Show Room 6,000,000 Polygons Will Render 10 Cars In A Show Room

Floor At 20/20 VisionFloor At 20/20 Vision – – COTS LimitationCOTS Limitation Lacks Capability Lacks Capability By 37.5 TimesBy 37.5 Times


IG Primitive CapabilitiesIG Primitive Capabilities

• Host Interrupts to IG controls the IG primitivesHost Interrupts to IG controls the IG primitives• 200,000 Moving Models can be controlled 200,000 Moving Models can be controlled • USB 2.0 interface to host computer, interrupt USB 2.0 interface to host computer, interrupt

driven driven • Texture Map control Texture Map control • Points and Polygons control Points and Polygons control • Translucency Translucency • Light points Light points • Light sourcesLight sources


RECOMMENDED SYSTEM RECOMMENDED SYSTEM APPROACHAPPROACH


Simple Requirements (Chg Title)Simple Requirements (Chg Title)

• To have a wearable Eye Mounted System for To have a wearable Eye Mounted System for the user to view the resulting data base with the the user to view the resulting data base with the same detail as the human eye can focus with same detail as the human eye can focus with 20/20 vision in a “CAVE”20/20 vision in a “CAVE” type of environment type of environment

• To update the entire display at To update the entire display at 60 Hz including 60 Hz including generation of the generation of the 3D graphics3D graphics images images from from source input to the virtual displayed imagesource input to the virtual displayed image

• To track the user’s eye and head movements in To track the user’s eye and head movements in 3D Space3D Space as large as a warehouse or as large as a warehouse or as small as small as a driver compartment.as a driver compartment.


To Be: Short Film to demonstrate the true To Be: Short Film to demonstrate the true requirements of real time “Cave”requirements of real time “Cave”

• DEALERSHIP SHOW ROOMDEALERSHIP SHOW ROOM– 4 cars to4 cars to– 10 cars10 cars

• WALK AROUND WITH CAMERAWALK AROUND WITH CAMERA• OPEN UP DOORS OF CARSOPEN UP DOORS OF CARS• SIT IN CARSIT IN CAR• TURN ON CAR FUNCTIONSTURN ON CAR FUNCTIONS• ZOOM INTO DIFFERENT DETAILS OF CARZOOM INTO DIFFERENT DETAILS OF CAR


What needs to be built or What needs to be built or modifiedmodified

• Need to satisfy the requirements of last 2 Need to satisfy the requirements of last 2 slidesslides

• Image Generation System capable of Image Generation System capable of rendering images in real timerendering images in real time

• Display System capable of projecting Display System capable of projecting image of cars to meet 20/20 visionimage of cars to meet 20/20 vision

• Data base set of 4 to 10 cars in a show Data base set of 4 to 10 cars in a show roomroom


The existing Image Generator and The existing Image Generator and Display System with Tracker System Display System with Tracker System (IGDST System) consists of 5 major (IGDST System) consists of 5 major

modules:modules:

• Advanced Image GeneratorAdvanced Image Generator

• Advanced Display SystemAdvanced Display System

• Advanced TrackerAdvanced Tracker

• Cross CompilersCross Compilers

• Data BasesData Bases


IGDST SystemIGDST System• Image GeneratorImage Generator

– Entire System Can be worn on bodyEntire System Can be worn on body– Up to 80,000,000 textured polygons at 60/hzUp to 80,000,000 textured polygons at 60/hz

• 6 – 20 million textured polygons for 4x6 inch unit6 – 20 million textured polygons for 4x6 inch unit• 24 – 80 million textured polygons for 9 inch unit24 – 80 million textured polygons for 9 inch unit

• Display SystemDisplay System– Display resolution produces 20/20 visionDisplay resolution produces 20/20 vision– Full 360 degrees field of viewFull 360 degrees field of view– Operations in very small to very large areasOperations in very small to very large areas

• Tracker SystemTracker System– 360 deg in yaw360 deg in yaw– 180 deg in pitch180 deg in pitch

• Cross Compilers to Data SetsCross Compilers to Data Sets• Data BasesData Bases

– Level of Detail for real time renderingLevel of Detail for real time rendering– Conversion of Nurbs and CAD/CAM Data SetsConversion of Nurbs and CAD/CAM Data Sets


Image Generator Phased Image Generator Phased ApproachApproach

• Built upon 30 years of research and development Built upon 30 years of research and development – Several previous designsSeveral previous designs– Low riskLow risk

• New System is FPGA Based, old system IC chip basedNew System is FPGA Based, old system IC chip based• Host Computer can be on IG board instead of reverseHost Computer can be on IG board instead of reverse• 5 Years of Design already accomplished, 2 more years to go before completion.5 Years of Design already accomplished, 2 more years to go before completion.

– Built upon success of working system 9 years agoBuilt upon success of working system 9 years ago– Now at the schematic detailed design stageNow at the schematic detailed design stage– Software compiler at the detailed design stageSoftware compiler at the detailed design stage

• More features then ATI and NVidiaMore features then ATI and NVidia– Need 16 ATI chips to render just the anti-aliasing this system accomplishesNeed 16 ATI chips to render just the anti-aliasing this system accomplishes– Do not need to go through the OpenGL or Direct3D architectures to talk to IG Hardware. You Do not need to go through the OpenGL or Direct3D architectures to talk to IG Hardware. You

can interface directly with the IG from host through an interrupt driven system.can interface directly with the IG from host through an interrupt driven system.– 200,000 moving models processing in 3ms.200,000 moving models processing in 3ms.– The best ATI and NVidia based systems can only produce 100,000 front facing polygons, The best ATI and NVidia based systems can only produce 100,000 front facing polygons,

this design at its minimum configuration is 600 times faster at 6,000,000 front facing this design at its minimum configuration is 600 times faster at 6,000,000 front facing polygons.polygons.

• Next 2 years of Image Generator ProjectNext 2 years of Image Generator Project– 8 months: Build Prototype 1 – 6 to 20 million polygons on 9”x 9” board8 months: Build Prototype 1 – 6 to 20 million polygons on 9”x 9” board– 4 months: Build Prototype 2 – shrink to 4” by 6” board4 months: Build Prototype 2 – shrink to 4” by 6” board– 12 months: Build Prototype 3 – UP TO 80 million polygons on 9”x9” board12 months: Build Prototype 3 – UP TO 80 million polygons on 9”x9” board


Display SystemDisplay System

• Fast Prototype Already ConstructedFast Prototype Already Constructed

• Patent PendingPatent Pending

• Unlimited Field of View for immediate Unlimited Field of View for immediate fovea area of interest – 20/20 vision fovea area of interest – 20/20 vision achievedachieved

• Unlimited Field of View for Peripheral Unlimited Field of View for Peripheral VisionVision


Cross Compilers For IGCross Compilers For IG

• Initial Layer to talk to new IG Initial Layer to talk to new IG

• Second Layer to talk to OpenGL Second Layer to talk to OpenGL generated data bases generated data bases

• Second Layer to talk to Direct 3D Second Layer to talk to Direct 3D generated data bases generated data bases

• Third Layer to talk directly to Known 3D Third Layer to talk directly to Known 3D Formats through Second Layer or Formats through Second Layer or directly to Initial Layerdirectly to Initial Layer


Tracker SystemTracker System

• No magnetic limitationsNo magnetic limitations

• Line of sight tracking for Head MovementLine of sight tracking for Head Movement

• Eye Tracking with respect to Head Eye Tracking with respect to Head MovementMovement

• Full 360 degrees of tracking in the YawFull 360 degrees of tracking in the Yaw

• 180 degrees plus tracking in the Pitch180 degrees plus tracking in the Pitch


Final AnalysisFinal Analysis

• ScheduleSchedule

• Funding ProfileFunding Profile

• Risks?Risks?

• Benefits?Benefits?


SCHEDULESCHEDULE

• 2 year plan to complete all tasks.2 year plan to complete all tasks.– Advanced Image GeneratorAdvanced Image Generator– Advanced Display SystemAdvanced Display System– Advanced TrackerAdvanced Tracker– Cross CompilersCross Compilers– Data BasesData Bases


SCHEDULESCHEDULEADVANCED DISPLAY SYSTEMADVANCED DISPLAY SYSTEM

• MONO AND STEREO VIEWINGMONO AND STEREO VIEWING• COMPUTER DISTORTION CORRECTIONCOMPUTER DISTORTION CORRECTION• OPTICSOPTICS

– BEAM SPLITTERBEAM SPLITTER– LENSLENS

• SERVO DEVELOPMENTSERVO DEVELOPMENT• COMFORTABLE HEAD MOUNTCOMFORTABLE HEAD MOUNT• 3 TYPES OF DISPLAY INFORMATION3 TYPES OF DISPLAY INFORMATION

– OUT THE CAROUT THE CAR– IN THE CARIN THE CAR– MOVE WITH EYEMOVE WITH EYE


SCHEDULESCHEDULEADVANCED TRACKERADVANCED TRACKER

• HEAD TRACKERHEAD TRACKER

• EYE TRACKEREYE TRACKER


SCHEDULESCHEDULEADVANCED IMAGE GENERATORADVANCED IMAGE GENERATOR

• SHOW PAST 5 YEARSSHOW PAST 5 YEARS

• SHOW NEXT 2 YEARSSHOW NEXT 2 YEARS


SCHEDULESCHEDULECROSS COMPILERSCROSS COMPILERS

• NURBS CONVERSIONNURBS CONVERSION

• CAD/CAM CONVERSIONCAD/CAM CONVERSION

• COMPILER TO NEW IGCOMPILER TO NEW IG

• COMPILER TO OPENGLCOMPILER TO OPENGL

• COMPILER TO DIRECT 3D (OPTIONAL)COMPILER TO DIRECT 3D (OPTIONAL)


SCHEDULESCHEDULEDATA BASEDATA BASE

• FIRST – COMPILE TO NEW IG FORMATSFIRST – COMPILE TO NEW IG FORMATS– CAD/CAM DATACAD/CAM DATA– NURBS DATANURBS DATA

• SECOND - CONSTRUCT HIGHER LEVEL OF SECOND - CONSTRUCT HIGHER LEVEL OF DETAIL TO MEET 20/20 VISION OF NEW DETAIL TO MEET 20/20 VISION OF NEW DISPLAY SYSTEM (AVERAGE 10 TIMES DISPLAY SYSTEM (AVERAGE 10 TIMES MORE DATA REQUIRED)MORE DATA REQUIRED)


FUNDING PROFILEFUNDING PROFILE= APPROX $4,174,000= APPROX $4,174,000

• MANPOWER = 9 people * $100/hr average* 2080*2 years = $3.744 MANPOWER = 9 people * $100/hr average* 2080*2 years = $3.744 millionmillion– 2.5 Hardware people for 2 years2.5 Hardware people for 2 years– 6 Software people for 2 years6 Software people for 2 years– 0.5 Managers for 2 years0.5 Managers for 2 years

• EQUIPMENT = TOTAL $400KEQUIPMENT = TOTAL $400K– IG HARDWAREIG HARDWARE

• PARTS = $100KPARTS = $100K• BOARD PROTOTYPES = $100KBOARD PROTOTYPES = $100K

– DISPLAY SYSTEMDISPLAY SYSTEM• PARTS = $50KPARTS = $50K• MECHANICAL ENGINEERING = $100KMECHANICAL ENGINEERING = $100K

– COMPUTERS = $30KCOMPUTERS = $30K– SOFTWARE APPLICATIONS = $20KSOFTWARE APPLICATIONS = $20K

• TRAVEL = APPROX $30KTRAVEL = APPROX $30K


RISKS?RISKS?

• Last 2 years of development runs in Last 2 years of development runs in parallel with system, but we are in the parallel with system, but we are in the detailed schematic design stage and we detailed schematic design stage and we have built 3 previous IG systems in the have built 3 previous IG systems in the past 30 years.past 30 years.

• So risks are at a minimumSo risks are at a minimum


BENEFITSBENEFITS

• Auto Industry can have influence on the next 2 years of processingAuto Industry can have influence on the next 2 years of processing• 6 to 20 million polygons wearable system at 1/606 to 20 million polygons wearable system at 1/60 thth second update second update

raterate• One 9 inch board system capable of producing up to 80,000,000 One 9 inch board system capable of producing up to 80,000,000

polygonspolygons• Anti-aliased systemAnti-aliased system

– 6,000 by 4,000 resolution processing of display6,000 by 4,000 resolution processing of display– 1,500 by 1,000 in final pixel domain after Anti-aliased1,500 by 1,000 in final pixel domain after Anti-aliased

• 600 to 2,000 times faster than any COTS system on the market 600 to 2,000 times faster than any COTS system on the market todaytoday

• Full control of Image GeneratorFull control of Image Generator– Do not have to process through OpenGL or Direct 3DDo not have to process through OpenGL or Direct 3D– Do not have to plug into PCI slot (limited bandwidth)Do not have to plug into PCI slot (limited bandwidth)


POTENTIAL APPLICATIONSPOTENTIAL APPLICATIONS

• CAVE APPLICATIONCAVE APPLICATION• CUT-A-WAYS SHOWING THE DETAILS INSIDECUT-A-WAYS SHOWING THE DETAILS INSIDE• MANY DISPLAYS IN AUTO - DIFFERENT CONFIGURATIONS MANY DISPLAYS IN AUTO - DIFFERENT CONFIGURATIONS

ARE FLEXIBLE/MOVEABLEARE FLEXIBLE/MOVEABLE• UNLIMITED INTERACTIVE WITHOUT THE USE OF SPECIAL UNLIMITED INTERACTIVE WITHOUT THE USE OF SPECIAL

HARDWARE BUTTONS OR TOUCH SCREENSHARDWARE BUTTONS OR TOUCH SCREENS• BETTER SITUATIONAL AWARENESSBETTER SITUATIONAL AWARENESS

– CAMERAS CAN PROJECT BLIND SPOTSCAMERAS CAN PROJECT BLIND SPOTS– UNLIMITED USE OF REAR VIEW MIRRORSUNLIMITED USE OF REAR VIEW MIRRORS

• PATH WAYS IN THE STREETPATH WAYS IN THE STREET• COLLISION AVOIDANCE WITH HEAD UP DISPLAY SHOWING COLLISION AVOIDANCE WITH HEAD UP DISPLAY SHOWING

WHERE POTENTIAL ACCIDENTS COULD OCCURWHERE POTENTIAL ACCIDENTS COULD OCCUR• WARNING SYSTEM THAT IS 3D VISUALWARNING SYSTEM THAT IS 3D VISUAL

3 D Visual Avis Project

Documents

Transcript of 3 D Visual Avis Project