Page 1 of 16

DGMD E-598 Digital Media Design Capstone Tutorial – Summer 2019

CapstoneProposal–ChristopherHansen

1. Project Scope

1.1 Project Title Digital Twin – A digital replica of a complex physical object for instructional purposes.

1.2. Project Goal Thegoalofthiscapstoneistocreateadigitalreplicaofacomplexphysicalobject.Thisobjectwillbecomposedofvaryingcomponents.Thedigitalreplicawouldbebrokendownintoasetofinstructionsthatdemonstrateandguidesauserthroughassemblyoftheobject.Thisrepresentationwouldbedoneonlineutilizingwebgltorender3dobjects.

1.3. Learning Goals Ibelievethetechnologyexiststocreateafeasiblehighlycuratedenvironmentfortechnical/vocationallearningandintendtousethesetoolstoinvestigatethis.Mygoalistoinvestigateandimplementtheviabilityoftechnologiesthatcouldallowthistohappen.Myskillsdevelopedduringthisprocesswillbethecapabilityofutilizingfrontendweblanguagestoaddresstheeducationalneedsoftechnicaltraining/instruction.

1.4. Target Audience ThecurrentaudiencefortheproposedimplementationoftheprojectwillbeownersandoperatorsoftheDremel3d453dprinter.Userswillutilizethisprojecttoaidintherepairandmaintenanceoftheir3dprinters.Thissetofinstructionswillbemadeavailableonlineandaccessibletoanyonewithaninternetconnectionandabrowserthatsupportswebgl.Thecurrentdemographicsareindividualsineducationalinstitutions(highschool,college).Thesecouldbefacultywhopurchaseamachineforresearchorinstructionalpurposes,technicianswhomanageequipment,studentswhoworkinlabs,shopsormakerspacesthathelptomaintaintheequipmentinthesespaces.Giventheskillrange,knowledge,experienceandexpertise,thistoolisintendedtoclosethatgapandofferallusersathoroughandcomprehensivesetofinstructionsontherepairofthesemachines.Thecurrentnumberofusersforthismachinebasedonthenumberofunitsthathavebeensoldareabout~10,000(Harvardalonecurrentlyownsover100oftheseunitsthatIamawareof).Thiscouldbeexpandedastheequipmentsupportedbythisrepresentationisincreased.Forpurposesofthisproject,theintendedaudiencewouldbeacuriousindividualwhowouldliketoendeavoronaprojectthattheydonotfeeltheyhavetheknowledgeofskillsetfor.Largeraudiencescouldbeeducational

Page 2 of 16

institutionswantingtocreateonlinecourses/instructionfortechnical/vocationalskillsorcommercialindustriesprovidingtraininginanonlineenvironment.SampleUserProfiles:Persona1-labmanagerThinks-howdoImaintainandfixthisequipment?Howdoitrainothertofixthisequipment?Feels-uncertainty,anxietyDoes-educatesthemselves.GathersandevaluatesallavailableresourcesThistoolwillhelptoreduceanxietyanduncertaintyabouthowtomaintainandrepairequipment.Allowingpieceofmindtothemanagerinhavingaclearsetofinstructionstheycangivetoothers.Persona2-studentworkerThinks-idon’tknowwhati’mdoingFeels-uncertain,notconfidentinabilitiesDoes-waitstobeshownwhattodoThistoolwillhelpthisuserfeelconfidentintheirabilitytofixandbeshownhowtomaintainthemachines.Persona3-companyrepresentativeThinks-howdoihelpownersoftheequipment?Feels-overwhelmed,confusedDoes-impartknowledgetheyhaveasclearlyaspossibleThistoolwillgiveacustomerreptheconfidencetotellapotentialcustomerthattheyhavedocumentationandinformationthatwillenablethecustomertomaintainthisequipment.

1.5. Elevator Pitch Take a Haynes technical manual and repurpose it for the digital age with it being curated similar to the lynda.com learning environment. The product will be an interactive technical manual. It will display, in a 3d environment, technical documentation accompanying a 3d model of a specific piece of hardware. This will be accessible via and web enabled device and present itself in a highly curated step-by-step manner.

1.6. Metrics Thedigitaltwinofapieceofhardwarewouldideallyhaveacommercialcomponent,meaninguserscouldorderpartsfromit,clickonacomponentandhavepartandpriceinfoofthatcomponent.Ibelievethesuccesscouldbemeasuredbyhowmanypeopleusetheinteractiveinstructionalenvironmenttoordercomponents

Page 3 of 16

represented.Sotheviabilityandsuccesswouldbeself-evidentinitsabilitytogeneraterevenue.Additionally,theprojectcouldexistonawebsitewhereusersarerequiredtocreateaccountstoaccessthetool.Successcouldthenbemeasuredbytheamountofuseraccountsarecreatedtoaccessthistool.Surveyquestions:

1. Wasthepresentationofinstructionsintuitive?2. Isa3denvironmentdifficulttonavigate?3. Wereinstructionsclear?4. Doeseachstepclearlydefineandillustratetaskstobedone,whattools

neededetc?5. Wouldyouliketoseethispresentationusedforotherpiecesofhardware

repairand/ortraining?6. Haveyouusedatoollikethisbefore?7. Whereyouabletofollowthistutorialtocompletion?8. Wouldyouusethisagain?9. Wouldyourecommendthistoothers?10. Wasthistoolfrustratingtouse?

Rubricusedtoevaluateprogressandprojectandcapstoneattributes 1 2 3 4 5UserabletocompleteTutorial

No Usercangetpartwaythrough

Usercancompletebarely

Usercancompletewithhelp

Usercanfinishunaided

UserfrustratedbyTutorial

yes Yes,butwithcoachingcancomplete

Cancompletewithminimalhelp

Cancompletebutsomethingunclear

Cancompleteeasilyandintuitively

Allstepsareclear

No,unusable

No,butwithclarificationisusable

Notintuitive,butdoable

Yes,butsomeclarityneeded

yes

AlltoolsneededareProperlyidentifiedandAssociate

No,nosecondarytoolsidentified

Toolsidentifiedbutnotassociatedwithsteps

Toolslooselyassociatedwithappropriatesteps

Toolsassociatedwithstepsbutcouldbeclearer

Alltoolsneededforstepsareclearlyidentifiedforspecifictask

Page 4 of 16

dwitheachstepEachstepclearlylustratedAnddescribedtaskstobedone

Nostephassecondaryillustrations

Illustrationexist,butnotidentifiedwitheachstep

Illustrationexistandarelooselyassociatedwithsteps

Illustrationareclear

Illustrationscanexistasstandaloneobjects.

1.7. Life of the project beyond capstone Currently,thereisatentativeagreementwithboschtoolsforthemtoutilizethistoolandmakeitavailabletotheircustomersontheirwebsite.Inalargersense,thispresentationcouldbeusedtorepresentothertoolsandtechnicalprocesses.Whichcouldleadtotheonlinepresentationandlearningofhandsonskills,whichcurrentlydoesnotexistinaveryinformative/intuitiveformatwithdistancelearning.ThefinalformIwouldliketoseethisprojectbecomeisaplatformforuserstouploadtheirown3dfilesandannotatethemforinstructionalpurposes.Muchlikeyoutubeallowsuserstouploadvideosforotherstowatch.

2. Competitor review Competitor1:Lynda.comLynda.comoffersawiderangeofsoftwaretutorials.Theyprovideaccesstotraining,expertknowledgeforvarioussoftwareprograms.Userscanaccessthesetrainingsandtutorialsfromanydevicethathasaninternetconnectionandworkattheirownpace.Thiswebsiteissubscriptionbasedandtracksalluseruseofcontent.Pros:accessibletoanyonewithaninternet.Lotsofcontent.Cons:membership/paidsubscription.NorealpersontocontactoraskquestionstoCompetitor2:HaynesmanualTheHaynesmanualsarehighlydetailedassemblyinstructionsforprimarilyautomotivevehicles.Theybreaktheautomobileintodifferentpartsandcomponentsinexplodeddiagrammaticdrawingsthatillustratehoweverythingfitstogether.Labelingcomponentsinthedrawingswiththeirnames.

Page 5 of 16

Pros:beautifullygraphicallyillustrated.Allcomponentsarelabelled.IsaphysicalproductsouserscantakeanduseranywhereCons:isphysical,sousershavetopurchaseandmaintainacopy.Allgraphicsarestatus3dimageswhichcanleadtoambiguity.Competitor3:Dozuki.comDozukiisawebsitethatallowsindividualstocreatetechnicalinstructions.Theseinstructionscanincludetextandpicturesandallowsuserstoannotateimages.Additionally,userscanbreakdowntechnicaltasksintostepsforuserstofollow.Italsoallowsforthetrackingofusersintheinstructions/tasksassignedorselected.Howlongittakesuserstocomplete,howlongtheyspendoneachstep.Pros:online,usertrackingofprogresstocreatemetrics.EasyforuserstocreateinstructionsmuchlikeawysiwygeditorinaCMSsystem.Cons:subscriptionbased.Onlyallows2dcontent.Eachcompetitoroffersdifferentsolutionstoasimilarproblem.Theyhavedifferenttargetaudienceswhichmaybeareasonfortheirdifferentstylesofdeliveryofinformation.Additionally,thetimeinwhicheachcompetitordevelopeditsproductveryclearlyshowsthediscrepanciesintechnologyavailableatthetime.Aswitheverything,eachcompetitorhasitsstrengthsandweaknesses.

Page 6 of 16

SummaryTableHighlightingDifferencewithCompetitors

Lynda.com Haynes Dozuki.com MyProjectAccessible x x xIntuitive x x xGraphicallyclear x x xSelfpaced x x x xAccessibleonline x x xClearUI x xEasycontentcreation x x3denvironment x2dgraphics x x x xVideos x x xOptimizedformobile x x

3. Technology requirements TechnologiesNeededWebgl/HTMLcanvaselementWebglallowsfortherenderingof3dobjectsinawebbrowser.Course:DGMDE-15Screen-Based,PhysicalComputing.Description:Thiscourseallowedmetoexplorethelibraryofthree.jsanditsimplicationsingenerating/displaying3dobjectsinthebrowser.AlternativeTechnology:Therereallyisn’tanalternative,thistechnologyisdeployedinvariousmediums.Throughcanvaselementonawebpageorthroughaproprietarywebbrowserplugin.Theprecursortothiswasflash,butthatisnolongerrelevant.I’vechosenthisasopposedtounity3d,asnospecialdownloadareneededandanyuserwitha

Page 7 of 16

webglcompatiblebrowsercansimplynavigatetothewebpagetoview3drenderings.Thistechnologywillbeusedtorender3dobjectsinabrowser.3dmodelingsoftware3dmodelingsoftwareallowsforthecreationof3dobjectsthatcanbeinteractedwith.Iwilllikelymakeuseofrhino3dtogenerateandedit3dmodels.Course:DGMDE-70PrinciplesofGameDesign.Description:Thiscourseofferedintroductiontomayaand3dmodeling.Butmy3dmodelingexperiencecomesfrommyformaleducationinArchitectureandDesign.AlternativeTechnology:Thereareseveralalternative3dmodelingsoftware.Maya,3dsmax,solidworksareafewalternatives.I’vechosentoworkwithrhino3dsinceIammostfamiliarwithit.HTML/CSS/JSTheprojectwillbepresentedinawebpage.Assuch,frontendwebtechnologywillbeusedforthispresentation.Theonlycurrentknownlibrarythatwillbeusedisthree.js.Thislibraryallowsfortherenderingof3dmodelsinawebbrowser.Course:CSCIE-3WebProgramming/JavaScript,DGMDE-12CreativeExploration/Web,CSCIS-12WebsiteDevelopment,DGMDE-15Screen-Based,PhysComputing.Description:Thelistedcoursesexposedmetofrontendwebdevelopmentanditsapplications.ThesecoursesarelargelywhyIamabletodothisprojectandpresentitinawebformat.AlternativeTechnology:Thisprojectcouldbedonesomewhatsimilarlyutilizingagameengineandphp/c#programming.Butgivenusingagameengineasamediumforpresentationmaymaketheprojectlessaccessible,requiringspecialdownloadsorplugins,wheremyintentistomakethisasaccessibleaspossible.

4. Visuals describing how your product will be used Theprojectwillconsistofawebpage.Thiswebpagewillrenderanddisplayadigitalreplicaofaphysicalpieceofhardware.Thiswebpagewillactasaninteractiveguidetoperformatechnicaltask.

Page 8 of 16

Dremel3dprinter 3dmodelof3dprinterrenderedinawebpageThis3dmodelthatisrenderedinawebpagewillbeinteractive.Userswillbeabletozoomin/out,panandrotatearoundthemodel.Thisismeanttosimulate,asmuchaspossible,interactingwiththephysicalobject.Componentswillbemodeledastheycurrentlyexist.Thisenvironmentismeanttobeinteractivewithrelevantinformationbeingdisplayeddependingonthetasktheuserwouldlikeinstructionson.Thedisplaymaylooksomethinglikethefollowingimage,withannotations/menysoverlayedonthe3dmodel.

Source:https://fablabgsd.s3.amazonaws.com/lasertraining/focus_ui/laser/focus.htmlInteractivehardwaretrainingenvironment

Page 9 of 16

Theinformationwillvary,someofitwillbedynamictothemodel,someofitwillbeillustrations/images/videosorwhateverformatbestdescribesthecurrentprocess.Toolsneededforastepwillalsobeincluded.Aswellaspartnumbers.

ExampleofextrainformationembeddedintowebpageSource:https://fablabgsd.s3.amazonaws.com/lasertraining/focus_ui/laser/laser.html

Page 10 of 16

Stepsinusingthistool/environmentwouldbeasfollows:

Step1:Usernavigatestoawebpagethedisplayadigitalreplicaofhardwaretheyareengagingwith.Fromthisinitialpagetheywillselectthetasktheywanttoperform.

Page 11 of 16

Step2:Fromamenu,theuserwouldselecttheprocesstheywouldliketobegivenatutorialofhowtoperform.Inthiscaseitwouldbemaintenance/repairtasksofadremel3d453dprinter.Onceselectedasecondmenuofthetaskbrokendownbystepswouldappear.Userswouldclickonthestepsinmenu2andfollowinstructionspresented.

Page 12 of 16

Step3:Onceataskisselected,alistofstepswillbedisplayed.Userswillsequentiallyselecteachstep.Whenselectingastep,the3dmodelwillchangetodisplaythemachineintheappropriatestateofdisassembly/assembly.Additionalannotations/toolneededwillbedisplayedinaseparateinformationpanel.Theinfopanelsuppliesextraannotationwheretheuserscanclickonlinksandimageshere.

Page 13 of 16

Thiswillbeaself-pacedexercise,whereuserscantogglebackandforthorjumpbetweenstepsastheywouldlike.

5.WorkplanandmilestonesGenerateDigitalAssetsNow-August30thThistaskiscreating/gathering3dobjects/modelsthatwillbethebackboneofthewebpage.Thiscreationof3dobjectwillbedoneinrhino3d.Generatesupportinggraphics(images,videos)Aug1-Aug30thInadditiontothe3dobjects,supportinggraphicswillbeneededtoaddclaritytoeachstepoftasksuserswillengagein.Thistaskwillentailcreating3dobjects,gathering/creatingnecessaryanimationsand/orvideos.These2dgraphicswillbegeneratedinphotoshop/illustrator.LabelDigitalassetsandcreatestagingin3dmodelingsoftwareAug30-Sept15thTheprojectwillbeprototypedandlaidoutroughlyinthe3dmodelingsoftware.Partofthisislabelingandannotatingeachsteponlayersinthe3dsoftwaretogiveagoodvisualindicatorbeforeheavywebprogrammingisdone.Thiswillbedoneinrhino3d.DevelopUIforwebpageNow-Sept30thWebdevelopmentoftheinterfaceforthewebpage.Attentionbeinggiventointuitivenessandsimplicityforaccessibilitybyallusers.Thisisdoneusinghtml/css/js.IncorporateAssetsintowebpageSept30th-Nov15thTakethedigitalassets(3dand2dobjects)andprogramthemtodisplayandinteractproperlyinthewebpage.Thiswillbeaccomplishedusinghtml/css/js.TestNov15th-Nov25th

Page 14 of 16

Testingthepageanddeterminingproblems.Iwilldothetestingandperhapsrecruitstudentswho,Iemployandwouldusethistool,toprovidefeedback.RefineNov25th-Dec10thApplyingsolutionstoidentifiedproblems.Problemscouldexistinclarityofthe3dmodel,requiringmoredigitalassetstobegenerated.ProblemscouldexistintheintuitivenessoftheUIrequiringadjustmentstothewebpage.DeliverfinishedprojectLastdayofSemester.

MilestonesThebigmilestonesare:

- Gettingallrelevant3dassetscreated,properlyannotatedandlayedoutdiagramaticallyinthe3dmodelingsoftware.ThisshouldbecompletedbyAugust30th.

- CreatingaskeletonUIforthedigitalassetstobepluggedinto.ThisshouldbecompletedbySeptember30th

- PlugginginalldigitalassetsintotheskeletonUI.ThisshouldbecompletedbyNovember15th.

Accomplishingthese3tasks,willataminimumaccomplishwhatthelargerprojectideaisabout.Everythingelseistoaddclaritytotheprojecti.e.secondary3dgraphicsandvideos,Labelingofpartnumbersetc.

6.References

Page 15 of 16

Dozuki–StandardWorkSoftware(2019).RetrievedJuly29,2019.https://www.dozuki.com/Lynda.com–OnlineCourses,Classes,Trainings,Tutorials(2019).RetrievedJuly29,2019.https://www.lynda.com/Haynes–Showsyouhow(2019).RetrievedJuly29,2019.https://haynes.com/en-us/homeHarvardUniversityGraduateSchoolofDesign–FabricationLabTutorials.RetrievedJuly29,2019.

Safetyvisualization-https://fablabgsd.s3.amazonaws.com/lasertraining/GUND_SAFETY/index.htmlLaserfocustutorial–https://fablabgsd.s3.amazonaws.com/lasertraining/focus_ui/laser/focus.htmlLaserComponents–https://fablabgsd.s3.amazonaws.com/lasertraining/focus_ui/laser/laser.htmlDremelprintheadtutorial–https://fablabgsd.s3.amazonaws.com/3d45/3d45.html

Gartner–DigitalTwin(2019).RetrievedJuly29,2019.https://www.gartner.com/en/newsroom/press-releases/2019-02-20-gartner-survey-reveals-digital-twins-are-entering-mai

https://www.gartner.com/smarterwithgartner/how-digital-twins-simplify-the-iot/

RayL.Page.“BriefHistoryofFlightSimulation”.Report,accessedonlinefromgooglesearch.January2016.http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.132.5428&rep=rep1&type=pdfThispaperdiscussestheoriginsofsimulations.ItdiscussestheneedforsimulatedtrainingthataroseduringWW1whentraininghadtoaccommodatetrainingoflargenumbersofpeople.Ifindacademiastrugglestoadequatelytrainstudentsindevelopingskillsetstoaccomplishtasksandassignmentsgiven.Andbelievethatsimulatedenvironments,muchlikeaviationsimulationscanhelptobridgethisgap.

Page 16 of 16

NationalCenterforEducationStatistics.“VocationalEducationintheUnitedStates:TheEarly1990s”.January10,2016.http://nces.ed.gov/pubs/web/95024-2.asp

Thiswebpagediscussesvocationaleducationinthe90’s.Therelevantportionsdiscusshowstudentstakevocationalcoursesordegreeprogramstodevelopaskillsetthatcanusedtoacquireajob.Italsodiscusseshowtheskillsetisspecializedtoacertaintradeorfunction.Italsodiscussesonacursoryleveltheattempttointegrateacademiccourseswithvocationalcoursesandhowprogramsusedamethodofintegratingacademicsintoexistingcoursesratherthanrestructuringprograms.Thisleadtoincreasedcollaborationandcoordinationbetweenacademicinstructorsandvocationalteachers.Thisisrelevantinthatthistrainingwouldexistinanacademicenvironmentandattempttoimparttechnicalskillstostudentsinacademicprograms.