LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin...
Transcript of LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin...
![Page 1: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/1.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
11 APRIL 2018MUNICH, GERMANY
KristenPudenzSeniorQuantumApplicationsEngineer
LOCKHEED MARTIN SITE UPDATE
![Page 2: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/2.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
THE USC-LM QUANTUM COMPUTING CENTER
Dr.EdwardH.“Ned”AllenChiefScientistandLMSeniorFellowLockheedMartinCorporation
UniversityofSouthernCaliforniaInformationSciencesInstituteMarinadeRey,California,USA
GregTallantProgramManagerandLMFellow
LockheedMartinAeronauticsSkunkWorks
![Page 3: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/3.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
QUANTUM APPLICATIONS TEAM
KristenPudenz,Ph.D.QuantumApplicationsQuantumErrorCorrection
SteveAdachi,Ph.D.QuantumMachineLearningLMFellow,SpaceSystems
JuliaKwok,M.E.E.QuantumGraphColoringClassicalOptimization
ChrisElliott,Ph.D.QuantumEnabledV&V15+YearsofFlightControlDevelopment
PeterStanfill30+YearsofFlightControl
Development
![Page 4: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/4.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
CENTER HISTORY AND TIMELINE• Early2010- LMidentifiedquantuminformationscienceasa
highpotentialtechnologytoaddresscriticalneeds
• Nov2010- PurchasedaccesstimeandsupportforDW-1Rainierquantumannealer fromD-WaveSystems
• Mar2011- FormedpartnershipwithUSC/ISItohostDW-1andestablishcollaborativeQCCenter
• Jan2012- USC-LMQCCenterOperational
• Mar2013– Completedupgradeto512-qubitDW-2Vesuviusprocessor
• Feb2016– Completedupgradeto1000+-qubitDW-2XWashingtonprocessor
MarinadelRey,CA
photo creditFatemeh Kashfi.
DW-1Rainier
DW-2Vesuvius
![Page 5: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/5.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
MACHINE LEARNING: CONNECTION PRUNING EXPERIMENT• Question:HowmuchqubitconnectivityisneededforMachineLearning?
• RestrictedBoltzmannMachine(RBM)caninprinciplebeafullbipartitegraph
• WeknowwecanachievegoodMachineLearningperformanceusingfullbipartiteRBMs
• D-Wave“Chimera”graphcorrespondstoaLocallyConnectedBoltzmannMachine(LCBM)
• EvidencesuggestssuchLCBMsaretoosparseforgoodMLperformance
• IstheresomeintermediaterangeofsparsitythatisrealizableonQAhardware,yetstillgives
goodMLperformance?
• CharacterizingMachineLearningapplicationneedsforqubitconnectivitymayhelptoinformQEOarchitecturedesign
• Startwithanalready-trained,fullbipartiteRBM
• Defineacutoff! andpruneconnectionswith "#$ < !• MeasureaccuracyoftheprunedRBMonthetraining/testset
• KeepincreasingCandobservehowaccuracydeteriorates
![Page 6: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/6.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
EXAMPLE DEEP BELIEF NET• Coarse-grained”MNIST(CG-MNIST)
• Eachtraining/testimageconsistsof32superpixels
• Modeledusing(32,32,32,10)DeepBeliefNet
• Inputlayerwith32nodes
• 2hiddenlayerswith32nodeseach
• Outputlayerwith10nodes
• RBMlayers
• Layer1=32x32RBM
• Layer2=32x32RBM
• Layer3=32x10RBM
originalimage
coarse-grainedimage
Adachi, S.H., Henderson, M.P. (2015) Application of Quantum Annealing to Training of Deep Neural Networks. http://arxiv.org/abs/1510.06356
![Page 7: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/7.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
EFFECT OF PRUNING CONNECTIONS ON ACCURACY
Inthisexample,wecanpruneoverhalfthelayer1and2connectionswithminimaldecreaseinaccuracy
![Page 8: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/8.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
WHAT DO THE PRUNED NETWORKS LOOK LIKE?
PrunedOriginal
![Page 9: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/9.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
CONNECTIVITY EFFECTS
Mostnodeshavedegreelessthanorequalto16
![Page 10: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/10.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
MOVING FORWARD• Pruningafterthefactischeating
• Doesn’ttellusbeforewetrain,whichconnectionswecandowithout
• SuggestshoweverthatwecanachievegoodMLperformancewithoutfullbipartiteconnectivity• Nextstepistotryquantum-assistedtrainingofnetworksthathavesparserconnectivityfromthestart
• CouldseeaslighttradeoffsincesparserRBMscanbeembeddedonChimerausingshorter-lengthchains• WhatkindofneuralnetworkcouldbeembeddedonPegasusarchitecture?
• Weneedtobecarefulaboutthewayinwhichquantumannealers approximatetheBoltzmanndistribution• Temperatureestimation• Othermethodsofmeasuringandcontrollingdistancebetweengatheredsamplesandidealdistribution
![Page 11: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/11.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
GRAPH COLORING• Wearepursuingagreedyapproachbasedonfindingonecolor’svertexsetatatimeonthequantum
annealer usingmaximumindependentset(MIS)orvertexcover(VC)• Thisallowsustocolorgraphsbyembeddingannvariableproblem
• Globalgraphcoloringapproachrequiresn*kvariables
• ClassicalcomputingclosestheloopformultipleMISorVCcyclestofindeachcolorsuccessively
• Findoneindependentset– thisisonecolor
• Removeindependentsetfromgraph
• Findnextindependentsetandcontinuetheloopuntilallverticesarecolored
• WeareexaminingthefullalgorithmonatestsetofparameterizedErdos-Renyi graphstofacilitatecomparisonstopreviousresultsusingtheglobalapproach
• Embeddingthegraphtobecoloredtakesmostoftheclassicalcomputetime
• Weareinvestigatingmethodsofadjustingthefirstembeddingtomakeacompactyeteasytocomputeembeddingforsubsequentsubgraphsasindependentsetsareremoved
![Page 12: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/12.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.
COLORING RESULTS• Formanygraphs,wefind
ak-coloringthatissmallerthantheoneplantedatinstancegeneration
• Wedoseesomek-coloringswithlargerthanplantedk
• Wearecurrentlyworkingonanimprovedalgorithmthatshouldhavebetterresultswithslightlymoreclassicalcomputetime
![Page 13: LOCKHEED MARTIN SITE UPDATE - D-Wave Systems report... · 2018-04-16 · Lockheed Martin Corporation University of Southern California Information Sciences Institute Marina de Rey,](https://reader030.fdocuments.us/reader030/viewer/2022041008/5eb2b3e6538fb41cf549812d/html5/thumbnails/13.jpg)
Copyright2018,LockheedMartinCorporation.Allrightsreserved.