Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

33
World ® ’1 6 Successfully Navigating the Choppy Waters of Storage Economics Jon Toigo - Managing Principal, Toigo Partners International LLC Session # MFT89S MAINFRAME AND WORKLOAD AUTOMATION

Transcript of Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

Page 1: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

World®’16

SuccessfullyNavigatingtheChoppyWatersofStorageEconomicsJonToigo - ManagingPrincipal,Toigo PartnersInternationalLLC

Session#MFT89S

MAINFRAMEANDWORKLOADAUTOMATION

Page 2: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation

Page 3: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Abstract

ItmakesperfectsensetotalkaboutstorageintermsofdollarsandcentsandROI(aka:thebusinesscase).Butisanother“economical”hardwarerefreshtherightthingtodo?Hasyourcompanyinvestigatedwaystoleverageandmaximizeutilizationofyourexistingstorage?Confusedaboutallthestorageeconomicsmessagingwoo?

AttendthissessionanddiscoverwhatstorageexpertJonToigohastosay—notonlyaboutwaystoimprovestorageefficiencyfromatechnicalandoperationalstandpointbutalsofromabusinessefficiencyperspective.

JonToigo

ToigoPartnersInternationalManagingPrincipal

Page 4: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Agenda

STORAGEECONOMICS

IoT,MOBILECOMMERCE

OPTIONSANDTECHNOLOGY

1

2

3

SUMMARY5

TOP10BESTPRACTICES4 ELIMINATINGFRICTION,BUSINESSANDTECHNICALVALUE4

Page 5: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

StorageEconomicsIsSuddenlyonEveryone’sMind

§ Cloudfolksareworriedaboutthe“ZettabyteApocalypse”Capacityisoutstrippingsupply

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 6: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

InternetofThings…

§ 50+billionconnecteddevicesby2020– 228msmartphonesin2015

– 258mpassengercarsin2015with>100kdatapointspercar

§ “Evenifconsumeradoptionlags,bigbusinessisalloverit…”*

*TheBattleforSmartCarData,BloombergBusinessWeek,July18,2016.

GoldmanSachs,http://www.goldmansachs.com/our-thinking/pages/iot-infographic.html

CiscoSystems,http://www.i-scoop.eu/internet-of-things/

Page 7: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

MobileCommerce…

http://www.smartinsights.com/mobile-marketing/mobile-marketing-strategy/future-mobile-commerce/

• 22.14EBoforderdatajustfromsmartphones• Doesn’tcounttabletorders(already3Xgreater)• Doesn’tcountdatacreatedbySystemsofInsight• Doesn’tcountthe“StarburstEffect”

Page 8: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Thestorythusfar…

Customersincreasinglymobile,usingapps(SystemsofEngagement)toperusecatalogsandplaceorders

CustomersappsinteractwithmostlyvirtualizedSystemsofInteraction,whereincomingrequestsarereceivedandinitiallyprocessed…

OrderinformationisshuntedtoSystemsofInsightwhereBigDataanalyticsalgorithmsvalidatepurchaseandpaymentdetails,andscancustomeraccountprofilesforup-sellingopportunities…

TheHybridDataCenterinaNutshell…

Goodordersarebookedandthe“StarburstEffect”occurs:onecustomertransactionspawnshundredsoftransactionswithinbackenddatabase“SystemsofRecord”…

Theprocessrepeatsmillionsoftimespersecond…• Ownersgetrich• Customerssaynicethingson

socialmedia• Businessthrives• Everyoneliveshappilyever

after…

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 9: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

TheDigitalDemocracy

• UCBerkeleystarteditallwiththeirHowMuchInformationstudyin2000,updatedin2003• Notedthattraditionallyanaloginformationwasbeingconvertedororiginatedin

digitalform• Estimatedtotalvolumeofdigitaldatain2000wasunder3Exabytes,whichhad

grownto5Exabytes in2002• IDC(backedbyEMC)tookoverestimatingthesizeoftheDigitalUniverse

• In2014,IDCestimatedthatthe4.4Zettabytesofdigitalinformationwouldgrowto44Zettabytesby2020

• Datathatwouldbeusefuliftaggedandanalyzedconstitutes37%ofalldata,butlessthan1%iscurrentlytaggedoranalyzed

• Moreover,lessthan45%ofthedigitaluniverseisprotected:formostdata,thereisnocopy

Page 10: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Capacitydemandwillshortlyoutstripsupply…Co

pyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 11: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

WhatHastheCloudFolksWorriedCapacitygapandcost

§ Industrialcloudprovidersalreadyconcernedabouthosting10-60ZBs– Hugeprofitpotentialforstorageas

aservice,but– Wheretofindcapacity?

§ Totalflashindustryoutput~500EBsofcapacityannually

§ Totaldiskindustryoutput~780EBsannually

– Inadequatetohandleburgeon;talking“CapacityGap”

Source:MicrosoftAzure,https://tapepower.fujifilmrmd.com/pdf/static/2015/ogus.pdf

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 12: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

IntheDataCenter,CapacityDemandIsGrowing

§ Leadinganalystshavemodifiedprojectionstoreflectchangesininfrastructureplatformchoices…

ByHowMuchAnnuallyisaMatterofSomeContention

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 13: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ServerVirtualizationDrivingCapacityDemand

§ StateofITInfrastructurein2016

Consolidatingservercomputinginfrastructure…

http://www.serverwatch.com/server-news/server-virtualization-market-is-peaking-gartner.html

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 14: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

VirtualizationDrivingConvergence/Hyper-Convergence

§ Software-DefinedStorageisalltherage…

Anefforttobringmainframe“multi-tenancy”tox86…thehardway

SDSabstractsvalue-addsoftwareservicesawayfromstoragecontrollerandinstantiatesservicesinaserver-sidesoftwarestack…likemainframeSMSc.1993

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 15: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Hyper-ConvergenceNotEntirelyWithoutMerit

§ “Atomicunitsofcompute”

§ Adoptedbysmallcompaniesandbymanyusersofbigdataanalyticsclusters

§ Benefits…anddrawbacks…abound

Infrastructurebythe“pizzabox”

Page 16: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DrawbacksintheFormofInfrastructureUtilizationWhilesomebenefitsseen,moreimportantinefficienciesexistandgrow

Source:Gartner,ITKeyMetricsData2016:KeyInfrastructureMeasures:StorageAnalysis:MultiyearPublished:14December2015

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 17: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Plus,ItIsEncouragingStrangeIdeas

§ Huh?!?

Likeabandoningtieredstorageforflatandfrictionlessstoragearchitectures

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 18: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Whywouldyoudosuchathing?

§ Tiering isintendedtoreducestoragecostsbyconstantlymigratingolderdatatolessexpensiveformsofstoragethatarebettersuitedtodatausagecharacteristics…

§ So“daybeforeyesterday”!

Isn’ttiering important?

http://www.horison.com/OracleTieredStorageTakesCenterStage.pdf

BackofEnvelopeMath

1Petabyte(PB)ofStorage• UsingonlyTier00:$1.5M• UsingonlyTiers1and2:$1M• UsingTiers0-3:$587

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 19: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Answer:ToEliminateAllFriction!

§ “Datamovementequalsfriction.”

§ “Frictionequalslatency.”

§ “Latencyisbad.”

§ “Therefore,friction(anddata

movement)arebad.”

§ Oh,andtiering ishardwork.

Interesting,ifmisguided…

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 20: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Howtopreserve/protectdataina“friction-less”infrastructure?

§ “Shelterinplace.”

§ Whenstoragenodeisfilledwithdatathatisnotaccessedorupdated,justpowerdownthedrive.Thenjustaddmorenodes.

§ Voila! Instantarchive,instantdatapreservation…

§ (PlayswellwiththeAFAcrowd.)

Youdon’t.

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 21: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

MightWorkforGradStudentsinaHighPerformanceComputingLab…

§ Asarule,storageisasignificantCAPEXexpense– Between33and70centsof

everydollarspentonhardwaredependingontheanalystoneconsults

– Backofenvelopemath

Butinmostcommercialdatacenters,notsomuch…

Workloadmustbeknown.Rewriterateof1xper3.5yearsdoublescost

24TBHAMRdiskspromisedby2020

butmoreexpensivethanPMRHDDs

Notoptimizedforfastwritesorfrequentfile

update

Source:MicrosoftAzure,https://tapepower.fujifilmrmd.com/pdf/static/2015/ogus.pdf

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 22: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Disk-basedstorageremainsdominantinMFdatacenter

§ Disk-basedDASDcosts~$30/GB1

– 3390-3volumeis~2.83GBofstorage– Costtoacquire,$84.90(notincludingmaintenance,environmentalcosts)

§ ManagingDASDstorage(archive,included)requirestimeand

money,butmakesdollarsandsense– Storagecleanuppracticesrequires8hoursforsix3390-3volumes– Systemsprogrammerscostroughly$90,000peryearso$53perhouror

$424tocleanupsixDASDvolumes– Cleanuptakeslongerifyouaredoingfilereorganization,andalsoarchiving

anddeletingfiles

§ Valueofreclaimedstorageis$840:Cheaperthanbuyingnew.

Simplecostmodelforwell-managedDASD

1JeffShoup,MainframeProductLeader,Ensono,https://www.ensono.com/insights/does-anyone-actually-manage-mainframe-storage-anymore

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 23: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ThePushisOnforMainframeFlashSystems

§ Nothingagainstall-flasharrays(AFA)but– Yourmileagewillvaryintermsoflatencyreduction– Businessapplicationsneedtobedesignedtotakefull

advantage– Maintenanceisnotnecessarilyeasierwithflashvsdisk

§ SimpletruthisthereisnotenoughproductioncapacityforflashordisktomeettheZettabytewave(ortheportionthatwillswampyourdatacenter)

§ Onlytapecanpossiblyfillthevoid

TheAll-SiliconDataCenteristheshinynewthing

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 24: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

TapeIsIdeallySuitedforArchiveWhereupto80%ofyourdatawillultimatelyreside…

Between40-60%ofdataintapelibraries,off-sitevaults:Archive,fixedcontent,compliance,referencedata

Between20-25%ofdatainmidrangearraysfeaturingSASandSATA:Vital,sensitive,businessimportantdata

Between12-20%ofdatainhighperformanceFCdiskarrays:Missioncritical,OLTP,revenuegeneratingapps

Between1-3%ofdatainSSD:I/Ointensive,responsetimecriticalhttp://www.horison.com/OracleTieredStorageTakesCenterStage.pdf

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 25: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

SolidTechnicalValueCase

§ LTO-7andEnterprisetapeareincreasinglyappreciatedasaneffectivesolutionformassfileandobjectstorage– CapacityimprovementsfromBariumFerrite(BaFe)areextraordinary

andon-going– LinearTapeFileSystem(LTFS)gatewaysaresimplifyingdatamovement

betweenflash/disktiersandtapetier– Dataaccesstimedeterminedbysizeoflibrary,numberofrobotsand

drives– frommillisecondstominutes,dependingoninfrastructure– Oncetapecartridgeisindrive,timetofirstbyteis~45seconds– Jitter-freestreamingwithtransferratesofupto750MBofcompressed

datapersecondor2.7TBofcompresseddataperhourperdrive(LTO)

§ That,plusmanageability,givestapeasolidtechnicalvaluecase

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 26: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

BusinessValueCaseIsAlsoStrong

§ Cost-containment:tape-basedstorageislesscostlytoacquireandtoownthanotherstorageinfrastructureoptions;tapefreesupexpensiveflash/diskcapacity

§ Riskreduction(downtime):tape-basedstorageprovidesdataprotectionviaanairgap,plusmediaresiliencyofupto30yearsandmuchlowerbiterrorratesthanothermedia

§ Riskreduction(investment):noriskofearlyobsolescence,backwardcompatibilityguarantees,goodrunwayfortechnology

§ Improvedproductivity:fasterdatatransfer,cloudseeding,betterstreamingratesandquality,greaterdataavailability

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 27: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

TapeArchivingCanSignificantlyReduceStorageExpenseAnditisthecheapestwaytostoredataovertime…

“The 12-year cost of energy for disk is greaterthan the entire TCO for tape over the same period:Disk is 70 times more costly than tape, based on energy cost alone.”

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 28: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PerhapsThisIsWhatIsDrivingtheTapeRenaissance

§ Asarecloudoperators

NoviceITpractitionersaregeneratinginterestintape…

• Mediacapacity,resiliencyanddurabilityaccelerating• CostperGBdeclining• Performanceandeaseofuseimproving• AirGapprotectsagainstRansomwareCo

pyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 29: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

HastyConclusions

§ Storageeconomicsstillfavorstoragetiering anddataarchiving

§ Therealcostcontainmentbenefitswillbeseenwithbetterdatamanagement(atalkfornextyear,perhaps)

§ CATechnologiesoffersnumerousproductsinitsportfoliothatcanhelptobendthestoragecostcurve:checkthemout!

Nothingmagicalaboutstoragecostcontainment…

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 30: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

30 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Questions?

• Thanks!• Pleasekeepintouch

• Email:[email protected]• Linkedin:JonToigo• Twitter:@JonToigo• Blog:DrunkenData.com• Websites:

• IT-SENSE.org• DataManagementInstitute• ToigoPartnersInternational

Copyrig

ht©

2016byth

eDa

taM

anagem

entInstitute,LL

C.A

llRightsReserved.

Page 31: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

31 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Questions?

Page 32: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Stayconnectedatcommunities.ca.com

Thankyou.

Page 33: Successfully Navigating the Choppy Waters of Storage Economics With John Toigo

33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

MainframeandWorkloadAutomation

FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI