Cloudera Enterprise Reference Architecture...Cloudera Enterprise adds layers of unification,...
6
20432 North Sea Circle, Lake Forest, CA 92630 * www.pssclabs.com * tel: 949-380-7288 * fax: 949-380-9788 Cloudera Enterprise Reference Architecture A PSSC Labs Reference Architecture Guide March 2018
Transcript of Cloudera Enterprise Reference Architecture...Cloudera Enterprise adds layers of unification,...
20432NorthSeaCircle,LakeForest,CA92630*www.pssclabs.com*tel:949-380-7288*fax:949-380-9788
ClouderaEnterpriseReferenceArchitecture APSSCLabsReferenceArchitectureGuideMarch2018
20432NorthSeaCircle,LakeForest,CA92630*www.pssclabs.com*tel:949-380-7288*fax:949-380-9788
IntroductionPSSCLabscontinuestobringinnovativecomputeserverandclusterplatformstomarket.Focusingonspecificapplicationswhereperformanceandreliabilityarecritical,highlightsPSSCLabsstrengths.TheApaceHadoopdataframeworkrequiressubstantialcomputeandstoragecapabilitiescoupledtightlytogether.ClouderaEnterpriseaddslayersofunification,securityandmanagement.PSSCLabsisthefirstmanufacturertodesignaserverplatformspecificallyforHadoop.IntroducingtheWorld’shighestdensity,lowestpowerconsuming,EnterpriseReadyBigDataserverplatformdesignedspecificallyforHadoopworkloads.TheCloudOOP12000offerstheabsolutehighestpossiblecomputeandstoragedensitycombinedwithhighperformanceDataIOthroughput.PSSCLabsalreadydeliverstheCloudOOP12000forsmallPOCtolargeproductionclustersspanninghundredsofnodes.Todate,over100PB+ofHadoopstoragehasbeendeployedontheCloudOOP12000.
KeyFeatures:
• ReduceDataCenterFootprintBy50%• ReducePowerConsumptionBy40%• Nearly50%GreaterDataIORates• PatentPendingToolFreeMaintenance
TechnicalSpecifications:• Upto12x3.5”SATAIIIor14xSSDsin1URackSpace
o 120TBusingtwelvex10TBHardDriveso Optional2xNVMeSSDs
• SupportsUPto2xIntel®Xeon®ScalabeProcessors• SupportsUpto5112GBECCEnterpriseMemory• 10GigE,40GigE,100GigE&InfinibandNetwork
Support• RedHat®,CentOS,Ubuntu,MSWindows®Compatible
20432NorthSeaCircle,LakeForest,CA92630*www.pssclabs.com*tel:949-380-7288*fax:949-380-9788
CloudOOP12000SampleConfigurationsEveryorganizationorusecaserequiresdifferentcomputingneeds.TheCloudOOP12000offersthegreatestflexibilitypossible.Belowarethreedifferentproposedarchitecturesfordifferentworkloads:highdensitystorage,highcomputationalrequirementsandabalancedconfiguration.
CloudOOP12000HighDensity
• 72TBTotalStorage• 20XeonScalableCPUCores• 128GBECCMemory• 2x10GigENetworkPorts• 2xGigENetworkPorts• RemoteIPMIManagement• CentOSLinuxOS• PowerDrawEstimate215WattIdle/275WattFullLoad
CloudOOP12000HighCompute
• 24TBTotalStorage• 40XeonScalableCPUCores• 512GBECCMemory• 2x10GigENetworkPorts• 2xGigENetworkPorts• RemoteIPMIManagement• CentOSLinuxOS• PowerDrawEstimate265WattIdle/380WattFullLoad
CloudOOP12000Balanced
• 48TBTotalStorage• 24XeonScalableCPUCores• 256GBECCMemory• 2x10GigENetworkPorts• 2xGigENetworkPorts• RemoteIPMIManagement• CentOSLinuxOS• PowerDrawEstimate230WattIdle/315WattFullLoad
ASampleofOrganizationsCurrentlyUsingPSSCLabsCloudOOP12000Servers
20432NorthSeaCircle,LakeForest,CA92630*www.pssclabs.com*tel:949-380-7288*fax:949-380-9788
CloudOOPRAX:ClouderaEnterpriseValidatedTurnKeyClusterPSSCLabsoffersacomplete,turn-keyclusterthatisreadytorunondelivery.PSSCLabsunderstandseverythingthatisnecessaryforasuccessfuldeployment.Allnecessaryhardwareincludingservers,networkequipment,powerandinfrastructureareincluded.PSSCLabsClusterEngineerspreconfigurenetwork,storage,operatingsystemandBIOSsettingstotheenduser’sspecifications.ClouderaEnterpriseisinstalledatPSSCLabsfactory.Thefinalstepistherunningofsampledatasetstoensureproperfunctionalityandperformance.BelowisanoverviewofeachdifferentserverplatformPSSCLabsoffersforClouderaEnterpriseturn-keydeployments.Dependingonthecomplexityoftheenvironment,somesoftwareresourcescanbeinstalledondifferentserverplatforms.CLOUDOOP12000DATANODE
TechSpecs KeyFeatures SoftwareResource
o 1UHighDensityFormFactoro 2xIntel®ScalableProcessorso 12xSATAIIIorSASHardDrivesor14xSSDs
o 24TBto120TBStorageo 64GBto512GBECCMemoryo 2xGigENetworkAdapterso Optional10GigE,40GigE,InfinibandSupport
o DedicatedIPMI/iKVM
o EnterprisePlatformo RedundantPowerSupplyo ImprovedDataIOThroughputo 40%ReductioninPowerConsumption
o 2xtheDensityofStandardServer
o FlexibleConfigurationOptionso 3YearWarrantyIncluded(24x7x365NBDAvailable)
o DataNodeDaemono GangliaMonitoro RegionServero NodeManagero Supervisor
CLOUDSEEK1000xRMANAGEMENTNODE(NAMENODE&SECONDARYNAMENODE)
TechSpecs KeyFeatures SoftwareResources
o 2xIntel®Xeon®ScalableCPUso 1TBto24TBSATAIII,SAS,SSDHardDrives
o 64GBto512GBECCMemoryo 2xGigENetworkAdapterso Optional10GigE,40GigE,InfinibandSupport
o DedicatedIPMI/iKVM
o EnterprisePlatformo RedundantPowerSupplyo RedundantStorageo RaidLevels0,1,5,6,10,50o FlexibleConfigurationOptionso 3YearWarrantyIncluded(24x7x365NBDAvailable)
o AppTimelineServero DRPCServero GangliaMonitoro HDFSCliento NameNode/SecondaryNNo OozieServer/Cliento YarnCliento ZookeeperServer/Cliento HDFSCliento MySQLServer
20432NorthSeaCircle,LakeForest,CA92630*www.pssclabs.com*tel:949-380-7288*fax:949-380-9788
CLOUDSEEK1000xREDGENODE
TechSpecs KeyFeatures Resources
o 2xIntel®Xeon®ScalableCPUso 1TBto24TBSATAIII,SAS,SSDHardDrives
o 64GBto512GBECCMemoryo 2xGigENetworkAdapterso Optional10GigE,40GigE,InfinibandSupport
o DedicatedIPMI/iKVM
o EnterprisePlatformo RedundantPowerSupplyo RedundantStorageo RaidLevels0,1,5,6,10,50o FlexibleConfigurationOptionso 3YearWarrantyIncluded(24x7x365NBDAvailable)
o HiveServer/Cliento TezCliento Nimbuso NagiosServer
CLOUDOOPRaxTurn-KeyClusterSampleConfigurationsHDPRax150
• 150TBTotalStorage• 2NameNode• 6DataNodes• 120XeonScalableCPUCores• 768GBECCMemory• 10GigENetworkBackplane• RemoteIPMIManagement• CentOSLinuxOS• HDPInstallationService• HDPValidationService
HDPRax500
• 500TBTotalStorage• 2NameNodes• 1EdgeNode• 12DataNodes• 240XeonCPUCores• 1536GBECCMemory• 10GigENetworkBackplane• RemoteIPMIManagement• CentOSLinuxOS• HDPInstallationService• HDPValidationService• Rack&RollService
HDPRax1500
• 1500TBTotalStorage• 2NameNodes• 1EdgeNode• 30DataNodes• 600XeonScalableCPUCores• 3840GBECCMemory• 10GigENetworkBackplane• RemoteIPMIManagement• CentOSLinuxOS• HDPInstallationService• HDPValidationService• Rack&RollService
“We believe strongly in our ability to deliver thehighest performance, highest reliability serverplatforms to Cloudera end users. Our experiencedeliveringclustersrangingfromseveralhundredTBstoseveraldozenPBs ensuresa successfulClouderaEnterprisedeployment.”
LarryLesserPSSCLabs,CTO
20432NorthSeaCircle,LakeForest,CA92630*www.pssclabs.com*tel:949-380-7288*fax:949-380-9788
TotalCostofOwnershipComparisonPSSCLabsgoalistooffersolutionswiththeabsolutelowesttotalcostofownership.Thebelowchartcomparesdifferentservermanufacturer’ssolutionfora1Petabyte(raw)Hadoopenvironment.PSSCLabsCloudOOPRax1000requires50%lessrackspaceandconsumes40%lesspower PSSCLabsCloudOOPRax
1000for1PBTotalStorageSpace
DellConfigurationfor1PBTotalStorage
HPConfigurationfor1PBTotalStorage
LenovoConfigurationfor1PBTotalStorage
RequiredDataCenterFootprint
Singlex42URack Twox42URack Twox42URack Twox42URack
PowerConsumptionEstimate*
4300WattsTotal@Idle5500WattsTotal@Load
5800WattsTotal@Idle8500WattsTotal@Load
6000WattsTotal@Idle8800WattsTotal@Load
5700WattsTotal@Idle8700WattsTotal@Load
RequiredPowerCircuits
Twox30Amp/208V/SinglePhase
Fourx30Amp/208V/SinglePhase
Fourx30Amp/208V/SinglePhase
Fourx30Amp/208V/SinglePhase
Pre-installationandValidationofClouderaEnterpriseatFactory
Yes.ClouderaEnterprisepreinstalledandtested.
No.Additionalservicesandfeesrequired.
No.Additionalservicesandfeesrequired.
No.Additionalservicesandfeesrequired.
OnsitePhysicalInstallation
Yes.Clusterarrivespre-racked,cabledandlabeled.
No.Additionalservicesandfeesrequired.
No.Additionalservicesandfeesrequired.
No.Additionalservicesandfeesrequired.
ClusterManagementTraining
Yes. No.Additionalservicesandfeesrequired.
No.Additionalservicesandfeesrequired.
No.Additionalservicesandfeesrequired.
DedicatedRemoteMonitoringCapabilities
Yes.IPMI2.0NetworkStandard
Yes. Yes. Yes.
HardwareWarranty 3YearNBDServiceAvailable.
3YearNBDServiceAvailable.
3YearNBDServiceAvailable. 3YearNBDServiceAvailable.
*Dell,HPandLenovopowerestimatesbasedonmanufacturerswebsitepowerdrawestimates.
