RDBMS & WLS Consolidation with ODA X5-2

RDBMS&WLSConsolidationwithODAX5-2

Whoweare

21.11.17 Page2ConsolidationwithODAX5-2

ExpertsAtYourService>Over50specialistsinITinfrastructure> Certified,experienced,passionate

BasedInSwitzerland> 100%self-financedSwisscompany>OverCHF8mio.Turnover

LeadingInInfrastructureServices>Morethan150customersinCH,D&F>Over50SLAsdbi FlexService contracted

Aboutme


ThomasReinConsultant

OVMImplementationSpecialist

+41789016705

thomas.rein[at]dbi-services.com

OracleVM3.0CertifiedSpecialist

Agenda

1.InitialSituation

2.DesiredTarget

3.MigrationWorkflow

26.04.2015 Page4dbiservices


1

2

3

InitialSituation

> SoftwareStack> DeploymentTypes> Licensing> Problems&Difficulties

21.11.17ConsolidationwithODAX5-2 Page6

InitialSituationSoftwarestack

OS&OracleSoftware> SUSESLES11.3> JRockit Java1.6>OracleRDBMS11.2.0.3>Weblogic10.3.6>OracleIDM11.1.0.6>OracleReports11.1.2>OracleSOA11.1.0.7.0> ADF11gbasedapplication

Application Server

Database Server

SUSE Linux SLES 11.3

Java 1.6

Weblogic 10.3.6

IDM SOAPFRD ADF

Application

SUSE Linux SLES 11.3

Oracle GI 11.2.0.3

Oracle EE 11.2.0.3


InitialSituationDeploymentTypes

CurrentWeblogicSystems> 4Systemsoverall(DEV/EDU/TST/PRD)> DEV/EDUnonclustered> TST/PRDclustered> DatabaseconfiguredasRACdatabase> Severalmanagedserversfortheapplication> Applicationalwaysnonclustered(HAwithLoadbalancer)

> DB1

INFRA1

> APP1 > APP2

IDM

PFRD

SOA

ISmed ISmed

1 2 X

APPL1

> DB2

APPL2

INFRA2

TST/PRD

1 2 X

LB

> DBServer

INFRA

> APPServer

APPL

IDM

PFRD

SOA

ISmed

DEV/EDU

1 2 X2

LB



ClusteredSystemsOverview> 3DBsstretchedRAConASM> APPDatabaseabout4.5TB> INFRADatabaseabout0.5TB> DBFSDatabaseabout0.5TB> hastosupportupto2500users

TST/PRD

> ASM

Failgroup PE

> APPServer

Failgroup PU

> DBServerPE > DBServerPU

> APPServer

Loadbalancer

INFRA1

APPL1

INFRA1

APPL1DBFS1 DBFS1

IDM

PFRD

SOA

ISmed ISmed

DOCS



Hardware(WLSServers)> 2Serverswith

> 2xE5-26508CoreCPUperServer> 256GBRAM> 500GBlocalstorage

Weblogicprocesses> IDM,PFRD,SOAclustereddomainwith2managedservers> 2LDAPProcessesOID1/OID2(unmanaged)> 2Reportsserver(unmanaged)> 2ApplicationDomains> severalmanagedservers,someADF,someWebservices> Loadbalancerusedforapplication,LDAPandReportsServeraccess

P11APP101 P11APP201

Weblogic 10.3.6 Weblogic 10.3.6

IDM Domain

IDM1 IDM2Admin

PFRD Domain

PFRD1 PFRD2Admin

OID1 OID2

SOA Domain

SOA1 SOA2Admin

rep101 rep201

NM NM

ISmed Domain

Adm

in

Serv

1

Serv

2

Serv

N

ISmed Domain

Adm

in

Serv

1

Serv

2

Serv

N

Loadbalancer


DeploymentTypes

DatabaseServers> 2Serverswith

> 2xE5-26508CoreCPUperServer> 128GBRAM> 500GBlocalstorage> ASMStorageonIBMXIV(12TB)

RACDatabases11.2.0.3(stretchedcluster)> ASM2Failgroups (foreachdatacenter)> ApplicationDatabase

> SGA=24GB,PGA= 14cGB,Processes =3000> ~1500connections> Infrastructuredatabase

> SGA=10GB PGA=2GB,Processes =800> ~600connections

InitialSituation


InitialSituationLicensing

Customerhas2500NUPsfor> Database

> OracleRDBMSEnterpriseEdition> RealApplicationClusters> DiagnosticPack> TuningPack>Weblogic

> WeblogicSuite> WeblogicServerManagementPack> SOASuiteforOracleMiddleware> UnifiedBusinessProcessManagementSuite


InitialSituationProblems&Difficulties

Database> RACisnotfordisasterprotection> SomeapplicationfeaturesdonotworkwellinRAC(i.e.hotindexblocks)>NewASMVolumeshavetofollowthefailgroupdefinition> Complexmanagement&setup>Oracle11.2.0.3nolongersupported

Weblogic>WholeMiddlewareStackisonthesamemachine> Patchingofsinglecomponentsinterfereswithothercomponents> Scaleupformoremanagedserversnotpossibleduetomemoryconstraints> ProvidingnewsystemsmeansyouhavetosetupnewHW>Growthindatameansbigger/moremanagedServers


1

2

3

DesiredTarget

> Requirements> Challenges&Constraints> SolutionApproach


DesiredTargetRequirements

Database>Upgradeto11.2.0.4(12cnotvalidatedyetbythesoftwarevendor)> Provideadisastersolution> Simplifysetup&management>Migratewithsmalldowntime> ReplaceDBFS

Weblogic> Systemsshouldbevirtualized>MiddlewareStackshouldbesimplified,severalsmallmachinesinsteadofonebigmachine>UpgradingIDM,PFRD,SOAshouldnotinfluenceeachother> Providingsystemswithdifferentreleasesoftheapplicationshouldbepossible>Networksegregation(noconnectionbetweeni.e.TST/PRD)


DesiredTargetChallenges&Constraints

Database> ApplicationusesVPD,differentbehaviorin11.2.0.3/11.2.0.4(Bug 19013183&23042493)> RestorefromNetworkertakes~12hours> Don’ttouchtheoldsystems

Weblogic>Middlewarestackshouldhavethesameconfiguration/releaselevelsaftermigrationtonewsystems> Don’ttouchtheoldsystems> Keepinstallation/configurationeffortlow> DatasourcesmustchangedtoGridLinkDS


DesiredTargetSolutionApproach

BasicDecisions> use2ODAX5-2invirtualizedsetup> DisasterprotectionwithDataGuard> useNetAppasexternalStorageforDocs>WeblogicSystemsasOracleLinuxVMsonODA> SeparateVMsforIDM,PFRD,SOA,APPandWS

Datacenter1 Datacenter2

Data Guard

NFS

NetAppClusterfor Documents


DesiredTargetOracleDatabaseAppliance

ODASystemsHW>meanwhileX7isout(announcedatOOW2017)> 3SystemtypesX7-2S,X7-2MandX7-2HA>OracleDatabaseEnterpriseEditionandStandardEdition>OracleAutomaticStorageManagement>OracleASMClusterFileSystem> KVMorOVMVirtualization> Capacity-on-demandlicensing



VMDeployment> ProductionsystemsonNode0> TestsystemsonNode1> use80%MemoryandCPUforODA_BASEandVMs> ApplicationismemoryboundratherthanCPUbound(SOA/APP)

ODA1

ODA2

> Node 0 (768GB/36Cores) > Node 1(768GB/36Cores)

> Node 0(768GB/36Cores) > Node 1(768GB/36Cores)

ODABASE101 ODABASE102

ODABASE201 ODABASE202

PINFRA PISMEDKINFRA

KISMED

PINFRA PISMED

Dom 0ODA101

PAPPAMS101

PAPPWS101

PAPPSOA101

PAPPPFRD101

PAPPOID101

PAPPAMS201

PAPPWS201

PAPPSOA201

PAPPPFRD201

PAPPOID201

Dom 0ODA102

Dom 0ODA201

Dom 0ODA202

TINFRA TISMED

KINFRA

KISMED

TINFRA TISMED

TAPPAMS101

TAPPWS101

TAPPSOA101

TAPPPFRD101

TAPPOID101

TAPPAMS201

TAPPWS201

TAPPSOA201

TAPPPFRD201

TAPPOID201

KAPPAMS101

KAPPWS101

KAPPSOA101

KAPPPFRD101

KAPPOID101

EAPPAMS201

EAPPWS201

EAPPSOA201

EAPPPFRD201

EAPPOID201

28vCPU264GB

12vCPU/264GB

8vCPU/82GB

4vCPU/24GB

4vCPU/16GB

4vCPU/16GB

28vCPU264GB

12vCPU/264GB

8vCPU/82GB

4vCPU/24GB

4vCPU/16GB

4vCPU/16GB

4GB

4GB

28vCPU 264GB

28vCPU 264GB

8/196

6/82

4/24

4/16

4/16 1/8

1/8

8/196

6/64

4/24

4/16

4/16

6/96

2/32

2/12

2/8

2/8

4GB

4GB

1/12

1/12

1/44



Networkstructure>UseVLANsforNetworksegregation> allVLANsmappedtoODA_BASE(listenerforeachVLAN)> singleVLANmappedtoWeblogicVMs> allnodeshavethesameVLANsetup,sorelocationofVMspossible(Maintenance)

ODA1/Node 0

eth0 eth1

eth2

eth3

eth4

eth5

icbond0

bond0

bond1

net1

VLAN621

VLAN622

VLAN623

ODABASE101

net2

priv1 eth0

eth1

eth3

eth4

eth5

eth2

eth3.1

eth4.1

eth5.1

LI621

LI622

LI623

GATEWAYDEV=eth3


1

2

3

MigrationWorkflow

> Phases> ODASetup> Databases> Middleware> Puttingalltogether


MigrationWorkflowMigrationPhases

FourMigrationPhases> Installation(done”offline”)

> ODASetup,VMs,Network,Middleware> Configuration(needtargetdatabasesinplace)

> CreateStandbyDatabases> ConfigureIDM,PFRD,SOAandApplication(DBinsnapshotstandby)> Testing

> converttosnapshotstandby&startWeblogicVMs> Production

> switchoverdatabases&startWeblogicVMs


MigrationWorkflowODA Setup

ODASetup> ReimageODAwithBundle12.1.2.8> oakcli ib2fiber(IBwassubstituted)> oakcli configurefirstnet

> Bug23346014:ODA:OAKCLICONFIGUREFIRSTNET:"ERRORTHENODE192.168.16.25ISNOTREACHABLE”

> Interfacepriv1andicbond0usethesameip address192.168.16.24> changeetc/sysconfig/network-scripts/ifcfg-icbond0onbothnodes> oakcli deployoda_base> Install11.2.0.3.15&11.2.0.4.160719RDBMSClones> CreateVLANs(oakcli createvlan)>MapVLANstoODA_BASE(oakcli configureoda_base)> srvctl addnetwork &srvctl addlistener


MigrationWorkflowODA Setup

VMSetup> CreaterepositoriesforVMs(oakcli createrepo)> DownloadOracleLinux6.8PVMAppliance(OVA)fromEdelivery> oakcli importvmtemplate -assembly> oakcli cloneVM… -driverdomain> oakcli create vdisk (donotuse –sparse)for /u01filesystem> oakcli modify vm –attachvdisk –addnetwork to configure disk &VLAN> alsocreate aVM,which acts as LinuxRepositoryfor further package installation> yum install oracle-rdbms-server-11gR2-preinstall.x86_64


MigrationWorkflowDatabase

DEV/EDUSystems>Noneedtokeepinsyncwitholdsystems>UsedastestsystemforVPDbug>Use11.2.0.4.160719HomeonODA_BASE> oakcli createdbstorage> RMANDuplicate> alterdatabaseopenresetlogs upgrade>@?/rdbms/admin/catupgrd> adddatabase&listenertoGI


MigrationWorkflowDatabase

TST/PRDSystems> Shouldbeinsyncwitholdsystems> SplitMigrationin2steps

> MigratedatabasetoODA(11.2.0.3.15)> Upgradeto11.2.0.4.160719> oakcli createdbstorage> RMANduplicateforstandby> configureStandbymanual(noDGMGRLconfiguration)


MigrationWorkflowMiddleware

TheChallenge>Wehavetosetupandconfigure30VMs(5EDU,5DEV,10TST,10PRD)> Installation&ConfigurationforWeblogic~2dayspersystem

TheSolution> Cloneinsteadofinstalling&configuring>OracleMiddlewareprovidescopyBinary/pasteBinary forcloningtheFMWstack>UsecopyConfig/pasteConfig toclonethedomainconfigurationandforinstancecreation


MigrationWorkflowMiddleware

ClonetheMiddlewareStack>usecopyBinary.sh onsourcesystem>usepasteBinary.sh targetsystems

ClonetheMiddlewareconfiguration>UsecopyConfig.sh togetacloneofIDM,PFRD,SOAandApplicationdomains>UseextractMovePlan.sh togettheXMLmoveplanfile>AdaptDatasources,Machinesandportsinmoveplan.xml>UsepasteConfig.sh &moveplan.xml tocreateyourdomainconfigurationonthetarget>IncaseofWeblogicClusterconfigurefirstnodeandexpandtheclusterwithconfig.sh onsecondnode>ForIDMprovidenewLDAPserverswithopmnctl createcomponent


MigrationWorkflowPutting all together

Fortesting> ConvertINFRAandAPPdatabasetosnapshotstandby> Runcatpsu toupgradeto11.2.0.3.15> FakeServices(P/T)ISMED_PRIand(P/T)INFRA_PRI> Runtheapplicationmigrationscript(Directories,ACLS,etc)> StartupIDM

> oneachIDMnodeopmnctl createcomponent -componentType OID> StartPFRD,SOA,WS&AMSVMs

Forproduction> ALTERDATABASECOMMITTOSWITCHOVER…> restisthesameliketesting


MigrationWorkflowPutting all together

Performance> LoadTestdonewithHPLoadRunner>Upto4timesfasterforsomeBusinessProcesses>Mostresponsetimeslessthen0.5seconds>NoBPmorethan5seconds(Up/Downloadofdocuments)


MigrationWorkflowConclusion

> CloningMiddlewareStackisfasterthanfreshinstall> CloningDomainskeepsyourconfiguration>Minimalworkhastobedoneduringthemigration(itsonlyaswitchover)> AlltestsandWLSconfigurationscanbedoneagainstthesnapshotstandbydatabases>Migrationwasdonebetween12/2016– 04/2017

> Issueswithib2fiberduringODASetup>MissingoptiontobuildVMtemplates/assembliesonODA(buildagoldenimage)> PVMGuestscannotusehugepages bydefault(hasto/etc/grub.conf onHypervisorDocID1529373.1)> IssueswithNICs(lro/gro)needtouseethtool –KethX lro off(seeDocID2087037.1)

Anyquestions?

Pleasedoask!WewouldlovetoboostyourIT-Infrastructure

Howaboutyou?

ZürichBasel

Delémont

Nyon


Let’s meet at booth 242

Hiddenslide


DONOTDELETE!!

ThisslideisrequiredforthemacrogeneratingtheAgenda.

Itcanbedeletedoncethepresentationhasbeenexportedin> PDF> PPTX

RDBMS & WLS Consolidation with ODA X5-2

Documents

Transcript of RDBMS & WLS Consolidation with ODA X5-2