Oracle RAC 12c Database on Linux Using VirtualBox

10/16/2015 OracleRAC12cDatabaseonLinuxUsingVirtualBox

http://www.lab128.com/rac12_installation_using_vb/article_text.html 1/111

OracleRAC12cDatabaseonLinuxUsingVirtualBoxBySergeiRomanenkoOctober,2013ThisarticledescribestheinstallationofOracleDatabase12cRelease1(12.1.0.164bit)RAConLinux(OracleLinux6.464bit)usingVirtualBox(4.2.18).Highlightsofthisinstallationprocedure:

SmallestpossiblefootprintintermsofRAManddiskspacewithoutnoticeableperformancehitShortandfastwaytogetRACinstalledandrunning.Onlyrequiredoperationsincluded.Ifyoucanfindmoreefficientway,pleaseletmeknowBothASMLibandUdevshareddiskconfigurationsarecoveredGUImaximized,itisfriendlyforbeginners,savestimeforexperiencedveterans

ContentIntroductionSystemRequirementsDownloadSoftwareVirtualMachineSetupGuestOperatingSystemInstallationCheckInternetAccessOracleClusterwareInstallationPrerequisites.Part1InstallGuestAdditionsOracleClusterwareInstallationPrerequisites.Part2NetworkSetupDownloadedOracleInstallationFilesClonetheVirtualMachineCreateSharedDisksInstalltheGridInfrastructureInstalltheDatabaseSoftwareInstalltheDatabaseChecktheStatusoftheRACMakingImagesoftheRACDatabaseRestoringRACfromSavedFiles

Introduction

Bethefirstofyourfriendstolikethis

lab128388likesLikePage



ThisismysecondarticleonOracleRACinstalledinVirtualBox.ThefirstonewasaboutRACversion11g(../rac_installation_using_vb/article_text.html),whichdrewverypositivefeedbackfromreaders.Overlastyear,IbecameveryactiveuserofVirtualBox,thisisquitestablepieceofsoftwareandImovedmanyagingphysicalcomputersinmyhouseholdintovirtualmachines.AyearagoIbought16GBofRAMformylaptop(payingabout$100)andneverregrettedaboutthispurchase.Probablyitisevenmoreaffordablenow.GiventhistrendofgallopingRAMsize,theentrylevellaptopcomputerswith16GBarenotfarawayfromnow.InthisarticleImadeadjustmentsforOracle12candlatestVirtualBoxversions.Somestepswerestraightenedordroppedmakinginstallationof12cslightlyeasierthan11g.Yourfeedbackiswelcome,ithelpstomakethewholeproceduresimplerandfaster.

IfyouwanttogetthroughallstepsoftheOracleRACinstallationandyourlaptopordesktopcomputerhas8GBormoreofRAM(16GBisrecommended),thenthisisentirelyfeasibleusingOracleVirtualBoxasdemonstratedinthisarticle.YoucangetarunningRACsystemwhichcanhostasmalltestdatabase.Thecreatedsystemisnot,andshouldnotbeconsidered,aproductionreadysystem.It'ssimplytoallowyoutogetusedtoinstallingandusingRACandtestvariousadministrationprocedures.ThearticlealsoexplainshowtosavetheimagesandrestoreRACfromtheimagesinamatterofminutes.Evenifyoubreakyourtestsystem,itwillbeeasytorestore.

Thisarticleusesthe64bitversionsofOracleLinux,version6.4,andOracle12cRelease1,version12.1.0.1.0.UsingVirtualBoxyoucanrunmultipleVirtualMachines(VMs)onasingleserver,allowingyoutorunbothRACnodesonasinglemachine.Inaddition,itallowsyoutosetupsharedvirtualdisks.Thefinishedsystemincludestwoguestoperatingsystems,twosetsofOracleGridInfrastructure(Clusterware+ASM)andtwoDatabaseinstancesallonasingleserver.

SystemRequirements8GBofRAM44GBoffreespaceontheharddisk+stagingareaforOracleLinuxandRACdownloads,about9GBThisprocedurewastestedon64bitWindows7.ThesuccessfulinstallationwasalsoreportedonMacBookPro2011,8GBRAM,withOSX10.8.5(MountainLion)andVirtualBox4.2.18thankstoRudreshRanawhosharedthisinformation.ItshouldbenoproblemusingVirtualBoxonotherHostOSes.PleaseletmeknowifyouhadsuccessorproblemsinotherOSes



DownloadSoftwareDownloadthefollowingsoftware.

OracleLinux(http://edelivery.oracle.com/linux)OnceintheOracleCloudservice,select"OracleLinux"and"x8664bit".Thenclickonrelease(6.4.0.0.0)anddownloadOracleLinuxRelease6Update4forx86_64(64Bit)V3708401VirtualBox(http://www.virtualbox.org/wiki/Downloads)(thelatestavailableversion4.2.18wasused)OracleDatabase12cRelease1(12.1.0.1.0)(http://www.oracle.com/technetwork/database/enterpriseedition/downloads/index.html)(useLinuxx8664,then"SeeAll"link).OracleDatabase12cRelease1GridInfrastructure(12.1.0.1.0)forLinuxx8664(http://www.oracle.com/technetwork/database/enterpriseedition/downloads/index.html)(useLinuxx8664,then"SeeAll"link).

VirtualMachineSetupInthisexercise,weareusingVirtualBoxinstalledon64bitWindows7.

WemustdefinetwovirtualRACnodes.WecansavetimebydefiningoneVM,thencloningitwhenitisinstalled.

StartVirtualBoxandclickthe"New"buttononthetoolbar.Enterthename"rac1",OS"Linux"andVersion"Oracle(64bit)",andthenclickthe"Next"button:



SetBaseMemoryto3072MB,thenclickthe"Next"button:



Acceptthedefaultoptiontocreateanewvirtualharddiskbyclickingthe"Create"button:



AcceptthedefaultVDItypeandclickthe"Next"buttonontheCreateVirtualHardDrivescreen:



Acceptthedefault"Dynamicallyallocated"optionbyclickingthe"Next"button:



Acceptthedefaultfilenameandsetsizeto"20G",thenclickthe"Create"button:



The"rac1"VMwillappearonthelefthandpane.Clickonthe"Network"linkontherightside:



Makesure"Adapter1"isenabled,attachedto"InternalNetwork"or"HostonlyAdapter".Thisinetrfacewillbeusedforpublicnetwork,forexample,forconnectiontotheRACdatbasefromotherapplications.Moreaboutnetworkingwillbeexplainedlater.Onthescreenshotbelow"InternalNetwork"isselectedandname"pubnet"wasgiventothisnetwork:



Thenclickonthe"Adapter2"tab.Makesure"Adapter2"isenabledandattachto"InternalNetwork".Namethisnetwork"privnet":



Thenfinallyclickonthe"Adapter3",enableit,andattachto"BridgedAdapter"or"NAT".Thisadapterwillbeusedforinternet.Thenpress"OK"button:



Optionally,youcandisabletheaudiocardusing"Audio"link.Thiswillprobablysavesomeamountofspaceandavoidpotentialproblemsrelatedtoaudiosettings.Alsoifyoursystemhas4CPUcoresormore,itwillmakesensetoallocate2CPUstotheVirtualMachine.Youcandothatin"System"settings.

Thevirtualmachineisnowconfiguredsowecanstarttheguestoperatingsysteminstallation.

GuestOperatingSystemInstallationPleasenotethatduringinstallationVirtualBoxwillbekeepingthemousepointerinsideVMarea.Toexit,pressRightControlkeyonthekeyboard.

WewilluseOracleLinux6.4ISOimagedownloadedearlier.Placethe.isofileintothevirtualDVD.Select"Storage"linkontherighthandpaneoftheVirtualBoxManagerscreentoopen"Storage"screen.ThenselectDVDdriveinthe"StorageTree"section:



In"Attributes"sectionclickontheDVDdiskiconandchooseDVD.isofile.NotethatnameofthefileshowsintheStorageTree.Thenpress'OK":



Startthevirtualmachinebyclickingthe"Start"buttononthetoolbar.TheresultingconsolewindowwillcontaintheOracleLinuxbootscreen.Proceedwiththe"Installorupgradeanexistingsystem":



Donotperformthemediatest.Choose"Skip"button:



ContinuethroughtheOracleLinuxinstallationasyouwouldforanormalserver.OnnextthreescreensselectLanguage,Keyboard,andBasicStorageDevicestype.Confirmtodiscardanydata.

Note.Forthissandboxsetupweuseddomainname"localdomain".Youcanchangeit,butkeepinmindtomakesamechangethroughoutthisexercise.

Set"Hostname"torac1.localdomainandpress"ConfigureNetwork":



IntheNetworkConnectionsscreenselect"Systemeth0"interface,whichwillbeusedforpublicnetwork,andpress"Edit":



Makesurethat"Connectautomatically"ischecked.Select"IPv4Settings"tabchangeMethodto"Manual"Press"Add"andfillAddress:192.168.56.71Netmask:255.255.255.0Gateway:0.0.0.0.Press"Apply"thendone:

IntheNetworkConnectionsscreenselect"Systemeth1"interface,thiswillbeusedforprivatenetwork,thenpress"Edit".Thencheckthebox"Connectautomatically".Select"IPv4Settings"tabchangeMethodto"Manual".Press"Add"andfillAddress:192.168.10.1Netmask:255.255.255.0Gateway:0.0.0.0.Whendone,press"Apply":



Finallyselect"Systemeth2"interface,thiswillbeusedforInternet,thenpress"Edit".Checkthebox"Connectautomatically".Select"IPv4Settings"tabmakesuretheMethodissetto"Automatic(DHCP)".Press"Apply"button:



CloseNetworkConnectionsscreenandproceedtonextsetupscreen.SelecttimezoneTypeinRootPassword:oracle

Select"UseAllSpace"typeofinstallationandcheck"Reviewandmodifypartitioninglayout":



Editsizeoflv_swapdeviceto1700MBtheneditsizeoflv_rootto18276MB.Press"Next":



Confirmthroughwarningsandcreatepartitions.KeepdefaultsinBootloaderscreen.

Inthesoftwaretypeinstallationscreenselect"DatabaseServer"andcheck"Customizenow"button.PressNext:



IntheCustomizationscreenselect"Databases"anduncheckallitemsselect"Desktops"andcheck"Desktop"and"GraphicalAdministrationTools"thenpressNextandfinishinstallation.Reboot.

Whenitcomesback,therewillbemoresetupscreensobvioustohandle.Don'tcreate'oracle'account,thiswillbedonelater.YoucanskipKdumpsettings.Congratulations!TheLinuxhasbeeninstalled.

Tip.WewillneedtotouseTerminalprogram(MainMenu|Applications|SystemTools|Terminal)veryoften.YoucansavetimebyaddingTerminalicontothePanelorDesktop.RightclickonTerminalmenuitemandselecteither"Addthislaunchertopanel"or"Addthislaunchertodesktop".



CheckInternetAccessWewillneedInternetaccessbecauseadditionalpackageswillbeinstalledonline.Openterminal(Mainmenu|Applications|SystemTools|Terminal)andtrytopinganyInternetsite,forexample:

pingyahoo.com

Ifpingdoesn'twork,troubleshoottheproblemusing'ifconfig'commandandmakingchangesinNetworkConnections(LinuxdesktopMainmenu|System|Preferences|NetworkConnections).IfyoumadechangesinNetworkConnections,restartinterfacebyrebootingVMorrunningthesetwocommands:

#ifdowneth2#ifupeth2

Thencheckthepingagain.

OracleClusterwareInstallationPrerequisites.Part1Allactionsinthissectionmustbeperformedbytherootuser.



Install'oraclerdbmsserver12cR1preinstall'package.ThispackageperformsprerequisitesincludingkernelparameterchangeandcreationofLinuxoracleaccount:

#yuminstalloraclerdbmsserver12cR1preinstall

Note.Probablyyouwillnotbeabletopasteandcopythiscommand.Soyouwillhavetotypeitmanually.WearegoingtofixthatshortlybyinstallingGuestAdditions.Fornowjusttypethosecommands.

AnotherNote.Whileusing'yum'sometimesIhaveseenthiserror:"Existinglock/var/run/yum.pid:anothercopyisrunningaspid523.Anotherappiscurrentlyholdingtheyumlockwaitingforittoexit...".Whenthishappened,Iwasinterruptingthiswaitwith'CtrlC'andthenkillingreportedprocess,inthisexample523:'kill523'.Afterthat,nextrunofyumwasalwaysOK.

TherearetwopreferredwaystomakeshareddrivesvisibletoASM:UdevandASMLib.Youhavetochoosebetweenthem.Thereareprosandconsofoneoranotherway,youcanfinddiscussionsonthistopicinInternet.Ifyoudon'tcareandonlyinterestedinhavingRACinstalled,chooseASMLibbecauseitiseasieranduseslessofOSresources,whichismoresuitableforthelaptopsetup.NexttwoactionsshouldbedoneifASMLibisselected.SkipthemifyoudecideonUdevway.

1.InstallASMLib:

#yuminstalloracleasm#yuminstalloracleasmsupport

2.ConfigureASMLibrunningthiscommandandansweringquestions:

#oracleasmconfigureiConfiguringtheOracleASMlibrarydriver.

ThiswillconfiguretheonbootpropertiesoftheOracleASMlibrarydriver.Thefollowingquestionswilldeterminewhetherthedriverisloadedonbootandwhatpermissionsitwillhave.Thecurrentvalueswillbeshowninbrackets('[]').Hittingwithouttypingananswerwillkeepthatcurrentvalue.CtrlCwillabort.

Defaultusertoownthedriverinterface[]:oracleDefaultgrouptoownthedriverinterface[]:oinstallStartOracleASMlibrarydriveronboot(y/n)[n]:yScanforOracleASMdisksonboot(y/n)[y]:WritingOracleASMlibrarydriverconfiguration:done#



Tip.Wewillneedtoeditconfigurationfiles.Ifyouarenotfamiliarwith"vi"editororpreferGUIeditor,install"gedit":

yuminstallgedit

Forexample,toedit"/etc/hosts"file,usethiscommand:"gedit/etc/hosts".

InstallGuestAdditionsGuestAdditionsareoptional,buthighlyrecommended.GuestAdditionsallowbetterintegrationofmousesupportandclipboardbidirectionalcopying.AnotherimportantfeatureissupportofsharedfoldersmakingfilesinHostOSvisibletoGuest.TheremainingofthisdocumentassumesthatGuestAdditionsareinstalled.

InordertoinstallGuestAdditions,rebootjustcreatedVM:Menu|System|ShutDown.Loginasroot.TheninthewindowmenuselectDevices|InstallGuestAdditions.GothroughthedownloaduntilyouseeDVDAutorunscreen:

Press"OK",then"Run"tostartinstallation.

Note.Theinstallationcanfailcomplainingonmissingkerneluekdevelpackageprovidinga'yum'commandtoinstallthispackage.Runthiscommandthat'swhyweneedInternetaccess.Alsoinstallanotherpackage:'yuminstallgcc'.ThenreinstallGuestAdditionsbydoubleclickingonVBOXADDITIONSDVDicononthedesktop,andclicking"OpenAutorunPrompt"button.

ShutdownVM.InVirtualBoxManagerwindowselect"General","Advanced"tab,andmakesurethat"SharedClipboard"issetto"Bidirectional".Restartthemachine.NowyoushouldbemuchhappieraboutVirtualBox!



OracleClusterwareInstallationPrerequisites.Part2CreatethedirectoryinwhichtheOraclesoftwarewillbeinstalled.

mkdirp/u01/app/12.1.0/grid_1mkdirp/u01/app/oraclechownRoracle:oinstall/u01chownoracle:oinstall/u01/app/oraclechmodR775/u01/

Addoracleaccounttovboxsfgroups.ThevboxsfgroupwascreatedbyVirtualBoxGuestAdditionsandwillalloworacleuseraccessfoldersintheHostOS:

#usermodGdba,vboxsforacle

Resetoracleuserpasswordtooracle:

#passwdoracleChangingpasswordforuseroracle.Newpassword:BADPASSWORD:itisbasedonadictionarywordBADPASSWORD:istoosimpleRetypenewpassword:passwd:allauthenticationtokensupdatedsuccessfully.#

Disablesecurelinuxbyeditingthe"/etc/selinux/config"file,makingsuretheSELINUXflagissetasfollows.

SELINUX=disabled

EitherconfigureNTP,ormakesureitisnotconfiguredsotheOracleClusterTimeSynchronizationService(ctssd)cansynchronizethetimesoftheRACnodes.InthiscasewewilldeconfigureNTP.



#servicentpdstopShuttingdownntpd:[FAILED]#chkconfigntpdoff#mv/etc/ntp.conf/etc/ntp.conf.orig#rm/var/run/ntpd.pid

CleanupYUMrepositories:

#yumcleanall

Checkfilesystemusage,about2.8GBisused:

#dfkFilesystem1KblocksUsedAvailableUse%Mountedon/dev/mapper/vg_rac1lv_root1842048427687241471603216%/tmpfs154458410015444841%/dev/shm/dev/sda14958447832239192217%/boot#

NetworkSetupAllactionsinthissectionmustbeperformedbytherootuser.

BelowisTCPlayoutofaddressesusedinpublicandprivatenetworks.Ifyouneedtouseanotheraddresses,makecorrespondingadjustmentsandremembertostayconsistentwiththoseadjustmentsthroughouttherestofthearticle.Pleasenotethatthesubnet192.168.56.0isadefaultconfigurationusedbytheVirtualBoxasHostonlynetworkconnectingthehostOSandvirtualmachines.TheVirtualBoxisalsorunningDHCPserveronthissubnetreservingaddressrange100254.Soitissafetouseaddressesbelow100forstaticaddresses.Youcanverifythesesettingsin:Mainmenu|File|Preferences|Network,thencheckthepropertiesoftheHostonlynetwork.WeareusingthissubnetfortheRACpublicnetwork.Evenifyoudon'tneedtoconnectfromtheHostOStotheRAC,andyouusedVB"InternalNetwork"forAdapter1,youstillcanuseproposedlayoutwithoutmakingchanges.

Edit"/etc/hosts"filebyappendingthefollowinginformation:



#Private192.168.10.1rac1priv.localdomainrac1priv192.168.10.2rac2priv.localdomainrac2priv

#Public192.168.56.71rac1.localdomainrac1192.168.56.72rac2.localdomainrac2

#Virtual192.168.56.81rac1vip.localdomainrac1vip192.168.56.82rac2vip.localdomainrac2vip

#SCAN192.168.56.91racscan.localdomainracscan192.168.56.92racscan.localdomainracscan192.168.56.93racscan.localdomainracscan

Note.TheSCANaddressshouldnotreallybedefinedinthehostsfile.InsteadisshouldbedefinedontheDNStoroundrobinbetween3addressesonthesamesubnetasthepublicIPs.Forthisinstallation,wewillcompromiseandusethehostsfile.IfyouareusingDNS,thencommentoutlineswithSCANaddresses.

WealreadysetIPaddressesofalladaptersduringLinuxunstallation.Ifyoufollowedtheinstructions,thereisnoneedtochangeanything.Butifyouneedtochangesomething,youcandosowiththeNetworkConnectionstool:LinuxdesktopMainmenu|System|Preferences|NetworkConnections.

Nowweneedtodisablethefirewall:LinuxMainmenu|System|Administration|Firewall.Clickon"Disable"icon,thenon"Apply".



DownloadedOracleInstallationFilesTherearetwooptionstohandleOracledownloads:

DownloadortransferfilesintoVManduncompresstheminVMDownloadanduncompressintheHostOS,thenmakefoldersaccessibletoVMfilesystem

Obviouslysecondoptionismuchbetterbecauseitdoesn'tusevirtualdiskofGuestVMandwillresultinsmallerfinalimage.Alsoinstallationfilescanbeeasilyreusedinanotherinstallationexercise.InthissectionwearegoingtosetupVirtualBoxSharedFolders.

Itisassumedthatyoualreadydownloadedoracleinstallationfilesanduncompressedthemintothe"grid"and"database"folders.Inourexamplethesefoldersarein"C:\TEMP\oracle_sw"folder.

C:\TEMP\oracle_sw>dirltotal0drwx+1sromanenkoDomainUsers0Aug518:10databasedrwx+1sromanenkoDomainUsers0Aug503:08grid



ShutdownVM.InVirtualBoxManagerclickon"SharedFolders"linkintherighthandpane.Addsharedfolderbypressing"plus"icon.Thenselectpathtothelocationoforaclesoftware,andcheckbothboxes"Readonly"and"Automount":

NoteYoucanuseanynamein"FolderName".Ifyouhaveoracleinstallationfilesatdifferentlocation,youcanoverwritethatnameto"oracle_sw".Thiswillmakeeasiertofollowstepsbelow.

Press"OK"tosavethissetting.NowSharedFoldersshouldlooklikethis:



RestartVMandloginasoracleuser.Changedirectoryto"/media/sf_oracle_sw"thisiswhereVirtualBoxmapsHostOSsharedfolder.NotethatVirtualBoxaddedprefix"sf_"tothenameofthefolder.List'ls'contentofthefolder:

$cd/media/sf_oracle_sw$lsdatabasegrid$

Note.Ifyouusedfoldernameotherthan"oracle_sw"whilecreatingsharedfolder,thenyouwillsee"/media/sf_"directory,pleasekeepthisinmindandmakecorrespondingadjustments.

Thereisonepackage'cvuqdisk'thatshouldbeinstalledbeforetheinstallation.InstallitfromtheOraclegrid/rpmdirectoryasrootuser:



$surootPassword:#cd/media/sf_oracle_sw/grid/rpm#CVUQDISK_GRP=oinstall;exportCVUQDISK_GRP#rpmUvhcvuqdisk*

ClonetheVirtualMachineShutdowntheVM.

IntheVirtualBoxManagerwindowstartclonewizard:Mainmenu|Machine|Clone.Type"rac2"forthenameofnewmachine.Makesurethat"ReinitializetheMACaddressofallnetworkcards"isnotchecked.Thenpress"Next":

Keepdefault"FullClone"optionselectedandpress"Clone":



StartclonedVMrac2andloginasrootuser.Thenchangehostnamebyeditingfile"/etc/sysconfig/network",HOSTNAMEparameter:

HOSTNAME=rac2.localdomain

Start"NetworkConnections"tool(Mainmenu|System|Preferences|NetworkConnections).Editeth0andeth1interfacesandsetinIPv4addresses192.168.56.72and192.168.10.2correspondingly.

Rebootsystem.

NowweneedtochangeMACaddressforallthreeinterfaces.AtthemomentwehavetwoVMswiththesamesetofMACaddresses.Wecanrunonemachineoranother,butnotbothofthematthesametimebecauseMACaddressmustbeunique.Nochangeswillbemadetorac1,wewillpickupthreenewunusedaddressesandsetthemforeth0,eth1,andeth2inrac2.Theeasiestwaytodothatistochangejustlasttwocharactersoftheaddress.Wearegoingtochangethemto'00'.Ifthelasttwocharactersarealready'00',thenchangetosomethingelse,'01',forexample.Justmakesurethattheseaddressesdon'tcollidewiththeMACaddressesofrac1.Inrunningrac2node,open"NetworkConnections"andeditMACaddressinthe"Wired"tab.ThescreenshotbelowshowswheretosetMACaddress.Don'tforgettochangeMACaddressesforallthreeinterfaces.PleasenotethatyoursetupwillhaveadifferentsetofMACaddressesbecausetheyarerandomgeneratedbyVirtualBox.



WritedownthenewMACaddressesforallthreeinterfaces.Savenewsettingspressing"Apply"button,thenshutdownthemachine.Aftershutdown,returntotheVirtualBoxManager,selectrac2VMandedit"Network"settings.MakesamechangestotheMACaddresses.Don'tforgettochangeMACaddressesforallthreeadapters.



Startbothmachinesandcheckthattheycanpingeachotherusingbothpublicandprivatenetwork.Forexample,onrac1:

$pingrac2$pingrac2priv

Ifyouhaveproblems,use'ifconfig'commandtochecktheconfiguration,thencorrecttheproblemusing"NetworkConnections"tool.

CreateSharedDisksShutdownbothvirtualmachines.Weneedtocreateanewvirtualdisk,changeitsattributetoShareableandaddtobothVMs.InthecurrentversionofVirtualBox,theonlywaytocreateanewdiskintheGUIisthroughthe"Storage"pageinthevirtualmachine'ssettings.Selecteitherrac1orrac2



VM,thenclickon"Storage"link.Select"SATAController"andclickon"AddHardDisk"icon.Ifnotsure,whichicontouse,sameactionisavailablethroughthepopupmenu,rightclickonthe"SATAController"andselect"AddHardDisk".

Press"Createnewdisk":

AcceptthedefaultVDItypeandclickthe"Next"buttonontheVirtualDiskCreationWizardwelcomescreen:



Select"Fixedsize"optionandpressthe"Next"button:



Changethenameandlocationofthisdisk.YoucankeepthisfileinthedefaultlocationthefolderofaselectedVM.Although,becausethisdiskisshared,itwillbebettertoputitintheparentdirectory.So,insteadof"...\VirtualBoxVMs\rac1"directory,placeitin"...\VirtualBoxVMs".Setthesizeto"4GB".Ifyouwillneedmorespace,youcanchoosethebiggersize.And,regardlessofwhatyoudecidenow,itwillbepossibletoaddmoreshareddiskstotheASMgroupaftereverythingisinstalled.



CreatethenewdiskandthisdiskwillbealreadyattachedtoVM.

Selectthisnewdisk.YouwillseeinthediskInformationthatthetypeofthisdiskis"Normal".Weneedtochangethisto"Shareable".Therewasnooptioninthepreviousdialogwindowstocreatenewdiskas"Shareable".PressOKandclosestoragesettings.IntheVirtualBoxManageropenVirtualMediaManager:(Mainmenu|File|VirtualMediaManager).SelectthisnewdiskintheVirtualMediaManager:



Clickon"Modify"iconandselect"Shareable":

AttachthisexistingdisktotheotherVMusing"Storage"page.Don'tforgettoselectcorrectcontrollerbeforeattachingthediskanduse"Chooseexistingdisk"option.



Intheendthe"Storage"sectionofbothVMsshouldbelookinglikethis:

Starteitherofthemachinesandloginasroot.Thecurrentdiskscanbeseenbyissuingthefollowingcommands.

#ls/dev/sd*/dev/sda/dev/sda1/dev/sda2/dev/sdb#

Usethe"fdisk"commandtopartitionthenewdisk"sdb".



#fdisk/dev/sdbDevicecontainsneitheravalidDOSpartitiontable,norSun,SGIorOSFdisklabelBuildinganewDOSdisklabelwithdiskidentifier0xd724aa83.Changeswillremaininmemoryonly,untilyoudecidetowritethem.Afterthat,ofcourse,thepreviouscontentwon'tberecoverable.

Warning:invalidflag0x0000ofpartitiontable4willbecorrectedbyw(rite)

WARNING:DOScompatiblemodeisdeprecated.It'sstronglyrecommendedtoswitchoffthemode(command'c')andchangedisplayunitstosectors(command'u').

Command(mforhelp):nCommandactioneextendedpprimarypartition(14)pPartitionnumber(14):1Firstcylinder(1391,default1):Usingdefaultvalue1Lastcylinder,+cylindersor+size{K,M,G}(1391,default391):Usingdefaultvalue391

Command(mforhelp):wThepartitiontablehasbeenaltered!

Callingioctl()torereadpartitiontable.Syncingdisks.#

Thesequenceofanswersis"n","p","1","Return","Return"and"w".

Oncethenewdiskispartitioned,theresultcanbeseenbyrepeatingtheprevious"ls"command.

#ls/dev/sd*/dev/sda/dev/sda1/dev/sda2/dev/sdb/dev/sdb1#

IfyoudecidedearlieronASMLibwayofexposingshareddiskstoASMthendo"CreateASMLibDisk"section,otherwisedo"UdevConfiguration"below.

CreateASMLibDiskMarkthenewshareddiskintheASMLibasfollows.



#oracleasmcreatediskDISK1/dev/sdb1Writingdiskheader:doneInstantiatingdisk:done#

Runthe"scandisks"commandtorefreshtheASMLibdiskconfiguration.

#oracleasmscandisksReloadingdiskpartitions:doneCleaninganystaleASMdisks...ScanningsystemforASMdisks...#

WecanseethediskisnowvisibletoASMusingthe"listdisks"command.

#oracleasmlistdisksDISK1#

StartanotherVMandloginasroot.CheckthattheshareddiskisvisibletoASMusingthe"listdisks"command.

#oracleasmlistdisksDISK1#

Thevirtualmachinesandshareddisksarenowconfiguredforthegridinfrastructure!Optionally,youcansavethisstateusingSimplifiedWayofSaving/RestoringImages.Pleaseskipthenextsection"UdevConfiguration".

UdevConfigurationThisconfigurationneedstobedoneonbothnodes,youcandoitstepbystepinparallelonbothnodes.

Open"/etc/scsi_id.config"file(forexample,"gedit/etc/scsi_id.config",ifthefiledoen'texist,itwillbecreated)andaddthisline:



options=g

Execute"scsi_id"filecommandfortheshareddisk.

#/sbin/scsi_idgud/dev/sdb1ATA_VBOX_HARDDISK_VBb6f0fac5f473897a

YouwillhavedifferentSCSIIDoutput.Thisidwillbeusedinudevrulesfile.Edit"/etc/udev/rules.d/99oracleasmdevices.rules"fileandaddfollowingentryasoneline.MakesureyouuseSCSIIDfromthepreviouscommand.

KERNEL=="sd?1",BUS=="scsi",PROGRAM=="/sbin/scsi_idgud/dev/$parent",RESULT=="1ATA_VBOX_HARDDISK_VBb6f0fac5f473897a",NAME="asmdisk1",OWNER="oracle",GROUP="dba",MODE="0660"

RestartVM,loginasoracleandcheckthatshareddiskcanbeexposedtoASM:

$lsal/dev/asm*brwrw1oracledba8,17Oct613:31/dev/asmdisk1

Thevirtualmachinesandshareddisksarenowconfiguredforthegridinfrastructure!Optionally,youcansavethisstateusingSimplifiedWayofSaving/RestoringImages.

InstalltheGridInfrastructureMakesurethe"rac1"and"rac2"virtualmachinesarestarted,thenloginto"rac1"asoracleuser(bettertoavoidusing"su"command,Ihadproblems)andstarttheOracleinstaller.

$cd/media/sf_oracle_sw/grid$./runInstaller

Select"Skipsoftwareupdates"option,press"Next":



Selectthe"InstallandConfigureGridInfrastructureforaCluster"option,thenpressthe"Next"button.



Selectthe"ConfigueaStandardcluster"option,thenclickthe"Next"button.



Selectthe"AdvancedInstallation"option,thenclickthe"Next"button.



SelectLanguageandgotothenextscreen.Onthe"GridPlugandPlayinformation"screen,changeClusterNameto"raccluster"andSCANNameto"racscan.localdomain",uncheck"ConfigureGNS"box,thenpressthe"Next"button.



Onthe"ClusterNodeConfiguration"screen,clickthe"Add"button.



Enterthedetailsofthesecondnodeinthecluster,thenclickthe"OK"button.

Clickthe"SSHConnectivity..."buttonandenterthepasswordforthe"oracle"user.Clickthe"Setup"buttontoconfigureSSHconnectivity,andthe"Test"buttontotestitonceitiscomplete.Thenpress"Next".



Onthe"SpecifyNetworkInterfaceUsage"screencheckthePublicandPrivatenetworksarespecifiedcorrectly.Pressthe"Next"button.



Onthe"GridInfrastructureManagementRepositoryOption"screencheck"No"andpressthe"Next"button.Confirmthisdecisiononthenextscreen.



Onthe"StorageOptionInformation"screenkeepOracleASMoptionselectedandpress"Next".



Onthe"CreateASMDiskGroup"screenclickon"ChangeDiscoveryPath"button:



IfusearlierusedASMLibconfiguration,thenenter"/dev/oracleasm/disks"(showninthescreenshotbelow).IfyouusedUdevconfiguration,thenenter"/dev/asm*".Press"OK":

Keep"DiskGroupName"unchanged.Select"External"redundancyoption.Check"/dev/oracleasm/disks/DISK1"or"/dev/asmdisk1"inthe"AddDisks"section.Whendone,press"Next".



Onthe"SpecifyASMPassword"screenselect"Usesamepasswordsfortheseaccounts"optionandtypein"oracle"password,thenpress"Next".Ignorewarningsaboutpasswordweakness.



Keepdefaultsonthe"FailureIsolationSupport"andpress"Next".



Keepdefaultsonthe"PrivilegedOperatingSystemGroups"andpress"Next".Ignorewarningonthenextscreen.



KeepsuggestedOraclebaseunchanged,andadjustSoftwarelocationonthe"SpecifyInstallationLocation"andpress"Next".



Keepsuggestedpathunchangedonthe"CreateInventory"andpress"Next".



Inthe"Rootscriptexecutionconfiguration"select"Automaticallyrunconfigurationscripts"andcheck"Userootoption",thentypepasswordoracle.Press"Next".



Theresultsofprerequisitechecksareshownonthenextscreen.Youshouldseethreewarningsandonefailure.ThefailurewascausedbyinabilitytolookupSCANinDNSandthatshouldbeexpected.Check"IgnoreAll"boxandpress"Next".



Press"Install"ontheSummaryscreen.



Waitwhileinstallationtakesplace...Whenaskedtoconfirmrootscriptsexecution,answerYes.The"rootscript"stepwasthelongestone,sobepatient!



WeexpecttheverificationphasetofailwitherrorsrelatedtolowHostRAM,SwapFilesizes,groupmismatchforDISK1,and"udevinformation".Theseerrorscanbeignored.Youcancheckerrorsopeninglogfile.Forexample,forthelogfileshownbelow"gedit/u01/app/oraInventory/logs/installActions20130930_102544PM.log",thensearchfor"Error".

Hereistheexampleofoffendinglinesfromthelogfileforrac1node:



INFO:INFO:ErrorMessage:PRVF7530:Sufficientphysicalmemoryisnotavailableonnode"rac1"[Requiredphysicalmemory=4GB(4194304.0KB)]INFO:INFO:Cause:Amountofphysicalmemory(RAM)founddoesnotmeetminimummemoryrequirements.INFO:INFO:Action:Addphysicalmemory(RAM)tothenodespecified.

...

INFO:INFO:ErrorMessage:PRVF7573:Sufficientswapsizeisnotavailableonnode"rac1"[Required=2.9462GB(3089292.0KB);Found=1.6602GB(1740796.0KB)]INFO:INFO:Cause:Theswapsizefounddoesnotmeettheminimumrequirement.INFO:INFO:Action:Increaseswapsizetoatleastmeettheminimumswapspacerequirement.

...

INFO:INFO:ERROR:[Result.addErrorDescription:618]PRVF9992:Groupofdevice"/dev/oracleasm/disks/DISK1"didnotmatchtheexpectedgroup.[Expected="dba";Found="oinstall"]onnodes:[rac1,rac2]

...

oracleINFO:INFO:ERROR:[Result.addErrorDescription:607]PRVF9802:Attempttogetudevinformationfromnode"rac1"failedINFO:NoUDEVrulefoundfordevice(s)specifiedINFO:

Providedthesearetheonlyerrors,itissafetoignorethemandcontinuebyclickingthe"Next"button.ClosetheConfigurationAssistantonthenextscreen.

Checkthestatusofrunningclusterware.Onrac1asrootuser:



#.oraenvORACLE_SID=[oracle]?+ASM1TheOraclebasehasbeensetto/u01/app/oracle

#crsctlstatusresourcetNameTargetStateServerStatedetailsLocalResourcesora.DATA.dgONLINEONLINErac1STABLEONLINEONLINErac2STABLEora.LISTENER.lsnrONLINEONLINErac1STABLEONLINEONLINErac2STABLEora.asmONLINEONLINErac1Started,STABLEONLINEONLINErac2Started,STABLEora.net1.networkONLINEONLINErac1STABLEONLINEONLINErac2STABLEora.onsONLINEONLINErac1STABLEONLINEONLINErac2STABLEClusterResourcesora.LISTENER_SCAN1.lsnr1ONLINEONLINErac2STABLEora.LISTENER_SCAN2.lsnr1ONLINEONLINErac1STABLEora.LISTENER_SCAN3.lsnr1ONLINEONLINErac1STABLEora.cvu1ONLINEONLINErac1STABLEora.oc4j1OFFLINEOFFLINESTABLEora.rac1.vip1ONLINEONLINErac1STABLEora.rac2.vip1ONLINEONLINErac2STABLEora.scan1.vip1ONLINEONLINErac2STABLEora.scan2.vip1ONLINEONLINErac1STABLEora.scan3.vip1ONLINEONLINErac1STABLE



#

Youshouldseevariousclusterwarecomponentsrunningonbothnodes.Iftherewereseriousproblemsduringinstallation,thecomponentsofclusterwarewouldn'tstart.Alsoyoucancheckclusterwarealertfile"gedit/u01/app/12.1.0/grid_1/log/rac1/alertrac1.log"(onrac1node,makeadjustmentsforrac2).

Thegridinfrastructureinstallationisnowcomplete!Optionally,youcansavethisstateusingSimplifiedWayofSaving/RestoringImages.

Checkfilesystemusage,about8.6GBareused:

$dfkFilesystem1KblocksUsedAvailableUse%Mountedon/dev/mapper/vg_rac1lv_root184204848691564879319250%/tmpfs154458464974089484443%/dev/shm/dev/sda14958447832239192217%/boot$

InstalltheDatabaseSoftwareMakesurethe"rac1"and"rac2"virtualmachinesarestarted,thenloginto"rac1"orswitchtheusertooracleandstarttheOracleinstaller.

$cd/media/sf_oracle_sw/database$./runInstaller

Uncheckthe"Iwishtoreceivesecurityupdates..."checkboxandpressthe"Next"button:



Check"Skipsoftwareupdates"checkboxandpressthe"Next"button:



Check"Installdatabasesoftwareonly"optionandpress"Next"button:



Select"OracleRealApplicationClusterdatabaseinstallation"andthenpress"Next"button.



Makesurebothnodesareselected.Presson"SSHConnectivity"enter"oracle"passwordandthenpress"Setup"button.AftertheSSHconnectivitysetupisfinished,press"Test"buttontotestit.ThenpressNextbutton.



SelectLanguageonnextscreenandpressthe"Next"button.

Accept"EnterpriseEdition"optionandpressthe"Next"button:



Acceptdefaultinstallationlocationsandpressthe"Next"button:



Acceptdefaultgroupsin"PrivilegedOperationSystemgroups"andpressthe"Next"button:



Waitfortheprerequisitechecktocomplete.Ifthereareanyproblems,eitherfixthem,orcheckthe"IgnoreAll"checkbox.Onthescreenshotbelow3warningsareshownwhicharesafetoignore.Clickthe"Next"button.



Ifyouarehappywiththesummaryinformation,clickthe"Install"button.



Waitwhiletheinstallationtakesplace.



Executerootscriptswhenpromptedonbothnodes.



#/u01/app/oracle/product/12.1.0/dbhome_1/root.shPerformingrootuseroperationforOracle12c

Thefollowingenvironmentvariablesaresetas:ORACLE_OWNER=oracleORACLE_HOME=/u01/app/oracle/product/12.1.0/dbhome_1

Enterthefullpathnameofthelocalbindirectory:[/usr/local/bin]:Thecontentsof"dbhome"havenotchanged.Noneedtooverwrite.Thecontentsof"oraenv"havenotchanged.Noneedtooverwrite.Thecontentsof"coraenv"havenotchanged.Noneedtooverwrite.

Entrieswillbeaddedtothe/etc/oratabfileasneededbyDatabaseConfigurationAssistantwhenadatabaseiscreatedFinishedrunninggenericpartofrootscript.Nowproductspecificrootactionswillbeperformed.#

Press"Close"buttonandtheOracleDBsoftwareisnowinstalled!Optionally,youcansavethisstateusingSimplifiedWayofSaving/RestoringImages.

InstalltheDatabaseStartdbcaDBConfigurationAssistant:



$cd/u01/app/oracle/product/12.1.0/dbhome_1/bin$./dbca

Accept"CreateDatabase"optionandpressthe"Next"button:

Check"Createadatabasewithdefaultconfiguration"typein"GlobalDtabaseName"thedesirednamewehaveselectedAL32UTF8characterset,makeyourchoiceasneededalsosupplyapasswordforSYS.Wearegoingtocreateareqular(pre12ctype)database,the"CreateAsContainerDatabaseisunchecked.PressNextbutton:



Waitfortheprerequisitechecktocomplete.Theonlyreportedproblemwasallfamilar"SwapSize".Check"IgnoreAll"checkboxandclickthe"Next"button.



Press"Finish"buttonintheSummaryscreen:



Clickthe"Close"buttontoexittheinstaller.



TheRACdatabasecreationisnowcomplete!

ChecktheStatusoftheRACThereareseveralwaystocheckthestatusoftheRAC.The srvctl utilityshowsthecurrentconfigurationandstatusoftheRACdatabase.

$.oraenvORACLE_SID=[oracle]?racdbTheOraclebasehasbeensetto/u01/app/oracle

$srvctlconfigdatabasedracdbDatabaseuniquename:racdbDatabasename:racdbOraclehome:/u01/app/oracle/product/12.1.0/dbhome_1Oracleuser:oracleSpfile:+DATA/racdb/spfileracdb.oraPasswordfile:+DATA/racdb/orapwracdbDomain:localdomainStartoptions:openStopoptions:immediateDatabaserole:PRIMARYManagementpolicy:AUTOMATICServerpools:racdbDatabaseinstances:racdb1,racdb2DiskGroups:DATAMountpointpaths:Services:Type:RACStartconcurrency:Stopconcurrency:Databaseisadministratormanaged

$srvctlstatusdatabasedracdbInstanceracdb1isrunningonnoderac1Instanceracdb2isrunningonnoderac2$

The V$ACTIVE_INSTANCES viewcanalsodisplaythecurrentstatusoftheinstances.



$exportORACLE_SID=racdb1[oracle@rac1Desktop]$sqlplus/assysdbaSELECTinst_nameFROMv$active_instances;

INST_NAMErac1.localdomain:racdb1rac2.localdomain:racdb2

exit$

MakingImagesoftheRACDatabaseAtanypointearlierwecouldsavetheimageofcreatedvirtualmachineandthenrestoreitatwill.HerewearegoingtosaveimagesofthenewlycreatedOracleRACsystemwhichwecanrestoreinthesamesystemorevenhandovertoanotherlocationandrestoreinamatteroffewminutes!

IfallyouneedissavingandrestoringimagesinthesameVirtualBoxsetup,youcanuseSimplifiedWayofSaving/RestoringImages.

TheexportofVMisastraightforwardprocessandsavingRACimageswouldbeaneasytaskifnotdealingwiththeshareddisk.Inmyviewthesimplestwaytohandlethatisbydetachingshareddiskfrombothnodesandtakingcareofthesethreeparts(twoselfcontainedVMsandoneShareddisk)separately.Intheendtherewillbethreefiles:twofilesforVMsandafilerepresentingtheshareddisk.Thesethreefilescanbefurtherzippedbyyourfavoritearchiverintoonefilewhichcanbeusedforstorageortransfer.Afterexportisdone,theshareddiskcanbeeasilyattachedbacktothenodes.SameistruefortheimportofVMsbackintoVirtualBoxalongwiththecopyofshareddisktheshareddiskisattachedtotheimportedVMsasanextrastep.Let'sperformalltheseactions.

CleanShutdownofRACButfirst,weneedtoshutdownserversinniceandcleanmannerbecausewewantsavetheminarobuststate.Shutdownthedatabase.Asoracleuserexecuteonanynode:


$srvctlstopdatabasedracdb$

Shutdowntheclusterwareonthefirstnode.Asrootuserexecute:



#.oraenvORACLE_SID=[racdb1]?+ASM1TheOraclebaseremainsunchangedwithvalue/u01/app/oracle

#crsctlstopcrs...CRS4133:OracleHighAvailabilityServiceshasbeenstopped.#

Shutdowntheclusterwareonthesecondnode.Asrootuserexecute:

#.oraenvORACLE_SID=[racdb1]?+ASM2TheOraclebaseremainsunchangedwithvalue/u01/app/oracle

#crsctlstopcrs...CRS4133:OracleHighAvailabilityServiceshasbeenstopped.#

Shutdownbothvirtualmachines.WaituntilallVMwindowsareclosed.

DetachSharedDiskandMakeaCopyOfItIntheVirtualBoxManageropenVirtualMediaManager:Mainmenu|File|VirtualMediaManager.ThenselectthediskusedbytheRAC(rac_shared_disk1.vdi).Notethatthisdiskshowsasattachedtorac1andrac2VMs:



Clickon"Release"iconandthenconfirminthepopupwindow.Notethatthisdisknowshowsas"Notattached".Clickon"Copy"tostartDiskCopyingWizard.



AcceptVirtualdisktocopyandpress"Next".



AcceptVirtualdiskfiletypeasVDIandpress"Next".



Select"Fixedsize"andpress"Next".



Onthenextscreenyoucansetlocationandnameofthenewfile.Whendone,press"Next".



OntheSummaryscreenreviewdetailsandpress"Copy"tocompletecopying.ClosetheMediaManagerwhencopyingisdone.Note.Donottrytocopy.vdifilebecausethecopywillretainsamediskUIDandVirtualBoxwillrefusetouseitbecausethereisalreadysuchdisk.WhencopyingtroughtheVirtualMediaManager,thenewUIDisassignedautomatically.

ExportVMsIntheVirtualBoxManagerselectVM,thencallApplianceExportWizard:Mainmenu|File|ExportAppliance.Exportingisgenerallyassimpleassavingafile.ExportbothVMs.

Nowyoushouldhave3filesthatcanbefurtherzippedintoasinglefilewiththesizeabout12GB.

ReattachSharedDisktotheOriginalRACSetupFixourcurrentworkingRACsetupbyreattachingshareddisktorac1andrac2VMusing"Storage"page.Don'tforgettoselectcorrectcontrollerbeforeattachingthedisk:



Press"AddHardDisk"iconanduse"ChooseExistingDisk"toattach rac_shared_disk1.vdi .OnceShareddiskisattachedtobothVMs,theRACisreadytorun.

RestoringRACfromSavedFilesInthissectionwewillimportRACfromthesavedfilescreatingasecondRACsystem.Don'trunbothRACatthesametimebecausetheywillhavesamenetworkattributes.

OpenApplianceImportWizard:Mainmenu|File|ImportAppliance.Choosethefileandpress"Next":



OntheApplianceImportSettingsdifferentattributesofnewVMcanbechanged.Wearegoingtoacceptsettingsunchanged.Itisinterestingtonote,thatdisksaregoingtobeimportedinVMDKformatdifferentfromtheoriginalVDIformat.



WaituntiltheVMisimported:

ImportbothVMsandcopySharedDisk rac_shared_disk1_copy.vdi fileintotheparentdirectory(VirtualVMs).Thisdiskcouldbeattachedtobothmachines,butunfortunatelycurrentversion(4.1.18)ofVirtualBoxdoesn'tpreservetypeofthediskthenmakingacopy.AttachthisdisktotheeitherofimportedVM,thenselectitandreviewdiskinformation:



IntheVirtualBox4.1.18,thecopieddiskhas"Normal"type.Ifyouhaveanewerversionandthetypeis"Shareable"thenthisbughasbeenfixed,andyoucanproceedtoanotherVM.Ifnot,deattachthedisk,thengototheVirtualMediaManagerandchangethedisktypeto"Shareable"ashasbeendescribedabove,thenreturntotheVirtualmachinesandattachedtheShareddisk.

StartnewVMs.Theclusterwareshouldstartautomatically.Youwillneedtobringupthedatabase.Loginastheoracleuserandexecute:


$srvctlstartdatabasedracdb$

TheRACshouldbewellandrunning!



SimplifiedWayofSaving/RestoringImagesThisisnotasupportedwaytosave/restoreimagesinVirtualBox,butitisverysimpleandworkedwell.TherestoreislimitedtotheVirtualBoxsetupwhereimagesweresaved.

StopbothVMs.FindthelocationwhereVBstoresimages:Mainmenu|File|Preferences|General,"DefaultMachineFolder"box.Forexample:"C:\Users\sromanenko\VirtualBoxVMs".Gotothisfolderandlocate"rac1","rac2"directoriesand"rac_shared_disk1.vdi"file.Makea.zipor.rarfilecontainingthesethreeitems.Ifyoudon'thavecompressingtoolsandthereisenoughdiskspace,youcancopythesethreeitemstoanotherlocation.Theimagesaresaved!

Inordertorestoretheseimages:

MakesureVMsarestoppedGotothe"VirtualBoxVMs"folderanddelete"rac1","rac2"directories,and"rac_shared_disk1.vdi"fileRestorethesethreeitemsfromthe.zipfileorcopyfromthelocationwheretheseitemsweresaved

TherestoredVMsarereadytorun.

That'sit!Pleasesendyourfeedbackto:

BacktotheTop.

CommentsCliffordMathewsays:January1,2014at20:24,GMT

Thankyoufortheinstructions.

DuringtheGRIDinstallation,IencounterederrorPRVF7617on"SettingUpGridInfrastructureStep8of19".Essentially,themulticasttestswerefailing.Toidentifyand"workaround"(seeCAUTIONbelow)thiserror,thefollowingstepsweretaken:

1.Executedthe"runcluvfy"commandasshownbelowfromtheshellprompt.Thiscommandfileislocatedinthesamedirectoryasthe"runInstaller".

./runcluvfy.shstageprecrsinstnrac1,rac2verbose

2.Turnedofftheipv4firewallusingthefollowingcommandsonbothRACnodes(rac1andrac2)serviceiptablesstopchkconfigiptablesoff

3.RestartbothVMs,andreexecuteStep1abovetomakesureerrorsareallclearedup

4.ContinuewithGRIDinstallasisdocumentedinthisblog.



CAUTION:ByshuttingdowntheFirewallasIdid,Imadethesystemvulnerablefromasecuritystandpoint.Apropersolutionshouldinvolveconfiguringthe"iptables"correctlytoallowwhatOraclewants.AtthispointIdon'thavethestepstodothis"proper"solution.

Notes:======IfanyonewishestodisableIPV6,thestepsbelowworkedforme.IPV6wasNOTthecausefortheaboveissuessothisisnotarequiredstep.

vi/etc/hosts#andcommentoutreferencestoanyipv6addressesbuplacinga"#"characterinfront,andsave

vi/etc/sysconfig/network#andaddthelinesgivenbelow,andsaveNETWORKING_IPV6=noIPV6INIT=no

vi/etc/modprobe.conf#andaddthelinegivenbelow,andsave(thisfilewasnotpresent,soIcreateditbysaving)installipv6/bin/true

chkconfigip6tablesoff

Restartthemachines

SergeiRomanenkosays:January1,2014at23:52,GMT

Thankyouforthecomment.Letmeaskifyoualreadydisabledfirewall(asdescribedin"NetworkSetup"section)beforegettingPRVF7617error?

CliffordMathewsays:January2,2014at00:26,GMT

AsecondcluvfyfailureoccurredattheendofGRIDinstall(runningfromserverrac1).ThishadtodowithSCANaddressesandnslookup.ToresolvethisIinstalledBINDononeoftheservers(rac1)usinginstructionstheURLbelow:

http://www.oraclebase.com/articles/linux/dnsconfigurationforscan.php(ThispagereferstoaGUIDNSeditorIcouldnotfindthatpackage,sothatwasnotinstalled.AllrequiredDNSfileswerecreatedwhen"servicenamedstart"commandwasissued.Afterstarting"named",Ifollowedtheinstructionsandedited(orcreatedtheadditional)filesmentionedinthatarticle.Ionlyaddedthe3SCANaddressesandlocalhostintheDNSdatabase.These3SCANaddresseswerethenremovedfrom/etc/hostsbycommentingthemout.Didafinal"servicenamedrestart",thentried"nslookupracscan.localdomain"whichresolved



thenameto3IPaddresses.

Afterthisclicked"Retry"buttontheinstallerwindow,anditsucceeded.

CliffordMathewsays:January2,2014at00:29,GMT

HelloSergei,Imighthavemissedthe"disablefirewall".Sorry.


Noproblem.Itisgoodyoumentionedthatdisablingfirewallisnotabestthinginanyrealworldsystem.

JohnHongsays:January1,2014at21:47,GMT

Hi,forthosepeoplewhoishavingthisissuepleaseseethelink

TOinstallguessadditionerrorinthelogthatunabletofindthesourceofyourkernel...."runkernelupdatereferthislinkhttp://oraclelabspace.blogspot.com/2012/06/settingupguestadditionsinoracle.html


Yes,VirtualBoxguestadditioncanbetrickyandprobablyversiondependent.So,youcommentshouldbehelpful.Thanks!

Pragneshsays:January9,2014at17:22,GMT

Hi,

Nicedocument.IinstalledVMRAC2nodeandthenIwantedtoaddanode.WhenIclonethemachineandrunclufyaftersuccessfullyinstallingtheGRIDsoftware,RAC3isnotshowingaspartoftheRACclusetr.DidImissanything?Istillwentaheadandinstalledthedatabasesoftwaresuccessfully.ThenwhenIrantheDBCAfromRAC1tocreateinstanceonRAC3,afterenteringtheSYSusernameandpasswordIgoterrormessage:serviceRAC1vip:1521:RAC1isnotavailable.Checkyourusername,passwordandmakesurethelistenerisupandavailable"Idon'tunderstandthiserror.Thescanandtheregularlistenerareupandrunning.DidIdoanythingwrong?Pleasehelp.

AkashShandilyasays:January15,2014at20:31,GMT

GreatDocument!

Justanote:Igotanotherfailedprerequisite.

PRVE0426:Thesizeofinmemoryfilesystemmountedas/dev/shmis"____"megabytes



whichislessthantherequiredsizeof"2048"megabytesonnoderac1,rac2

Justincaseyougetthiserror,modifythesizeoftmpfsusingthefollowingsteps:

#vi/etc/fstab

Modifythetmpfslinetolooksomethinglike:tmpfs/dev/shmtmpfssize=3g00

savethefileandquit

remounttmpfs:mountoremounttmpfs

checkchanges:dfh

Runprerequisitechecksagain.Solved.

Enjoy!

Costisays:January25,2014at08:36,GMT

Hi.Ifollowedyourtutorial,stepbystepandeverytimeIhavedifferentspaceavai.ForexamplenowIhavealmostfree6GB,thereforeIwillhaveanerrorwheninstallingtheOracleDB.Doyouknowwhy?Isitpossibletobeincreased,otherwiseIwillhavetotakeitagainallover.Thankyou


Requireddiskspacecanfluctuateandeachnewinstallationcanbedifferent,Ididn'tkeepexactnumbers,butitwasnotverybig.ThiscanbedependentonmanythingsincludingLinuxversion,whichkeepschanging,yumonlinerepositorywhichalsogetsbiggerovertimeandyourVMwillcacheit.Bytheway,don'tforgettoreleaseyumrepositorywhenyoudon'tneeditanymore:'yumcleanall'.

Ithinkitispossibletoresize.VDIdiskusing'VBoxmanagemodifyhd'commandandthenmodifyingLinuxpartitionsby'GParted'butInevertriedthat.YoucansearchInternetfordetailsonthat.

Prakashsays:June10,2014at15:53,GMT

In"InstallGuestAdditions",SometimeGuestAdditionFailstoInstall.ItwillbesafetoExecutebelowTwoCommandsFollowedby"Reboot"forSmoothadditionofSharedFolder.

$yuminstallkernel*dkmsgcc



$yuminstallkerneluekdevel

ThisWillEnsureyour"GuestAdditions"installationalwaysSucceeds.

SergeiRomanenko(http://kab128.com)says:June10,2014at16:15,GMT

Prakash,Thankyouforyourcomment.VirtualBoxGuestAdditionisabittricky,soyourhintshouldhelp.

Jimsays:June29,2014at01:14,GMT

Isuccessfullycreateatwonoderac12cusingoraclevirtualbox(nodeol6121rac1,ol6121rac2)systemworksfine.

NowIwanttocreateathirdnode.Itriedusingvboxtocloneanewserverol6121rac3.itclonedokandIresettheipaddressforthenewnode,.etc.

Sincethenode1andnode1areusingGridInfrastutueandASM,mynode3clonehaswhatnodeonehadinstall.HOwdoIchangenode3tobeadded.ItalreadyhastheGRIDHomeandORACLEHOME...

Billsays:July4,2014at11:14,GMT

Great.Icreaterac1andrac2.Howdoyouaddathirdnode.

Thanks

SergeiRomanenko(http://lab128.com)says:July6,2014at02:44,GMT

Jim,Bill:AlthoughIdidn'ttrythat,Iwoulddothesesteps:removeonenode,sayrac1,fromtheclusterclonerac1torac3,doingallneededchanges(MACaddresses,hostname,IPaddressesetc)describedinthearticleaddtwonewnodes(rac1,rac3)tothecluster.RemovingandaddingnodesisastandardprocedurecoveredinOracledocumentation,alsoavailableonmanywebsites.

Billsays:July6,2014at22:19,GMT

Iwasabletocreate/addathirdnoderac3toyoursetupabove.Willsendthedocs.

Thanks

AnibalLopezsays:August15,2014at09:16,GMT



HiSergei,

TheshareddrivesarenotmountedontheLinuxenvironment.Isthereawaytocheckthis?

Doweneedtodothemountofthesharedstoragemanually?

Thx,

Anibal

SergeiRomanenko(http://www.lab128.com)says:August15,2014at17:54,GMT

No.Checkthatshareddriveisaddedandaccessible:#ls/dev/sd*

Theoutputshouldbesimilartothis:/dev/sda/dev/sda1/dev/sda2/dev/sdb/dev/sdb1


HiSergei,

TheotherproblemistheSharedFolder.Ihaveaddedthedirectoryetc.Whendoing:[root@rac1media]lslthereisnotoracle_sw.

YouknowifIcancheckthistoo?

Thx,

Anibal


InVirtualBoxManager,selectVMandthenopenSharedFolders.Checkthat"oracle_sw"isinthere.Ifnot,seethedocumentandaddit.YoumayneedtorestarttheVMifyoumadechanges.

Thenin"/media"youshouldseesf_oracle_swfolder.NotethatVBadds"sf_"prefix.


HiSergei,

Ihavedonethisbutwithoutsuccess.



Isthereanywaytocheckwhy?

Isthereamissingoptionhere?

Thx,

Anibal


ThisfunctionalityisprovidedbyVBGuestAdditions.TrytoreinstallGuestAdditions.Ifthatdoesn'thelp,youshouldlookforhelponVirtualBoxforums.


HiSergie,

Havethingsworkingtilltheinstallofthedatabasesoftware.Igottheerror:notenoughspace.

IhaveresizedthiswiththeVBoxManagerfromwithintheWindows8OS.

IhavealsohavetodoadiskresizingintheLinuxenvironmentwhenstartinguptheracvm's.

Doyoumayhaveanyadviceorhintonthis?

Thx,

Anibal

Davidsays:August18,2014at05:01,GMT

Iamabeginner.Ifollowallyourstepsandfinishinstallwithnoproblem,thankyou.Itrytoaddanode,butIcan'tfindaddNode.shin$ORACLE_HOME/oui/bin/.CouldyoutellmehowtorunaddNode.sh,appreciate.


Onthefirstnode:

[oracle@rac1~]$.oraenvORACLE_SID=[grid]?+ASM1

[oracle@rac1~]$echo$ORACLE_HOME/u01/app/11.2.0/grid



[oracle@rac1~]$ls$ORACLE_HOME/oui/bin/addNode.sh/u01/app/11.2.0/grid/oui/bin/addNode.sh

says:September19,2014at17:49,GMT

HiSergei,Greatdocumentandnicedetailedsteps,thankyouverymuchforyoureffort:)IwasabletodotheinstallIdidruninafewissues,butnothingthatpatienceandgooglesearchcouldnotsolve.

Thankyou,Florin


Hi,

Thanksforsharing.Thisisgold!Justwanttosharesomeexperiencewhilesettingup12.1.2insteadof12.1.1.

1.Youneedalargerstorageforbothshareddiskandracvmsorelseyouwillrunintoissueswheninstallingthedatabase.iuse10gbforshareddiskand30gbforracvms.Ibelievea30%bumpwilldo(Ijustwanttobesafe)

2.Ihitanmemory_targetissuewhilestartinguptheRACvmafterthecreationofdatabase.Iresolveditbyincreasingmyvmmemoryto4gbandsettmpfsto3gb.Notsurewhatsthebestwaytoresolveitbutit'sworkingformeatm.

Thankyou,Roger


Roger,

Thankyouforthisvaluableinformation!


SergeiRomanenko,Whyyoudidn'tuseSCAN/DNSserver?

ThanksBhim

Sohansays:October11,2014at10:10,GMT



Dowedon'tneedtodefineparameterin.bash_profileofbothnode?

syedaleemsays:October24,2014at16:26,GMT

HiSergei:

Thankyouverymuchforsharingthisdocumentandgreatlyappreciatedforyoureffort.IusedallinstructionsnicelylaidoutinthisdocumentandsetupmythetwonodeRACsuccessfully.

Thankyouagain.

SyedAleem.

Sohansays:October29,2014at07:43,GMT

HiSyed,didyousetkernelparameterfortheconfigurationin/etcsysctl.conf?

RuiXianBAOsays:December12,2014at23:49,GMT


HelloSergeiandothers,

Sorryfortheaboveemptypostamistake:)

BTWSergei,sincethefirsttimeIhadmoreerrorsthanexpectedafterinstallingtheGrid,thenIdeletedtheoldrac1andrac2andhavedoneareinstallation,butgotthesameerrorsasbelow.Anyideawillbehighlyappreciated.

Best

RuiXian

INFO:INFO:ParsingKFOD00311:Errorscanningdevice/dev/sdaINFO:INFO:ParsingORA27041:unabletoopenfileINFO:INFO:ParsingLinuxx86_64Error:13:PermissiondeniedINFO:INFO:ParsingAdditionalinformation:42INFO:INFO:ParsingAdditionalinformation:140733744835552INFO:INFO:ParsingKFOD00311:Errorscanningdevice/dev/sdbINFO:INFO:ParsingORA27041:unabletoopenfileINFO:INFO:ParsingLinuxx86_64Error:13:PermissiondeniedINFO:INFO:ParsingAdditionalinformation:42INFO:INFO:ParsingAdditionalinformation:140733744835552INFO:INFO:ParsingKFOD00311:Errorscanningdevice/dev/sda1INFO:INFO:ParsingORA27041:unabletoopenfileINFO:INFO:ParsingLinuxx86_64Error:13:Permissiondenied



INFO:INFO:ParsingAdditionalinformation:42INFO:INFO:ParsingAdditionalinformation:140733744835552INFO:INFO:ParsingKFOD00311:Errorscanningdevice/dev/sda2INFO:INFO:ParsingORA27041:unabletoopenfileINFO:INFO:ParsingLinuxx86_64Error:13:PermissiondeniedINFO:INFO:ParsingAdditionalinformation:42INFO:INFO:ParsingAdditionalinformation:140733744835552INFO:INFO:ParsingKFOD00311:Errorscanningdevice/dev/sdb1INFO:INFO:ParsingORA27041:unabletoopenfileINFO:INFO:ParsingLinuxx86_64Error:13:PermissiondeniedINFO:INFO:ParsingAdditionalinformation:42INFO:INFO:ParsingAdditionalinformation:140733744835552INFO:INFO:ParsingKFOD00316:ErroracquiringASMdiscoverystring:ORA29780:unabletoconnecttoGPnPdaemon[CLSGPNP_ERR]INFO:INFO:ParsingKFOD00105:Couldnotopenpfile'[email protected]'a


HelloSergeiandothers,

FYI,IgotthesameerrorevenwhenItriedudevinsteadofASMLib.Andmyfriendalsogetstheexactsameerror.Guessthisistheresultofthecurrentsoftwarecomponents'combination.Intheend,wedecidedgoingfarwardanywaydespiteoftheerrors.Andsurprisinglyallisthegoodintheend:)Thankyouagainforyourniceinstrucitons!

Best

RuiXian

Paul(www.webgeest.nl)says:February27,2015at09:21,GMT

Hi,Perfectdescription,stepbystepworkssmooth.Except1thing:theSSHconnectivityduringInstallingDatabasestep7of13.Beforedoinganythingonthisscreen,openupaterminalonbothnodes.Checkthat:*youcansshoracle@rac2ANDsshoracle@rac1twoways*youcanalsosshtoyourself!sosshoracle@[email protected]'own'machinecomeintotheknown_hosts*makesurethattheauthorized_keyscontainsthepubkeysforBOTHhosts

Ifthisworksfine,thenONLYclicktheTestbutton.AndthenNext.DoNOTclickSetupbutton,becauseIthinkthismessesuptheconfiguration.



Thankyouverymuchforthisexcellentpost!

Paul

rajsays:March7,2015at15:40,GMT

Hi,

Thisisanawesomepost.Ididsetupsuccessfully.Itwouldbeniceifyouwritepostsonnodeadditionandnodedeletionandstandbysetupin12c.

Thanks.

Rajansays:April7,2015at13:15,GMT

WhiletakingbackupusingRMAN,gettingbelowerrorsdueto/dev/sdb1notmountedandneedoracleuserpermissiontowriteit,

RMAN00569:===============ERRORMESSAGESTACKFOLLOWS===============RMAN00571:===========================================================RMAN03009:failureofbackupcommandonORA_DISK_1channelat04/07/201518:12:23ORA19502:writeerroronfile"/u01/app/oracle/product/12.1.0/dbhome_1/dbs/b_RACDB_0kq3q7jv_20_1",blocknumber11648(blocksize=8192)

Plsadvise.Thanks.

EdgarRangelsays:April13,2015at06:08,GMT

Sergei,

Thankyouverymuchforthisgreatguide!,IcreatedthelabsusingVirtualBoxinLinux(RedHatEnterpriseLinuxServerrelease6.5),asperothercommentpostedhereIalsoused12.1.0.2,buttogetitworkingIhadtoincreasememoryupto4gbpereachnode,andalsosettmpfsto3gb.

Vaibhavsays:June7,2015at13:10,GMT

Excellent

Dr.HussienSharaf(ite.frommasr.com)says:August13,2015at19:28,GMT

Excellenttutorial.IusedOracleLinux7for64bitandIfoundthatatthesectiontitled"UdevConfiguration"shouldbe#/usr/lib/udev/scsi_idgud/dev/sdbinsteadof:#/sbin/scsi_idgud/dev/sdb



Dr.HussienSharaf(ite.frommasr.com)says:August16,2015at14:31,GMT

InOracleLinux7,disablingFirewall:#systemctlstopfirewalld#systemctldisablefirewalld

Leaveyourcomment:

YourName*

Email

Website(includehttp://...)

Thisisasimpleantispammeasure.Pleasesolvethemathproblem:(1211)*1485=

PostComment

Copyright128ConsultingLLC

Oracle RAC 12c Database on Linux Using VirtualBox

Documents

Transcript of Oracle RAC 12c Database on Linux Using VirtualBox