Deploying Oracle 11gr2 Rac on Rhel6 1.1

download Deploying Oracle 11gr2 Rac on Rhel6 1.1

of 32

Transcript of Deploying Oracle 11gr2 Rac on Rhel6 1.1

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    1/98

    Deploying Oracle RAC 11g R2

    Database on Red Hat Enterprise

    Linux 6

    Best Practices

    Roger Lope! Principal "o#t$are Engineer

    RHCE

    %ersion 1&1

    Dece'ber 2(1)

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    2/98

    1801 Varsity Drive™Raleigh NC 27606-2072 USAPhone !1 "1" 7#$ %700Phone 888 7%% $281&a' !1 "1" 7#$ %701P( )o' 1%#88Resear*h +riangle Par, NC 2770" USA

    in.' is a registere/ tra/ear, o in.s +orval/s Re/ 3at4 Re/ 3at 5nterrise in.' an/ the Re/ 3atSha/oan logo are registere/ tra/ear,s o Re/ 3at4 9n* in the Unite/ States an/ other*o.ntries

    (ra*le an/ :ava are registere/ tra/ear,s o (ra*le

    9ntel4 the 9ntel logo an/ ;eon are registere/ tra/ear,s o 9ntel Cororation or its s.

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    3/98

    Co''ents and .eedbac,

    9n the sirit o oen so.r*e4 e invite anyone to rovi/e ee/

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    4/98

    Table of Contents

    1 5'e*.tive S.ary 1

    2 Reeren*e Ar*hite*t.re 5nvironent 2

    21 Reeren*e Ar*hite*t.re (vervie 2

    22 Netor, +oology %

    2% 3ar/are Details $

    2$ &ile Syste ayo.t E Dis, Sa*e Details #

    2# Storage ayo.t 7

    26 Sa Sa*e 7

    27 Se*.rity &ireall Settings 8

    28 Se*.rity S5in.' "

    % Reeren*e Ar*hite*t.re Conig.ration Details 10

    %1 Setting (S 3ostnae 10

    %2 Netor, Conig.ration 11

    %21 Conig.ring @et*@resolv*on ile 11

    %22 Conig.re SCAN via DNS 11

    %2% Conig.re Virt.al 9P ?V9P via DNS 1%

    %2$ P.

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    5/98

    %%1$ Setting Shell iits or the Bri/ an/ (ra*le User %0

    %$ Storage Conig.ration %2

    %$1 Setting . DF-F.ltiath %2

    %$2 Partitioning Devi*e Faer Share/ Dis,s %6

    %$% Conig.ring (ra*le ASF Dis,s %7

    %$%1 (ra*le ASFi< Alternative Conig.ring ./ev R.les %7

    %$%2 Conig.ring (ra*le ASFi

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    6/98

    Aen/i' +ro.

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    7/98

    1 Executive Summary9+ organiGations a*e *hallenges o otiiGing (ra*le /ata

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    8/98

    2 Reference Architecture Environment+his se*tion o*.ses on the *oonents .se/ /.ring the /eloyent o (ra*le RACData

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    9/98

     2.2 Network Topology +he netor, toology .se/ in this reeren*e ar*hite*t.re *onsists o to .

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    10/98

     2.3 Hardware Detail+he olloing are the ini. har/are re.ireents to roerly install (ra*le RACData

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    11/98

    "$itc* Hard$are

    &i

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    12/98

    0able 2&&2 .ile "yste' Layout se*iies the ile syste layo.t or the to servers .se/ inthis reeren*e ar*hite*t.re +he layo.t ens.res the /is, sa*e re.ireents to roerly installthe (ra*le Bri/ 9nrastr.*t.re an/ (ra*le Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    13/98

     2.' #torage %ayout 

    0able 2&7&1 "torage Dis, Layout #or Re#erence Arc*itecture shos the storage /is,layo.t or ea*h vol.e

    %irtualDis,group

    5a'e

    %olu'e5a'e

    %olu'e "ie RA/D roup0ype

    Harddri4eCount

    Hot"pares

    A4ailable

    "ie o#%irtualDis,

    v/01 /

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    14/98

     2.) #ecurity* "irewall #etting+his se*tion o*.ses on rovi/ing the /etails re.ire/ to r.n iptables s.**ess.lly or an

    (ra*le RAC Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    15/98

    /nter#ace "ource Address Destination Address

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    16/98

    3 Reference Architecture Configuration

    Details

    +his reeren*e ar*hite*t.re o*.ses on the /eloyent o (ra*le RAC Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    17/98

    3.2 Network /onfiguration+he netor, *onig.ration o*.ses on the roer set. o a .

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    18/98

    /oain s.i' ithin the reeren*e environent4 the /oain is cloud/lab/en"/bo#/redhat/coman/ SCAN nae is db-oracle-#can

    An e'ale DNS entry or the SCAN is as ollos

    db-oracle-scan IN " 1%.1&.1').,(IN " 1%.1&.1').,'IN " 1%.1&.1').,,

    An e'ale o the DNS entry or the SCAN to ena

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    19/98

    5O0E +he reeren*e environent resolves the olloing 9P a//ress to the olloing hostnaes

    /P Hostna'e

    10161$2#% /

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    20/98

    An e'ale o the DNS entry or the SCAN to ena

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    21/98

    (n ea*h no/e4 as the root .ser4 e'e*.te the olloing *oan/ hi*h *reates a ile nae/bondin"/con ithin the etcmod!robe/d  /ire*tory nee/e/ to *reate a ,de'3c1e857+*'yes'&75*8'bond0' 

    # cat /etc/sysconfig/network-scripts/ifcfg-em

    7E;I5E=8em)8:OOTROTO=8none8W"77R=8%%),:("+&8I;&INIT=8no?N45ONTRO66E7=8no8ON:OOT=8yes8T9E=8Ethernet8I7=8*d)>d+*3-,)bb-'dc&-++ca-d%+,*c*d*3d>857+*'yes'&75*8'bond0'

    re#arc*+#eedbac,-red*at&co' 17  $$$&red*at&co'

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    22/98

    Ater all the netor, s*rits are *onig.re/4 restart the netor, servi*e on ea*h no/e via the*oan/

    # service network restart!hutt/ng don /nter3ace bond% @ OK A!hutt/ng don loo0bac2 /nter3ace @ OK A:r/ng/ng u0 loo0bac2 /nter3ace @ OK A

    :r/ng/ng u0 /nter3ace bond% @ OK A

    (n*e the bond0 /evi*e is *onig.re/ on ea*h no/e4 .se the ping *oan/ to veriy

    *onne*tivity as ollos

    (n no/e one la

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    23/98

    # cp /etc/sysconfig/network-scripts/ifcfg-em" /etc/sysconfig/network-scripts/em".bkup# cp /etc/sysconfig/network-scripts/ifcfg-em4 /etc/sysconfig/network-scripts/em4.bkup

    # cat /etc/sysconfig/network-scripts/ifcfg-em"

    7E;I5E=8em(8:OOTROTO=8stat/c8W"77R=8%%),:("+&%&a-e3%>,de'3c1e8I"77R=?1>).11.1').,1?NET"!K=?),,.),,.),,.%?&9:;000:

    # cat /etc/sysconfig/network-scripts/ifcfg-em4

    7E;I5E=8em'8:OOTROTO=8stat/c8W"77R=8%%),:("+&8I;&INIT=8no?N45ONTRO66E7=8no8ON:OOT=8yes8T9E=8Ethernet8I7=8*d)>d+*3-,)bb-'dc&-++ca-d%+,*c*d*3d>8I"77R=?1>).1).1').,1?NET"!K=?),,.),,.),,.%?

    &9:;000:

    5O0E +he F+U siGe is set to "000 or the ena

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    24/98

    5O0E 5ns.re that all rivate 5thernet intera*es ie em3 an/ em44 are set to /ierents.).1).1').,)C ,&B+'C bytes o3 data.&' bytes 3rom 1>).1).1').,) /cm04seD=1 ttl=&' t/me=%.1+( ms

    (n no/e to la).11.1').,1 B1>).11.1').,1C ,&B+'C bytes o3 data.&' bytes 3rom 1>).11.1').,1 /cm04seD=1 ttl=&' t/me=%.1(+ ms

    # ping 1;.1.14.!1ING 1>).1).1').,1 B1>).1).1').,1C ,&B+'C bytes o3 data.&' bytes 3rom 1>).1).1').,1 /cm04seD=1 ttl=&' t/me=%.1&' ms

    /P Et*ernet /nter#ace Host

    1"2111$2#1 e% /

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    25/98

    3.2.6 NTP Configuration+he ntpd rogra is an oerating syste /aeon hi*h sets an/ aintains the syste

    tie4 syn*hroniGing ith 9nternet stan/ar/ tie servers6 +he ntpd rogra oerates

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    26/98

    3.3 O# /onfiguration

    3.3.1 Accessing the RHN Repository9nstr.*tions on ho to register a syste an/ anage s.

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    27/98

    (ra*le Bri/ 9nrastr.*t.re 112 an/ (ra*le RAC Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    28/98

    3.3.3 Configuring Security-Enhanced Linux (SELinux)SELinux  is an ileentation o a an/atory a**ess *ontrol ?FAC e*hanis /eveloe/)%,( )%1(3/lterINT "55ET @%%A

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    29/98

    OTT "55ET @),)&&%A-" INT -s 1%.1&.1').,1F() -/ bond% - "55ET-" INT -s 1%.1&.1').,)F() -/ bond% - "55ET-" INT -/ em( - "55ET-" INT -/ em' - "55ET-" INT -m state --state RE6"TE7JE!T":6I!E7 - "55ET-" INT -0 /cm0 - "55ET

    -" INT -/ lo - "55ET-" INT -s 1>).11.1').%F)' -d )(%.%.1.% - "55ET-" INT -s 1>).11.1').%F)' -d ))'.%.%.),1 - "55ET-" INT -s 1>).1).1').%F)' -d )(%.%.1.% - "55ET-" INT -s 1>).1).1').%F)' -d ))'.%.%.),1 - "55ET-" INT -/ bond% -d )(%.%.1.% - "55ET-" INT -/ bond% -d ))'.%.%.),1 - "55ET-" INT -0 tc0 -m state --state NEW -m tc0 --d0ort )) - "55ET-" INT -0 tc0 -m state --state NEW -m tc0 --d0ort ''( - "55ET-" INT -m state --state NEW -m tc0 -0 tc0 -s 1%.1&.1').,' --d0ort 1,)1 -"55ET-" INT -m state --state NEW -m tc0 -0 tc0 -s 1%.1&.1').,' --d0ort 11,+ -"55ET

    -" INT - REE5T --reect-/th /cm0-host-0roh/b/ted-"

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    30/98

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    31/98

    3.3.6 Setting Shared MemoryShare/ eory allos ro*esses to *o.ni*ate ith ea*h other &

    (n*e the age siGe is *at.re/4 *al*.late S;+ALL as ollos

    6 &6AL 'A+ )$ B6ES  PA*E8S)

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    32/98

    Sin*e the val.es o S;++A  an/ S;+ALL *al*.late/ are saller then the val.es alrea/y set4 no*hanges to those araeters are a/e ithin etc##ctl/con/ 3oever4 an entry or S;++$) isre.ire/ on any o the (ra*le RAC Data'*&*(&2ernel.shmall = ')>'>&*)>&

    2ernel.shmmn/ = '%>&

    9n or/er or the *hanges ta,e ee*t ie/iately4 on ea*h no/e r.n the olloing *oan/

    # sysctl -p

    5O0E A .ll listing o all the ,ernel araeters o/iie/ ithin the etc##ctl/con  ile *an

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    33/98

    9n or/er or the *hanges ta,e ee*t ie/iately4 on ea*h no/e o the (ra*le RAC Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    34/98

    3.3.11 Increasing File Handles+he ,ernel araeter %S/%)LE -+A  sets the a'i. n.

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    35/98

    5O0E (ra*le AS+Lib /oes not oen ile /es*ritors or ea*h /evi*e4

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    36/98

    (SD)A gro. ?5BA /eterines (S .ser a**o.nts ith D)A rivileges

    (S(P5R gro. ?&PE' an otional gro. *reate/ to assign liite/ D)A rivileges ?SS&PE' rivile/ge to arti*.lar (S .ser a**o.nts

     +he olloing are the re*oen/e/ syste gro.s *reate/ or the installation o the (ra*leBri/ 9nrastr.*t.re an/ art o the gr/d .ser

    (SD)A gro. ? AS+5BA rovi/es a/inistrative a**ess to (ra*le ASF instan*es

    (SASF gro. ? AS+A5+)$ rovi/es a/inistrative a**ess or storage iles via the SSAS+ rivile/ge

    (S(P5R gro. ? AS+&PE' an otional gro. *reate/ to assign liite/ D)A rivileges ithregar/s to ASF to arti*.lar (S .ser a**o.nts

    (n ea*h no/e ithin the (ra*le RAC Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    37/98

    ithin the etc#ecuritlimit#/d==-"rid-oracle-limit#/con  ile4 on ea*h no/e o the (ra*le RACData

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    38/98

    5O0E hile the ulimit  val.es *an

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    39/98

    # cp /usr/share/doc/device-mapper-multipath-0.4.;/multipath.conf /etc/

    % Cat.re the s*si i/ o the lo*al /is,?s on the syste

    # scsi2id --whitelisted --replace-whitespace -device/dev/sda(&%%,%+b1%%1%(%(,('('(&(&'&(%1)%%

    $ Un*oent an/ o/iy the

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    40/98

    .igure )&&1&1 8ultipat* De4ice 'pat*b i/entiies the *.rrent .ltiath alias nae4 siGe4)5, an/ dm /evi*e/ +his inoration is re.ire/ or the ali*ation o a *.sto alias toea*h vol.e as shon in ste "/

    5O0E D.e to the siGe o soe the /is,s )rr4e/ght 0r/or/t/es3a/lbac2 /mmed/ateno40ath4retry 3a/luser43r/endly4names yes

    5O0E +he stan/ar/ otions *an

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    41/98

      /d (&%%c%33%%%dab3e,+,a%3&,1%1%%%%%%  al/as redo

    mult/0ath

    /d (&%%c%33%%%dab3e,>&a%3&,1%1%%%%%%  al/as ocr$ote1

    mult/0ath /d (&%%c%33%%%dab3e,a)a%3&,1%1%%%%%%

      al/as ocr$ote)mult/0ath

    /d (&%%c%33%%%dab3e,b'a%3&,1%1%%%%%%  al/as ocr$ote(

    10Restart the device ma!!er multi!ath /aeon

    # service multipathd restartok5topping multipathd daemon< N O P5tarting multipathd daemon< N O P

    11Veriy the device ma!!er  aths an/ aliases are /islaye/ roerly )elo is ane'ale o one device ma!!er  /evi*e lae+,ac,1%1%%%%%%C dm-1% J!")()'3cs/e=1+&G 3eatures=1 Dueue4/34no40ath hhandler=% 0=rQ-U- 0ol/cy=round-rob/n % 0r/o=1(% status=act/$eQ Q- (%%( sdd +'+ act/$e ready runn/ng

    Q Q- (%1( sdh +11) act/$e ready runn/ngQ Q- '%%( sdt &,'+ act/$e ready runn/ngQ V- '%1( sd &,11) act/$e ready runn/ngV-U- 0ol/cy=round-rob/n % 0r/o=1% status=enabledQ- (%)( sdl +1*& act/$e ready runn/ngQ- (%(( sd0 +)'% act/$e ready runn/ngQ- '%)( sdab &,1*& act/$e ready runn/ngV- '%(( sda3 &,)'% act/$e ready runn/ng

    3.4.2 Partitioning Device Mapper Shared DisksPartitioning o the device ma!!er  share/ /is,s is only re.ire/ hen .sing (ra*le AS+Lib

    +his reeren*e ar*hite*t.re rovi/es instr.*tions to *onig.re either (ra*le AS+Lib or udev  r.les Partitions or ea*h /evi*e aer vol.e are *reate/ to *oly ith either otion

    (n the irst no/e o the (ra*le RAC Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    42/98

    (n*e the artitions are *reate/4 veriy a nely *reate/ /evi*e aer /evi*e is *reate/ orea*h An e'ale o veriying the db1!1 artition as ollos

    # ls -l /dev/mapper/db1p1lrrr. 1 root root + "0r 1& 1,1, Fde$Fma00erFdb101 - ..Fdm-11

    5O0E A nely *reate/ artition re.ires the alias nae olloe/

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    43/98

    # for i in ocrvote1p1 ocrvotep1 ocrvote"p1 db1p1 dbp1 frap1 redop1Q doprintf 'Rs RsSn' 'Di' 'DTudevadm info --Fueryall --name/dev/mapper/Di $grep -i dm2uuidU'Q done ocr$ote101 E 74I7=0art1-m0ath-(&%%c%33%%%dab3e,>&a%3&,1%1%%%%%%ocr$ote)01 E 74I7=0art1-m0ath-(&%%c%33%%%dab3e,a)a%3&,1%1%%%%%%ocr$ote(01 E 74I7=0art1-m0ath-(&%%c%33%%%dab3e,b'a%3&,1%1%%%%%%db101 E 74I7=0art1-m0ath-(&%%c%33%%%d*e*a+,'a%3&,1%1%%%%%%

    db)01 E 74I7=0art1-m0ath-(&%%c%33%%%dab3e,&)a%3&,1%1%%%%%%3ra01 E 74I7=0art1-m0ath-(&%%c%33%%%d*e*a+*'a%3&,1%1%%%%%%redo01 E 74I7=0art1-m0ath-(&%%c%33%%%dab3e,+,a%3&,1%1%%%%%%

    2 Create a ile la

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    44/98

    % ithin ==-oracle-a#mdevice#/rule# ile4 *reate r.les or ea*h /evi*e siilar to thee'ale

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    45/98

    ude$adm4test 74!!EN7E7=%ude$adm4test 7E;6INK!=Fde$Fma00erFdb101 Fde$Fd/s2Fby-/dFdm-name-db101Fde$Fd/s2Fby-/dFdm-uu/d-0art1-m0ath-(&%%c%33%%%d*e*a+&'+,ac,1%1%%%%%%Fde$Fbloc2F),(11ude$adm4test I74

    8 Conir ea*h /evi*e has the /esire/ erissions on ea*h no/e ithin the *l.ster# ls -lh /dev/dm-Jbr-r----. 1 gr/d asmadm/n ),(J 1' "ug 1 1&%) Fde$Fdm-1'br-r----. 1 gr/d asmadm/n ),(J 1, "ug 1 1&%) Fde$Fdm-1,br-r----. 1 gr/d asmadm/n ),(J 1& "ug 1 1&%) Fde$Fdm-1&br-r----. 1 gr/d asmadm/n ),(J 1* "ug 1 1&%) Fde$Fdm-1*br-r----. 1 gr/d asmadm/n ),(J 1+ "ug 1 1&%) Fde$Fdm-1+br-r----. 1 gr/d asmadm/n ),(J 1> "ug 1 1&%( Fde$Fdm-1>br-r----. 1 gr/d asmadm/n ),(J )% "ug 1 1&%) Fde$Fdm-)%

    5O0E 9 the /esire/ erissions are not visi

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    46/98

    $ 9nstall the ASFi< ,ernel o/.le a*,age ?kmod-oracleasm4 ASFi< li

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    47/98

    8 R.n the olloing oracleasm *oan/ to ens.re that oraclea#m is ena

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    48/98

    Reload/ng d/s2 0art/t/ons done5lean/ng any stale "! d/s2s...!cann/ng system 3or "! d/s2s...

    5O0E 9 the iss.e ersists ater a res*an o the (ra*le ASF /is,s4 a re

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    49/98

    3.4.4 Optimizing Database Storage using Automatic System

    Tuning+he tuned a*,age in Re/ 3at 5nterrise in.' 6 is re*oen/e/ or a.toati*ally t.ning

    the syste or *oon or,loa/s via the .se o roiles 5a*h roile is tailore/ or /ierent or,loa/ s*enarios s.*h as

    • enterrise-storage

    • oer savings

    • high netor, thro.gh.t

    9t is re*oen/e/ to *reate a *.sto roile ith the sae settings as the enterrise-storageroile

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    50/98

    2 5na dm-) dm-)% dm-( dm-' dm-, dm-& dm-* dm-+ dm-> sdasdaa sdab sdac sdb sdc sdd sde sd3 sdg sdh sd/ sd sd2 sdl sdm sdn sdosd0 sdD sdr sds sdt sdu sd$ sd sd sdy sd@ OK A!tart/ng tuned @ OK A

    8 Veriy that +3P is no /isa

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    51/98

    5O0E 9 at any oint in tie a revert to the original settings are re.ire/4 the olloing*oan/ *an

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    52/98

    4 Oracle 11gR2 Configuration

    4.1.1 Installing Oracle Grid Infrastructure (Required for ASM)

    +he installation o the (ra*le Bri/ 9nrastr.*t.re or (ra*le RAC Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    53/98

    • 5/it the cvu8coni" ile as ollos

    # sed -i Bs/+27559&*2),5,)*4/+27559&*2),5,)*6/B/u01/app/grid/grid-software/grid/stage/cvu/cv/admin/cvu2config

    $ As the gr/d .ser4 start the (U9 via the *oan/

    # /u01/app/grid/grid-software/grid/run,nstaller!tart/ng Oracle n/$ersal Installer...

    5hec2/ng Tem0 s0ace must be greater than 1)% :. "ctual (&>% :assed5hec2/ng sa0 s0ace must be greater than 1,% :. "ctual 1&(+( :assed5hec2/ng mon/tor must be con3/gured to d/s0lay at least ),& colors."ctual 1&***)1& assed

    5O0E 5ns.re to 55? ith the - otion as the gr/d .ser ro the *lient server4 otherise

    the olloing error ill o**.r# /u01/app/grid/grid-software/grid/run,nstaller  !tart/ng Oracle n/$ersal Installer...

    5hec2/ng Tem0 s0ace must be greater than 1)% :. "ctual (&>% :assed5hec2/ng sa0 s0ace must be greater than 1,% :. "ctual )%'*> :assed5hec2/ng mon/tor must be con3/gured to d/s0lay at least ),& colors

    5ould not eecute auto chec2 3or d/s0lay colors us/ng commandFusrFb/nFd0y/n3o. 5hec2 /3 the 7I!6"9 $ar/able /s set.

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    54/98

    ◦ Cl.ster Nae db-ora-clu#ter 

    ◦ SCAN Nae db-oracle-#can/cloud/lab/en"/bo#/redhat/com

    5O0E +he SCAN Nae is the nae registere/ ith the DNS Server asseen in "ection )&2&2 Con#igure "CA5 4ia D5"

    ◦ SCAN Port 1@21

    ◦ Un*he*, Configure GNS

     $$$&red*at&co' : re#arc*+#eedbac,-red*at&co'

    Figure 4.1.1.1: Orcle &lug n' &ly (in'ow

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    55/98

    10ithin the /luter Node nfor$ation in/o4 *li*, the Add 

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    56/98

    11ithin the sae /luter Node infor$ation in/o4 sele*t the SSH Connectivity

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    57/98

    1$ithin the Create ASF Dis, Bro. in/o4 rovi/e the olloing

    • Dis, Bro. Nae

    • Re/.n/an*y evel

    ◦ E  6E'$AL  re/.n/an*y rovi/e/

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    58/98

    +o /islay the aroriate *an/i/ate /is,s i not alrea/y /islaye/4 *li*, on the C%ange&iscovery Pat% 

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    59/98

    18 ithin the "ailure olation #upport  in/o4 sele*t hether to .se or not .se the9ntelligent Plator Fanageent 9ntera*e ?9PF9 +his reeren*e ar*hite*t.re sele*tsthe &o not use Intelligent Platfor! "anage!ent Interface #IP"I$ ra/io

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    60/98

    ▪ Pa*,age cvuFdisk-1.0.;-1  An r a*,age re.ire/ or the

    installation o the (ra*le Bri/ 9nrastr.*t.re 9 the rere5uiite /heck  in/o /oes not rovi/e a &i'a

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    61/98

    5O0E hen r.nning the root/#h on no/e to o the *l.ster4 the olloing C('SD 4402D 6he(SS daemon wa# #tarted in exclu#ive mode but ound an active (SS daemon on node db-oracle-node1, number 1, and i# terminatin" An active clu#ter wa# ound durin" exclu#ive#tartu!, re#tartin" to oin the clu#ter/C  essage aears rior to the s.**ess.l installation othe (ra*le Bri/ 9nrastr.*t.re or a Cl.ster +his essage is not an error hen r.nning (ra*le

    Bri/ 9nrastr.*t.re 1120%4 an/ *an

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    62/98

    5O0E 5verything sho.l/ have a target an/ state o &$L)$E  e'*et or anythingen/ing in /"#d/ Blo

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    63/98

    % As the oracle .ser4 lo*ate the (ra*le Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    64/98

    8 ithin the ntallation Option in/o4 sele*t Install data.ase software only an/ *li*,Next

     $$$&red*at&co' 7: re#arc*+#eedbac,-red*at&co'

    Figure 4.1.2.1: +n*tlltion Option (in'ow

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    65/98

    " ithin the rid ntallation Option in/o4 sele*t Oracle +eal Application Clustersdata.ase installation ra/io

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    66/98

    12ithin the ntallation %ocation in/o4 sele*t the aroriate (ra*le

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    67/98

    ▪ Clo*, Syn*hroniGation *he*,s the (ra*le Cl.ster +ie Servi*es an/rovi/es ithin the &etails

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    68/98

    4.1.3 Creating ASM Diskgroups via the ASM Configuration

    Assistant (ASMCA)Prior to the *reation o an (ra*le RAC /ata

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    69/98

    % ithin the /reate Dik roup in/o4 *reate the olloing /is, gro.s as ollos

    • Dis, Bro. Nae

    • Re/.n/an*y level

    • Sele*tion o the /is,s to

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    70/98

    5O0E +o /islay the aroriate eligi

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    71/98

    Cli*, the OK 

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    72/98

    8 ithin the Data6ae "ile %ocation in/o4 sele*t the aroriate storage tye an/storage lo*ation &or the .roses o the reeren*e environent the olloingsele*tions are a/e

    • S6&'A*E  6 PE   Automatic Stora"e +ana"ement FAS+G

    • S6&'A*E  L&(A6)&$S  :#e &racle-+ana"ed %ile#

    ◦ 5 A6ABASE  A'EAD H5A6A5*

     $$$&red*at&co' 66 re#arc*+#eedbac,-red*at&co'

    Figure 4.1.4.1: !t$*e File 0oction* (in'ow

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    73/98

    " Sele*t the "ultiplex +edo 0ogs and Control )iles 

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    74/98

    11ithin the Recovery /onfiguration in/o4 sele*t the re*overy otions aroriateor the /ata

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    75/98

    12ithin the Data6ae /ontent  in/o4 sele*t the *oonents to

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    76/98

    4.1.5 Enabling HugePages+ransarent 3.ge Pages ?+3P are ileente/ ithin Re/ 3at 5nterrise in.' 6 toirove eory anageent

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    77/98

    $ A// the n.

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    78/98

    5 Logging into an Oracle RAC Database

    11g Release 2 Instance (11.2.0.3)

    +his se*tion o*.ses on ens.ring on*e the (ra*le RAC Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    79/98

    6 ConclusionRe/ 3at has a history o *reating sol.tions that in*l./e (ra*le Data

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    80/98

    Appendix A Re4ision History

    Revision 11 +.es/ay De*e

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    81/98

    Appendix B Contributors1 )rett +h.r

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    82/98

    Appendix C D8 8ultipat* Con#iguration.ile# Th/s /s a bas/c con3/gurat/on 3/le /th some eam0lesJ 3or de$/ce ma00er

    # mult/0ath.# Fmult/0ath.con3.annotated## REE:ER "3ter u0dat/ng mult/0ath.con3J you must run## ser$/ce mult/0athd reload## 3or the changes to ta2e e33ect /n mult/0athd

    ## :y de3aultJ de$/ces /th $endor = 8I:8 and 0roduct = 8!F(>%.8 are

    ## blac2l/sted. To enable mul/t0ath/ng on these de$/esJ uncomment the## 3ollo/ng l/nes.#blac2l/st4ece0t/ons # de$/ce # $endor 8I:8# 0roduct 8!F(>%.8# #

    ## se user 3r/endly namesJ /nstead o3 us/ng WWI7s as names.de3aults   user43r/endly4names yes

    #### ere /s an eam0le o3 ho to con3/gure some standard o0t/ons.###de3aults   ude$4d/r Fde$  0oll/ng4/nter$al 1%  0ath4selector 8round-rob/n %8  0ath4grou0/ng40ol/cy mult/bus  getu/d4callout 8Fl/bFude$Fscs/4/d --h/tel/sted--de$/ce=Fde$FSn8  0r/o alua  0ath4chec2er readsector%

      rr4m/n4/o 1%%  ma43ds +1>)  rr4e/ght 0r/or/t/es  3a/lbac2 /mmed/ate  no40ath4retry 3a/l  user43r/endly4names yes#### The /d l/ne /n the 3ollo/ng blac2l/st sect/on /s shon as an eam0le

     $$$&red*at&co' 96 re#arc*+#eedbac,-red*at&co'

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    83/98

    ## o3 ho to blac2l/st de$/ces by /d. The ) de$node l/nes are the## com0/led /n de3ault blac2l/st. I3 you ant to blac2l/st ent/re ty0es## o3 de$/cesJ such as all scs/ de$/cesJ you should use a de$node l/ne.## oe$erJ /3 you ant to blac2l/st s0ec/3/c de$/cesJ you should use## a /d l/ne. !/nce there /s no guarantee that a s0ec/3/c de$/ce /ll## not change names on reboot B3rom Fde$Fsda to Fde$Fsdb 3or eam0leC## de$node l/nes are not recommended 3or blac2l/st/ng s0ec/3/c de$/ces.

    ##blac2l/st   /d (&%%,%+b1%%1%(%(,('('(&(&'&(%1)%%  de$node 8PBramQraQloo0Q3dQmdQdm-QsrQscdQstC@%->A8  de$node 8Phd@a-A8mult/0aths   mult/0ath   /d (&%%c%33%%%d*e*a+>>d+,1,1%1%%%%%%  al/as db1    mult/0ath   /d (&%%c%33%%%dab3e,a*d+,1,1%1%%%%%%

      al/as db)    mult/0ath

    /d (&%%c%33%%%dab3e,>&a%3&,1%1%%%%%%al/as ocr$ote1

    mult/0ath

    /d (&%%c%33%%%dab3e,a)a%3&,1%1%%%%%%al/as ocr$ote)

    mult/0ath

    /d (&%%c%33%%%dab3e,b'a%3&,1%1%%%%%%al/as ocr$ote(

    mult/0ath

      /d (&%%c%33%%%dab3e,3'd+,1,1%1%%%%%%  al/as redo 

      mult/0ath   /d (&%%c%33%%%d*e*a+dbd+,1,1%1%%%%%%  al/as 3ra 

    #de$/ces

    # de$/ce # $endor 85O"[ 8# 0roduct 8!;11% B5C5O"[8# 0ath4grou0/ng40ol/cy mult/bus# getu/d4callout 8Fl/bFude$Fscs/4/d --h/tel/sted--de$/ce=Fde$FSn8# 0ath4chec2er readsector%# 0ath4selector 8round-rob/n %8# hardare4handler 8%8# 3a/lbac2 1,

    re#arc*+#eedbac,-red*at&co' 99  $$$&red*at&co'

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    84/98

    # rr4e/ght 0r/or/t/es# no40ath4retry Dueue# # de$/ce # $endor 85O"[ 8# 0roduct 8!"1%%% 8# 0ath4grou0/ng40ol/cy mult/bus

    # #

    Appendix D iptables Con#iguration .ile# Generated by /0tables-sa$e $1.'.* on on "ug , 1>)%,( )%1(3/lterINT "55ET @%%A).1).1').%F)' -d )(%.%.1.% - "55ET-" INT -s 1>).1).1').%F)' -d ))'.%.%.),1 - "55ET-" INT -/ bond% -d )(%.%.1.% - "55ET-" INT -/ bond% -d ))'.%.%.),1 - "55ET-" INT -0 tc0 -m state --state NEW -m tc0 --d0ort )) - "55ET-" INT -0 tc0 -m state --state NEW -m tc0 --d0ort ''( - "55ET-" INT -m state --state NEW -m tc0 -0 tc0 -s 1%.1&.1').,' --d0ort 1,)1 -"55ET-" INT -m state --state NEW -m tc0 -0 tc0 -s 1%.1&.1').,' --d0ort 11,+ -"55ET-" INT - REE5T --reect-/th /cm0-host-0roh/b/ted-"

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    85/98

    Appendix E Huge Pages "cript+he olloing h.geages s*rit is ro +.ning Re/ 3at 5nterrise in.' &or (ra*le E (ra*leRAC

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    86/98

    Appendix . Oracle Database Pac,ageRe=uire'ents 0ext .ilecloog-00l

    com0at-l/bca01com0at-l/bstdcUU-((c00gccgcc-cUUgl/bc-de$elgl/bc-headers2ernel-headers2shl/bHmul/bHtl/bH$l/bH3+&dga

    l/bH3+&m/scl/bH3+&$ml/ba/o-de$ell/bdml/bstdcUU-de$elm03rma2e00lorg-11-ut/lsorg-11-auth

     $$$&red*at&co' :( re#arc*+#eedbac,-red*at&co'

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    87/98

    Appendix ;ernel Para'eters$m.sa00/ness = %$m.d/rty4bac2ground4rat/o = ($m.d/rty4rat/o = +%

    $m.d/rty4e0/re4cent/secs = ,%%$m.d/rty4r/tebac24cent/secs = 1%%2ernel.shmma = &+*1>'*&*(&2ernel.shmall = ')>'>&*)>&2ernel.shmmn/ = '%>&2ernel.sem = ),% ()%%% 1%% 1)+# 3s.3/le-ma needs to be set to at least &+1,*'' 3or the Oracle R"5Installat/on.3s.3/le-ma = &+1,*''3s.a/o-ma-nr = 1%'+,*&net./0$'./04local40ort4range = >%%% &,,%%net.core.rmem4de3ault = )&)1''net.core.rmem4ma = '1>'(%'

    net.core.mem4de3ault = )&)1''net.core.mem4ma = 1%'+,*&# set to the a00ro0r/ate 0r/$ate eth de$/cesnet./0$'.con3.em(.r043/lter = )net./0$'.con3.em'.r043/lter = )

    re#arc*+#eedbac,-red*at&co' :1  $$$&red*at&co'

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    88/98

    Appendix H Li'its Con#iguration .ile

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    89/98

    Appendix /

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    90/98

    Appendix "a'ple ;ic,start .ile# Red at Q Oracle !olut/ons K/c2start !cr/0t

    /nstallurl --url=Y0lace-d/stro-url-herelang en4!.T

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    91/98

    Appendix ; Con#iguration .ilesAll *onig.ration iles *an

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    92/98

    Appendix L 0roubles*ooting ORA+F Errors+his se*tion o*.ses on .sing the *oan/ line tool4 A.toati* Diagnosti* ReositoryCoan/ 9nterreter ? A5'()4 to tro.+)J )%11J Oracle andFor /ts a33/l/ates. "ll r/ghtsreser$ed.

    "7R base = 8Fu%1Fa00Foracle8adrc/

    $ At the A5'() rot4 sho (ra*le 3oeLs availa

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    93/98

    B/nc/dent=(&,*COR"-%*'', ece0t/on encountered core dum0 @semt/medo0BCU1%A @!IG!EG;A@"77R%7'(1%%%%,*:"A @5%(:(1)E"

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    94/98

      ERROR4

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    95/98

    adrci( Fuit# cat /tmp/utsout2"L"214012.adoFFu%1Fa00ForacleFd/agFrdbmsFracdbFracdb1F/nc/dentF/ncd/r4(&,*Fracdb14dbrm

     4*&))4/(&,*.trc----------------------------------------------------------6E;E6 "96O"7-----

    ------------------------------------------------------------------------------------------------------------------------------------------------

    7um0 3/leFu%1Fa00ForacleFd/agFrdbmsFracdbFracdb1F/nc/dentF/ncd/r4(&,*Fracdb14dbrm4*&))4/(&,*.trc

    Oracle 7atabase 11g Enter0r/se Ed/t/on Release 11.).%.(.% - &'b/troduct/on

    W/th the art/t/on/ngJ Real "00l/cat/on 5lustersJ "utomat/c !torageanagementJ O6"J

    7ata /n/ng and Real "00l/cat/on Test/ng o0t/onsOR"56E4OE = Fu%1Fa00ForacleF0roductF11.).%Fdbhome41!ystem name 6/nuNode name db-oracle-node1.cloud.lab.eng.bos.redhat.com

    Release ).&.()-(,+.el&.+&4&';ers/on #1 ! Tue an )> 11'*'1 E!T )%1(ach/ne +&4&'Instance name racdb1Redo thread mounted by th/s /nstance 1Oracle 0rocess number *n/ 0rocess 0/d *&))J /mage Z

    )%1(-%+-)1 1%(,1%.+>) !E!!ION I7B11(.1C )%1(-%+-)1 1%(,1%.+>) 56IENT I7BC )%1(-%+-)1 1%(,1%.+>) !ER;I5E N"EB!9!L:"5KGRON7C )%1(-%+-)1 1%(,1%.+>) O76E N"EBC )%1(-%+-)1 1%(,1%.+>) "5TION N"EBC )%1(-%+-)1 1%(,1%.+>)

    7um0 cont/nued 3rom 3/leFu%1Fa00ForacleFd/agFrdbmsFracdbFracdb1FtraceFracdb14dbrm4*&)).trc1 Error !tac2

    OR"-%*'', ece0t/on encountered core dum0 @semt/medo0BCU1%A@!IG!EG;A @"77R%7'(1%%%%,*:"A @5%(:(1)E"

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    96/98

     # D87*2?&*/bin/adrciadrc/ ips create package problem 1 correlate all5reated 0ac2age 1 based on 0roblem /d 1J correlat/on le$el all

    5O0E Pro

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    97/98

    Appendix 8 Re#erences

    0ECH Gnix "e'ap*ores and "*ared 8e'ory Explained /D 17766&1Ihtt@@/o*sora*le*o@*/@511882K01@install112@e2$%21@reKinstallht

    Oracle rid /n#rastructure! Oracle Docu'entationhtt@@/o*sora*le*o@*/@5182$8K01@/o*@install112@e1676%@ora*lerestarthtC3D&DA9Bhtt@@/o*sora*le*o@*/@511882K01@install112@e10812@*on*etsht

    0uning Red Hat Enterprise Linux .or Oracle Oracle RAC by "cott Crot! "r&Consultant! Red Hathtt@@re/hat*o@[email protected]@2010@[email protected]@/e*o/ing-the-*o/e@ri@s*ott-"$#[email protected]>

  • 8/21/2019 Deploying Oracle 11gr2 Rac on Rhel6 1.1

    98/98