NAS5320 SunCluster RAC

download NAS5320 SunCluster RAC

of 27

Transcript of NAS5320 SunCluster RAC

  • 8/13/2019 NAS5320 SunCluster RAC

    1/27

    Oracle(R)10gR2 Real ApplicationCluster Installation Using Sun ClusterSoftware and Sun StorageTek(R)000Series !AS Appliance

    AS"#

    $isk "roducts %roupSun &icros'stes Inc*

  • 8/13/2019 NAS5320 SunCluster RAC

    2/27

  • 8/13/2019 NAS5320 SunCluster RAC

    3/27

    Sun &icros'stes Inc*

    + 200 Sun &icros'stes Inc* ,10 !etwork Circle Santa Clara CA -0, USA

    All rig.ts reser/ed*

    T.is product or docuent is protected ' cop'rig.t and distriuted under licenses restricting its use cop'ing distriution and

    decopilation* !o part of t.is product or docuent a' e reproduced in an' for ' an' eans wit.out prior written aut.oriation ofSun and its licensors if an'* T.irdpart' software including font tec.nolog' is cop'rig.ted and licensed fro Sun suppliers*

    "arts of t.e product a' e deri/ed fro 3erkele' 3S$ appliances licensed fro t.e Uni/ersit' of California*

    Sun Sun &icros'stes Sun Stor#dge t.e Sun logo are tradearks registered tradearks or ser/ice arks of Sun &icros'stesInc* in t.e U*S* and ot.er countries*

    U!I4 is a registered tradeark in t.e United States and ot.er countries e5clusi/el' licensed t.roug. 46Open Copan' 7td*

    8indows is a registered tradeark of &icrosoft Corporation in t.e United States and ot.er countries*

    All S"ARC tradearks are used under license and are tradearks or registered tradearks of S"ARC International Inc* in t.e U*S*and ot.er countries* "roducts earing S"ARC tradearks are ased upon an arc.itecture de/eloped ' Sun &icros'stes Inc*

    T.e O"#! 7OO9 and Sun:s %rap.ical User Interface was de/eloped ' Sun &icros'stes Inc* for its users and licensees* Sunacknowledges t.e pioneering efforts of 4ero5 in researc.ing and de/eloping t.e concept of /isual or grap.ical user interfaces for t.ecoputer industr'* Sun .olds a none5clusi/e license fro 4ero5 to t.e 4ero5 %rap.ical User Interface w.ic. license also co/ers Sun:slicensees w.o ipleent O"#! 7OO9 %UIs and ot.erwise copl' wit. Sun:s written license agreeents*

    R#STRICT#$ RI%;TS< Use duplication or disclosure ' t.e U*S* %o/ernent is su=ect to restrictions of >AR 2*22?1,(g)(2)(@6?)and >AR 2*22?1-?) or $>AR 22*22??01()(@6-) and $>AR 22?*?202B(a)* $OCU!TATIO! IS "ROI$#$ DAS ISE A!$A77 #4"R#SS OR I&"7I#$ CO!$ITIO!S R#"R#S#!TATIO!S A!$ 8ARRA!TI#S I!C7U$I!% A!F I&"7I#$ 8ARRA!TF O>RC;A!TA3I7ITF >IT!#SS >OR A "ARTICU7AR "UR"OS# OR !O!I!>RI!%#!T AR# $ISC7AI$ #4C#"T TO T;##4T#!T T;AT SUC; $ISC7AIRS ;#7$ TO 3# 7#%A77F

  • 8/13/2019 NAS5320 SunCluster RAC

    4/27

    2 Sun &icros'stes Inc*

    Table of Contents

    Introduction*************************************************************************************************************************************************************1

    Sun StorageTek 000 Series !AS Appliance for Oracle*****************************************************************************************1

    Sun Cluster for Oracle RAC************************************************************************************************************************************1

    Supported Configuration*****************************************************************************************************************************************2

    Sun Cluster Guoru $e/ice(G$) ***************************************************************************************************************************B

    SCSI Reser/ation *************************************************************************************************************************************************B

    Internet SCSI (iSCSI)**********************************************************************************************************************************************,

    Oracle RAC wit. Sun Cluster Ipleentation o/er/iew******************************************************************************************,

    Stage 1 < ;ost Configurations *******************************************************************************************************************************@

    Stage 2a < >ile olue Configuration on StorageTek !AS Appliance*********************************************************************?

    Stage 2 < iSCSI 7U! Configuration on StorageTek !AS and Cluster !odes********************************************************

    Stage B < Sun Cluster B*1 U , setup************************************************************************************************************************-

    Stage , < Installing Oracle RAC >raework for Sun Cluster*********************************************************************************10

    Stage < Oracle #n/ironent Setup*********************************************************************************************************************11

    Stage @ < Oracle 10gR2 Clusterware Installation***************************************************************************************************1B

    Stage ? < Oracle RAC $ataase inaries Installation********************************************************************************************1,

    $ataase Creation************************************************************************************************************************************************1

    Reference*************************************************************************************************************************************************************1@

    Appendi5***************************************************************************************************************************************************************1?

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    5/27

    1 Introduction Sun &icros'stes Inc*

    Introduction

    T.is tec.nical report descries t.e procedure to ipleent a twonode Oracle10gR2 (R) Real Application Cluster

    (RAC) wit. Sun Cluster Software in a Solaris T&10 U2 Operating en/ironent using Sun StorageTek(R) 000!AS appliance for storage*

    T.e intended audience are s'ste and6or dataase adinistrators* T.e reader of t.is docuent is assued to.a/e a fair understanding of Solaris Sun Cluster software Oracle Clusterware iSCSI and !>S protocols*

    !ote < T.e ter Sun StorageTek NAS Applianceis s'non'ousl' used wit. Sun StorageTek NAS 5320Appliance.

    Sun StorageTek 000 Series !AS Appliance for Oracle

    Soe of t.e ke' ad/antages ' ipleenting Oracle RAC using Sun StorageTek 000 Series !AS Applianceare S s.ared and /er' eas' to anage*

    B* Controller ased RAI$ data protection*,* 3usiness Continuit' protection features suc. as C.eckpoint Software (Snaps.ot) and >ile Replicator

    (Reote irroring) pro/ide wa's to protect t.e data fro failures* 3ot. t.ese features are certified towork wit. Oracle10g6-i dataases*

    * Oracle RAC ipleentations on Sun StorageTek !AS appliance is certified ' Oracle*@* $'naic addition of space to t.e file /olue wit.out an' down tie for Oracle RAC*

    Sun Cluster for Oracle RAC

    Sun Cluster is part of t.e Solaris #nterprise S'ste* Sun Cluster software offers t.e preier a/ailailit' platforfor ipro/ing t.e predictailit' and resilience of usiness critical applications suc. as Oracle dataases in aclustered en/ironent* Sun Cluster fraework for Oracle RAC pro/ides t.e enterprise wit. increasedanageailit' for RAC deplo'ents on ot. S"ARC and 4@, platfors*

    T.e following are soe of t.e ad/antages w.ile ipleenting Oracle RAC wit.in Sun Cluster fraework S/B

    Sun Cluster Guoru de/ice iSCSI 7U! of Sun StorageTek 000 !AS

    (or)

    A s.ared >C storage (direct attac.ed 6 SA!)

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    7/27

    B Sun Cluster Guoru $e/ice(G$) Sun &icros'stes Inc*

    Sun Cluster Guoru $e/ice(G$)

    In Sun Cluster t.e ec.anis t.at deterines node participation is known as a quorum* #ac. cluster node is

    counted towards a Huoru /ote* >or t.e cluster to e operational t.e /ote reHuireent is !62 K 1 w.ere ! is t.enode count* In a twonode cluster in order for t.e cluster to sur/i/e it reHuires at least 2 /otes* 8it.out a t.irdHuoru in t.e e/ent of one of t.e cluster node is down t.e entire cluster would e down* In order to a/oid t.atcondition a s.ared storage de/ice is identified and configured as t.e Huoru de/ice* T.e de/ice ust e as.ared disk t.at can e accessed ' ot. t.e nodes of t.e cluster* Sun Cluster configurations use Huorude/ices to aintain data and resource integrit' ' pre/enting anesia and splitrain proles w.en t.e clusternode attepts to =oin t.e cluster*

    T.e reHuireents or ot.er topologies it is optional* Configure odd nuer of Huoru de/ices* To ensure t.e Huoru de/ices to .a/e .a/e copletel'

    independent failure pat.wa's* T.ere is no real sie reHuireent for t.e Huoru de/ice* It is also possile to assign t.e de/ice w.ic.

    could contain user data as t.e Huoru de/ice*

    To ipleent a twonode Sun Cluster wit. StorageTek !AS Appliance t.e following et.ods can e used*

    1* Use iSCSI 7un fro StorageTek !AS appliance as s.ared lock de/ice for Huoru de/ice*2* Use s.ared disk fro direct attac.ed >C storage (or) SA! 7un for Huoru de/ice*B* Using Sun Cluster B*2 /ersion a Guoru Ser/er can e configured*

    In t.is docuent t.e procedure for et.od (1) w.ic. uses iSCSI as t.e Huoru de/ice is e5plained* If t.e userc.oose to use a noniSCSI lun as G$ t.e sae procedure can e followed e5cluding Stage2 w.ic. descriesiSCSI configuration*

    SCSI Reser/ation

    Sun Cluster uses t.e SCSI reser/ation ec.anis in con=unction wit. Huoru principle for data integrit'protection* 8.en t.e cluster is fored one node takes responsiilit' of t.e Huoru de/ice and is tagged as t.e

    owner* T.e ot.er node is tagged as capale of ecoing owner* T.e ke's are written to t.e Huoru de/ice 'ot. t.e nodes and so t.e nodes are allowed to e part of t.e cluster* If a node lea/es t.e cluster t.e ot.ernode clears t.e ke's t.at elong to t.e node t.at left t.e cluster* T.e node is fenced and no I6O can .appen frot.e node* 8.en t.at node re=oins t.e cluster t.e ke's are reregistered and enaled access* Sun Cluster useseulated "%R (persistent group reser/ation) for SCSI2 de/ices* >or cluster nodes wit. ore t.an two nodest.e s.ared storage de/ice ust e SCSIB capale*

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

    !odea !ode

    1 1

    Guoru $e/ice

    1

  • 8/13/2019 NAS5320 SunCluster RAC

    8/27

    , Internet SCSI (iSCSI) Sun &icros'stes Inc*

    Internet SCSI (iSCSI)

    iSCSI is a protocol t.at enales transport of lock data o/er I" network* T.is protocol doesnJt reHuire an' specialnetwork infrastructure t.at is t'picall' reHuired for lock de/ice access fro de/ices suc. as >ire c.annel* SunStorageTek !AS appliance .as t.e capailit' to pro/ide lock le/el access for t.e file /olue*

    T.e iSCSI luns are created and granted access to t.e nodes in t.e StorageTek !AS appliance* After t.at t.eiSCSI configuration .as to e done at t.e nodes* T.e iSCSI luns are disco/ered ' t.e nodes eit.er using staticor dynamic (target) et.od* In static et.od de/ice is disco/ered ' pro/iding t.e iSCSI nae w.ic. is gi/en' t.e !AS appliance for t.at lun* In target disco/er' et.od all t.e iSCSI luns t.at are created in t.e !ASappliance can e accessed ' t.e node*

    Oracle RAC wit. Sun Cluster Ipleentation o/er/iew

    >or t.is proof of concept StorageTek !AS B20 Appliance is used to store all Oracle files including Oracledataase files OCR oting and Oracle inaries* >or Huoru de/ice iSCSI lun fro StorageTek !AS is

    used*Sun Cluster inaries are stored local to t.e nodes*

    In our test en/ironent a fres. install of Solaris 10 U 2 was done on ot. t.e cluster nodes* A slig.tl' differentprocedure .a/e to e followed for t.e 4@ and Sparc arc.itectures* T.ose are e5plained w.ere/er applicale*

    Note :T.e steps pro/ided .ere are to e considered onl' as a guideline and not to e sustituted for t.e installprocedures pro/ided ' t.e indi/idual coponents* >or details please refer to t.e installation docuents forSun Cluster B*1 Oracle RAC agent for Sun Cluster B*1 Oracle Clusterware Oracle $ataase StorageTek B20!AS Appliance and Solaris operating s'ste* Also /erif' t.e copatiilit' atri5 etween Solaris /ersionsOracle /ersions and Sun Cluster /ersions for dependencies*

    T.e steps and procedures e5plained in t.is docuent are ased on Sun Cluster B*1 Update , /ersion* >or SunCluster B*2 /ersion please refer to t.e docuentation for t.at steps need to e followed*

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    9/27

    Stage 1 < ;ost Configurations Sun &icros'stes Inc*

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    10/27

    @ Stage 1 < ;ost Configurations Sun &icros'stes Inc*

    Stage 1 < ;ost Configurations

    T.e following steps are to e perfored on ot. t.e nodes*

    hysical configurations

    1* Two cluster nodes wit. siilar arc.itecture (4@ or Sparc)*2* One 00&3 partition for gloalde/ice configuration on eac. node*B* At least two pri/ate interconnects (%ig#) etween t.e /ia gig# switc.*,* Sun StorageTek !AS appliance wit. two %ig# network interface for data pat.* T.e t.ird !IC is used for

    anageent*

    !n"iron#ent configurations

    1* #nale telnetsessions and /erif' S e5port for t.e file /olues fro %UI enu P click on file /olue P rig.t click and c.ooseproperties*

    1* Access < ead-rite

    2* &ap root user < root

    B* ;ost < C.ooseost /roupand fro dropdown c.oose t.e scracnas*

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

    http://sunsolve.com/http://sunsolve.com/
  • 8/13/2019 NAS5320 SunCluster RAC

    12/27

    Stage 2 < iSCSI 7U! Configuration on StorageTek !AS and Cluster !odes Sun &icros'stes Inc*

    Stage 2 < iSCSI 7U! Configuration on StorageTek !AS and Cluster !odes

    T.e following is t.e procedure to create and use t.e iSCSI lun as Huoru de/ice* >or t.is proofofconcept t.e

    iSCSI de/ice is going to e used purel' for Huoru purposes and not for storing an' data* !o iS!S ser/er isconfigured*

    On Sun StorageTek !AS Appliancero t.e dropdown /olue list* C.oose t.e file/olue iscsiqd* C.oose sie saller t.an t.e file/olue sie ( &3 ) After t.is step t.e !AS o5 adds t.e iSCSI lun and assigns nae*

    iqn.1986-03.com.sun:01:000e0c9f0afe.44D4C0E4.iscsiqd

    On ot. t.e cluster nodes > /boot/solaris/filelist.ramdisk

    Sun Cluster Install steps on node-a:

    1* Install t.e sun cluster software* >ro t.e installation C$ or location run t.e coand scinstallcoand toinitiate t.e installation*

    # cd /sparc/stack/Solaris_sparc/Product/sun_cluster/Solaris_10/Tools

    # ./scinstall

    2* C.oose to install nly t!is node at t!is timeoption

    B* "ro/ide t.e cluster nae* >or e5aple scracnas

    ,* After t.e copletion of t.e steps t.e s'ste reoots*

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

    http://scsi_vhci/ssd@g6080020fff9e6d400000000300000000http://scsi_vhci/ssd@g6080020fff9e6d400000000300000000
  • 8/13/2019 NAS5320 SunCluster RAC

    14/27

    10 Stage B < Sun Cluster B*1 U , setup Sun &icros'stes Inc*

    * 8.en t.e s'ste coes ack up runusrcluster+inscsetupand perfor t.e following raework for Sun Cluster

    On both the nodes:

    1* For $34C 5ased syste#s only

    &ake entries inetcv#sta+so t.at t.e /olues can e ounted autoaticall' upon s'ste reoots* &ake suret.at t.e rsie and wsie are atleast B29* $irect I6O ust e used on OCR oting and dataase files* $irect I6Os.ould not e used for Oracle inaries ount point*

    As oracle user ake sure to add t.e .ost naes in .r!osts* Ot.erwise rs. a' fail and causes N1ser

    6quivalence ailed during Oracle:s runcluv#ycoand*

    6ount O(tions :

    Ty(e of File NF$ 6ount O(tions

    Oracle Clusterware files (oting and OCR) L

    Oracle $ataase >iles

    rwg.ardnointrrsieB2?@wsieB2?@prototcp/ersBnoacforcedirectio

    Oracle Clusterware inaries

    Oracle $ataase inaries

    rwg.ardnointrrsieB2?@wsieB2?@prototcp/ersBnoacsuid

    8escri(tions for the NF$ #ount o(tions :

    Mount Options Description

    hard / soft If N.ard ounted t.e Oracle ser/er does not cras. if t.e underl'ing files'ste is una/ailale (eit.er due to planned or unplanned down tie for!AS appliance)* If Nsoft ounted t.en t.e Oracle ser/er a' cras. if t.edataase /olues especiall' for control and redo log /olues areuna/ailale* It is strongl' recoended to use N.ard ount for Oracledataases*

    rw / ro T.e ode of file s'ste access* readwrite or readonl'*

    suid T.is option instructs t.e Oracle $ataase ser/er to .onor t.e setuid iton files ounted at t.e ount point* If 'ou are placing an' of t.e Oracleinaries onto t.e StorageTek !AS Appliance t.en t.is setting ust eused*

    intr T.is option akes t.e connection interruptile* 8.en coined wit. t.eN.ard option t.is paraeter enales t.e adinistrator to interrupt t.eapplication t.at is .olding t.e !>S connection*

    forcedirectio T.is option enales $irect I6O for all files under t.e ount point and

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    17/27

    1B Stage < Oracle #n/ironent Setup Sun &icros'stes Inc*

    Mount Options Description

    allows t.e 7og 8riter to efficientl' transit t.e data to storage wit.out t.elatenc' associated wit. splitting I6O into page sie transfers*

    Recoended for data files and redo logs* Note7 T!is option is not to +eused on racle +inary location or luster egistry iles*

    bg T.is option indicate t.at ount is to retr' in t.e ackground if t.eser/er:s ount daeon does not respond*

    vers T.e N/ers option enales t.e adinistrator to specif' t.e !>S /ersionto use* T.ere are two /ersions of !>S< /ersion 2 and /ersion B* ersion Bsupports additional file operations t.at /ersion 2 did not .a/e*

    proto It is t.e t'pe of I" connection to e used* Sun and Oracle Suggest usingTC"* TC" enforces iportant reHuireents suc. as packet ordering andpacket acknowledgent for reacting to /arious network anoalies*

    rsize & wsize T.ese are to set t.e read and write packet sies* It s.ould e a ultiple

    of 12 'tes* >or oracle dataases set it to B2?@ (B29)*llock T.is !>S ount option was introduced to address perforance issues '

    utiliing local file locking rat.er t.an !>S: !etwork 7ock &anager (!7&)*T.is .as t.e potential to draaticall' ipro/e perforance*

    timeo Tieout in 1610 of t.e second* Specif'ing @00 it is @0 seconds*

    Sun StorageTek 000 !AS appliance .a/e t.e usiness continuit' preiu features suc. as snaps.ot andreote replication w.ic. can e ipleented for RAC dataase* "lease refer to t.e docuents under.ttp

  • 8/13/2019 NAS5320 SunCluster RAC

    18/27

    1, Stage @ < Oracle 10gR2 Clusterware Installation Sun &icros'stes Inc*

    @* C.oose 6"ternal edundancyand pro/ide one location for OCR file*

    /clusterware/ocr/ocr.dbf

    ?* C.oose 6"ternal edundancy and pro/ide one location for oting disks*/clusterware/voting/voting.dbf

    Note :6"ternal edundancy is used ecause t.e !AS appliance uses RAI$ to stripe data across dri/es* If

    additional protection is reHuired t.en it is recoended to create RAI$ groups out of different set of dri/es and

    create file/olue to store additional copies of clusterware files*

    * Run ora8nstoot.s!and root.s! w.en propted for on ot. t.e nodes one at a tie and not to e run inparallel* T.e script forats t.e /oting and OCR files* On t.e second node w.ile t.e root*s. configures t.eclusterware file it atteps to configure I" ' doing a silent launc. of /ipca* $epending on t.e I" address (if t.eaddress is of R>C1-1 copliant) t.e registration of resources suc. as I" %$S and O!S a' not occur*

    -* If t.e pre/ious step was run successful wit.out errors skip t.is step* Ot.erwise fro one of t.e node as root

    user set t.e $IS"7AF paraeter and launc. /ipca utilit'*# $ORA_CRS_HOME/bin/vipca

    "ro/ide t.e correct I" addresses for ot. t.e nodes* T.e %UI t.en registers t.e I"%S$ and O!Sresources to t.e CRS* T.en it starts t.ose resources*

    T.e Oracle Clusterware installation can e /alidated using t.ecrs4stat coand (after running t.e root*s. frot.e last node)* 8it. t.at step t.e Oracle Clusterware installation is coplete*

    Stage ? < Oracle RAC $ataase inaries Installation

    "lease refer to Oracle docuentation for step'step details on Oracle RAC $3 installation* It is possile toinstall t.e Oracle dataase inaries on eit.er s.ared .oe on !AS or local to t.e nodes*

    If a s.ared Oracle .oe is used t.en ORAC7#Q;O ust e t.e sae across nodes* A soft link cane created w.ic. points to t.e !AS director' (or) use t.e sae ount point*

    /oracle/products/db/10.2.0

    As oracle user initiate t.e uni/ersal installer for Oracle RAC dataase inar' installation

    $ export DISPLAY=:0.0

    $ cd /.runInstaller

    "ro/ide t.e following inforation w.en asked for oreasier and efficient anageent it is sufficient to .a/e one large file /olue to store all t.e dataasefiles and online redo logs* If additional cluster node is added t.en an additional set of redo logs wit. anew t.read nuer are to e created and enaled*

    2* #ac. instance nae and instance nuer ust e uniHue* T.e :A;64

  • 8/13/2019 NAS5320 SunCluster RAC

    20/27

    1@ Sun &icros'stes Inc*

    Conclusion

    Sun StorageTek !AS offers a perfect and eas' platfor for Oracle RAC deplo'ent for easier ipleentationand aintenance* StorageTek !AS also offers iSCSI luns t.at can e used for data as well as Huoru disk forCluster* Using Sun Cluster B*1 wit. Oracle Clusterware pro/ides superior a/ailailit' scalailit' stailit' andperforance to t.e Oracle 10g RAC infrastructure*

    Reference

    Sun Cluster $ata Ser/ice for Oracle Real Application Clusters guide for Solaris OS ("art 1-0B10)Sun StorageTek B20 !AS $ocuentation (.ttp

  • 8/13/2019 NAS5320 SunCluster RAC

    21/27

    1? Appendi5 Sun &icros'stes Inc*

    Appendi5

    /etc/hosts

    # cat /etc/hosts

    #

    # Internet host table

    #

    127.0.0.1 localhost

    172.20.98.85 node-a loghost

    172.20.98.86 node-b

    ## VIP Nodes

    172.20.200.200 node-a-vip

    172.20.200.201 node-b-vip

    For ,-.1 /boot/solaris/filelist+ra#disk

    # cat filelist.ramdisk

    etc/rtc_config

    etc/system

    etc/name_to_major

    etc/driver_aliases

    etc/name_to_sysnum

    etc/dacf.conf

    etc/driver_classes

    etc/path_to_inst

    etc/mach

    etc/devices/devid_cache

    etc/devices/mdi_scsi_vhci_cache

    etc/devices/mdi_ib_cachekernel

    platform/i86pc/biosint

    platform/i86pc/kernel

    boot/solaris.xpm

    boot/solaris/bootenv.rc

    boot/solaris/devicedb/master

    boot/acpi/tables

    etc/cluster/nodeid

    /etc/"fstab

    # Oracle Binaries

    b20-5310a:ora10gbin - /oracle nfs - yes

    rw,bg,hard,nointr,rsize=32768,wsize=32768,vers=3,noac,proto=tcp,suid# OCR and Voting Files

    b20-5310a:clusterware - /clusterware nfs - yes

    rw,bg,hard,nointr,rsize=32768,wsize=32768,vers=3,noac,proto=tcp,forcedirectio

    # Database Files

    b20-5310a:oradata - /oradata nfs - yes

    rw,bg,hard,nointr,rsize=32768,wsize=32768,vers=3,noac,proto=tcp,forcedirectio

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    22/27

    1 Appendi5 Sun &icros'stes Inc*

    ifconfig co##and# ifconfig -a

    lo0: flags=2001000849 mtu 8232 index 1

    inet 127.0.0.1 netmask ff000000

    bge0: flags=1000843 mtu 1500 index 2 inet 172.20.98.85 netmask ffffff00 broadcast 172.20.98.255

    groupname sc_ipmp0

    ether 0:14:4f:2a:93:3a

    bge0:1: flags=1040843 mtu 1500 index

    2

    inet 172.20.200.200 netmask ffffff00 broadcast 172.20.200.255

    bge1: flags=1008843 mtu 1500 index 4

    inet 172.16.0.129 netmask ffffff80 broadcast 172.16.0.255

    ether 0:14:4f:2a:93:3b

    bge2: flags=1008843 mtu 1500 index 3

    inet 172.16.1.1 netmask ffffff80 broadcast 172.16.1.127

    ether 0:14:4f:2a:93:3c

    clprivnet0: flags=1009843

    mtu 1500 index 5

    inet 172.16.193.1 netmask ffffff00 broadcast 172.16.193.255

    ether 0:0:0:0:0:1

    lo0: flags=2002000849 mtu 8252 index 1

    inet6 ::1/128

    bge1: flags=2008841 mtu 1500 index 4

    inet6 fe80::214:4fff:fe2a:933b/10

    ether 0:14:4f:2a:93:3b

    bge2: flags=2008841 mtu 1500 index 3

    inet6 fe80::214:4fff:fe2a:933c/10

    ether 0:14:4f:2a:93:3c

    >or 4@ scstat g ( notice no racQudl resources )

    # scstat -g

    -- Resource Groups and Resources --

    Group Name Resources

    ---------- ---------

    Resources: rac-framework-rg rac_framework rac_hwraid

    -- Resource Groups --

    Group Name Node Name State

    ---------- --------- -----

    Group: rac-framework-rg node-b Online

    Group: rac-framework-rg node-a Online

    -- Resources --

    Resource Name Node Name State Status Message

    ------------- --------- ----- --------------

    Resource: rac_framework node-b Online Online

    Resource: rac_framework node-a Online Online

    Resource: rac_hwraid node-b Online Online

    Resource: rac_hwraid node-a Online Online

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    23/27

    1- Sun &icros'stes Inc*

    >or Sparc s'ste

    # scstat -g

    -- Resource Groups and Resources --

    Group Name Resources

    ---------- ---------

    Resources: rac-framework-rg rac_framework rac_udlm rac_hwraid

    -- Resource Groups --

    Group Name Node Name State

    ---------- --------- -----

    Group: rac-framework-rg node-a Online

    Group: rac-framework-rg node-b Online

    -- Resources --

    Resource Name Node Name State Status Message

    ------------- --------- ----- --------------

    Resource: rac_framework node-a Online Online

    Resource: rac_framework node-b Online Online

    Resource: rac_udlm node-a Online Online

    Resource: rac_udlm node-b Online Online

    Resource: rac_hwraid node-a Online Online

    Resource: rac_hwraid node-b Online Online

    Sparc scstat coand

    # scstat

    ------------------------------------------------------------------

    -- Cluster Nodes --

    Node name Status

    --------- ------

    Cluster node: node-a Online

    Cluster node: node-b Online

    ------------------------------------------------------------------

    -- Cluster Transport Paths --

    Endpoint Endpoint Status

    -------- -------- ------

    Transport path: node-a:bge2 node-b:bge2 Path online

    Transport path: node-a:bge1 node-b:bge1 Path online

    ------------------------------------------------------------------

    -- Quorum Summary --

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    24/27

    20 Sun &icros'stes Inc*

    Quorum votes possible: 3

    Quorum votes needed: 2

    Quorum votes present: 3

    -- Quorum Votes by Node --

    Node Name Present Possible Status

    --------- ------- -------- ------

    Node votes: node-a 1 1 Online

    Node votes: node-b 1 1 Online

    -- Quorum Votes by Device --

    Device Name Present Possible Status

    ----------- ------- -------- ------

    Device votes: /dev/did/rdsk/d7s2 1 1 Online

    ------------------------------------------------------------------

    -- Device Group Servers --

    Device Group Primary Secondary

    ------------ ------- ---------

    -- Device Group Status --

    Device Group Status

    ------------ ------

    -- Multi-owner Device Groups --

    Device Group Online Status

    ------------ -------------

    ------------------------------------------------------------------

    -- Resource Groups and Resources --

    Group Name Resources

    ---------- ---------

    Resources: rac-framework-rg rac_framework rac_udlm rac_hwraid

    -- Resource Groups --

    Group Name Node Name State

    ---------- --------- -----

    Group: rac-framework-rg node-a Online

    Group: rac-framework-rg node-b Online

    -- Resources --

    Oracle 10gR2 RAC wit. Sun Cluster on StorageTek !AS Appliance

  • 8/13/2019 NAS5320 SunCluster RAC

    25/27

    21 Sun &icros'stes Inc*

    Resource Name Node Name State Status Message

    ------------- --------- ----- --------------

    Resource: rac_framework node-a Online Online

    Resource: rac_framework node-b Online Online

    Resource: rac_udlm node-a Online Online

    Resource: rac_udlm node-b Online Online

    Resource: rac_hwraid node-a Online Online

    Resource: rac_hwraid node-b Online Online

    ------------------------------------------------------------------

    -- IPMP Groups --

    Node Name Group Status Adapter Status

    --------- ----- ------ ------- ------

    IPMP Group: node-a sc_ipmp0 Online bge0 Online

    IPMP Group: node-b sc_ipmp0 Online bge0 Online

    i$C$I co##and e0a#(les 9in the nodes :

    #iscsiadm list discovery

    Discovery:

    Static: disabled

    Send Targets: disabled

    iSNS: disabled

    To #nale static configuration