Oracle Database 11g Installation of Clusterware and RAC

8/10/2019 Oracle Database 11g Installation of Clusterware and RAC

1/97

Overview of RAC

Learning Objective

After completing this topic, you should be able to

identify key concepts related to Real Application Clusters

1. Cluster databases and workload types

Oracle Database 10 g and the specific new manageability enhancements provided byOracle RAC 10 g enable RAC for everyone all types of applications and enterprise grids(the basis for fourth generation computing!"

#nterprise grids are built from large configurations of standardi$ed% commodity pricedcomponents! &hey are processors% networ'% and storage! ith Oracle RAC)s cachefusion technology% the Oracle database adds to this the highest levels of availability andscalability! Also% with Oracle RAC 10 g % it becomes possible to perform dynamicprovisioning of nodes% storage% C*+s% and memory to maintain service levels more easilyand efficiently!

Graphic

The History of Innovation begins with the Nonblocking queries and OPS

components It then proceeds to !ata "uard and #esource $anager and then to#%& and 'ow(cost commodity clusters components It then reaches the)nterprise "rids )nterprise "rids are built from %utomatic Storage $anagement*

%utomatic +orkload $anagement* "rid &ontrol* and Oracle &lusterware

upple!ent

Selecting the link title opens the resource in a new browser window

tyle considerations

,iew more information on the style considerations for Oracle 11 g Database usedin this course

Launch window

#nterprise grids are the data centers of the future and enable business to be adaptive%proactive% and agile for the fourth generation!
http://dowindow%28%27../t2/misc/lwod_orac_a01_it_enus_t201.html')http://dowindow%28%27../t2/misc/lwod_orac_a01_it_enus_t201.html')


2/97

&he ne-t ma.or transition in computing infrastructure is going from the era of bigsymmetric multiprocessing or / * models to the era of grids!

A cluster consists of two or more independent% but interconnected servers! /everalhardware vendors have provided cluster capability over the years to meet a variety ofneeds!

/ome clusters were intended only to provide high availability by allowing wor' to betransferred to a secondary node if the active node fails! Others were designed to providescalability by allowing user connections or wor' to be distributed across the nodes!

Another common feature of a cluster is that it should appear to an application as if it werea single server! /imilarly% management of several servers should be as similar to themanagement of a single server as possible! &he cluster management software providesthis transparency!

"ote

Interconnected nodes act as a single server &luster software hides the structure!isks are available for read and write by all nodes Operating system is the sameon each machine

or the nodes to act as if they were a single server% files must be stored in such a waythat they can be found by the specific node that needs them! &here are several differentcluster topologies that address the data access issue% each dependent on the primarygoals of the cluster designer!

&he interconnect is a physical networ' used as a means of communication between eachnode of the cluster! 2n short% a cluster is a group of independent servers that cooperate asa single system!

"ote

The clusters you are going to manipulate in this course all have the sameoperating system This is a requirement for #%& clusters

Real Application Clusters is a software that enables you to use clustered hardware by

running multiple instances against the same database! &he database files are stored ondis's that are either physically or logically connected to each node% so that every activeinstance can read from or write to them!

&he Real Application Clusters software manages data access so that changes arecoordinated between the instances and each instance sees a consistent image of thedatabase! &he cluster interconnect enables instances to pass coordination informationand data images between each other!


3/97

&his architecture enables users and applications to benefit from the processing power ofmultiple machines! RAC architecture also achieves redundancy in the case of% fore-ample% a system crashing or becoming unavailable3 the application can still access thedatabase on any surviving instances!

&he following are benefits of using RAC4

high availability that deals with surviving node and instance failures

scalability% which allows you to add more nodes as you need them in the future

pay as you grow% which re5uires you to pay for only what you need today% and

'ey grid computing features that include growth and shrin'age on demand% single button additionof servers% and automatic wor'load management for services

&he Oracle Real Application Clusters or RAC includes further benefits! +sing RACenables high utili$ation of a cluster of standard% low cost modular servers such as blades!

RAC offers automatic wor'load management for services! /ervices are groups orclassifications of applications that comprise business components corresponding toapplication wor'loads! /ervices in RAC enable continuous% uninterrupted databaseoperations and provide support for multiple services on multiple instances!

6ou assign services to run on one or more instances% and alternate instances can serveas bac'up instances! 2f a primary instance fails% the Oracle server moves the servicesfrom the failed instance to a surviving alternate instance!

&he Oracle server also automatically load balances connections across instances hostinga service!

RAC harnesses the power of multiple low cost computers to serve as a single largecomputer for database processing% and provides the only viable alternative to large scalesymmetric multiprocessing or / * for all types of applications!

RAC% which is based on a shared dis' architecture% can grow and shrin' on demandwithout the need to artificially partition data among the servers of your cluster! RAC alsooffers a single button addition of servers to a cluster! &hus% you can easily provide orremove a server to or from the database!

2f your application scales transparently on / * machines% then it is realistic to e-pect it toscale well on RAC% without having to ma'e any changes to the application code!

RAC eliminates the database instance and the node itself as a single point of failure% andensures database integrity in the case of such failures!


4/97

Graphic

In this e,ample* there are two models - S$P and #%& The S$P model has two pairs of &P.s )ach pair of &P. is linked to a &ache /oth the &aches are inter(linked and it is labeled as &ache coherency The &aches along with the &P.s arelinked to the $emory Similarly* the #%& model includes two pairs of /"Ps )ach

pair of /"P is linked to an S"% and both S"%s are inter(linked and it is labeled as&ache fusion The /"Ps along with the S"%s are linked to the Shared storage

&he following are e-amples of scalability4

allowing more simultaneous batch processes

allowing larger degrees of parallelism and more parallel e-ecutions to occur% and

allowing large increases in the number of connected users in online transaction processing orO7&* systems

"ote

+hat is true for S$P is also true for Non(.niform $emory %rchitecture or N.$%architectures N.$% architectures are the logical ne,t step in scaling from S$Parchitectures

/uccessful implementation of cluster databases re5uires optimal scalability on four levels!&hese levels include the scalability of

hardware

2nterconnectivity is the 'ey to hardware scalability% which greatly depends on highbandwidth and low latency!

operating syste!s

ethods of synchroni$ation in the operating system can determine the scalability of theoperating system! 2n some cases% potential scalability of the hardware is lost because ofthe operating system)s inability to handle multiple resource re5uests simultaneously!

database !anage!ent syste!s# and

Database management system)s 'ey factor in parallel architectures is whether theparallelism is affected internally or by e-ternal processes! &he answer to this 5uestionaffects the synchroni$ation mechanism!

applications

Applications must be specifically designed to be scalable! A bottlenec' occurs in systemsin which every session is updating the same data most of the time! 8ote that this is notRAC specific and is true on single instance system too!


5/97


6/97

additional 5ueries can run without introducing the contention that might occur were theyto run concurrently!

&he type of wor'load determines whether scaleup or speedup capabilities can beachieved using parallel processing! &he three types of wor'loads available are

Graphic

The table for speedup* scaleup* and workloads includes three columns and fourrows The column headings are +orkload* Speedup* and Scaleup The threeworkloads displayed under +orkload column are O'TP and Internet* !SS with

parallel query* and /atch 1mi,ed2 The +orkload O'TP and Internet cannotachieve speedup* but can achieve scaleup The +orkload !SS with parallel query can achieve scaleup and speedup The +orkload /atch 1mi,ed2 has possibilitiesto achieve speedup and can achieve scaleup

Online transaction processing or OL$%

Online transaction processing or O7&* and 2nternet application environments arecharacteri$ed by short transactions that cannot be further bro'en down and% therefore% nospeedup can be achieved!

:owever% by deploying greater amounts of resources% a larger volume of transactions canbe supported without compromising the response!

&ecision support syste!s or & # and

Decision support systems or D// and parallel 5uery options can attain speedup as well as

scaleup because they essentially support large tas's without conflicting demands onresources!

&he parallel 5uery capability within the Oracle database can also be leveraged to decreasethe overall processing time of long running 5ueries and to increase the number of such5ueries that can be run concurrently!

'atch or !i(ed

2n a batch environment with a mi-ed wor'load of D//% O7&*% and reporting applications%scaleup can be achieved by running different programs on different hardware! /peedup ispossible in a batch environment% but may involve rewriting programs to use the parallel

processing capabilities!

)uestion

&he type of wor'load determines whether scaleup or speedup capabilities can beachieved using parallel processing! hich type of environments can achievespeedup capabilities;


7/97

Options*

1! O7&*

9! D// with parallel 5uery

>! 2nternet application

Answer

Option 1: Incorrect Online transaction processing or O'TP is characteri9ed byshort transactions that cannot be further broken down and* therefore* no speedupcan be achieved However* by deploying greater amounts of resources* a largervolume of transactions can be supported without compromising the response

Option 2: &orrect Speedup is possible in a batch environment* but may involverewriting programs to use the parallel processing capabilities

Option 3: &orrect !ecision support systems or !SS with parallel query optionscan attain speedup as well as scaleup because they essentially support largetasks without conflicting demands on resources The parallel query capabilitywithin the Oracle database can also be leveraged to decrease overall processingtime of long(running queries and to increase the number of such queries that canbe run concurrently

Option 4: Incorrect Internet application environments are characteri9ed by shorttransactions that cannot be further broken down and* therefore* no speedup canbe achieved However* by deploying greater amounts of resources* a largervolume of transactions can be supported without compromising the response

Correct answer+s,*

-. $ypical co!ponents and global resources

&o ma'e sure that a system delivers the 2O demand that is re5uired% all system

components on the 2O path need to be orchestrated to wor' together! &he wea'est lin'determines the 2O throughput!

&he system% in this e-ample% includes four nodes two :ost =us Adapters (:=As" pernode and two fiber channel switches% which are attached to four dis' arrays each! &hecomponents on the 2O path are the :=As% cables% switches% and dis' arrays!

*erformance depends on the number and speed of the :=As% switch speed% controller


8/97


9/97

decision support system or D// applications against a database cluster without having toma'e e-pensive code changes or spend large amounts of valuable administrator timepartitioning and repartitioning the database to achieve good performance!

Although OracleE i Real Application Clusters did much to ease the tas' of allowingapplications to wor' in clusters% there are still support challenges and limitations! Amongthese cluster challenges are comple- software environments% support% inconsistentfeatures across platforms% and aw'ward management interaction across the softwarestac'!

Graphic

There are two connected divisions - ;i #%& and 85g Oracle &lusterware The ;i#%& division includes seven components They are %pplications* &luster control*


10/97


11/97

enqueuing mechanisms The primary resources of the ")S controls are dictionary cache locks and library cache locks The ")S also performs deadlock detection toall deadlock(sensitive enqueues and resources

Option 3: Incorrect The "lobal #esource !irectory 1"#!2 is used by #%& torecord information about how resources are used within a cluster database

Option 4: Incorrect )ach instance maintains a part of the "#! in its System"lobal %rea 1S"% 2

Correct answer+s,*

Consider a scenario of ?lobal Cache Coordination that assumes that the data bloc' hasbeen changed% or dirtied by the first instance! urthermore% only one copy of the bloc'e-ists clusterwide% and the content of the bloc' is represented by its /C8! ollowing arethe steps involved in the global cache coordination4

1! &he second instance attempting to modify the bloc' submits a re5uest to the ?C/!

9! &he first instance receives the message and sends the bloc' to the second instance! &he first instanceretains the dirty buffer for recovery purposes! &his dirty image of the bloc' is also called a past image ofthe bloc'! A past image bloc' cannot be modified further!

>! On receipt of the bloc'% the second instance informs the ?C/ that it holds the bloc'!

"ote

The data block is not written to disk before the resource is granted to the secondinstance

Consider this e-ample of rite to Dis' Coordination% which describes how an instancecan perform a chec'point at anytime or replace buffers in the cache as a response to freebuffer re5uests!

=ecause multiple versions of the same data bloc' with different changes can e-ist in thecaches of instances in the cluster% a write protocol managed by the ?C/ ensures thatonly the most current version of the data is written to dis'!

2t must also ensure that all previous versions are purged from the other caches! A writere5uest for a data bloc' can originate in any instance that has the current or past imageof the bloc'!


12/97

2n this rite to Dis' Coordination scenario% assume that the first instance holding a pastimage buffer re5uests that the Oracle server writes the buffer to dis'! :ere are theremaining steps in this scenario4

1! the first instance sends a write re5uest to the ?C/

All system components on the 2O path need to be configured to wor' together! OracleClusterware provides an integrated clusterware layer that delivers a completeenvironment for applications! And these cluster operations re5uire synchroni$ation amongall instances to control shared access to global resources! &o do this% RAC uses the?lobal Resource Directory!

0eatures and functions of RAC

Learning Objective


recognize the main features and functions of RAC


13/97

1. RAC features

hen one instance departs the cluster% the ?RD portion of that instance needs to beredistributed to the surviving nodes! /imilarly% when a new instance enters the cluster% the?RD portions of the e-isting instances must be redistributed to create the ?RD portion ofthe new instance!

2nstead of remastering all resources across all nodes% RAC uses an algorithm called la$yremastering to remaster only a minimal number of resources during a reconfiguration!

or each instance% a subset of the ?RD is mastered along with the names of theinstances to which the resources are currently granted! hen the second instance fails%its resources are remastered on the surviving instances! As the resources areremastered% they are cleared of any reference to the failed instance!

2n addition to dynamic resource reconfiguration% the ?C/ which is tightly integrated with

the buffer cache enables the database to automatically adapt and migrate resources inthe ?RD! &his is called dynamic remastering!

&he basic idea is to master a buffer cache resource on the instance where it is mostlyaccessed! 2n order to determine whether dynamic remastering is necessary% the ?C/essentially 'eeps trac' of the number of ?C/ re5uests on a per instance and per ob.ectbasis!

&his means that if an instance compared to another is heavily accessing bloc's from thesame ob.ect% the ?C/ can ta'e the decision to dynamically migrate all of that ob.ect)sresources to the instance that is accessing the ob.ect most!

Graphic

In this e,ample* there is an Ob=ect with four resources in it There are two nodes -Node8 with Instance8 and Node4 with Instance4 Instance8 also has fourresources )ach one is connected to the resources in the Ob=ect /efore dynamicremastering* two of the resources are connected to Instance4 in Node4 with "&Smessage to master %fter dynamic remastering* none of the resources inInstance8 are connected to Instance4

&here is a situation where the same ob.ect has master resources spread over differentinstances! 2n that case% each time an instance needs to read a bloc' from that ob.ectwhose master is on the other instance% the reading instance must send a message to theresource)s master to as' permission to use the bloc'!

2n the situation after dynamic remastering has occurred% bloc's from the ob.ect haveaffinity to the reading instance which no longer needs to send ?C/ messages across theinterconnect to as' for access permissions!


14/97

"ote

The system automatically moves mastership of undo segment ob=ects to theinstance that owns the undo segments

)uestion

hen an instance departs or enters the cluster% the ?RD portions of the e-istinginstances must be redistributed! hat is this called;

Options*

1! Ob.ect affinity

9! Dynamic reconfiguration

>! ?lobal dynamic performance views

Answer

Option 1: Incorrect %fter dynamic remastering occurs* blocks from the ob=ecthave affinity to the reading instance* which no longer needs to send "&Smessages across the interconnect to ask for access permissions

Option 2: Incorrect In addition to dynamic resource reconfiguration* the "&S*which is tightly integrated with the buffer cache* enables the database toautomatically adapt and migrate resources in the "#! This is called dynamicremastering

Option 3: &orrect +hen one instance departs the cluster* the "#! portion of that instance needs to be redistributed to the surviving nodes Similarly* when a newinstance enters the cluster* the "#! portions of the e,isting instances must beredistributed to create the "#! portion of the new instance This is called dynamic reconfiguration

Option 4: Incorrect "lobal dynamic performance views retrieve information about all started instances accessing one #%& database In contrast* standard dynamic

performance views retrieve information about the local instance only

Correct answer+s,*

9! Dynamic reconfiguration

eatures of global dynamic performance views are


15/97


16/97

6ou can monitor the e-act RAC memory resource usage of the shared pool by 5ueryingV$SGASTAT with this 5uery!

Code

SELECT - ROM %$s*astat&'ERE name ! (e )*_s+) or name ! (e ).CL+)

Oracle supports efficient row level loc's! &hese row level loc's are created when Dataanipulation 7anguage D 7 operations% such as U/DATE % are e-ecuted by anapplication! &hese loc's are held until the application commits or rolls bac' thetransaction!

Any other application process will be bloc'ed if it re5uests a loc' on the same row! Cacheusion bloc' transfers operate independently of these user visible row level loc's! &hetransfer of data bloc's by the ?C/ is a low level process that can occur without waitingfor row level loc's to be released!

=loc's may be transferred from one instance to another while row level loc's are held!?C/ provides access to data bloc's allowing multiple transactions to proceed in parallel!

Graphic

There are four stages in efficient internode row(level locking )ach stage hasNode8 with Instance8 and Node4 with Instance4 In stage one* there is an.P!%T) method and a row(level lock in Instance8 In stage two* there is a row(

level lock in both Instance8 and Instance4 In stage three* there are two row(levellocks in Instance4 and none in Instance8 In the stage four* the &O$$IT methodreplaces the .P!%T) method and there are two row(level locks in both Instance 8and Instance4 There is no block(level lock in any of the four stages

Oracle)s cost based optimi$er incorporates parallel e-ecution considerations as afundamental component in arriving at optimal e-ecution plans! 2n a RAC environment%intelligent decisions are made with regard to intranode and internode parallelism!

or e-ample% if a particular 5uery re5uires si- 5uery processes to complete the wor' andsi- parallel e-ecution slaves are idle on the local node (the node that the user is

connected to"% then the 5uery is processed by using only local resources! &hisdemonstrates efficient intranode parallelism and eliminates the 5uery coordinationoverhead across multiple nodes!

:owever% if there are only two parallel e-ecution servers available on the local node% thenthose two and four of another node are used to process the 5uery! 2n this manner% bothinternode and intranode parallelism are used to speed up 5uery operations!


17/97

2n real world decision support applications% 5ueries are not perfectly partitioned acrossthe various 5uery servers! &herefore% some parallel e-ecution servers complete theirprocessing and become idle sooner than others!

&he Oracle parallel e-ecution technology dynamically detects idle processes and assignswor' to these idle processes from the 5ueue tables of the overloaded processes! 2n thisway% the Oracle server efficiently redistributes the 5uery wor'load across all processes!

Real Application Clusters further e-tends these efficiencies to clusters by enabling theredistribution of wor' across all the parallel e-ecution slaves of a cluster!

-. RAC principles

6ou may see a few additional bac'ground processes associated with a RAC instancethan you would with a single instance database! &hese processes are primarily used tomaintain database coherency among each instance! &hey manage what is called the

global resources!

L3O"

7 O8 is the ?lobal #n5ueue /ervice onitor!

L3& 0

7 D 5 is the ?lobal #n5ueue /ervice Daemon!

L3 x

7 / , is any ?lobal Cache /ervice *rocess% where - can range from 0 to .!

LC4 0 7CH5 is the 7oc' process!

&2AG

D2A? is the Diagnosability process!

At the cluster level% you find the main processes of Oracle Clusterware! &hey provide astandard cluster interface on all platforms and perform high availability operations! 6oufind these processes on each node of the cluster4

CRSD and RACGIMON are engines for high availability operations

OCSSD% which provides access to node membership and group service

EVMD that scans callout directory and invo'es callouts in reactions to detected events% and

O/ROCD% which is a process monitor for the cluster


18/97

&here are also several tools that are used to manage the various resources available onthe cluster at a global level! &hese resources are the Automatic /torage anagement or

A/ instances% the RAC databases% the services% and node applications!

/ome of the tools that you use throughout this course are /erver Control or SRVCTL%

D=CA% and #nterprise anager!

&he Oracle Database 10 g Real Application Clusters installation is a two phaseinstallation! 2n the first phase% you install Oracle Clusterware! 2n the second phase% youinstall the Oracle database software with RAC components and create a clusterdatabase!

&he Oracle :ome that you use for Oracle Clusterware must be different from the one thatis used for the RAC software! Although it is possible to install the RAC software on yourcluster shared storage when using certain cluster file systems% software is usuallyinstalled on a regular file system that is local to each node!

&his permits rolling patch upgrades and eliminates the software as a single point offailure!

2n addition% at least two files must be stored on your shared storage! &hese files are

!onitoring infor!ation and

&he monitoring information file stores the monitoring information across the cluster! 2ts si$eis set to around


19/97

6ou must also create at least two redo log groups for each instance% and all the redo loggroups must also be stored on shared devices for instance or crash recovery purposes!#ach instance)s online redo log groups are called an instance)s thread of online redo!

2n addition% you must create one shared undo tablespace for each instance for using therecommended automatic undo management feature! #ach instance)s undo tablespacemust be shared by all other instances for recovery purposes!

Graphic

%ccording to #%& database storage principles* the %rchived log files are stored inthe 'ocal storage The !ata files* Temp files* &ontrol files* :lash recovery areafiles* &hange tracking file* SP:I')* T!) +allet are stored in the Shared storage.ndo tablespace files and Online redo log files are stored in Instance8 andInstancen separately

Archive logs cannot be placed on raw devices because their names are automaticallygenerated and are different for each archive log! &hat is why they must be stored on a filesystem! 2f you use a Cluster ile /ystem or C /% it enables you to access these archivefiles from any node at any time!

2f you do not use a C /% you are always forced to ma'e the archives available to theother cluster members at the time of recovery for e-ample% by using a 8etwor' ile/ystem or 8 / across nodes!

2f you are using the recommended flash recovery area feature% then it must be stored in a

shared directory so that all instances can access it!

"ote

% shared directory can be an %S$ disk group* or a cluster file system

/torage is a critical component of any grid solution! &raditionally% storage has beendirectly attached to each individual server Directly Attached /torage% or DA/! Over thepast few years% more fle-ible storage% which is accessible over storage area networ's orregular #thernet networ's% has become popular!

&hese new storage options enable multiple servers to access the same set of dis's%simplifying the provisioning of storage in any distributed environment!

/torage Area 8etwor' or /A8 represents the evolution of data storage technology to thispoint!&raditionally% on client server systems% data was stored on devices either inside or directlyattached to the server!


20/97

8e-t in the evolutionary scale comes 8etwor' Attached /torage 8A/ that too' thestorage devices away from the server and connected them directly to the networ'!

/A8s ta'e the principle a step further by allowing storage devices to e-ist on their ownseparate networ's and communicate directly with each other over very fast media! +serscan gain access to these storage devices through server systems that are connected toboth the 7ocal Area 8etwor' or 7A8 and /A8!

&he choice of file system is critical for RAC deployment! &raditional file systems do notsupport simultaneous mounting by more than one system! &herefore% you must store filesin either raw volumes without any file system% or on a file system that supports concurrentaccess by multiple systems!

&hus% three ma.or approaches e-ist for providing the shared storage needed by RAC4

raw volu!esRaw volumes are directly attached raw devices that re5uire storage that operates in bloc'mode such as fiber channel or i /C/2!

cluster file syste!# and

One or more cluster file systems can be used to hold all RAC files! Cluster file systemsre5uire bloc' mode storage such as fiber channel or i /C/2!

Auto!atic torage 3anage!ent or A 3

A/ is a portable% dedicated% and optimi$ed cluster file system for Oracle database files!

i /C/2 is important to /A8 technology because it enables a /A8 to be deployed in a7ocal Area 8etwor' or 7A8% ide Area 8etwor' or A8% or etropolitan Area 8etwor' or A8!

5. RAC functions

Oracle Cluster ile /ystem or OC / is a shared file system designed specifically forOracle Real Application Clusters!

OC / eliminates the re5uirement that Oracle Database files be lin'ed to logical drivesand enables all nodes to share a single Oracle :ome (on indows


21/97

Oracle files (control files% data files% redo logs% bfiles% and so on"

shared configuration files (spfile"

files created by Oracle during run time% and

voting and OCR files

Oracle Cluster ile /ystem is free for developers and customers! &he source code isprovided under the ?eneral *ublic 7icense or ?*7 on 7inu-! 2t can be downloaded fromthe Oracle &echnology 8etwor' eb site!

"ote

:rom OTN* you can specifically download O&:S for 'inu, However* when youdownload the database software for +indows* O&:S is already included

Automatic /torage anagement or A/ is a new feature in Oracle Database 10 g % whichprovides a number of functions! &he functions of the A/ include

high6perfor!ance and integrated !irroring

A/ provides a vertical integration of the file system and the volume manager that isspecifically built for Oracle database files% thus providing the first portable and highperformance database file system!

A/ can provide management for single / * machines or across multiple nodes of a

cluster for Oracle Real Application Clusters support! A/ provides integrated mirroringacross dis's!

!anage!ent of Oracle database files

A/ manages Oracle database files by distributing 2BO load across all available resourcesto optimi$e performance while removing the need for manual 2BO tuning!

A/ helps D=As manage a dynamic database environment by allowing them to increasethe database si$e without having to shut down the database to ad.ust the storageallocation!

load balancing across disks# and

A/ can maintain redundant copies of data to provide fault tolerance% or it can be built ontop of vendor supplied% reliable storage mechanisms% thus spreading data across dis's tobalance load!

Data management is done by selecting the desired reliability and performancecharacteristics for classes of data rather than with human interaction on a per file basis!

resolution of storage challenges


22/97


23/97

>! #nables autoe-tend on Oracle data files

Answer

Option 1: Incorrect % cluster file system or &:S is not guaranteed to be

supported by Oracle #aw devices are always used when &:S is not available ornot supported by Oracle

Option 2: Incorrect #aw devices offer best performance without any intermediatelayer between Oracle and the disk

Option 3: &orrect &lustered file systems provide a greatly simplified installationand administration of #%& This includes a single Oracle software installation

Option 4: &orrect &luster file systems enable autoe,tend on Oracle data files*whereas autoe,tend fails on raw devices if the space is e,hausted &:S also

provides uniform accessibility to archive logs in case of physical node failure

Correct answer+s,*

9! *rovides simplified management>! #nables autoe-tend on Oracle data files

#ach node in a cluster re5uires a supported interconnect software protocol to supportinterinstance communication% and &ransmission Control *rotocolB2nternet *rotocol or&C*B2* to support Oracle Clusterware polling!

All +82I and 7inu- platforms use +ser Datagram *rotocol or +D* on ?igabit #thernet or?b# asone of the primary protocols and interconnect for RAC interinstance 2*C communication!

Other vendor specific interconnect protocols include Remote /hared emory for /C2 and/un ire 7in' interconnects% and :yper essaging *rotocol for :yperfabric interconnects!2n any case% your interconnect must be certified by Oracle for your platform!

Graphic

In this e,ample* there are three sections - Servers* Interconnect* and !atabaseshared storage The Oracle &lusterware connects Interconnect and !atabaseshared storage It contains platforms like 'inu,* .NI>* HP(.>* Solaris* and+indows It also has %S$* O&:S* #%+* &:S* OS &3+* and OS &


24/97

you deploy RAC!

/imilar to the interconnect% the shared storage solution you choose must be certified byOracle for your platform! 2f a Cluster ile /ystem or C / is available on the targetplatform% then both the database area and flash recovery area can be created on eitherC / or A/ !

2f a C / is unavailable on the target platform% then the database area can be createdeither on A/ or on raw devices (with the re5uired volume manager"% and the flashrecovery area must be created on the A/ !

"ote

It is strongly recommended that you use .!P over "b)

Real Application Clusters Certification atri- is designed to address any certification

in5uiries! +se this matri- to answer any certification 5uestions that are related to RAC! &onavigate to Real Application Clusters Certification atri-% perform these steps4

1! connect and log in to http4BBmetalin'!oracle!com

F! select the correct platform and clic' ub!it

/ervices are a logical abstraction for managing wor'loads! /ervices divide the universe of wor' e-ecuting in the Oracle database into mutually dis.oint classes! #ach servicerepresents a wor'load with common attributes% service level thresholds% and priorities!

/ervices are built into the Oracle database providing a single system image forwor'loads% prioriti$ation for wor'loads% performance measures for real transactions% andalerts and actions when performance goals are violated!

&hese attributes are handled by each instance in the cluster by using metrics% alerts%scheduler .ob classes% and the resource manager! ith RAC% services facilitate loadbalancing% allow for end to end lights out recovery% and provide full location transparency!

Graphic

+hile dealing with #%& and services there are four dis=oint classes - %pplicationserver* 'isteners* #%& instances* and Oracle &lusterware In %pplication server*there are two Service connections - )#P and $ #%& instances include


25/97

/ackup* Priority* %lerts* and Tuning It has four )#P service connections and four$ service connections Oracle &lusterware stops or starts service connectionsor modifies service to instance mapping

A service can span one or more instances of an Oracle Database in a cluster% and asingle instance can support multiple services! &he number of instances offering theservice is transparent to the application!

/ervices enable the automatic recovery of wor'! ollowing outages% the service isrecovered automatically at the surviving instances!

hen instances are later repaired% services that are not running are restoredautomatically by Oracle Clusterware! 2mmediately the service changes state% up% down% or too busy3 a notification is available for applications using the service to trigger immediaterecovery and load balancing actions!

7isteners are also aware of services availability% and are responsible for distributing thewor'load on surviving instances when new connections are made! &his architectureforms an end to end continuous service for applications!

u!!ary

&o replace the process of remastering all resources% RAC uses an algorithm called la$yremastering! 2n dynamic remastering% the ?C/% which is tightly integrated with the buffercache% enables the database to automatically adapt and migrate resources in the ?RD!RAC also includes ?lobal Dynamic *erformance ,iews that help ac5uire data about allstarted instances!

RAC software resources manage the global resources 7 O8% 7 D 5 % 7 / , % 7CH5 % andD2A?! At the cluster level% the main processes of each node of the cluster include CRSD and RACGIMON%OCSSD%EVMD% andO/ROCD! According to RAC /oftware /torage*rinciples% the Oracle Database 10 g RAC installation is a two phase installation! &hethree ma.or approaches that e-ist for providing the shared storage needed by RAC areraw volumes% cluster file system% and automatic storage management!

iles such as Oracle files and voting and OCR files can be placed on Oracle cluster filesystem version 1! A/ is a new feature in Oracle Database 10 g ! 2t helps manage Oracledatabase% balances load files% provides integrated mirroring across dis's% and solves

many storage management challenges!

%reinstallation Re8uire!ents for Oracle Clusterware

Learning Objective



26/97

identify the requirements for installing Oracle Clusterware

1. %reinstallation re8uire!ents

&he installation of Oracle Database 11 g re5uires that you perform a two phase process inwhich you run the Oracle +niversal 2nstaller or O+2 twice! &he first phase installs OracleClusterware! Oracle Clusterware provides high availability components and can alsointeract with vendor clusterware% if present% to coordinate cluster membership information!

&he second phase installs the Oracle Database 11 g software with RAC! &he installationalso enables you to configure services for your RAC environment! 2f you have a previousOracle cluster database version% O+2 activates the Database +pgrade Assistant or D=+Ato automatically upgrade your pree-isting cluster database!

&he Oracle Database 11 g installation process provides a single system image% ease ofuse% and accuracy for RAC installations and patches!

&he installation utilities% such as O+2% include a number of new features% changedscreens% and enhancements! &hese utilities include

&'CA

D=CA provides a command line feature called 0e!eteASM that removes A/ software! 2talso provides the option to switch from a database configured for Oracle #nterpriseanager Database Control to Oracle #nterprise anager ?rid Control!

&'9A# and

D=+A creates a restore script to restore thedatabase% on re5uest for a bac'up during the upgrade!

&his utility includes an improved pre upgrade script to provide space estimation%initiali$ation parameters% statistics gathering% and new warnings! D=+A also providesupgrades from Oracle Database releases E!0% E!"etCA

8etCA deinstallation removes listener CR/ resources that are defined in the same Oraclehome and do not have end points in the ! stener1ora file! 2t converts e-isting

noncluster listeners to cluster listeners!

&o successfully install Oracle RAC 11 g % it is important that you have an understanding ofthe tas's that must be completed and the order in which they must occur!

Co!plete preinstallation tasks

&o install Oracle RAC 11 g % you must first complete a set of preinstallation tas's! =efore theinstallation can begin in earnest% each node that is going to be part of your RAC installation


27/97

must meet the hardware and software re5uirements!

6ou must perform step by step tas's for hardware and software verification% as well as forthe platform specific preinstallation procedures!

6ou must install the operating system patches re5uired by the cluster database% and youmust verify that the 'ernel parameters are correct for your needs!

2nstall Oracle Clusterware

Oracle Clusterware must be installed using O+2! a'e sure that your cluster hardware isfunctioning normally before you begin this step! ailure to do so results in an aborted ornonoperative installation!

2nstall A 3 and Oracle &atabase 11 g software

After Oracle Clusterware has been successfully installed and tested% again use O+2 toinstall Automatic /torage anagement (A/ " and the Oracle Database 11 g software%

including software options re5uired for a RAC configuration!

2t is not mandatory to install A/ to a separate ORAC7#J:O #! &his is considered abest practice!

2nstall 3 agent on cluster nodes

2f you intend to use #nterprise anager ?rid Control to manage your RAC deployments%then you must install the #nterprise anager (# " agent on each cluster node ne-t!

%erfor! cluster database creation

*erforming cluster database creation is one of the important steps in installing Oracle RAC11g !

Co!plete postinstallation tasks

After the database has been created% there are a few postinstallation tas's that must becompleted before your RAC database is fully functional! &he remainder of this lessonprovides the necessary 'nowledge to complete these tas's successfully!

2f you are e-perienced with installing Oracle components in +82I environments% note thatmany manual setup tas's re5uired on +82I are not re5uired on indows!

&he 'ey installation features that are different in +82I and indows installations are

startup and shutdown services

2n indows% O+2 creates and sets startup and shutdown services at installation time! 2n+82Isystems% administrators are responsible for creating these services!

environ!ent variables


28/97


29/97

3 *re4 MemTota! 54roc5mem n6oMemTota!7 889:;::?9@ (2

3 06 ( 5tm4!esBstem 8. !oc(s Use0 A%a !a !e Use+

50e%5s0a: :8 @>>: ?8? 9< 9 ;> >: >;+

At least 1 gigabyte or ?= of physical memory is needed! &o determine the amount of physicalmemory% enter the *re4 MemTota! 54roc5mem n6o command!

CodeK grep em&otal BprocBmeminfoem&otal4 11< >00 '=

K grep /wap&otal BprocBmeminfo/wap&otal4 1F 9


30/97

CodeK grep em&otal BprocBmeminfoem&otal4 11< >00 '=

K grep /wap&otal BprocBmeminfo/wap&otal4 1F 9>: ?8? 9< 9 ;> >: >;+

)uestion

6ou want to install Oracle Database 11 g on a 7inu- system and implement RAC!hich option does not meet the minimum re5uirements for the installation;

Options*

1! 1 ?= of physical memory

9! F00 = of dis' space for the 5tm4 directory>! 9 ?= of dis' space for the Oracle Database 11 g software

Answer


31/97

Option 1: Incorrect %t least 8 gigabyte 1"/2 of physical memory is needed Todetermine the amount of physical memory* enter this command? *re4 MemTota!54roc5mem n6o

Option 2: Incorrect % minimum of 8 "/ of swap space or twice the amount of

physical memory is needed On systems with 4 "/ or more of memory* the swapspace can be between one and two times the amount of physical memory Todetermine the si9e of the configured swap space* enter this command? *re4 S=a4Tota! 54roc5mem n6o

Option 3: Incorrect %t least @55 megabytes of disk space must be available in the5tm4 directory To determine the amount of disk space available in the 5tm4 directory* enter this command? 06 ( 5tm4 %lternatively* to list disk space inmegabytes or gigabytes* enter? 06 F

Option 4: &orrect .p to @ "/ of disk space is required for the Oracle !atabase

88g software* depending on the installation type The 06 command can be used tocheck for the availability of the required disk space

Correct answer+s,*

>! 9 ?= of dis' space for the Oracle Database 11 g software

#ach node must have at least two networ' adapters one for the public networ' interfaceand the other for the private networ' interface or interconnect! 2n addition% the interfacenames associated with the networ' adapters for each networ' must be the same on allnodes!

or the public networ'% each networ' adapter must support &C*B2*! or the privatenetwor'% theinterconnect must support +D* (&C* for indows" using high speed networ' adaptersand switches that support &C*B2*! ?igabit #thernet or an e5uivalent is recommended!

=efore starting the installation% each node re5uires an 2* address and an associated hostname registered in the D8/ or the 5etc5 osts file for each public networ' interface!One unused virtual 2* address and an associated ,2* name registered in the D8/ or the5etc5 osts file that you configure for the primary public networ' interface are neededfor each node! &he virtual 2* address must be in the same subnet as the associatedpublic interface!

After installation% you can configure clients to use the ,2* name or 2* address! 2f a nodefails% its virtual 2* address fails over to another node!

or the private 2* address and optional host name for each private interface% Oraclerecommends that you use private networ' 2* addresses for these interfaces! 6ou can use


32/97

the 5etc5 osts file on each node to associate private host names with private 2*addresses!

Graphic

The e,ample for the private network IP address displayed here is

85 A A A or 8;4 8BC A A

,irtual 2* or ,2* addresses are all about availability of applications when an entire nodefails! hen a node fails% the ,2* address associated with it automatically fails over tosome other node in the cluster! hen this happens% the following occurs4

&he new node indicates the new edia Access Control or AC address for the ,2*! or directlyconnected clients% this usually causes them to see errors on their connections to the old address!

/ubse5uent pac'ets sent to the ,2* address go to the new node% which will send error reset orR/& pac'ets bac' to the clients! &his results in the clients getting errors immediately!

&his means that when the client issues /M7 to the node that is now down% or traversesthe address list while connecting% rather than waiting on a very long &C*B2* timeout%which could be as long as ten minutes% the client receives a &C* reset!

2n the case of /M7% this results in an ORA ?88? error! 2n the case of connect% the ne-taddress in tnsnames is used!

ithout using ,2*s% clients connected to a node that died will often wait a 10 minute &C*timeout period before getting an error! As a result% you do not really have a good :igh

Availability solution without using ,2*s!

Graphic

In this e,ample* the client* whose )#P description is )#P01!)SIPTION011HOST0clusnode(82211HOST0clusnode(4221S)#


33/97

%fter you are in the SE' stack and blocked on read3write requests* you need touse :ast %pplication Notification or :%N to receive an interrupt

-. "etwork and package re8uire!ents

#ach node in a cluster re5uires a supported interconnect software protocol to supportCache usion% and &C*B2* to support Oracle Clusterware polling! 2n addition to +D*%other supported vendor specific interconnect protocols include Remote /hared emory%:yper essaging protocol% and Reliable Data ?ram!

8ote that &o'en Ring is not supported for cluster interconnects on A2I! 6our interconnectmust be certified by Oracle for your platform! 6ou should also have a web browser to viewonline documentation!

Oracle Corporation has done e-tensive testing on the Oracle provided +D* libraries (and&C* for

indows!" On the basis of this testing and e-tensive e-perience with productioncustomer deployments% Oracle /upport strongly recommends the use of +D* (or &C* onindows" for RAC environments related to Oracle Database 11 g ! &he following are bestpractices for +D*4

use at least a gigabit #thernet for optimal performance

crossover cables are not supported (use a high speed switch"

increase the +D* buffer si$es to the O/ ma-imum% and

turn on +D* chec'summing

or functionality re5uired from the vendor clusterware% OracleNs clusterware provides thesame functionality! Also% using Oracle Clusterware reduces installation and supportcomplications!

:owever% vendor clusterware may be needed if customers use non #thernet interconnector if you have deployed clusterware dependent applications!

*ac'age versions are chec'ed by the c!u%6B utility! or e-ample% Red :at >!0 andOracle #nterprise 7inu- > include these pac'ages and versions!

Graphic

The packages and versions are the following?glibc(4 7 @(4 4F glibc(common(4 7 @ 4(4F glibc(devel(4 7 @ 4(4F


34/97

gcc(7 @ B(7gcc(cGG(7 @ B(7libaio(5 7 85F(4 libaio(devel(5 7 85F(4 libstdcGG(7 @ B(7 8make(7 C5(B sysstat(F 5 F(88

Depending on the products that you intend to install% verify that these pac'ages areinstalled on the system! Oracle +niversal 2nstaller or O+2 performs chec's on yoursystem to verify that it meets the 7inu- pac'age re5uirements of the cluster database andrelated services!

&o ensure that these chec's succeed% verify the re5uirements before you start O+2% usingthe following steps4

Code

3 r4m H 4ac(a*e_name3 r4m FHa *re4 4ac(a*e_name_se*ment

&o determine whether the re5uired pac'ages are installed% enter these commands!

CodeK rpm 5 pac'ageJnameK rpm 5a grep pac'ageJnameJsegment

&o chec' the *cc compatibility pac'ages% run this command% and

CodeK rpm 5a grep compatcompat libstdcPP 99 9!L!9compat gcc 9< 9!L!9compat libgcc

2f a pac'age is not installed% install it from your 7inu- distribution media as the root user by usingthe r4m F command! or e-ample% to install the com4at 0 pac'age% use this command!

CodeK rpm i compat db >!1!


35/97

6ou must create the o nsta!! group the first time you install the Oracle databasesoftware on the system! &his group owns the Oracle inventory% which is a catalog of allthe Oracle database software installed on the system!

6ou must create the 0 a group the first time you install the Oracle database software on

the system! 2t identifies the +82I users that have database administrative privileges!

2f you want to specify a group name other than the default 0 a group% you must choosethe custom installation type to install the software% or start O+2 as a user that is not amember of this group! 2n this case% O+2 prompts you to specify the name of this group!

Code

3 *rou4a00 * >


36/97

Code

$ c0$ % 1 as _4ro6 !eumas( 00 megabytes of free dis' space% identify a filesystem that is large enough and set the TM/ and TM/DIR environment variables tospecify a temporary directory on this file system! +se the 06 ( command to identify asuitable file system with sufficient free space! a'e sure that the orac!e user and theo nsta!! group can write to the directory!

Code

3 06 (

!esBstem 8. !oc(s Use0 A%a !a !e Use+ Mounte0 on50e%5 0 8 ?


37/97

or the no6 !e parameter% the ma-imum number of open file descriptors should beFF9 !

nproc

or the n4roc parameter% the ma-imum number of processes available to a single user

must not be less than 1 9@>!

&he hard values% or upper limits% for these parameters can be set in the5etc5secur tB5! m ts1con6 file!

Code

- so6t n4roc 9?:

&he entry configures *luggable Authentication odules or *A to control sessionsecurity! *A is a system of libraries that handle the authentication tas's of applications(services" on the system! &he principal feature of the *A approach is that the nature ofthe authentication is dynamically configurable! &o configure *A% add this line to the5etc54am105!o* n file!

Code

sess on reHu re0 5! 5secur tB54am_! m ts1so

Assume that your cluster comprises two nodes% v-00>> and v-00>F! &o configure //:using D/A on that cluster% you can perform these steps as the orac!e user4

Code

$ r4m Ha *re4 o4ensso4enss ?1 48 @1R'EL;19>SQ ssh v-00>> Tcat UB!sshBidJdsa!pubT VV W


39/97


40/97

v-00>>SQ ssh v-00>> Tcat UB!sshBidJdsa!pubT VV WUB!sshBauthori$edJ'eysv-00>>SQ ssh v-00>F Tcat UB!sshBidJdsa!pubT VV WUB!sshBauthori$edJ'eys

v-00>>SQ scp UB!sshBauthori$edJ'eys v-00>F4BhomeBoracleB!sshB

v-00>>SQ ssh v-00>F hostnameQ ssh v-00>F uptimev-00>F!us!oracle!com

"ote

SSH using SS% is also supported

5. &irectory and para!eter re8uire!ents

6ou must identify five directories for the Oracle database software!

Code

5mount_4o nt5a445orac!e_s=_o=ner

ORACLE_2ASE5oraIn%entorB

5u


41/97

installations on a single system

The first time you install the Oracle database software on a system* O.I prompts you tospecify the path to this directory If you are installing the software on a local file system* itis recommended that you choose this path O.I creates the directory that you specify and

sets the correct owner* group* and permissions on it/u01/crs11

The Oracle &lusterware home directory is the directory where you choose to install thesoftware for Oracle &lusterware ou must install Oracle &lusterware in a separate homedirectory /ecause the clusterware parent directory should be owned by root * it requiresa separate base directory from the one used by the database files

+hen you run O.I* it prompts you to specify the path to this directory* as well as a namethat identifies it It is recommended that you specify a path similar to this path for theOracle &lusterware home directory In this e,ample* 5u

>! ORACLE_2ASE54ro0uct588181


42/97

Option 1: &orrect The Oracle &lusterware home directory is the directory whereyou choose to install the software for Oracle &lusterware /ecause the&lusterware parent directory should be owned by root* it requires a separate basedirectory from the one used by the database files +hen you run O.I* it promptsyou to specify the path to this directory* as well as a name that identifies it It isrecommended that you specify a path similar to the following for the Oracle&lusterware home directory? 5u


43/97

In this table* there has three rows - Parameter*


44/97

&MEM_MAX stands for the ma-imum &C* send window si$e!

-$E$_)E*A+L,

&MEM_DE AULT stands for the default &C* send window si$e!

6ou can ad.ust these semaphore parameters manually by writing the contents of the54roc5sBs5(erne!5sem file using this code!

Code

3 ec o SEMMSL_%a!ue SEMMNS_%a!ue SEMO/M_%a!ue KSEMMNI_%a!ue 54roc5sBs5(erne!5sem

&o change these parameter values and ma'e them persistent% edit the5etc5sBsct!1con6 file! &he 'ernel parameters that are displayed here arerecommended values only! or production database systems% it is recommended that you

tune these values to optimi$e the performance of the system!

Code

3 % 5etc5sBsct!1con6)111(erne!1sem 9>< ?9?:rmem_ma# ;8 ;?


45/97

Determine the storage option for your system% and configure the shared dis'! Oraclerecommends that you use Automatic /torage anagement also 'nown as A/ andOracle anaged iles% which is represented as O % or a cluster file system such asOracle Cluster ile /ystem% which is also 'nown as OC /! 2f you use A/ or a clusterfile system% you can also utili$e O and other Oracle Database 11 g storage features!

Oracle Clusterware re5uires that the OCR files and voting dis' files be shared! 8ote that A/ cannot be used to store these files as the clusterware components are startedbefore the A/ or RAC instances! &hese files could map to a shared bloc' or rawdevices or e-ist on an OC / volume!

&he last cluster setup tas' is to install the necessary operating system patches!

6ou need to follow these steps to verify cluster setup with c!u%6B 4

Code

3 su root3 c0 5sta*e50 5r4m3 e#4ort CVU DIS._GR/ 0 a3 r4m % c%uH0 s( 81


46/97

J cd 3stage3db3runcluvfysh stage (post hwos (n all (verbose

CodeK su rootK cd BstageBdbBrpmK e-port C,+MD2/HJ?R* dbaK rpm iv cvu5dis' 1!0!1 1!rpm

K cd BstageBdb!Bruncluvfy!sh stage post hwos n all verbose

&he Cluster ,erification +tility c!u%6B enables you to perform many preinstallationand

postinstallation chec's at various stages of your RAC database installation! &he c!u%6B utility isavailable in Oracle Database 11 g Release 1! &o chec' the readiness of your cluster for anOracleClusterware installation% run the c!u%6B utility using this code!

Code

$ runc!u%6B1s sta*e 4ost =os n a!! %er ose/er6orm n* 4ost c ec(s 6or ar0=are an0 o4erat n* sBstemsetu4C ec( n* no0e reac a ! tB111)111Resu!t7 No0e reac a ! tB c ec( 4asse0 6rom no0e J%#


47/97

Oracle RAC 11 g incorporates a two phased preinstallation process installation of OracleClusterware and Oracle database 11 g software with RAC! &hese installation phases arepreceded by a set of preinstallation tas's such as chec'ing system re5uirements%chec'ing software re5uirements% and creating groups and users! /ome of the minimumhardware re5uirements for this process are one ?= of physical memory% one ?= of swapspace% and four ?= of dis' space!

&he RAC networ' software re5uirements for the Oracle Clusterware installation processincludes interconnect software protocols that are supported! And during this process% thepac'age versions are chec'ed by the c!u%6B utility! &o configure the oracle userenvironment% you configure the umas( and the DIS/LA %ORACLE_2ASE %TM/% andTM/DIR environments variables! &o improve the performance of the software% you alsoincrease the no6 !e and n4roc shell limits for the orac!e user!

&he five directories re5uired for the Clusterware installation include Oracle base directory%Oracle inventory directory% Oracle Clusterware home directory% Oracle home directory for

the database% and Oracle home directory for A/ ! After identifying these directories% youset the values for the various 7inu- operating system parameters! &hen you perform thedifferent cluster setup tas's and verify cluster setup with the c!u%6B utility!

2nstall and Configure Oracle Clusterware

Learning Objective


recognize how to install and configure Oracle Clusterware

1. 2nstalling Oracle Clusterware

&o install Oracle Clusterware% set the ORACLE_2ASE environment variable in accordancewith your installation location scheme! Run O+2 by e-ecuting the runInsta!!er command from the installation CD or the staged software directory!

Code

$ e#4ort ORACLE_2ASE 5u


48/97

the Oracle database software (that is% if the environment does not have an O+2inventory"% O+2 displays the /pecify 2nventory directory and credentials screen!

2f you are performing this installation in an environment where the O+2 inventory isalready set up% O+2 displays the /pecify ile 7ocations screen instead of the /pecify2nventory directory and credentials screen!

Graphic

The Select a Product to Install screen includes three radio buttons - Oracle!atabase 88g* Oracle &lient* and Oracle &lusterware Oracle !atabase 88ginstalls features such as an optional preconfigured starter database* productoptions* management tools* and more for an Oracle !atabase Server It alsosupports %utomatic Storage $anagement database configuration Oracle &lientinstalls features such as enterprise management tools* networking services*utilities and more Oracle &lusterware installs the Oracle &lusterware

components It also enables the management of Oracle !atabase and otherapplications within the cluster

On the /pecify 2nventory directory and credentials screen% enter the inventory location! 2fORACLE_2ASE has been properly set% O+2 suggests the proper directory location for theinventory location as per O A guidelines!

2fORACLE_2ASE has not been set% enter the proper inventory location according to yourre5uirements! #nter the +82I group name information o nsta!! in the /pecifyOperating /ystem group name field% and then clic' "e(t !

Graphic

The Specify Inventory directory and credentials screen displays the )nter the full path of the inventory directory te,t field and the path 3u583oraInventory is enteredin it In the Specify Operating System group name drop(down list* oinstall is shownselected

8e-t O+2 displays the /pecify :ome Details screen! &he /pecify :ome Details screencontains predetermined information for the source of the installation files and the targetdestination information! O+2 provides an Oracle Clusterware :ome name in the 8ame

field located in the Destination section of the screen! 6ou may accept the name or enter anew name at this time!

2fORACLE_2ASE has been set% an O A compliant directory path appears in the *ath fieldlocated below the Destination section! 2f not% enter the location in the target destination%and clic' "e(t to continue!


49/97

Graphic

In this e,ample* the Name is displayed as Ora&rs88gDhome and the Path isentered as 3u583crs88g

2fORACLE_'OME is set in the environment% this appears in the O+2 location window!ORACLE_'OME typically refers to the D= home% and there is no correspondingenvironment variable for the Clusterware installation!

6ou should be aware of this% and not .ust clic' through because there is a value! &heparent directory of the Clusterware :ome should be owned by root and writable by theinstall group%o nsta!! !

&he installer then chec's your environment to ensure that it meets the minimumre5uirements for an Oracle Clusterware installation! &he installer chec's for the e-istenceof critical pac'ages and release levels% proper 'ernel parameter settings% networ'settings% and so on!

2f discrepancies are found% they are flagged and you are given an opportunity to correctthem! 2f you are sure that the flagged items will not cause a problem% it is possible to clic'the item and change the status to self chec'ed% and continue with the installation! Only dothis if you are absolutely sure that no problems actually e-ist% otherwise correct thecondition before proceeding!

hen all chec's complete successfully% clic' the "e(t button to proceed!

Graphic

In this e,ample* the Product(Specific Prerequisite &hecks screen displays three&hecks - &hecking local &luster Synchroni9ation Services 1&SS2 status &hecking whether Oracle ; 4 #%& is available on all selected node* and &hecking Oracle ;i O partition si9e The Type of these &hecks is displayed as

%utomatic and their Status appears as Succeeded

&he /pecify Cluster Configuration screen displays predefined node information if O+2detects that your system has vendor clusterware! Otherwise% O+2 displays the ClusterConfiguration screen without the predefined node information!

2f all your nodes do not appear in the cluster nodes window% clic' the Add button! 6oumust supply the public node names% private node names% and virtual host names for eachnode that you add! All of these names must be resolvable on every node by using eitherD8/ or the 5etc5 osts file!

Graphic


50/97

The Specify &luster &onfiguration screen displays the &luster Name asv,Dcluster54 In this e,ample* the Public Node Name of the &luster Node appearsas v,5787 us oracle com and its Private Node Name is displayed as v,5787(

priv us oracle com Its


51/97

&he /pecify Oracle Cluster Registry (OCR" 7ocation screen appears ne-t! #nter a fully5ualified file name for the shared bloc' or raw device or a shared file system file for theOCR file!

2f you are using an e-ternal dis' mirroring scheme% clic' the (ternal Redundancy radiobutton! 6ou will be prompted for a single OCR file location! 2f no mirroring scheme isemployed% clic' the "or!al Redundancy radio button!

6ou will be prompted for two file locations! or highest availability% provide locations thate-ist on different dis's or volumes! Clic' "e(t to continue!

Graphic

The Specify Oracle &luster #egistry 1O 'ocation screen displays two O&onfiguration options - Normal #edundancy and ),ternal #edundancy The),ternal #edundancy radio button appears selected The Normal #edundancy

radio button enables the Oracle &lusterware to manage O mirroring %nadditional 4FB $/ of disk is required for the mirrored copy

),ternal #edundancy can be used when using disk management system to provide O redundancy In this e,ample* 3dev3sdb8 is displayed as the O'ocation name

)uestion

During the installation of Oracle Clusterware% you come to the /pecify Oracle

Cluster Registry (OCR" 7ocation screen! 6ou currently have no mirroring schemeemployed! hat information will you have to provide on this screen;

Options*

1! *rovide a single OCR file location

9! /pecify a normal redundancy

>! /pecify an e-ternal redundancy

Answer

Option 1: Incorrect ou will be prompted for a single O file location if youselected the External Redundancy radio button

Option 2: &orrect ou will be prompted for two O file locations if you selectthe Normal Redundancy radio button :or highest availability* provide locationsthat e,ist on different disks or volumes


52/97

Option 3: &orrect If no mirroring scheme is employed* click the NormalRedundancy radio button

Option 4: Incorrect If you are using an e,ternal disk mirroring scheme* click theExternal Redundancy radio button

Correct answer+s,*

-. Configuring Oracle Clusterware

&he primary purpose of the voting dis' is to help in situations where the private networ'communication fails!

hen the private networ' fails% the clusters are unable to have all nodes remain availablebecause they cannot synchroni$e 2BO to the shared dis'! &herefore% some of the nodesmust go offline! &he voting dis' is used to communicate the node state information usedto determine which nodes will go offline!

=ecause the voting dis' must be accessible to all nodes to accurately assessmembership% the file must be stored on a shared dis' location! &he voting dis' can resideon a bloc' or raw device or a cluster file system!

Graphic

In the Specify


53/97

The Summary window includes four sections - "lobal Settings* Product'anguages* Space #equirements* and New Installations 17B products2

8e-t O+2 displays a dialog bo- indicating that you must run the ora nstRoot1s androot1s script on all the nodes that are part of this installation! &he root1s script runs

the assistants without your intervention4

Oracle Cluster Registry Configuration &ool or ( ocrcon6 * " and

Cluster Configuration &ool or ( c!sc6*

upple!ent

Selecting the link title opens the resource in a new browser window

Configuration scripts

,iew the ora nstRoot1s and root1s scripts in detail!

Launch window

hen the root1s script has been run on all nodes% clic' the O4 button to close thedialog bo-! Run the c!u%6B utility to verify the post crs installation!

"ote

$ake sure you run the root1s scripts serially on each node in the proposedorder

hen the configuration scripts have been run on both nodes% the Configuration Assistantspage is displayed! &he O8/ Configuration Assistant and *rivate 2nterconnectConfiguration Assistant are run and their progress is displayed here! &he Cluster,erification +tility is then run to test the viability of the new installation!

hen the "e(t button is clic'ed% the #nd of 2nstallation screen appears! Clic' (it toleave O+2!

or verifying the Oracle Clusterware installation% you

Code

3 cat 5etc5 n tta3 Run #0m n run!e%e! >#7>7res4a=n75etc5X8854re60m no0aemon
http://dowindow%28%27../t9/misc/lwod_orac_a01_it_enus_t901.html')http://dowindow%28%27../t9/misc/lwod_orac_a01_it_enus_t901.html')


54/97

87?>7res4a=n75etc5 n t105 n t1e%m0 run 50e%5nu!!9 8 50e%5nu!!97?>7res4a=n75etc5 n t105 n t1css0 6ata! 50e%5nu!!9 8 50e%5nu!!?7?>7res4a=n75etc5 n t105 n t1crs0 run 50e%5nu!!9 8 50e%5nu!!

chec' for Oracle Clusterware processes with the 4s command% and

chec' the Oracle Clusterware startup entries in the B etc5 n tta file

=efore continuing with the installation of the Oracle database software% you must verifyyour Oracle Clusterware installation and startup mechanism! ith the introduction ofOracle RAC 11 g % cluster management is controlled by the e%m0%ocss0 % andcrs0 processes!

Run the 4s command on both nodes to ma'e sure that the processes are running!

Code

$ 4s Fe6 *re4 01 norac!e ??9 ?8? < Oct?< W


55/97

The processes are started at run levels 7 and F and are started with the res4a=n flag

&his means that if the processes abnormally terminate% they are automatically restarted! 2f you 'ill the Oracle Clusterware processes% they automatically restart or% worse% cause the

node to reboot! or this reason% stopping Oracle Clusterware by 'illing the processes isnot recommended! 2f you want to stop Oracle Clusterware without resorting to shuttingdown the node% you should run the crsct! command!

Code

3 5u


56/97

)uestion

=efore continuing with the installation of the Oracle database software on a 7inu-system% you must verify your Oracle Clusterware installation and startupmechanism! hich two methods should you use to verify that the OracleClusterware processes and startup entries are correct;

Options*

1! Review the entries in the BetcBinittab file

9! Run the crsct! sto4 command on each node in the cluster

>! ,iew the log files located in the crs0 directory under the Oracle Clusterware :ome

Answer

Option 1: &orrect In Oracle #%& 88g* Oracle &lusterware processes are startedby entries in the 3etc3inittab file* which is processed whenever the run levelchanges 1as it does during system startup and shutdown 2

Option 2: &orrect +ith the introduction of Oracle #%& 88g* cluster managementis controlled by the e%m0*ocss0 * and crs0 processes #un the 4s command onthe cluster nodes to make sure that the processes are running

Option 3: Incorrect The recommended method to stop Oracle &lusterware*without resorting to shutting down the node* is to run the crsct! sto4 command

Option 4: Incorrect If you encounter difficulty with your Oracle &lusterwareinstallation* it is recommended that you check the associated log files To do this*check the directories under the Oracle &lusterware Home

Correct answer+s,*

1! Review the entries in the BetcBinittab file

u!!ary

&he process of installing Oracle Clusterware includes a number of steps! irst% you needto run the runInsta!!er command from the installation CD! &his opens the /elect a*roduct to 2nstall screen% which enables you to install Oracle Clusterware! &his screenleads you to a number of other screens such as the /pecify 2nventory directory andcredentials screen% which include the different settings you need to configure for installingOracle Clusterware!


57/97

&he O+2 must install the components such as ?lobal /ettings% *roduct 7anguages toconfigure Oracle Clusterware! During this process% O+2 notifies you to run theora nstRoot1s and root1s script on all nodes! After these scripts are run and theviability of the new installation is chec'ed% you can verify the Oracle Clusterware

installation and startup mechanism using the 4s command!

2nstalling Oracle Clusterware

Learning Objective


install Oracle Clusterware

(ercise overview

6ou are the database administrator and you have been as'ed to install OracleClusterware on a node!

2n this e-ercise% you)re re5uired to ensure the Clusterware minimum re5uirements aremet on a node before using Oracle +niversal 2nstaller to install Oracle Clusterware!

&his involves the following tas's4

verifying cluster setup installing Oracle Clusterware completing the installation

$ask 1* 7erifying cluster setup

+sing command prompt% verify the cluster setup for node s5ldb0LL9 before starting theOracle Clusterware installation! /how the ma-imum amount of information in the output!

teps list

2nstructions

1! &ype runc!u%6B sta*e 4ost =os n sH!0 < ? %er ose and press nter

$ask -* 2nstalling Oracle Clusterware

/tart the installation of Oracle Clusterware! 2nstall the product in the locationTC4WRACWAdministratorWproductW11!1!0Wcrs!T /pecify the cluster name by appending T1T to


58/97

the default name! Configure the 7ocal Area Connection < interface as public! /top at theCluster Configuration /torage page of the O+2! Accept all other default selections!

teps list

2nstructions

1! Clic' "e(t

! Clic' the Local Area Connection - interface name and clic' the dit button

L! /elect the %ublic radio button and clic' O4

@! Clic' "e(t

$ask 5* Co!pleting the installation

Continue the installation of Oracle Clusterware! +se partition 1 as the OCR primary andpartition < as the voting dis' and format both with C /! Complete the installation andclose the O+2!

teps list

2nstructions

1! Clic' dit

9! Clic' the second partition and clic' dit

>! /elect the %lace 7oting &isk on this %artition and 0or!at partition with C0 chec'bo-es and clic' O4

F! Clic' "e(t

! Clic' O4

L! Clic' O4

@! Clic' 2nstall

E! Clic' (it10! Clic' ;es

2nstall A 3 and Oracle &atabase oftware

Learning Objectives


59/97


60/97

that has scalability* performance* high availability and security features that arerequired to run the most demanding* mission critical applications Standard )dition17 87"/2 is ideal for workgroups* departments and small(to(medium si9edbusinesses looking for a lower(cost offering Selecting the &ustom radio buttonallows you to choose individual components to install

&he ne-t screen that appears is the 2nstall 7ocation screen! :ere you specify the locationof your A/ home directory and installation name!

Although it is possible for A/ and the databaseinstallation to reside in the same directory and use the same files% you are installing A/separately% into its own ORACLE_'OME to prevent the database ORACLE_'OME from beinga point of failure for the A/ dis' groups and to prevent versioning difficulties betweenthe A/ and database file installations!

=e sure to specify a name for your installation that reflects this! &hen clic' the "e(t button to continue!

Graphic

The Install 'ocation screen contains the Oracle /ase field in the first section Thete,t 3u583app3oracle is entered in this field The second section - Software'ocation - contains the fields Name and Path The te,t Ora%sm88gDhome8 isentered in the Name field and the te,t 3u583app3oracle3product388 8 53asmD8 isentered in the Path field

hen the /pecify :ardware Cluster 2nstallation ode screen appears% clic' the Cluster2nstallation radio button! 8e-t ensure that all nodes in your cluster are selected byclic'ing the elect All button!

2f O+2 does not display the nodes properly% perform clusterware diagnostics by e-ecutingthe o!sno0es % command from the ORA_CRS_'OME5 n directory% and analy$e itsoutput!

Alternatively% you may use the c!u%6B utility to troubleshoot your environment! Refer toyour documentation if the detailed output indicates that your clusterware is not runningproperly! hen this is done% clic' the "e(t button to continue!

Graphic

The Specify Hardware &luster Installation $ode screen contains two radio buttons - &luster Installation and 'ocal Installation /y selecting the &luster Installationoption* you can select the nodes in the hardware cluster where the installer should install the product


61/97

)uestion

During the installation of A/ to manage the shared storage for your clusterdatabase% you need to specify the hardware cluster installation mode! 6ou chooseCluster 2nstallation! 6ou notice that all of the nodes in your cluster are notdisplaying properly!

hat actions can you ta'e to help fi- this issue;

Options*

1! Run the c!u%6B utility

9! #nsure all nodes in your cluster are selected

>! /witch to the 7ocal 2nstallation mode from the Cluster 2nstallation mode

Answer

Option 1: &orrect If the nodes in your cluster are not displaying properly* youmay use the c!u%6B utility to troubleshoot your environment #efer to yourdocumentation if the detailed output indicates that your &lusterware is not running

properly

Option 2: &orrect If O.I does not display the nodes properly* perform&lusterware diagnostics by e,ecuting the o!sno0es % comman0 from theORA_CRS_'OME5 n directory* and analy9e its output

Option 3: Incorrect ou select all of the nodes in your cluster so that the installerwill identify them and install the specified products during the installationHowever* if they are not displaying properly* all of the nodes will not be shown foryou to select

Option 4: Incorrect ou need to install %S$ to manage the shared storage foryour cluster database* performing a 'ocal Installation is not the correct selectionfor this

Correct answer+s,*

1! Run the c!u%6B utility

&he *roduct /pecific *rere5uisite Chec's screen verifies the operating systemre5uirements that must be met for the installation to be successful! After each successfulchec'% the /ucceeded chec' bo- is selected for that test! &he test suite results aredisplayed at the bottom of the screen! Any tests that fail are also reported here!


62/97

&his e-ample deals with the results of a completely successful test suite! 2f you encounter any failures% try opening another terminal window and correct the deficiency from anotherterminal window! &hen return to O+2% and clic' the Retry button to rerun the tests!

2t is possible to bypass the errors that are flagged by selecting the chec' bo- ne-t to theerror% but this is not recommended unless you are absolutely sure that the reported errorwill not affect the installation! hen all tests have been successful% clic' the "e(t buttonto continue!

Graphic

The Product(Specific Prerequisite &hecks screen contains a field that displaysthree options - &hecking kernel parameters* &hecking #ecommended glibcversion* and &hecking physical memory requirements

&he /elect Configuration Option screen allows you to choose from the following options4

Graphic

There are two fields below the &onfigure %utomatic Storage $anagement 1%S$2radio button - Specify %S$ S S Password and &onfirm %S$ S S Password

Create a &atabase

Configure Auto!atic torage 3anage!ent +A 3, % and

2nstall oftware Only

&his installation is concerned only with installing the A/ :ome% so clic' the 2nstalloftware Only button! hen you have done this% clic' the "e(t button to proceed!

On the *rivileged Operating /ystem ?roups page% choose the operating system groupscorresponding to the Database trusted groups listed to support O/ authentication! &hedefault value is dba for each group O/D=A% O/O*#R% and O/A/ ! Clic' "e(t tocontinue!

Graphic

The Privileged Operating System "roups page contains three groups - !atabase %dministrator 1OS!/%2 "roup* !atabase Operator 1OSOP)#2 "roup* and %S$administrator 1OS%S$2 "roup )ach group has a drop(down list that has the dbaoption selected


63/97


64/97

hen the root1s script has been e-ecuted on all nodes in the cluster% return to the#-ecute Configuration scripts window and clic' the O4 button to continue!

Graphic

The information about the Script 'ocation and the Nodes is present The Script'ocation displays 3u583app3oracle3product388 8 53asmD83root sh as the locationv,575B and v,5787 are displayed as Nodes .nder the Script 'ocation* the stepsfor e,ecuting the configuration scripts are displayed These steps are Open aterminal window* 'og in as MrootM* #un the scripts in each cluster node* and #eturnto this window and click MOkM to continue

hen the installation is finished% the #nd of 2nstallation screen appears! Clic' the (it button to 5uit!

After the A/ software has been successfully installed% the A/ instances should beconfigured and started and dis' groups should be created to support the shared storageneeds of your cluster database!

D=CA is used to do this 5uic'ly and accurately! #-ecute dbca from the A/ORACLE_'OME5 n directory!

Code

$ e#4ort ORACLE_'OME 5u


65/97

At this stage% no A/ instances are running on your cluster nodes! =efore starting theinstances% you must provide a password for the A/ S S user! 2n addition% choose thetype and location of the parameter file to be used for the A/ instances!

2f you re5uire specific initiali$ation parameter values to be set for your A/ instances%

you can modify the default values by clic'ing the A 3 %ara!eters button! &hen clic'"e(t to continue!

Graphic

This page contains two fields - S S password and &onfirm S S password Thene,t section displays two radio buttons - &reate initiali9ation parameter file 1I:I')2and &reate server parameter file 1SP:I')2 .nder the &reate initiali9ation

parameter file 1I:I')2 radio button* a field is provided whereO#%&')D/%S) 3admin3G%S$3pfile3init ora is set as Initiali9ation Parameter:ilename .nder the &reate server parameter file 1SP:I')2 radio button* a field is

provided where O#%&')DHO$) 3dbs3spfileG%S$ ora is set in the ServerParameter :ilename field

A

Oracle Database 11g Installation of Clusterware and RAC

Documents

Transcript of Oracle Database 11g Installation of Clusterware and RAC