Post on 24-Dec-2015
© 2003 EMC Corporation. All rights reserved.© 2003 Dell Inc. All rights reserved.
Infrastructure of choice for Oracle Real Application Clusters
Bob Ng, EMC
Ravi Kumar, Dell Inc
© 2003 EMC Corporation and Dell Inc. All rights reserved. 22
Objectives of This Session
Oracle Real Application Cluster (Oracle RAC) on Linux
EMC CLARiiON Storage platforms – value add for Oracle RAC environments.
Dell | EMC - Oracle RAC joint configuration for Linux
Customer adoption and examples
© 2003 EMC Corporation and Dell Inc. All rights reserved. 33
Linux Emphasis in Oracle Real Application Clusters Drive down TCO for infrastructure running DB service
– RAC technology emphasizes scaling out via clustering– RAC on Linux offers cost effective modular growth
Technical advantages of Linux for Oracle– Open source
• Collaborate, contribute and influence
– Strong alliance with OS delivery partners– Easier transition and adoption from UNIX to Linux
© 2003 EMC Corporation and Dell Inc. All rights reserved. 44
EMC Support for Linux
EMC CLARiiON Application Solution team involvement– Working onsite at Oracle HQ with Linux team
EMC CLARiiON CX600 used in Oracle RAC Linux development
EMC Interoperability lab stepped up Linux qualifications– RH 2.1AS on many server platforms– EMC-qualified HBA drivers (e.g., QLOGIC, EMULEX)– PowerPath 3.0 under Red Hat 2.1AS– Oracle RAC as a special clustering technology– Oracle Cluster File System
Joint support service center with Oracle at Hopkinton
© 2003 EMC Corporation and Dell Inc. All rights reserved. 55
Running Oracle RAC on EMC Clariion Storage Platforms Boosted price performance of the Oracle RAC Linux
solutions– Clariion hardware enhancements– New software features with the Clariion product line
ATA technology integration within Clariion system– Option to increase capacity at attractive cost level
© 2003 EMC Corporation and Dell Inc. All rights reserved. 66
EMC Clariion Family at a Glance
Feature CX200 CX400 CX600Max System Cache 1 GB 2 GB 8 GB
Max Write Cache 512 1 GB 2 GB
Front-End Ports (2 Gb)
4 4 8
Max HA Hosts 15 64 128
Back-End Ports (2 GB)
2 4 4
Min to Max Disks 4 to 30 5 to 60 5 to 240
Max LUNs per System
128 256 512
Max LUNs per Disk 32 32 32
Max IOPS (cached) 40,000 60,000 150,000
Max Bandwidth (cached)
200 MB/s 680 MB/s 1,300 MB/s
© 2003 EMC Corporation and Dell Inc. All rights reserved. 77
Investment Protection for Your Linux RAC Infrastructure
2-Way
CX200
FC direct Connect
Private Cluster Interconnect
© 2003 EMC Corporation and Dell Inc. All rights reserved. 88
Cluster Private interconnect
Switch
Scaling Out to the Full RAC Configuration
CX600/CX400
4-way top end servers
© 2003 EMC Corporation and Dell Inc. All rights reserved. 99
EMC Clariion CX600 value to scaling Oracle RAC
RAC Scale-out Implications Relevant CX600 Enhancements
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1010
EMC Clariion CX600 value to scaling Oracle RAC
RAC Scale-out Implications Relevant CX600 Enhancements
Continual need to be able to add RAC server nodes to fabric
Increased connectivity from expanded front-end ports (4/SP)
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1111
EMC Clariion CX600 value to scaling Oracle RAC
RAC Scale-out Implications Relevant CX600 Enhancements
Continual need to be able to add RAC server nodes to fabric
Increased connectable node due to expanded front-end ports (4/SP)
Higher burst of DB page flushing from server to storage for OLTP
Expanded cache provision extends headroom to absorb flushing burst
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1212
EMC Clariion CX600 value to scaling Oracle RAC
RAC Scale-out Implications Relevant CX600 Enhancements
Continual need to be able to add server nodes to fabric
Increased connectable node due to expanded front-end ports (4/SP)
Higher burst of DB page flushing from server to storage for OLTP
4 GB cache per SP quadruple headroom to absorb flushing burst
Increasing OLTP random I/O requires more physical disk spindles
Increased spindle count support to 240 disks per array
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1313
EMC Clariion CX600 value to scaling Oracle RAC
RAC Scale-out Implications Relevant CX600 Enhancements
Continual need to be able to add server nodes to fabric
Increased connectable node due to expanded front-end ports (4/SP)
Higher burst of DB page flushing from server to storage for OLTP
4 GB cache per SP quadruple headroom to absorb flushing burst
Increasing OLTP random I/O requires more physical disk spindles
Increased SP power supports up to 240 FC disks per array
Larger database in single array Support larger and more databases within the same CX600 array
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1414
EMC Clariion CX600 value to scaling Oracle RAC
RAC Scale-out Implications Relevant CX600 Enhancements
Continual need to be able to add server nodes to fabric
Increased connectable node due to expanded front-end ports (4/SP)
Higher burst of DB page flushing from server to storage for OLTP
4 GB cache per SP quadruple headroom to absorb flushing burst
More spindles support for higher OLTP random I/O
Increased SP power supports up to 240 FC disks per array
Larger database in single array Up to 35 TB per array
Increased degree of parallel DSS operations
Full 2 GB end-to-end internal enhancements boost maximum DSS data streaming rate (700 MB+ sustained)
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1515
EMC Clariion Software - Value to Oracle RAC / Linux
PowerPath– Enterprise level Multi-path I/O with load balancing
Snap View– “Instantaneous” stored data replication– Persistent snapshots (logical copies, reduced space requirement)– Business Continuance Volumes (Full replicas for performance
critical work)– Enabling technology supporting a variety of rapid Oracle
deployment options. Rapid cloning services jointly delivered by EMC/Oracle consulting (e.g. Oracle 11i Apps environment rapid cloning)
SAN Copy– Block storage copy between storage systems
Support for SAN Copy and MirrorView over IP
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1616
Cluster Interconnect
Brocade Switch
EMC PowerPath Software with Oracle RAC
SP-A connect
SP-B connectCX600/CX400
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1717
EMC SnapView Software with Oracle RAC
Production Production RAC nodesRAC nodes
Production DBProduction DB
Gold backup Gold backup BCV copyBCV copy
Restore DB with fast Restore DB with fast reverse resynchronizationreverse resynchronization
Repurposing BCVRepurposing BCV
Backup Backup RAC nodesRAC nodes
Repurposing DB Repurposing DB using split BCVusing split BCV
Establish BCVsEstablish BCVs
Point-in-time BCV splits Point-in-time BCV splits with Oracle in hot backupwith Oracle in hot backup
Linux servers
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1818
EMC SAN Copy Software with Oracle RAC
Production Production RAC nodesRAC nodes
PE6650PE6650
Second Second RAC nodesRAC nodes
Production DB
SV/BCV
Source arraySource array Target arrayTarget array
© 2003 EMC Corporation and Dell Inc. All rights reserved. 1919
Using EMC SAN Copy to Setup an Oracle Standby DB
Production Production RAC nodesRAC nodes
PE6650PE6650Production DB
logs
Production Production site arraysite array
Standby site Standby site arrayarray
Production control filesProduction control files
Standby DB Standby DB RAC nodesRAC nodes
Standby DB filesStandby DB files
Standby logs Standby logs (active/archive)(active/archive)
Standby control filesStandby control filesBackup Backup control filescontrol files
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2020
EMC CLARiiON ATA technology
Integrated component of the CX product offering
Industry unique capability of co-existence with Fibre Channel disks within same storage system
Leverage all processing and caching features of the CX storage systems
Supported by all software that runs on the CX systems
– Snap View, SAN Copy, MirrorView, etc.
Session 36675, Wed, 9/10Session 36675, Wed, 9/10
ATA drives
FC drives
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2121
Linux Oracle RAC Supported Configuration An Oracle concept initiated about three years ago Emphasis on reduction in TCO
– Rapid deployment– Reliability of deployment– Reliable support – Single-point acquisition, single-point support
Oracle/EMC/Dell collaboration on Dell Linux Oracle RAC Supported Configuration
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2222
EMC Contribution and Support for Configuration
EMC CLARiiON Application Solution team involvement– Assist with component definition of configuration– Verify delivery– Provide backing support to Dell’s single-point-of-field support
Interoperability lab– Share product and qualification roadmap plan with Dell and
Oracle– Prioritize effort to fit with joint delivery plans
Joint support service center with Oracle at Hopkinton– Fully leveraged to augment Oracle Unbreakable Linux
support model
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2323
Dell | EMC | Oracle Engineering Partnership History
1997 1998 1999 2000 2001 1H 2002 2H 2002 1H 2003
1998First Dell |
Oracle Products Launch
2000Oracle Linux development
on Dell
2001Oracle begins
migration to Linux on Dell within their
datacenter
Oracle pilots Dell in Oracle datacenter
Dell announces Oracle9i RAC with
EMC storage
1H 2002 Dell Deploys
Oracle 9i RAC for Order
Management
Dell | Oracle | Red Hat Launch
Unbreakable Linux
2H 2002
Over 22,000 Dell|Oracle
installations in past year
Oracle deploys 2,000 Dell servers in
Oracle datacenters
1997Dell | Oracle Partnership
FormedDell SC 1.0
Dell SC 2.0
Dell SC 2.1
2H 2003Dell SC 2.2
Dell SC 2.3
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2424
Dell | EMC | Oracle - Solutions History
1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003
Dell Supported Configuration 1.x
Red Hat Linux
7.2 Professional
Oracle Database
9i R1 901
Shared Storage
raw partitions
Dell | EMC EMC FC-4700
PE Servers 6450
Delivery Factory Installed
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2525
Dell | EMC | Oracle - Solutions History
1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003
Dell Supported Configuration 2.0
Red Hat Linux
2.1 Advanced Server
Oracle Database
9i R2 9.2.0.1
Shared Storage
raw partitions
Dell | EMC EMC FC-4700-2
PE Servers 6650, 6600, 6450
Delivery Factory Installed
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2626
Dell | EMC | Oracle - Solutions History
1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003
Dell Supported Configuration 2.1
Red Hat Linux
2.1 Advanced Server
Oracle Database
9i R2 9.2.0.1
Shared Storage
raw partitions
Dell | EMC EMC CX600, CX400, FC-4700-2
PE Servers 6650, 6600, 6450, 2650, 8450
Delivery Deployment Kit
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2727
Dell | EMC | Oracle - Solutions History
1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003
Dell Supported Configuration 2.2
Red Hat Linux
2.1 Advanced Server, e12
Oracle Database
9i R2 9.2.0.2
Shared Storage
raw partitions, OCFS 1.0.5, Powerpath 3.0.2
Dell | EMC EMC CX600, CX400, CX200, 4700-2
PE Servers 6650, 6600, 6450, 2650, 8450
Delivery Deployment Kit
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2828
Dell | EMC | Oracle – Solutions Today
1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003
Dell Supported Configuration 2.2.1
Red Hat Linux
2.1 Advanced Server, e24
Oracle Database
9i R2 9.2.0.2
Shared Storage
raw partitions, OCFS 1.0.8, Powerpath 3.0.3
Dell | EMC EMC CX600, CX400, CX200, 4700-2
PE Servers 6650, 6600, 6450, 4600, 2650-533
Delivery Deployment Kit
© 2003 EMC Corporation and Dell Inc. All rights reserved. 2929
Dell | EMC | Oracle - Solutions Today
1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q4 2003 1H 2004
Dell Supported Configuration 2.3
Red Hat Linux
2.1 EL, e24
Oracle Database
9i R2 9.2.0.4
Shared Storage
raw partitions, OCFS 2.0, Powerpath
Dell | EMC EMC CX600, CX400, CX200, 4700-2
PE Servers 6650, 6600, 6450, 4600, 2650, 2600, 1750
Delivery Deployment Kit
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3030
Dell | EMC | Oracle - Solutions Future
1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q4 2003 1H 2004
Dell Supported Configuration for Oracle 10g on RH 2.1
Red Hat Linux
2.1 EL, RH 2.1 QU3, RH 3.0 EL
Oracle Database
10g R1 10.0.1.0 (+IB)
Shared Storage
OCFS 2.0 (+shared home), OSM, Powerpath
Dell | EMC All EMC Clariion, other SAN switches, HBAs
PE Servers All Dell 2P, 64-bit
Delivery Deployment Kit using DSA
?
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3131
Dell PC5012 / PC5244 Cluster
Interconnect
Brocade Switch
A typical four node Dell Supported Configuration
CX600/CX400
PE6650
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3232
Dell Linux Oracle RAC Supported Configuration
Emphasis on reduction in TCO– Rapid deployment– Reliability of deployment– Reliable support – Single-point acquisition, single-point support
For more information:
http://www.dell.com/oracle
A bundle that is ordered as a single SKU– Dell servers (2-4-8 nodes)– Dell Deployment Software Tools for Oracle– Dell | EMC CLARiiON storage and SAN switches– Installation service
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3333
Dell Solution Components
Storage
Switch
HBA / RAID
Servers
OS/OCFS versions
DatabaseOracle Oracle
DatabaseDatabase
PERC 3/DCPERC 4/DC
PE2650, 4600, 6600, 6650PE2650, 4600, 6600, 6650, 8450
QLA2342
DASW3800SW3200
CX200FC4700-2 CX600CX400
QLA2340
QLA2310
Red Hat AS Updates/Major Release N and/or OCFS N
Red Hat AS Updates/Major Releases N-1 and/or OCFS N-1
PV220SU320
PV220SU160
Oracle Test Focus
EMC Test Focus
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3434
Dell Test Methodology: Dell performs comprehensive tests on 9i RAC [Clusters of
2-8 nodes] and 9i DB [Single Node] products
Level 1 Testing [Functional Testing]:– Integration Testing [e.g. Oracle patches + OCFS + PowerPath]– Functional Testing [e.g. Install Wizard and Configuration Wizard]– Bounds / Coverage testing– Documentation testing
Level 2 Testing [Integration/Solution Testing]:– Performance, stress testing– Multiple HW Configurations [e.g. 2x2650, 4x6650, 8x8450,
CX200,CX400, CX600 etc.,]– Destructive Testing while running stress test [e.g. PowerPath, Private
interconnect]– Documentation testing
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3535
Dell’s Oracle Solution Deliverables Deployment CD-ROM kit
– Contains all software / source / documentation to deploy Oracle product.
Installation Wizard– Installs Oracle and Red Hat 2.1 AS in a Turnkey fashion.
Live Install– Component of Installation Wizard, allows installation of
Oracle on a pre-existing RH 2.1 AS system.
Configuration Wizard– Configuration framework for pre-Oracle OS/Oracle.
Deployment Guide, Howtos, white papers– Documentation bundle for the solution
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3636
Customer Requirement:
Oracle9i RAC: Lithonia LightingOracle 8i on W2K to Oracle 9iRAC on LinuxApplication Tier
• Oracle 11i: HR, ERP(Financials), Payroll, Manufacturing*• 11.5.3 to 11.5.6 on W2K for 9i
Database Tier • Oracle8i on W2K• 8.1.7/W2K to 9i RAC/RH
Biz Issues: 1200 users load• Oracle/W2K had 4GB Mem Limit• 150 user capable: ea user = 4MB-6MB
Biz Solution: 1200 users + hi-availability• Oracle/Linux has 64GB Mem Limit• ~400 user capable on PE6450• Oracle9i RAC RH cluster = ~1600 users• Convert PE8450 from Oracle8i/W2K to Oracle9i RH and use as development/test box
Applications• 4xPE2300’s
Production Database• PE8450’s
Applications• 4xPE2300’s
9i Development Database• PE8450’s
Dell|EMCSAN Switch
Dell|EMC FC4700+ 3 Enclosures
9iRAC Production Database• 4x PE6450
9iRAC Hot Spare• PE6450’s
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3737
FAA: Oracle 9iRAC on Linux
Deploying Oracle9i RAC solutions from Dell– Two node clusters running on PowerEdge 6450’s– Fiber Channel storage / SAN– Linux provides a solid platform and an easy transition
from proprietary RISC architectures
Customer testimonial"The Oracle9i Real Application Clusters Certified
Configuration for Dell will enable us to take advantage of a highly available, scalable solution that will truly simplify our database implementations, allowing us to operate more efficiently."
Quote from John Kelly, database administrator and project manager with Kenrob & Associates, a technical contractor for
the FAA command center
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3838
Oracle9i RAC: Dell ITOracle 8i to Oracle 9iRAC on Linux
9iRAC Production Database + Apps• 2x PE6450
Enterprise Database• Oracle8i
Enterprise Application• Sales ODS Software• Customers order from dell.com – ODS provide order status Production Database + Apps
Dell Storage
Dell | EMCSAN Switch
Biz Issues: TCO, Mission Critical and Scale•TCO: use Dell to reduce cost of Unix system• SPF, Single Point of Failure, w/ 1 system• Limited Scale-up for performance
Biz Solution: Lower TCO + hi-availability + scale• TCO = Dell hardware + Dell storage• High Availability = Oracle9iRAC• Scale-out = Oracle9iRAC
© 2003 EMC Corporation and Dell Inc. All rights reserved. 3939
Summary
Dell | EMC | Oracle are committed to Linux
EMC and Dell Linux emphasis in sync with Oracle
EMC CLARiiON robustness, scaling, and performance– Key value addition to support Oracle RAC on Linux with
meeting the Enterprise mission-critical challenges
Dell Linux Oracle Solutions Offerings: – Tremendous value as a new infrastructure acquisition for
supporting Oracle database service– Pre-tested on a supportable hardware and software stack
© 2003 EMC Corporation and Dell Inc. All rights reserved. 4040
DELLDELL
Integrate Integrate and Deliverand Deliver
ORACLEORACLE
Lower TCOLower TCO
EMC2
Automated StorageAutomated Storage
Red HatRed Hat
Enterprise LinuxEnterprise Linux
The best choice for running your Oracle The best choice for running your Oracle database on Linuxdatabase on Linux
CollaboratingCollaborating……
© 2003 EMC Corporation and Dell Inc. All rights reserved. 4141
Next Step
For more details on Dell’s Oracle Solutions: – http://dell.com/oracle– Session 40390 [Tue. 9/9 – Moscone 300 - 3:30 - 4:30PM]
• Dell |Oracle Rapid deployment Techniques for Linux
– Session 40379 [Mon. 9/8 – Moscone 301 - 11 - 12 PM]• Scaling-Out with Oracle Grid Computing on Dell Hardware
For more details on EMC storage solution for Oracle:– http://emc.com/oracle– Session 36675 [Wed. 9/10 – Moscone 304 - 8:30 - 9:30 AM]
• Oracle 10G disk based backup and EMC ATA
Visit EMC (#1302) and Dell (#1726) booths to see demo of this system solution