Oracle and NetApp Mike McGuiggan Consulting Systems Engineer Northeast Region.
-
Upload
simon-curtis -
Category
Documents
-
view
231 -
download
0
Transcript of Oracle and NetApp Mike McGuiggan Consulting Systems Engineer Northeast Region.
Oracle and NetApp
Mike McGuigganConsulting Systems EngineerNortheast Region
2© 2008 NetApp. All rights reserved.
Oracle and Network Appliance®
12 years of innovation driving down infrastructure costs AND increasing enterprise IT productivity
NetApp helpsestablishOracle Storage Compatibility Program (OSCP)
1999
OraclecertifiesNetApp
1997
First filer for Oracle DB sold
1995
NetApp runs its core business on Oracle E-Business Suite
NetApp and OracleBlueprints from Oracle Consulting
2001
3000+ Oracle on NetApp customers in production
Linux competency center
2003
2000Oracle B2B Exchange selects NetApp
NetApp is Certified Solution Partner
2004NetApp deployment at Oracle:
- over 2000 TB - 9,500 Servers at Oracle Austin Data Center
Enterprise Grid Alliance
Oracle builds next Apps on NetApp storage
2002NetApp deployment at Oracle: 500TB
Oracle NetApp Joint Escalation Team ONJET
Joint Center of Excellence (CoE) and professional services
2005NetApp deployment at Oracle:
- over 3200 TB
- 14,000 Servers
ONTAP 7G FlexVol & FlexClone deployed
NetApp runs Oracle ERP, CRM and HR
SnapValidator announced
EM Grid Control Integration
2006NetApp deployment at Oracle:
- over 5500 TB
- 20,000 servers
OCS SnapLock Integration
SnapManager for Oracle Launched
5000+ joint customers
2007NetApp deployment at Oracle:
- over 6900 TB
- 20,000+ servers
Oracle Enterprise Linux 4 Support
SnapLock Integration
3© 2008 NetApp. All rights reserved.
Safra Catz, President and CFO of OracleOOW quote:
“I would like to introduce my good friend Tom Mendoza…………NetApp is a very, very close
partner of Oracle…..we have worked together for a very long time in advancing technology, grid
computing, and data center consolidation……..for any of you that has visited our Austin Data Center, it is a commercial for NetApp. We voted for them
with our money.”
4© 2008 NetApp. All rights reserved.
Oracle Austin Data Center.Over 20,000 servers. Over 6900+ TB of NetApp Storage.
Austin Data Center Stats• More than 20,000+ servers
• Largest Dell/Linux installation on earth
• 6,900+ terabytes of NetApp storage
• Largest NetApp single installation on earth
• Scaling at over 60TBs of storage each month
• Over 500 mission-critical customers' apps hosted on the premises
• Primary data center for 50,000+ Oracle employees
• 2 acres of data center raised floor space
Results• Experiencing 30% higher utilization and faster
application deployment• Storage management overhead reduced 50%• Global IT has 88% faster response time on
NetApp FC SAN
5© 2008 NetApp. All rights reserved.
The Bottom Line
100
171
260
155
0
50
100
150
200
250
300
NetApp FAS HP EVA EMC CLARiiON EMC Symmetrix
Acquisition & Ongoing Vendor Costs
Internal Operational Costs
Business Cost of Downtime
Source: Mercer Database Storage Total Cost Comparison Interviews, December 2005 - January 2006.
To
tal C
ost
Ind
ex
(No
rmal
ized
to
Net
Ap
p S
an =
100
)
Total Cost Comparison Typical Database Applications
+108%
+243%
▶ Modular arrays – 55% to 71% more than NetApp
▶ Frame arrays – over 250% more than NetApp
+92%
6© 2008 NetApp. All rights reserved.
Oracle as a Customer - Highlights
99% of Oracle application development is on NetApp (2400TB)
99% of Oracle OnDemand “Production Applications and DB” (2100 TB)
100% Oracle University (120TB)100% Oracle Demos DB & Applications
(500TB)50% Database Development (300TB)65% of Oracle internal production (2420 TB)
“NetApp has reduced the overhead necessary to perform storage-related management activities by 50%.”
7© 2008 NetApp. All rights reserved.
SAN(Block)
NAS(File)
NetApp Supports Them All!Fabric Attached Storage Topology
DedicatedEthernet
Fibre Channel
EnterpriseSAN
EnterpriseNAS
DepartmentalNAS
Corporate
LAN
Corporate
LAN
iSCSISAN
NetApp®
FAS
8© 2008 NetApp. All rights reserved.
Simplifying Database Management:
NetApp’s Value Proposition to the DBA
9© 2008 NetApp. All rights reserved.
NetApp’s Value to the DBA
Performance and UtilizationBackup and RecoveryData ProtectionDisaster Recovery and Business ContinuanceTest / DevelopmentASMSnapManager for Oracle
10© 2008 NetApp. All rights reserved.
Database Performance Tuning and Capacity Planning Challenges
Storage can be a performance bottleneck
Duplicate database copies are needed to maintain availability and SLAs
Performance of each volume is limited to the number of spindles within
“Hot” volumes can’t be “helped” by disks in other volumes
Capacity planning, forecasting and management are imprecise tasks
Availability, scalability and capacity must be maintained or increased while driving down costs…
11© 2008 NetApp. All rights reserved.
FlexVol™ - Flexible, Virtualized Volumes & LUNs
Conventional Volumes & LUNs
Full provisioning tied to physical disks
Manual, inefficient
Unused space not available to others
vol3
data
free
Test
Data ONTAP 7G™ – FlexVols™
vol0
HM DIR’s
vol1
SQL “HOT”
vol2
Oracle/Caché
n Raid Groups = AGGREGATE = Physical Storage Pool
FlexVol™ = Logical Data Container (1MB – 16TB)
FlexVol™s share disk Aggregate
Grow & shrink non-disruptively
Higher Storage Utilization
Improved Performance
Thin Provision
add disks on-the-fly
More shared spindles mean NO “HOT” vols / LUNs
WAFL® Provisions-on-Demand
SoftwareProvision – on – Demand … with LESS
PPPP
P P
12© 2008 NetApp. All rights reserved.
WAFL®, Snapshot™, and FlexClone™:The Foundation
NetApp’s Unique DNA WAFL – Write Anywhere File Layout
– Core block and file storage services
– Resiliency features (RAID-DP™) Snapshot
– Near-instantaneous, point-in-time “copy” of file system (vol) or LUN
– Read-only SnapRestore®
– Near-instantaneous “rollback” of vol or LUN to prior Snapshot copy
FlexClone
– Near-instantaneous, WRITABLE “copy” of vol or LUN
– Same space-sharing characteristics
A B C D
Active Filesys or LUN
Inodes, block maps
Disk blocks
Snapshot
D’ Y
FlexClone
13© 2008 NetApp. All rights reserved.
Introducing SnapshotTM
A B DC
RootInode
RootInode
C’
After Block UpdateBefore Snapshot
Snapshot(Inode Copy)
After Snapshot
Disk Blocks
Disk Usage
14© 2008 NetApp. All rights reserved.
Introducing SnapRestore®
A B DC
(New) RootInode
RootInode
C’
After Snapshot
Snapshot™(Inode Copy)
After SnapRestore
Disk Usage
Disk Blocks
15© 2008 NetApp. All rights reserved.
Database Performance TuningExample
Test OLTP Database 1
Test OLTP Database 2
Transaction LogArchive LogFlashback
Data Files All Files
24-DiskAggregate
32-Disk Aggregate
8-Disk Aggregate
16© 2008 NetApp. All rights reserved.
Database Performance TuningExample
Test OLTP Database 1
Test OLTP Database - 2
Transaction LogArchive LogFlashback
Data Files All files
24-DiskAggregate
32 Disk Aggregate
8-Disk Aggregate
-24%
17%
-25%
-20%
-15%
-10%
-5%
0%
5%
10%
15%
20%
Disk Utilization Transactions/min
17© 2008 NetApp. All rights reserved.
NetApp’s Value to the DBA
Performance and UtilizationBackup and RecoveryData ProtectionDisaster Recovery and Business ContinuanceTest / DevelopmentASMSnapManager for Oracle
18© 2008 NetApp. All rights reserved.
Database Backup and Recovery
Challenges RMAN backups consume
significant physical resources Cold backups lead to lower
SLAs Separate backups on each
platform Time-to-recover from tape
becomes prohibitive DBA’s time spent on non-value-
add backup/restore tasks Backups performed with less
frequency
19© 2008 NetApp. All rights reserved.
Backup and Recovery with Snapshot and SnapRestore
Significant time savings Stay online Reduce system and
storage overhead Consolidated backups Backup more often
Time in Hours
Time toBackup
Time toRecover
To Tape (60GB/Hr Best Case)
From TapeRedo Logs
300GB Database
0 1 2 3 4 5 6 7 8
Snapshot™
Redo Logs
SnapRestore®
A B C D
Active Filesys or
LUNSnapshot
D’ Y
FlexClone
Primary Backup
Secondary BackupSnapVault
20© 2008 NetApp. All rights reserved.
NetApp’s Value to the DBA
Performance and UtilizationBackup and RecoveryData ProtectionDisaster Recovery and Business ContinuanceTest / DevelopmentASMSnapManager for Oracle
21© 2008 NetApp. All rights reserved.
RAID-DP Reliability
2,000 to 4,000 times more secure than regular RAID
More reliable than mirroring for double-disk failure
14% Parity Overhead vs. 50% Overhead w/Mirror(*)
72% more usable capacity than competitive offerings(*)
(*) Comparing 2P+12D vs. 7+7 Mirror
P
P DP
RAIDProtects against single disk failure
RAID DP Protects against any two-disk failure
22© 2008 NetApp. All rights reserved.
RAID-DP vs Other RAID Methods
RAID Level Failure Protection# of Disks (Cost Hit)
Performance Impact
RAID 1(Mirroring)
Multiple disks, except mirror pairs
2N(N or 100%)
2x writes; none to add or reconstruct
RAID 5(“RAID”)
1 failed disk or uncorrectable disk (hard) errors
N+1; N7(1/N or 14%)
XOR calculation on writes, and when disks added or data reconstructed
NetApp RAID 4
1 failed disk or uncorrectable disk (hard) errors
N+1; N7(1/N or 14%)
XOR calculation on writes and when data reconstructed;none when adding disks
NetApp RAID-DP
2 failed disks or 1 failed disk and hard disk errors
N+2; N14(2/N or 14%)
XOR calculation on writes and when data reconstructed;none when adding disks
RAID-DP provides RAID 1 protection……with RAID 4 cost, performance and simplicity
23© 2008 NetApp. All rights reserved.
Protect Oracle Data with SnapLock
Tablespaces
Oracle Database
Datafiles
(partitions)
/oradata/2001a.dbf
/oradata/2001b.dbf
2005 2004
2003
2001
2002
Q1 Q2
Fabric Attached Storage (FAS)
Unified Storage
Architecture
SnapLock software helps ensure the permanence, accuracy, integrity, and security of data by enabling business records and Oracle data files to be both unalterable and rapidly accessible online for long periods of time.
Online Archive (SnapLock)
Low Cost ATA Drives
High Perf. (SnapLock)
High Performance
24© 2008 NetApp. All rights reserved.
Migrate Data Across Storage Tiers
Periodically move data between storage tiers as access patterns change– e.g. MOVE PARTITION holding Q2
Orders from high performance storage tier to low cost storage tier
Move important data on demand– UPDATE of partition key will cause
row to move to a new partition e.g. product warranty expires
Write protect data with SnapLock on any storage tier– e.g. MOVE PARTITION to SnapLock
volume and mark as “read only” and set the retention date.
High PerformanceStorage Tier
Low CostStorage Tier
PartitionRules
Use Cases:Content Mgmt., ILM, Compliance, Litigation,Etc.
25© 2008 NetApp. All rights reserved.
Protect Against Oracle Block Corruption
Database
Block Write
Volume Manager
I/O Driver
Operating System
Host Bus Adapter
SAN / NAS Cloud
Data passes through many layers before reaching the storage subsystem.
Corruption can occur at any point in the data path.
Prevention is better than recovery…
“… the larger outage was caused by a corruption of data files. The corrupted files began to replicate and quickly spread across the system, …” April 11, 2002
eBay suffers three outages in three days
Oracle® Database
Hardware and/or firmware failures, misconfiguration, etc.
26© 2008 NetApp. All rights reserved.
SnapValidator: Prevents Oracle block corruption SnapValidator™ is NetApp’s implementation of
Oracle’s HARD initiative– HARD stands for Hardware Assisted Resilient Data
Validates writes to volumes that contain Oracle data– Oracle checksum verification
Feature of Data ONTAP Supported with Oracle Database 9i and 10g (NFS,
iSCSI, FCP) NetApp is the only HARD partner to support this
initiative across its entire product line. NetApp is the only HARD partner to support
filesystems.
27© 2008 NetApp. All rights reserved.
NetApp’s Value to the DBA
Performance and UtilizationBackup and RecoveryData ProtectionDisaster Recovery and Business ContinuanceTest / DevelopmentASMSnapManager for Oracle
28© 2008 NetApp. All rights reserved.
Disaster Recovery Planning
Challenges 4x actual storage requirement Expensive transport
infrastructure Cumbersome to install and
manage Difficult to keep backup copies
synchronized
Secondary Data CenterPrimary Data Center
DatabaseServer
RAID0 + 1Mirror Copy
RAID0 + 1Mirror Copy
DedicatedLines andSwitches
DatabaseServer
29© 2008 NetApp. All rights reserved.
Disaster Recovery with SnapMirror®
Fast data replication and failover
Significant reduction in storage required
Sync or async replication More efficient network
utilization Access to mirrored data Volume or qtree replication Secondary can become
primary in case of disaster at primary site
Easy to install and manage over existing IP infrastructure (WAN)
SnapMirror
Production Site
Remote Disaster Recovery Site
30© 2008 NetApp. All rights reserved.
Unified and Tiered Disaster Recovery with ReplicatorX®
SAN SAN / iSAN
Current Instance
Point-in-Time Clones
Or any Legacy
Storage
HA/BC siteFAS Storage
FlexClone
Data replication and recovery over any distance in a heterogeneous environment
100% data consistency across any number of servers, storage devices, and fabric-based devices
Guarantees block write order
31© 2008 NetApp. All rights reserved.
NetApp’s Value to the DBA
PerformanceBackup and RecoveryData ProtectionDisaster Recovery and Business ContinuanceTest / DevelopmentASMSnapManager for Oracle
32© 2008 NetApp. All rights reserved.
Database Cloning and the Application Development Process
Full or partial database copies required for:– App and DB Development
– Maintenance (OS, DB upgrade)
– Test and QA
– Training and Demos
– Reporting and DW ETL Ability to do this quickly,
correctly, and efficiently directly impacts Application Development and Deployment
PROD SECONDARY (DR)
DEV MAINT TEST/QA RPT/ETL
33© 2008 NetApp. All rights reserved.
Application Development and TestingExample: Traditional Approach
Production database 100GB
Mirror copy 100GB
Development copies 300GB
Testing copies 300GB
Total: 800GB
8x actual storage requirement Time consuming Resource overhead
Test 1 Test 2 Test 3
Production Mirrored Copy
Dev 1 Dev 3Dev 2
34© 2008 NetApp. All rights reserved.
Application Development and TestingExample: NetApp Approach
Production database 100GB
Mirror copy 100GB
Development copies 30GB
Testing copies 30GB
Total: 260GB
Over 67% reduction in storage required
Near instantaneous copies Negligible overhead Ability to have many more test and
dev copies
Test 1 Test 2 Test 3
Production Mirrored Copy
Dev 1 Dev 3Dev 2
Assumption: up to 10% change in data in the test and dev environments
more clones = higher productivity
35© 2008 NetApp. All rights reserved.
Database Maintenance with FlexClones
Benefits
Instantaneous copies
Low resource overhead
Inexpensive Easy and relatively inexpensive
way to make copies of a production database without impacting the database
Use database clones to test migrations, apply bug fixes, upgrades, and patches
Easily reallocate storage for a database and its transaction log files
Test 1 Test 2 Test N
Production Mirrored Copy
Dev 1 Dev NDev 2Production DB Clones
A B C D
Active Filesys or
LUNSnapshot
D’ Y
FlexClone
36© 2008 NetApp. All rights reserved.
Cloning for Production Support Applications EMC to NetApp example using ReplicatorX
Continuous replication with no disruption to production
Avoid duplicating expensive storage for production support
Local or remote environments
Integrated, instantaneous cloning of current production data
Manage up to 255 clones with minimal storage capacity
Production Environment Production Support Environment
SAN SAN / iSAN
Current Instance
Point-in-Time Clones
Instantaneous Clone
Continuous Replication
• Development and Test• Reporting• Analytics / Data Warehouse
Or any Legacy
Storage
FAS Storage FlexClone
ReplicatorX ReplicatorX
37© 2008 NetApp. All rights reserved.
New Database Development Methodology
Mirror PROD for initial copy (DR)– If non NetApp PROD, use
ReplicatorX for SAN-to-SAN Clone database replicas as
needed Create Snapshot™ copies of
replicas for instant SnapRestore® of working databases
Exploit multiple mirrors to increase fan-out and support multiple sites
PROD Secondary (DR) Clones
Develop ● Test ● Deploy
38© 2008 NetApp. All rights reserved.
NetApp’s Value to the DBA
Performance and UtilizationBackup and RecoveryData ProtectionDisaster Recovery and Business ContinuanceTest / DevelopmentASMSnapManager for Oracle
39© 2008 NetApp. All rights reserved.
NetApp Adds Value to Oracle ASM
Oracle ASM NetApp Oracle ASM + NetApp
Data Resilience
Protect against Single Disk Failure Yes Yes Yes
Protect against Double Disk failure No Yes Yes
Passive Block corruption detection Yes Yes Yes
Active Block corruption detection Yes Yes Yes
Lost disk write detection No Yes Yes
Performance
Stripe data across ASM Disks Yes No Yes
Balance I/O across ASM Disks Yes No Yes
Stripe data across Physical Disks No Yes Yes
Balance I/O across Physical Disks No Yes Yes
I/O prioritization No Yes Yes
Storage Utilization
Free space management across physical disks
No Yes Yes
Thin provisioning of ASM Disks No Yes Yes
Space efficient Cloning No Yes Yes
Data Protection
Storage Snapshot based Backups No Yes Yes
Storage Snapshot based Restores No Yes Yes
40© 2008 NetApp. All rights reserved.
NetApp’s Value to the DBA
Performance and UtilizationBackup and RecoveryData ProtectionDisaster Recovery and Business ContinuanceTest / DevelopmentASMSnapManager for Oracle
41© 2008 NetApp. All rights reserved.
SnapManager® for Oracle®
Automated, fast, and efficient
Uptime AND performance
Simplify backup, restore, and cloning
Tight Oracle Database 10g integration– Automated Storage
Manager (ASM)– RMAN
Oracle Databases
NetApp StorageAppliance
SnapManager (GUI)
SnapDrive™
NetApp Appliance
NFS, FCP, or iSCSI
42© 2008 NetApp. All rights reserved.
Oracle Advanced
43© 2008 NetApp. All rights reserved.
Other Cool Stuff…
NFS,v4– Support with Data ONTAP 7.3
Planned– Feature implementation with DNFS for 11gR2
Workload prioritization Smart redirection
RAC Failover Management with NetApp– Integrate Manage ONTAP API’s into CRS…
If Storage not accessible, is it failing over? (planned or unplanned)
Alternative: node eviction + “suicide” + application/user must reconnect…
Oracle Enterprise Manager Grid Control– Enhanced plugin (to include blocks)– Connector (to Operations Manager)
SMB/E Solution with DNFS+SE-RAC on Windows…
44© 2008 NetApp. All rights reserved.
FlexShare Key Features
Relative priority of different volumes
Application (user) Vs. Data ONTAP background (system) prioritization
Per-volume cache policies
Dynamic configuration updates
0 10 20 30 40 50 60 70 80
Low PriorityVolumes
Medium PriorityVolumes
High PriorityVolumes
Latency (msec)
Without FlexShare™
0 10 20 30 40 50 60 70 80
Low PriorityVolumes
Medium PriorityVolumes
High PriorityVolumes
Latency (msec)
With FlexShare
SystemClient
Time
Sys
tem
Lo
ad
(IO
PS
)
Prioritize Client over System
Prioritize System over Client
45© 2008 NetApp. All rights reserved.
FlexShare High Benefit Use Cases
Consolidated Environments– Production, Test, and Development on the same system
Backup/Disaster Recovery Throttling Manage “like” data with consistent performance
– Structured and unstructured Match NetApp cache management with Oracle cache management
46© 2008 NetApp. All rights reserved.
Oracle Enterprise Manager Grid Control Plugin for NetApp
Monitor Trends and Threshold Alerts
Monitor Key Statistics
Monitor Utilization
Etc.
•Ships with Oracle Enterprise Manager
•Developed, maintained and licensed separately by Oracle
47© 2008 NetApp. All rights reserved.
Introducing Database NFS - DNFS
What is DNFS? – An Oracle developed and supported NFS client for
all platforms. (Including Windows)What are the benefits of DNFS?
– Simpler management with enhanced performance and scalability.
– No certification required immediate customer availabilityFully tested during development rather than after
deployment
– Supports RAC, ASM, and HARD across all operating environments
48© 2008 NetApp. All rights reserved.
Performance
Automatic Link Aggregation– Users can specify multiple ethernet connections between the
Oracle database and the NFS server
– DNFS will distribute the load over all active links in a balanced fashion
Improved I/O Concurrency– Supports fully concurrent, asynchronous I/O on all platforms
Summary– Any Oracle application can easily take advantage of the
performance available on multiple parallel wires
– No other NFS client can do this…
High performance and high throughput, regardless of operating environment and without the need for expert tuning
49© 2008 NetApp. All rights reserved.
Simplicity
Runs outside of the OS kernel– No integration with operating system’s virtual
memory or buffer cacheDNFS has a shorter code path faster than other
NFS clients with fewer bugs
No mount options– Already tuned for database operations
– Simple to set up fewer operational errors
– Fewer support calls
50© 2008 NetApp. All rights reserved.
Database Backup with A-SIS Deduplication (Advanced Single Instance Storage)
Data Center
Database Servers
Hetero-geneous Storage
Backup Server
Remote Office
NetApp Storage
A-SISdeduplication
NearStore
Backup Data
• Backing up Oracle Databases to NearStore
• Reported 50:1 space savings with A-SIS deduplication vs tape backups
• Backups are quickly recovered from disk
• Initial database backup is deduplicated and reduced in size
• Each subsequent backup provides space savings through deduplication
50:1Space
Savings
Fortune 500 Manufacturer
No perceivable performance impact–Write Overhead ~1%–Read Overhead 0%
51© 2008 NetApp. All rights reserved.
Question and Answers
AQ&