Enterprise Manager Snap Clone - Oracle · •For SAN, mount luns as raw disk and format with ZFS...

Enterprise Manager Snap Clone Snapshot your data without snapping your storage

David Wolf Director of Product Management Fabio Batista Sales Consultant June 25, 2015

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2


Session Abstract SES16172

Are database refresh challenges causing you to miss projects deadlines? Is your storage cost for dev/test environments spiraling out of control? In this session, you will learn how the Snap Clone feature of Oracle Cloud Management Pack for Oracle Database

• Can refresh production databases after masking and subsetting

• Can enable instant cloning of large databases (TBs) while saving more than 90 percent on storage costs

• Fits perfectly with your existing investments in storage, servers, and engineered systems

• Is being used by other customers for large-scale environments

3


Program Agenda

1

2

3

4

Current Challenges

EM 12c Solution

Demo

Summary

4


A Large Financial Institution – Storage Challenges

1 - 3 Years SPARC x86

3 – 5 Years

Storage Cost / GB = $6.6/year

Estimated Annual Storage OPX

Cost “$198M/year” for Oracle

Environments

Applications Team: “1300 Apps

are utilizing private Cloud”

Storage Team: “We have 50 PB SAN.

Annual growth has ranged from 20-35%”

Database Team: “delivering

test data for UAT is a focus for private Cloud

this year ”

NonProductionEnvironments

AverageCostPerEnvironmentPerApplication

VerySmall(less<1TB) 1,400 300 5 2,100,000 $13,860,000 $9,900Small(1TBto5TB) 500 3,000 5 7,500,000 $49,500,000 $99,000Medium(5TBto10TB) 75 7,500 7 3,937,500 $25,987,500 $346,500Large(10TBto15TB) 25 12,500 7 2,187,500 $14,437,500 $577,500VeryLarge(>15TB) 20 20,000 7 2,800,000 $18,480,000 $924,000

Total: 2,020 18,525,000 $122,265,000 $60,527

OracleDBSize

EstimatedStorage(GB)Requirements

AverageNumberofNon-prod

Environments

AverageDBSize(GB)

Numberof

Applications

EstimatedAnnualOPXCosts

5 to 7 non-prod clones per production database

18 of 30 PB for non-prod Oracle environments

$122M of $198M for non-prod clones

5


Process Challenges

“Database Refresh is a

necessary evil!”

60000 refresh/year

2000+

Dev/Test DB

3 – 5 TB

Typical DB size

RMAN full clones

10 - 20 issues/day

EMC & NetApp storage

- Christian Bilien, Global Head of Database Team

6


Evolution of Solutions

Point Features Point Tools EM Solution

Storage level: snapshot, volume/lun thin clone, dedupe, compression, etc

× Lacked DB or application context

× Does not solve process problem

VM cloning

DB cloning using smart file systems

× Limited focus on just cloning

× Lacked lifecycle management of clones

Technology agnostic

End-to-End automation from prod to test/dev

Designed for DBAs

Complete mgmt of clones - masking, performance, patch/upgrade, etc

7


EM Solution – Data Lifecycle Management (DLM)

Supports full and thin database clones

Technology Agnostic

End-to-End Automation – Prod to Test/Dev

Designed for DBAs

Integrated Masking, Patch, etc

Available via Admin Flows and Self Service portal

EMCLI and REST API for integrations

8


Strong Investment in EM’s Data Cloning Solution

EM 12c R2 EM 12c R3 EM 12c R4 EM 12c R4 PG

• Snap Clone for NAS

storage – NetApp &

Sun ZFSSA

• RMAN backup based

clones

• Snap Clone Analyzer

to show storage

savings

• Snap Clone using

CloneDB

• Data Guard Standby

as a Test Master

• NetApp Ontap 8.x

cluster mode

• Certification for Eng.

systems, I/O over IB

• Support for NFSv4


Solaris File System

(ZFS)

• Snap Clone for PDBs

(Admin Flows)

• Data Lifecycle

Management


EMC SAN and ASM

• Admin flows for test

master creation

• Integration with

masking, patching,

upgrades, etc

EM 12c R5

• Exadata Sparse

Clones for DB and

Multitenant

• PDB Thin clone using

ACFS Snapshot

9


Data Cloning Options

Software Solution [Vendor Agnostic]

Hardware Solution [Vendor Specific]

Full Clones Snap (Thin) Clones

NAS SAN

Database Native [Storage Agnostic]

RMAN Restore

RMAN Duplicate

Data Pump

• Leverage your existing investments • Cater to both functional and stress testing needs • Maximize for best performance

Use Snap Clone whenever you need >1 clones!

ACFS

10


Snap Clone using Solaris File System (ZFS)

• Uses a single stock Solaris 11.1+ image – physical or virtual [and NOT the Sun ZS3 Appliance ]

• Supports any kind storage – NAS or SAN

• For SAN, mount luns as raw disk and format with ZFS filesystem

• Does NOT require the snapshot/clone licenses from the storage vendor, these features are available for free

• Additional features include compression, deduplication, IO caching, etc

• HA has to be handled externally either via Solaris Clusters, or by using HA features of the underlying hypervisor

11


CloneDB using DNFS • Ability to create thin databases from

RMAN image copies

• Uses NFS v3 client embedded in database

• Supported configurations

– Single instance databases

– Note: Only file system support for this setup (No ASM)

• Supported Versions: 11.2.0.3+, 12.1

• Advantages

– Easy to setup

– No special storage software needed

– Works on all platforms

– Time efficient: Instantaneous cloning

– Space efficient: Create multiple clones based on one backup

– Uses dNFS to improve performance, high availability, and scalability of NFS storage

12


Snap Clone on ASM + EMC Storage

• Ability to create ‘live’ thin clones of databases on ASM

• Live Clone: NOT snapshot based, but a live clone of DB

• Clone can be within the same or on a different cluster

• EMC VMAX (with Time Finder VPSnap) and VNX storage appliances

• Supported configurations: SI and RAC

• Supported Versions: DB = 10.2.0.5 or higher; GI = 11.2 and higher

13


New Rapid Database Snapshots for Dev/Test

• Fast space-efficient Snapshot database creation

– Create sparse diskgroup on Exadata storage

– Then create snapshot database or snapshot PDB that reads from base read-only copy of DB and writes to sparse diskgroup

• Integration with pluggable database enables creation of DB snapshot with single Click.

• All Exadata features work on Snapshots (smart scans, smart flash cache, resource management …)

14

Sparse Snap

Base DB

Sparse Snap

CDB


Snap Clone on Exadata Single Click – Rapid Database snapshots using sparse technology

15

Time to create new snap clone ~1min


Snap Clone on Exadata Snap Clone aka Snapshot Databases for both Multitenant & regular Databases

16


End to End Automation Data Lifecycle Management

17


Data Movement

Test Master Database

NAME SSN SALARY

MILLER 112-23-4567 40,000

SMITH 111-22-3333 60,000

Masking & Config Mutation

Production Database

010110011

101001010

000111010

NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

Prod DB Backups Mask / Mutate Test Master Clones

Refresh

Data Guard Standby

Refresh

18


DB Clone and Refresh – Admin Flow

Mask

Subset

Update [Patch – PSU]

Change Configuration [SI / RAC]

Snap Clone

Use as Test Master

Version: 11.2.0.4

Config: 3 Node RAC

Data: RMAN Backup1

Version: 11.2.0.4.4

Config: Single Instance

Data: RMAN Backup1

t0 t1 t2 …. tN

Production Database Clone / Test Master

RMAN Backup / Data Pump / Storage Snapshot

19


Test Master t0 t1 t2 …. tN

Scheduled or Manual Storage Snapshots or RMAN Backups of the test master database, called Profiles

Private backups

Clones

• Clones can be created from any profile

• Each user gets a personal read-write

database clone

Test master is

regularly

refreshed with

current data

from production Data Refresh

Agile ‘Data Refresh’ Time Travel – Refresh, Rewind across Snapshots

20


Self Service Provisioning and Service Catalog

• Out-of-box self service portal

• Catalog of different database configuration with varied datasets

• Resource quota based on role

• Integrated monitoring, snapshot/rollback, etc

21


Demo

22


Complete APIs for Automation or Integration

DBaaS Providers: • CRUD on Zones / Pools / Service templates / Profiles / Quota / etc

List

DBaaS Portal & API

Deploy

Delete Manage

List Zones

List Service Templates

List Service Instances

Request DBs

Request PDBs

Request Schemas

Track request progress

Service Control (start/stop)

Backup

Restore

Snapshot

Get Chargeback info

Delete Service

Extend reservation

33


Complete REST API for Automation or Custom Portals

OR

Out of box Self Service Portal

POST : https://example.oracle.com/em/cloud/dbaas/zone/82CF1C28FA20A18

3C99D138FF8065F19

Authorization: basic ZGVtb3VzZXI6ZGVtb3VzZXI=

Content-Type:

application/oracle.com.cloud.common.DbPlatformInstance+json

Accept:

application/oracle.com.cloud.common.DbPlatformInstance+json

Body:

{

"based_on":

"/em/cloud/dbaas/dbplatformtemplate/CC3BBB665A6BC6FFE040F00AEF

252456",

"name": "<Request name>",

"description": "<Request Description>",

"params":

{ "username": "Master Account username for the DB",

"password": "Password for the Master Account on the DB"

}

}

34

https://example.oracle.com/em/cloud/dbaas/zone/82CF1C28FA20A183C99D138FF8065F19

https://example.oracle.com/em/cloud/dbaas/zone/82CF1C28FA20A183C99D138FF8065F19


Data Lifecycle Management for Multitenant Databases EM – Single tool to Provision, Migrate , Clone , and Snap Clone

35

GL OE AP

GL-2 GL-1 AP-1 AP-2 PO-1

PO

• Clone across CDBs

(remote CDB)

• Clone within the CDBs

• Create snap clones in

seconds.

• Migrate non CDB into

PDB

• Supported both On

Premise and Oracle

Cloud Databases


EM offers PDB Thin Cloning & beyond…

36

Mu

ltit

enan

t C

lon

ing

Full Clones Supported on all platforms

Snapshot clones

Source in Read-only if child exists

File System Agnostic (CloneDB=TRUE)

Exadata Sparse clones

Copy-on-write - Source opened in read write after

clone is created

ACFS

ZFSSA / ZS3

Netapp

Configuration mutation from n-Node RAC -> SI

In-line PSU patch application

Integrated Data Masking

Advanced PDB Create options Max Size. Max Shared Tbsp Size. Logging options.

Customization hooks…

Pre-Create Script Post-Create Script Custom Sql Script


Summary

37


Test Master Database

010110011

101001010

000111010

Snap Clone with Oracle Engineered Systems

Enterprise Manager 12c

Exadata

• Compute nodes are used to run snap

clone databases

• The storage is external to Exadata

and served over NFS

• In case of ZS3 storage, all traffic over

infiniband

SuperCluster

• Solaris Zones or LDOMS used to run

snap clone databases

• Embedded ZS3-ES storage served

over infiniband

Oracle Virtual Compute Appliance

• Oracle VMs used to run snap clone

databases

• Embedded ZS3-ES storage served

over infiniband

/source [nfs]

.. more

/clone1 [nfs]

External Storage

/clone2 [nfs]

38


Cloud Management Pack for Oracle Database Summary

Metering, Chargeback

Supports Databases, Schema, and PDBs

Database Cloning Full clones and Snap Clones (thin clones)

Quota and Policy based Management

Self-Service Provisioning

Enforces governance and control

Supports Database, Schema, and PDBs

Comprehensive REST and EMCLI APIs For all self service and admin functions

Enterprise-wide Service Catalog Role based, Single catalog, to enforce standardization across the DB estate

39


References

• Enterprise Manager Page on O.com

• Cloud Management Page on OTN

• Cloud Administration Guide (Documentation)

• MOS Note: EM12c Recommended Plug-Ins and Patches for DBaaS (1549855.1)

40

http://www.oracle.com/us/products/enterprise-manager/index.html

http://www.oracle.com/technetwork/oem/cloud-mgmt/em-dbaas-2104694.html

http://docs.oracle.com/cd/E24628_01/doc.121/e28814/toc.htm

Enterprise Manager Snap Clone - Oracle · •For SAN, mount luns as raw disk and format with ZFS...

Documents

Transcript of Enterprise Manager Snap Clone - Oracle · •For SAN, mount luns as raw disk and format with ZFS...