Storage Overview And Architecture

Arvind Shrivastava

Enterprise Network Storage Architecture

Unbounded Unbounded performance and performance and

capacitycapacity

Unprecedented Unprecedented flexibilityflexibility

Simplified managementSimplified management

The lowest The lowest total cost of ownershiptotal cost of ownership

++

++

==

Core Core TechnologyTechnology

Network Network Attached Attached StorageStorage

Direct Direct AttachedAttached

ServicesServices

Storage Storage Area Area

NetworkNetwork

SoftwareSoftware

Direct Attached Storage(DAS)

Low Cost Solution

Simple to Configure

De-Centralized Storage

No Storage Consolidation

No High Availability

Low Performance

Network Attached Storage(NAS)

Heterogeneous Environment

Centralized Storage

Low Performance

Limited scalability

Network Congestion during backups & Restore

Ethernet Limitations

Storage Area Network

Heterogeneous environment

Centralized Storage Management

High Degree of Fault Tolerance

Best and superior performance

Storage Consolidation

Fast and efficient backups and restores

Dynamic Scalability

Expensive solution for small setups

SAN V/s NAS

Fibre Channel IP

Reliable Unreliable

Extremely low CPU Overhead Extremely High

Large Blocks of Data Large Nos. of small Blocks

LAN-free back-up Lan Back-up

Applications managing own Data specs

Applications driven by universal access to files

Mid-Range Storage Features

• Excellent ease of use

• Virtualization

• Dynamic virtual disk expansion

• Business Copy functions

• Continuous Access functions

• High availability features

• High, middle*, and low models and configurations

• Multiple operating system support

• Single pathing support for all operating systems

• Coexistence with heterogeneous configurations

Buisness copy Overview

Continuous Access-Overview

Flex Copy Concept

Features• Allows use of low end storage

for low-cost point-in-time copies of production data

• Point-in-time copy to and restore from Low end storage

• CLI or GUI ConfigurationBenefits

• Reduced TCO in mixed product/non-production

• Offloads production data from secondary operations

• Allows for distributed remote data and hi performance two-stage backup/archive configurations

Cost-effective, external point-in-time copies

Low end storage

P

C1

Enterprise storage

Product Positioning

Additional Features EVA4000/6000/8000

Additional features unique to the second generation EVA

• New controllers with improved performance, higher capacity

support, larger cache, more FC ports

• Up to 200TB of presented capacity (versus 35TB for the first

generation EVA)

• Support for 1024 LUNs (first generation EVA was 512)

• Support for active-active failover using multipath software

for all operating systems

• Increased support for boot from SAN (AIX, Solaris)

• Direct Connect support for Windows

• Additional CA functionality

• Support for native HBAs and HBA drivers

• Additional snapshot and snapclone functionality

Useful Links

Information sources :-– HP Enterprise Virtual Array• http://h18006.www1.hp.com/storage/arraysystems.html– HP Command View EVA• http://h18006.www1.hp.com/products/storage/software/cmdvieweva/index.htm– Whitepapers• http://h18006.www1.hp.com/storage/arraywhitepapers.html

Storage backup Overview And Architecture

Arvind Shrivastava

BACKUP SOFTWARE

What is it?

• Software that provides automated data protection for businesses with 24x7 availability needs.

What does it do?

• Data Protection: copies data onto a storage device, so that in case of a need (loss, corruption, disaster), data can be easily recovered and made accessible.

• Media management: easily manages the library catalogues to keep track of all media and copies of data for fast recovery.

Most important features:

• Automated backups that scale from small workgroups to multi-site, heterogeneous SAN & NAS environments with thousands of servers.

• Fully-integrated Zero-Downtime backup with Instant-Recovery.

Architecture Components

manager of managers

distributed GUI

operations console

cell manager

cell manager

cellclients

cellclients

Client-Server Modules

media agent(MA)

disk agent(DA)

cell console(CC)cell manager

(CM)

Inter-process Communication (IPC)

session manager

cell manager

tcp/ip

tcp/ip

tcp/ip

disk agent

media agent

disk agent

media agent

tcp/ip

tcp/ip

scheduler

cell console

network backup/restore

local backup/restore

shared memory

session manager

How to choose between tape drives and tape libraries servers

Tape drives Autoloaders Tape Libraries• Servers are configured individually and backup device is connected directly to the server

• Disk capacity to be backed up is less than 200 GB

• Cost conscious customer

• Single/Multiple servers

• Unattended backup

• LAN based Backup

• Disk capacity to be backed up is 200 GB to 1 TB

• Consolidation is required

• Multiple servers are configured together

• Unattended backup

• LAN or SAN based backup

• Disk capacity to be backed up is more than 1 TB

• Consolidation and centralized management is required

• Storage external to servers in JBOD or disk arrays

25GB

100GB

50GB

6 10025 50 200Speed GB/hour (compressed)

12

Cap

acit

y (

com

pre

ssed

)

Relative Performance

Ultrium 215

Ultrium 230

DAT 40

Ultrium 460

SDLT 320

DAT 24

400GB

200GB

DLT VS80

Workstations

Office Servers

Departmental/local network

Corporate/

networked backup

DAT 72

Complied by Ranganath Sadasiva

Tape Device

Native Compressed Native Compressed Native Compressed

DAT 12/ 24 1.2 2.4 12 24 4.32 8.64

DAT 20/ 40 2.4 4.8 20 40 8.64 17.28

DAT 72 3 6 32 72 10.8 21.6

DLTvs80 3 6 40 80 10.8 21.6

DLTvs160 8 16 80 160 28.8 57.6

DLT 80 (obs) 6 12 40 80 21.6 43.2

SDLT 110/ 220(obs) 11 22 110 220 39.6 79.2

Ultrium 215 7.5 15 100 200 27 54

Ultrium 230 15 30 100 200 54 108

SDLT 160/ 320 16 32 160 320 57.6 115.2

SDLT 600 36 72 300 600 129.6 259.2

Ultrium 448 24 48 400 800 86.4 172.8

Ultrium 460 30 60 200 400 108 216

Ultrium 960 80 160 400 800 288 576

Date Transfer Speed MB/ Sec Data Capacity in GB

Back up capacity GB / hour-

max

Tape drives – Speeds and feeds - Comparison

Features

Features Required in any Backup software• Advanced backup to disk

• Oracle/SAP Integrations

• Zero Downtime Backup

• Split mirror

• Snapshot

• Snapclone

• Filesystem / application backup on inactive MC/SG node

Overview – Advanced backup to disk

Why backup to disk?Benefits

• Fast random access allowing:– Fast single file restore– Space efficient backup

• Instant recovery– e.g. switching for recovery instead of restoring

data from tape• Faster restore of backup chains• No tape streaming problems• Ideal for RAID 5• Easy to detect disk failures• More protected, e.g. it’s not easy to steal a disk

Advantages of ZDB

The advantages of using Data Protector Oracle ZDB integration are the following:• ZDB reduces the performance degradation of the application system.• The tablespaces are in backup mode (online backup) or the database is shut down (offline backup) only during the short period required to create a replica (split the mirror disks or create snapshots).• The time to create a replica is significantly reduced. Following its creation, tape backup can be created on the copied data, at leisure , using a separate backup system.•The Data Protector Oracle ZDB integration offers online and offline backup of your Oracle Server System (application system).

BACKUP CONCEPT-SPLIT MIRROR BACKUP

ZDB Setup

P

P – primary LDEV

M – mirror copy (MU0-2)

• True online backup for integrated applications

• Split mirrors may used for instant recovery or resynced

• No performance impact on applications during backup

• Mirror synchronization before or after backup

• Automatic mirror rotation

• API based integration

Backup host

Application host

MM

XP

M0 21

Backup Software and Storage Integration Concept

Client 1 Client 2

Questions?

New HP Storage Products

Arvind Shrivastava

RISS

Introducing…

HP StorageWorks Reference Information Storage System

What is RISS is and who wants it?

The HP StorageWorks Reference Information Storage System (RISS)

A cornerstone of HP ILM (Information Lifecycle Management )

A fully integrated and uniquely scalable system for access to reference information that…

…reduces Total cost of Ownership, mitigates risk and turns data into information

HP StorageWorks Reference Information Storage System

• Manage Costs

– Remove static data from application servers/storage

– Shorten backup windows– Eradicate duplicate data objects

• Mitigate Risks – Automated retention of messages &

attachments– Data is digitally signed, time

stamped & protected– Assist customers to meet their

compliance requirements

• Exploit Data Assets

– Power indexing!– Grid computing for fast

search/retrieval

AB C

AB CA

B C

AB

C

As the number of information objects grows…• cost of management increases

• accessibility to the information decreases

Scale is the Problem

TCO $

# of content objects managed

AccessTime

TCO

Performance

HP StorageWorks RISSarchitectural benefits

‘back end'

‘front end'

Modular, redundant, self healing gridcomputing and storage (smart cells)

Application-independent indexing, search and retrieval of information

Objects in the RISS cannot be modified or deleted until end of retention period

Content is digitally signed and time stampedfor regulatory compliance

User Application

Application Integration

RISS

Open protocol API

Clients

smart cell

Application integrationwith e-mail and MS Office

Client applications get added archive functionality(architecture transparent to them)

smart cell

hp StorageWorksFile System Extender (FSE)

A General Overview

Arvind Shrivastava

What is FSE?

• HP StorageWorks File System Extender (FSE) is new-generation data management software that is part of the HP Information Lifecycle Management portfolio.

• Enables automatic and transparent data movement between production (primary) storage media and secondary storage media, using simple user-defined rules.

Changing digital storage demands

Time

Sto

red

data

Reference

Operational

Majority is reference

information

FSE attacks the costs of reference data

FSE Basics

• Based on Client/Server architecture.

• Infinite File System

• FSE software supports LTO drive technologies for – LTO Ultrium 1 and LTO Ultrium 2 media.

• WORM Support.

• Automatic error detection

• FSE automatically detects drive and media hardware errors.

• NFS & CIFS support

Managing storage spaces

FSE storage spaces

MSA/EVA & FSE

h p S torageWorksM SL 6030

production storage SCSI

disk

MSA1500/EVA

secondary storage

SATA/FATA disk

secondary storage

MSL tape library

1. Inactive files moved from SCSI to SATA disk

2. Optional second copy to tape

3. Automatic & transparent recall of migrated files

4. File recall from second copy if first unavailable

Contents

What is the EFS WAN Accelerator?

HP EFS WAN AcceleratorHow Does it Work?

Removes All Redundant TCP Traffic on WANs• Files, Emails, Backup, Web Traffic, FTP, Applications

• Stores All TCP Traffic On Disk

• Never Send The Same Data Twice

• Reduces WAN Traffic By Up To 98%

Optimizes Application Protocol Behavior • Removes Most Round Trips for Chatty Apps Like Windows

• Highly Effective for the Most Common Applications

Optimizes the Behavior of TCP• Reduces “Chattiness” in TCP

• Implements Latest TCP Optimizations

Up to 100 Times Faster Throughput

HP EFS WAN AcceleratorThree-part Solution

The Problem HP’s Solution What it Does

1. Not Enough Bandwidth

Scalable Data Referencing (SDR)

Remove repeated bytes from the WAN for all TCP traffic

2. TCP Chattiness and Inefficiency

Virtual Window Expansion (VWE)

Optimizes performance of TCP

High speed TCP optimizations

Enables much higher throughput on “LFNs”

3. Application Chattiness and Inefficiency

Transaction Prediction (CIFS, MAPI)

Optimizes the performance of specific applications

HP EFS WAN Accelerator Management Features Overview

EFS WAN Accelerator Manager• Provides central management of up to 500 appliances

• Provides fleet management– Monitors health, throughput & acceleration done– Performs SW updates to groups of nodes

• Separate product packaged as an appliance

HP Proliant Management• HP Systems Insight Manager

• Full Integrated Lights-out (iLO) support

HP Storage Essentials Suite

Storage Software DivisionHewlett-Packard

Unified Management of Server and Storage Infrastructure

Storage Island

Efficiency

Consolidate infrastructure mgmt tools

Centralize and automate routine tasks

Improve deployment costs

Lower training costs

Deploy resources faster and more reliably

Enable IT agility

Single point of integration between business process and IT infrastructure

Specify SLA’s across entire infrastructure

Consistent security model for entire infrastructure

Quick access to business operation metrics (e.g., audit and usage reports)

Increase availability

Quicker time to problem resolution

Manage systems remotely from any location

Server Island

Introducing HP Storage Essentials

Chargeback

Oracle Views

Customize Reports

ExchangeViews

File System Views

Provisioning

• Capacity • Performance• Topology Maps

SybaseViews

Centralized Reporting

• Policy Mgr• GUI & CLUI

3rd Party/HP Developed

Main console for open, heterogeneous SAN management

Enterprise Edition

Provisioning Mgr

Chargeback Mgr

Oracle Viewer

Main console for open, heterogeneous SAN management

Heterogeneous host to array path provisioning wizard

Asset based chargeback management. Assign tiers

Oracle database availability and performance views

Exchange database availability and performance viewsExchange

ViewerSybase database availability and performance views

File System Viewer

Global Reporter

Report Designer

Sybase Viewer

File system scanning – reclaim wasted space

Rollup reporting of multiple Storage Essentials Server instances

Develop custom reports for storage infrastructure

HP Storage Essentials – Enterprise Edition

Capabilities:

Application-to-LUN auto-discovery

Topology visualization

Dependency, path, & connection management

Capacity management

Real-time performance monitoring

Advisors & Automators

Enabling Features:

Role-based security

Event management

Historical & predictive trends

Reporting engine

Policy engine

OpenRAD and CLIs

Main console for open, heterogeneous SAN management

Deployment on Windows 2003

Topology

Capacity

HP Storage Essentials – Oracle Viewer

Capabilities:

Discovers database instances, hosts, databases & tablespaces

SAN dependency & path management

“Closed loop” capacity management

Real-time performance monitoring

Role-based security

Policies, events, reports

Extends Storage Essentials capabilities "inside" Oracle databases to ensure availability and performance of database applications

Where is the Pain ?

Under-utilized assets

• Storage infrastructure

• IT staff

Cost of heterogeneous management is expensive and inefficient

Application down time issues angers the customer

• Troubleshooting is time consuming

• Help desks are flooded

Server consolidation/data center moves drives the budget

On-going justification of the budget

• What happened to all the storage?

• Why do we need more now? When again?

Key Qualification QuestionsIdentifying the Pain Points

How do you manage increasing storage capacity with flat or shrinking IT headcount?

Do you have a SAN? Can you tell what the impact of a lost SAN element will be on your applications and users?

How do you keep your staff trained on a wide range of device-specific element managers and tactical SRM tools that, right now, only add complexity?

Do you want to replace the whiteboards and spreadsheets you’re currently using for SAN management with something that is more scalable and reliable?

How do you avoid vendor lock-in and heavy, proprietary agents that come with other solutions?

Can you provision storage in real time to support new applications and projects?

How do you comply with SAN change control and internal audits?

Questions ?