Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product...
-
Upload
truongdung -
Category
Documents
-
view
222 -
download
1
Transcript of Margaret Hamburger Solaris Product Manager – Storage … · Margaret Hamburger Solaris Product...
Margaret HamburgerSolaris Product Manager – Storage Software
Sun StorageTek Storage Archive ManagerSun StorageTek QFS4.6 Features Announced April 3rd, 2007
Sun Proprietary/Confidential Page 2
Data Management Challenges
The value of data is becoming
more criticalData management
costs are highThe amount of storage is ever-
increasing
Sun Proprietary/Confidential Page 3
AutomatedData Migration with SAM
Sun Proprietary/Confidential Page 4
Sun StorageTek SAMIntelligent Storage Archive Management
Data Classification &Policy Management
> Policy manage-ment based on file attributes of the local file system
> Easy manage-ment GUI
> Transparent user access to all data regardless of physical location
Automatic Data Recovery & Protection
> Create up to 4 copies of a file
> Remote archiving for disaster recovery
> User level file recovery
> Manage data across storage tiers to local and remote disk and tape storage
> Tight Integration with QFS Shared file systems or as
> Local Archiving FS
Tiered StorageManagement &
Movement
Sun Proprietary/Confidential Page 5
SAM BenefitsCost-effective data lifecycle management across storage tiers•Manage more with less
> Manage data across tiers of storage based on business value of data and cost to store over time
> Reduce administration costs with automated migration services
•Reduce costs> Less disk storage is required to manage and
purchase> Large volumes of data can be managed by fewer
administrators•Business Compliance
> Manage, retain and recover data to meet business compliance governing business data overtime
Sun Proprietary/Confidential Page 6
SAM Enables Storage Tiering
Server w/ File System
Supports both local and remote disk and tape archiving
Server w/ File System(s)
BlockStorage
SL500(Tape Library)
BlockStorage
BlockStorage
BlockStorage
Sun Proprietary/Confidential Page 7
SolarisFile Sharing with QFS
Sun Proprietary/Confidential Page 8
Sun StorageTek QFSSAN File Sharing Innovation
Data Consolidation
> SAN file sharing> Name services
and spacemanagement on the metadata server
> Direct access to the data devices
Parallel Processing
> Multi-node read/write access
> 128 nodes supported
> 256 nodes with IB support
> Tune file system to the application
> Predictable performance
> File system performance scales linearly with the hardware
Performance &Scalability
Sun Proprietary/Confidential Page 9
QFS – SAN File Systems
LANNetwork SAN
Meta Data Server
BlockStorage
BlockStorage
Meta Data Server handles name services and space management
Data is accesseddirectly from devices
Client Client Client Client n ...
Meta data pathData path
BlockStorage
BlockStorage
BlockStorage
Sun Proprietary/Confidential Page 10
San File Systems with Tiering – Sam QFS
LANNetwork SAN
Meta Data Server
BlockStorage
BlockStorage
BlockStorage
BlockStorage
BlockStorage
BlockStorage
Meta Data Server handles name services and space management
Data is accesseddirectly from devices
Client Client Client Client n ...
Meta data pathData path
SL500(Tape Library)
Sun Proprietary/Confidential Page 11
QFS Benefits
• Share data on the same devices in a SAN
• Ideal for streaming I/O applications> Stripe groups allow speed to match
bandwidth> Data rate is channel speed for multiple
streams> Large allocations reduce or eliminate
fragmentation without the need to defrag
> Metadata separation for performance• Supports 100s of shared clients in
shared SAN configuration
File System PositioningMargaret [email protected]
File Systems - UseZFS Free• Local data• Large storage requirements• Keep it simple• Cheap JBOD use with s/w RAID• Solaris 10 U2 & above
Shared QFS (SQFS) $• High perf./shared data access• Large storage requirements• Typically requires tuning• Integrated tiering & protection (SAM)• RAC/cluster support
UFS Free• Tried and true• Boot/root file system• Local data• Small storage requirements• Solaris 8, 9, 10
File System Use Cases
If you want... Then select...
ZFS
SQFS or NFS
SAM-QFS
SAM-QFSOracle RAC with Sun Cluster SQFS
A single server running applications that will require large, dynamic files system(s)Multiple servers to share a file systemTo tier data across multiple disparate arrays
To tier data across multiple disparate arrays and tape libraries
File System Use Cases If you want... Then select... Why? Root file system UFS Support Low cost, local file system UFS (S8, 9) or ZFS (S10) Both low cost
ZFS
SQFS Oracle RAC with Sun Cluster SQFS Support Storage tiering support SAM-QFS Tiering Storage tiering with tape SAM-QFS Tape
Above with scale and availability/data integrity
Scale and data protection
Heterogeneous, shared SAN access to data
Heterogeneous, shared
Margaret [email protected]
4.6 Feature Slides
Sun Proprietary/Confidential Page 17
4.6 Features • Solaris 9 (Sparc) & SOLARIS 10 (Sparc/x64/X86)• Linux Support – SLES10• Archive Copy Retention• Data Integrity Verification Test• Simplified FS setup with Advanced option tab (GUI)• Resource Mgt Info (GUI)• Sun Cluster Configurations - Shared QFS clients outside cluster• 5800 (Honeycomb) Integration – Disk Archiving Target• High Availability – HA SAM• Directory Lookup Performance Enhancements• WORM options - Snaplock Compatibility for ECMs; WORM Lite
Sun Proprietary/Confidential Page 18
More ManageabilityWizard Installation and Initial File System Setup
● Default configuration enables a first-time or a novice user to create an archiving file system with a simple wizard.
● “Advanced Options” button - Shared configurations
Tree Navigation ● Replaces the current tab-based navigation.
Sun Proprietary/Confidential Page 19
●Default configuration - combined metadata and data devices.●Default values for dau size and stripe●Users can change the values by clicking on the Show Advanced Options button ( next two slides)
New File System Wizard – Simple Mode
Sun Proprietary/Confidential Page 20
New File System Wizard – Advanced Mode Options for combined metadata and data
Sun Proprietary/Confidential Page 21
New File System Wizard – Advanced ModeOptions for separate Metadata and data
Sun Proprietary/Confidential Page 22
This step provides for the configuration of the default archive set for the file system that is being created.
Users can elect to use vsn pools or can assign all media of aspecific type to the archive set.
All settings can later be modified under theArchive Management tab.
New File System Wizard – Archiver Configuration
Sun Proprietary/Confidential Page 23
New File Browser ● Display and manipulate the placement of file data.
● The NEW file browser enables bi-directional data transfer from a single-point, i.e., archive, stage, release and restore a file.
● Browse the file system and directories;enables users to view if a file is on-line or offline; the number of copies; the storage tier that each copy resides on; and stage or archive any file with a simple point-n-click
● The samfs dump and restore capability is integrated into the NEW file brower. Enables you to schedule, browse and restore samfsdumps from the file browser
Sun Proprietary/Confidential Page 24
● Click on Recovery Point and select a date
● User will see the current directory as it existed when the recovery point was generated
● stage, release, archive and restore are available in the operations dropdown.
● Users can move files and directories between tiers and restore files from samfsdumps.
● In this screen:− All files are offline except
for fsmgr_uninstall and the directory CVS.
− Each file has 4 copies. 1 & 3 are to the tape tier and 2 & 4 are to disk archive tier
− Copy number 2 of fsmgr_setup and string_replace are damaged.
File Browser
Sun Proprietary/Confidential Page 25
● Launched from the file browser
● File detail includes: ● file owner, group, size
permissions, times and status● Copy media type, VSN, time
and status● releaser, stager and archiver
attributes● Users can change releaser, stager and archiver attributes
File Details Window
Sun Proprietary/Confidential Page 26
Simplified File Restore Operation• Launched from the file
browser to restore the selected file or directory from the recovery point that is being browsed
Sun Proprietary/Confidential Page 27
New Monitoring Tool Resource Management Info GUI● Encapsulates these file system and archiving tools: samu, robottool,
devicetool, previewtool, libmgr for easier management and monitoring.
● Monitor application daemons, file systems, tape libraries, drives, VSN, and queues, e.,g, archiving, staging and tape mount queues.
● Ppreset a refresh rate of the auto-refresh display for a hands-free operation.
Sun Proprietary/Confidential Page 28
Monitoring Console: Archive Queue
Lets users monitor outstanding archive copy operations. Archive Copy Queue is flagged in the right hand panel because the operations have been pending formore than 30 minutes. The VSN Pending Load Request and Staging Queueswould also be flagged if there were long standing requests.
Sun Proprietary/Confidential Page 29
Monitoring Console: File Systems
The File Systems entry in the left hand panel would be flagged if anyarchiving file systems are above their high water mark, any non-archivingfile systems have a usage higher than 80% or any file systems are notmounted.
Sun Proprietary/Confidential Page 30
Monitoring Console: Unusable VSNs
Shows volumes that are not usable for archiving
Sun Proprietary/Confidential Page 31
More Monitoring options• Daemons page - lists running daemons, their start time and last log
entry. The page will be flagged if daemons are not running that should be.
• Archiver Media Utilization - lists the archive media utilization by archive set. The page will be flagged if any sets have less than 20% space remaining.
• Library and Drives pages show the state and status of libraries and drives. The pages will be flagged if information is not available or if the state or status of the resource indicates it is unusable.
• If the archiver, stager or load queues have more than 100 entries or if any entry has been waiting for more than 30 minutes the pages will be flagged.
Sun Proprietary/Confidential Page 32
Generating Media Metrics
Once generated- metricsare retained until they are removed by the user
Sun Proprietary/Confidential Page 33
Media Metrics View
AllFiles.1
Sun Proprietary/Confidential Page 34
File System Metrics: Storage Tiers
View of the initial growth of the data in 3 tiers(Disk Cache, Disk Archive and Tape Archive) for the file system.
Sun Proprietary/Confidential Page 35
More AvailabilityNEW - HA SAM Cluster Agent• Interface between a SAM-QFS file system and SunCluster software
running on Solaris for SPARC and x64 hardware. • Manages archiving and staging on QFS file systems during failover. • Both voluntary and involuntary failover are supported on active-passive
configurations. • For tape archiving and staging to continue after failover
> Tapes must be visible to all nodes in a cluster on which HA-SAM is running,
> Tapes should not be configured as Sun StorageTek SAM shared drives.
• Supports disk archiving with disk archives visible to all nodes in a cluster.
• Dependant on the QFS SunCluster agent and assumes that QFS file systems are mounted and managed by the QFS agent.
• Requires the SAM catalog and stager directories be linked from the standard location to a directory in a HAStoragePlus file system.
• HA-SAM should be a resource in a resource group that contains QFS d l
Sun Proprietary/Confidential Page 36
More ScalabilitySupport for 128 node Shared QFS configurations
Sun Proprietary/Confidential Page 37
More Linux SupportSupport for Redhat Enterprise Linux and SuSE.● The following Linux versions are supported in the 4.6 software release: ● Red Hat Enterprise 3.0 (UD-4 and UD-6) for x86/x64 platforms ● Red Hat Enterprise 4.0 (UD-2) for x64 platforms ● SuSE Enterprise Server 8 (service pack 4) for x64 platforms ● SuSE Enterprise Server 9 (service pack 2) for x64 and SGI Altix
platforms● SuSE Enterprise Server 10 for X64 platforms
Sun Proprietary/Confidential Page 38
Archiving EnhancementsNEW Recycler Tool improves Archive Copy Retention • Works in conjunction with the File System Manager's backup and
recovery features. • Uses SAM dump files for archive retention • New Recycler Removes expired archive copies and frees up archive
volumes in order to aid in the ability to . > Scans file system metadata and SAM dump files to determine which
removable media and disk archive volumes contain archive images.> Determine which volumes do not contain archive images and the
space on these volumes can be reclaimed.
Sun Proprietary/Confidential Page 39
Archiving EnhancementsNEW Data Integrity – Verification Test• Checks for data corruption on any data written to the file system then
moved to secondary media, then restored to primary storage for access. • The data verification process performs a read-after-write verification
test, and records a confirmation of data validity in the metadata properties for that file.
• The current checksum method is employed to verify copies written to tape or disk archive.
• Bare bones implementation> No verification of data as it is written to file system> No automatic restoration of invalid copies> No verification that copies are written to different tapes on different drives> No ability to run data verification in batch mode
Sun Proprietary/Confidential Page 40
Data Verification• Enhancements to File System and Stager
> File system sends verification request to stager as soon as an archive copy is made
> Stager reads copy back from archive medium, does not write to disk
> File not released until all copies created and verified> Resource consideration – additional tape drives needed
Sun Proprietary/Confidential Page 41
Data Verification • Set on file or directory with ssum -e
> When set on directory, all files and subdirectories will inherit data verification
> Example: ssum -e /samfs1/file1> Causes -g and -u options to also be set (checksum
generated when copy made, checksum used whenever copy staged)
Sun Proprietary/Confidential Page 42
Archiving EnhancementsNEW Directory Lookup Performance improved
• Improve directory lookup performance• create, link, and rename system calls are up to 100
times faster than our previous release.
Sun Proprietary/Confidential Page 43
File System EnhancementsSnapLock Emulation• The NetApp SnapLock software allows an application to set a retention
date and create WORM files. A new mode of operation has been added to the Sun StorageTek
• QFS WORM software in order to emulate SnapLock behavior. The WORM software has been modified to emulate a SnapLock system.
WORM Lite option • Eases restrictions on WORM-enabled volumes and retained files.• WORM Lite behaves in the same way as WORM with the following
exceptions:> Files can be removed before the retention time has expired.> The retention time can be shortened.> WORM Lite-enabled volumes can be deleted.
Sun Proprietary/Confidential Page 44
More supported StorageDisk Archiving to a Sun StorageTek 5800 System (Honeycomb) supported
Sun Proprietary/Confidential Page 45
More Supported Sun Cluster Configurations
Shared QFS configurations with support for nodes outside the cluster
Margaret [email protected]
SAM/QFS Futures
Sun Proprietary/Confidential Page 47
SAM-QFS Futures• On-line grow, shrink, and fsck• Rolling upgrades• Extended Attributes• Metadata journaling• Directory lookup phase 2• Enterprise Media Management• Open source QFS and SAM• Stager write performance