Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

8
© 2007 DataDirect Networks, Inc. All Rights Reserved. Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity Power & Space Efficiency S2A Technology Update A Tradition of HPC Data Leadership 2008 HPC User Forum Spring Meeting Jeff Denworth: Director of Platform Solutions

description

Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity Power & Space Efficiency. S2A Technology Update A Tradition of HPC Data Leadership 2008 HPC User Forum Spring Meeting Jeff Denworth: Director of Platform Solutions. - PowerPoint PPT Presentation

Transcript of Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

Page 1: Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

© 2007 DataDirect Networks, Inc. All Rights Reserved.

Simple Petabyte-Level ScalingIndustry Leading Performance

SATAssure Data IntegrityPower & Space Efficiency

S2A Technology UpdateA Tradition of HPC Data Leadership

2008 HPC User Forum Spring MeetingJeff Denworth: Director of Platform Solutions

Page 2: Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

DataDirect NetworksTarget Applications

Total Worldwide Digital Archive Capacity: 2007-2012Source: Enterprise Strategy Group

Servicing performance and capacity-bound applications experiencing compounding storage management issues

These application profiles collide in the HPC data center 2 Sample Data Points

– Defensive I/O: Multi-Core = More Memory = More data to Checkpoint• Scalable, High-Performance WRITE-INTENSIVE storage is required• Low-Cost, High Density RAM (eg. MetaRAM) will only compound this problem

– Productive I/O: Data Volume is Exploding• CERN LHC will produce 27TB per day!• That data needs to be distributed to

7000 researchers worldwide

Page 3: Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

© 2007 DataDirect Networks, Inc. All Rights Reserved.

SATA Usage & Capacity Increases Vulnerability Implications

The Appeal of SATA Technology:– Lower price per GB– Larger capacity– Lower power consumption– Less heat than Enterprise drives

Feature Enterprise-Class SATA

Rotational Speed 15,000 RPM 7,200 RPM

Capacity 400GB 1TB (1,000 GB)

Drive Defect List In hardware On media

# of CPUs 2 – one for I/O, one for mgmt 1 for everything

Prone to silent data corruption No Yes

Duty Cycle Continuous Non-continuous

Average Failure Rate Low High

The Trade-Off:Performance is 1/2 - 1/3 of SCSI SATA exacerbates storage issues

– Lower seek performance– Less reliability controls (mechanically)– Less robust electronically

Rebuild Times Grow w/ Capacity– Not Complimentary to Reliability– Many Drives not even dead

– Sick/Slow Drives are Common

The Physics of a Spindle:

Rebuild Time Hours Hours-Days

DataDirect Networks4th Largest Linux TB Shipped ‘06

The Experience from a leader:

“No Trouble Found”RMAs Infrequent Over 80%

Page 4: Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

© 2007 DataDirect Networks, Inc. All Rights Reserved.

High Performance ComputingTraditional Storage Issues

We believe that traditional storage technologies are incapable of responding to the growing data challenge.

Issues with Issues with traditional storagetraditional storage in HPC in HPCSystems deliver substantially lower write performance than read Systems deliver substantially lower write performance than read performance – often ½ lessperformance – often ½ lessSystems are not designed to provide predictable I/O and handle failuresSystems are not designed to provide predictable I/O and handle failuresStriped storage environments realize degrading performance as the Striped storage environments realize degrading performance as the cluster grows – Amdahl’s Law cluster grows – Amdahl’s Law

Degraded shared file performance as Degraded shared file performance as systems encounter sluggish / failed drivessystems encounter sluggish / failed drives

CapacityCapacity

Sys

tem

Sys

tem

Per

form

ance

Per

form

ance Peak System PerformancePeak System Performance

Not delivered in clustered environmentsNot delivered in clustered environments

Page 5: Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

© 2007 DataDirect Networks, Inc. All Rights Reserved.

DataDirect Networks S2A9900

6GB/s Read & Write Performance: 24GB/s Internal Bandwidth

8 x Active/Active Host Ports: FC4, FC8, 4xDDR-InfinibandScales to Support 1,200 Hard DrivesUp to 40,000 IOPS to diskMix SAS + SATA For Storage Tiering600 Drives per Rack; 1.2PB in Two RacksZero-Compromise SATA LatencyNo-Impact Drive RebuildsJournaled Fast Drive RebuildSleep Mode for Optimum Power EfficiencyReal-Time Read Parity CheckingNon-Disruptive Drive Power Cycling reduces SATA drive maintenance by up to 90% - no more No Trouble Found RMAs! combined with Journaled Rebuilding - dramatically increases reliability

8th Generation S2A TechnologyResolving Performance & Reliability Within the Box

2008 WinnerVisionary Product

Page 6: Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

© 2007 DataDirect Networks, Inc. All Rights Reserved.

DataDirect Networks Product Family

S2A9900

6GB/s Write & Read Sequential I/O Optimized 1,200 SAS and/or SATA Drives 1.2PB in Two Racks

Optional Solutions:S2A Clustered NAS

S2A HPC Storage SolutionS2A Shared SAN File System

S2A VTL SolutionS2A9700

3GB/s Read & Write Sequential I/O Optimized 1,200 SAS and/or SATA Drives 1.2PB in Two Racks

S2A9550

3GB/s Read & Write Sequential I/O Optimized 960 Fibre-Channel or SATA Drives 960TB in Two Racks

Announced Today!!

Announced Today!!

Page 7: Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

© 2007 DataDirect Networks, Inc. All Rights Reserved.

S2A Storage = The Gold Standard in HPC I/O – Common Platform: Processing, Backup and Archiving– OPEN storage application & file system flexibility– DirectRAID Algorithms optimized for large data transfer

• Writes as fast as reads; Unrivaled real-world performance – with SATA– Green Storage: SleepMode and up to 660 drives/rack– The Performance & Capacity Storage Leader

• 40 of the top 100 supercomputers choose S2A Technology– Tight Integration with Parallel and Archival File Systems

• Lustre, GPFS, pVFS, Quantum StorNext, CXFS + DMF, HPSS, etc.

Case Study: LLNLRequirements:•Multi-Cluster, Massively Scalable Site-Wide Lustre Platform

•Includes world’s fastest BlueGene/L•130GB/s GPFS System for Capability System (Purple)•Maximum SATA data integritySolution:•150GB/s+ S2A Systems providing scalable I/O and Data Availability

Sample Customers:Variety of Applications

Worldwide HPC Experience

Partners:

Page 8: Simple Petabyte-Level Scaling Industry Leading Performance SATAssure Data Integrity

© 2007 DataDirect Networks, Inc. All Rights Reserved.

Thank You.Thank You.

Simple Petabyte-Level Scaling Industry Leading Performance

SATAssure Data IntegrityPower & Space Efficiency