Voltaire - IBM Researchresearch.ibm.com/haifa//Workshops/SystemsAnd... · Voltaire High Performance...

VoltaireVoltaireHigh Performance InfiniBand SolutionsHigh Performance InfiniBand Solutions

Enabling Enabling High PerformanceHigh PerformanceGrid ComputingGrid Computing

Yaron HavivYaron HavivCTOCTO

2© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

Building complete server grid solutions Building complete server grid solutions

Consolidating Network, Storage and Servers• Server, Fabric and Storage virtualization • Business continuity, fail-over and recovery on all levels • Management software abstraction, automation

FC Storage (SAN)

servers & Server Blades

Network

Administration��

��

��

��

� !

IP Storage (SAN & NAS)

Remote Backup


Database Grids on Wall Street TodayDatabase Grids on Wall Street Today

Before:• Used a mainframe to run a

trading floor application• Monthly cost of $1M• Performance: 1.5M stock

transactions per hour

• Mainframe services were replaced with a 5 node InfiniBand Linux cluster

• Costs reduced to a fraction• Exceeded Mainframe Performance

Cost Saving of $Millions Per Year!!Cost Saving of $Millions Per Year!!

After:


What Does It Take to Build a Computing Grid?What Does It Take to Build a Computing Grid?

Physical Distribution• High Bandwidth for

Growing Data Requirements

• Low Latency, RDMA for Linear Scalability

Logical Consolidation• Virtualization• Built-in RAS Capabilities

High Performance Interconnect

IntelligentInterconnect


InfiniBand: HighInfiniBand: High--Speed Grid Interconnect Speed Grid Interconnect

• Standards Interconnect technology optimized for Server Grids

• Highest Bandwidth: 10Gbps links today• 30Gbps by year end, 60 Gb/s next year

• Low Message Latency: less than 6us • Support messaging and memory (RDMA) operations • Commodity Pricing• Optional GbE and FC shared I/O routers • Built in HA, QoS, Partitioning, etc’

The Best Clustering Technology Available TodayThe Best Clustering Technology Available Today


RDMA Enabling highRDMA Enabling high--end clusters end clusters

CPU

CPU

CPU

CPU

CPU

CPU

Memory

CPUCPU

CPU

Memory

HCACPU

CPU

Memory

HCACPU

CPU

Memory

HCACPU

CPU

Memory

HCACPU

InfiniBand Switch

Switch

Expensive SMP Serverwith Proprietary Interconnect InfiniBand Cluster

based on 2-way Servers

RDMA Operations allow fast access of

CPUs to remote memory

Similar shared memory model at much lower costs!Similar shared memory model at much lower costs!

I/O

I/O


VirtualizingVirtualizing Grids using Intelligent connectivity Grids using Intelligent connectivity

IP RouterServer & Network Resource Virtualization

Storage RouterStorage Virtualization & Partitioning

Virtual ConsolidationVirtual Consolidation

Fabric ManagementFabric Resource Provisioning


Fabric VirtualizationFabric Virtualization

Isolate congestion domains• one Virtual Fabric doesn’t impact the performance of another

Partitioning • Which node is a member in which virtual fabric/domain

Resource Allocation Policy, Prioritization • How to distribute and prioritize the real fabric resources

Fault detection and recovery • Automatically migrate to alternate paths, recover from failures

Integrated performance, health, and inventory monitoring

Emulation of Multiple Logically Independent

fabrics on a single fat pipe


Storage Virtualization Storage Virtualization

1. Generate Logical Volume from physical drives2. Use snapshots for backups and data migration 3. Use masking to control who see what 4. Enable high-availability using Mirroring, backup,

and Multi-Pathing

Physical Volumes

GroupsLogical Volumes

Snapshots

Mask


One Host card/driver, Many Storage optionsOne Host card/driver, Many Storage options

High-performance Low-cost Native

InfiniBand Storage

Fibre Channel SAN

IP SAN

FCGbE

IB HCA

iSCSI RDMA

Server

SCSIEmulate Virtual Local storage for hosts

Determine the right media option using software, on

the fly


Router/Gateway Virtualization Router/Gateway Virtualization

What it takes to Virtualize routers as one logical entity • Elect Master and Standby • Synchronize policy, configuration, and state using group

communication • Dynamically distribute traffic across routers • Automatically fail-over when needed

Enable simpler deployment, administration, and automatic fault recovery

Use multiple gateways and routers to aggregate performance

and provide high-availability


Managing GridsManaging Grids

Grid management interfaces• Provide status of physical resources• Provide consolidated status of logical entities• Enable to dictate group policies • Enable to dynamically assign/migrate physical

resources to logical groups/entities• Enable cloning and backup

Service/Application level management and policy enforcement can be conducted by an external management platforms or applications


Building Computing Grids with Voltaire’s InfiniBand SolutionsBuilding Computing Grids with Voltaire’s InfiniBand Solutions

HCA Adapters

Complete SW Stack

Low-Port Count Switch Router

High-Port Count Switch Router

InfiniBand to IP Router Blade

InfiniBand to FC Router Blade

Grid Management


Summary Summary

Grids provide Efficiency For High-Performance Grids InfiniBand fabric is most suitableSolutions should include • Server, Fabric and Storage virtualization • Redundancy and fail-over• Management abstraction and automation

Solutions should provide high-level of integration to be successful

BackupBackup


Voltaire: Fast FactsVoltaire: Fast Facts

Locations• Business HQ: Boston• R&D: Herzeliya Israel

Headcount : 60Financing• Strategic Investors: Hitachi and Quantum• Well financed

Recent Partnerships• Oracle• IBM• Hitachi• HP

Voltaire - IBM Researchresearch.ibm.com/haifa//Workshops/SystemsAnd... · Voltaire High Performance...

Documents

Transcript of Voltaire - IBM Researchresearch.ibm.com/haifa//Workshops/SystemsAnd... · Voltaire High Performance...