Voltaire - IBM Researchresearch.ibm.com/haifa//Workshops/SystemsAnd... · Voltaire High Performance...

of 16/16
Voltaire Voltaire High Performance InfiniBand Solutions High Performance InfiniBand Solutions Enabling Enabling High Performance High Performance Grid Computing Grid Computing Yaron Haviv Yaron Haviv CTO CTO
  • date post

    20-Mar-2020
  • Category

    Documents

  • view

    2
  • download

    0

Embed Size (px)

Transcript of Voltaire - IBM Researchresearch.ibm.com/haifa//Workshops/SystemsAnd... · Voltaire High Performance...

  • VoltaireVoltaireHigh Performance InfiniBand SolutionsHigh Performance InfiniBand Solutions

    Enabling Enabling High PerformanceHigh PerformanceGrid ComputingGrid Computing

    Yaron HavivYaron HavivCTOCTO

  • 2© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Building complete server grid solutions Building complete server grid solutions

    Consolidating Network, Storage and Servers• Server, Fabric and Storage virtualization • Business continuity, fail-over and recovery on all levels • Management software abstraction, automation

    FC Storage (SAN)

    servers & Server Blades

    Network

    Administration��������������������������

    ����������������������������������������������

    ��������������

    ��

    � !

    IP Storage (SAN & NAS)

    Remote Backup

  • 3© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Database Grids on Wall Street TodayDatabase Grids on Wall Street Today

    Before:• Used a mainframe to run a

    trading floor application• Monthly cost of $1M• Performance: 1.5M stock

    transactions per hour

    • Mainframe services were replaced with a 5 node InfiniBand Linux cluster

    • Costs reduced to a fraction• Exceeded Mainframe Performance

    Cost Saving of $Millions Per Year!!Cost Saving of $Millions Per Year!!

    After:

  • 4© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    What Does It Take to Build a Computing Grid?What Does It Take to Build a Computing Grid?

    Physical Distribution• High Bandwidth for

    Growing Data Requirements

    • Low Latency, RDMA for Linear Scalability

    Logical Consolidation• Virtualization• Built-in RAS Capabilities

    High Performance Interconnect

    IntelligentInterconnect

  • 5© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    InfiniBand: HighInfiniBand: High--Speed Grid Interconnect Speed Grid Interconnect

    • Standards Interconnect technology optimized for Server Grids

    • Highest Bandwidth: 10Gbps links today• 30Gbps by year end, 60 Gb/s next year

    • Low Message Latency: less than 6us • Support messaging and memory (RDMA) operations • Commodity Pricing• Optional GbE and FC shared I/O routers • Built in HA, QoS, Partitioning, etc’

    The Best Clustering Technology Available TodayThe Best Clustering Technology Available Today

  • 6© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    RDMA Enabling highRDMA Enabling high--end clusters end clusters

    CPU

    CPU

    CPU

    CPU

    CPU

    CPU

    Memory

    CPUCPU

    CPU

    Memory

    HCACPU

    CPU

    Memory

    HCACPU

    CPU

    Memory

    HCACPU

    CPU

    Memory

    HCACPU

    InfiniBand Switch

    Switch

    Expensive SMP Serverwith Proprietary Interconnect InfiniBand Cluster

    based on 2-way Servers

    RDMA Operations allow fast access of

    CPUs to remote memory

    Similar shared memory model at much lower costs!Similar shared memory model at much lower costs!

    I/O

    I/O

  • 7© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    VirtualizingVirtualizing Grids using Intelligent connectivity Grids using Intelligent connectivity

    IP RouterServer & Network Resource Virtualization

    Storage RouterStorage Virtualization & Partitioning

    Virtual ConsolidationVirtual Consolidation

    Fabric ManagementFabric Resource Provisioning

  • 8© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Fabric VirtualizationFabric Virtualization

    Isolate congestion domains• one Virtual Fabric doesn’t impact the performance of another

    Partitioning • Which node is a member in which virtual fabric/domain

    Resource Allocation Policy, Prioritization • How to distribute and prioritize the real fabric resources

    Fault detection and recovery • Automatically migrate to alternate paths, recover from failures

    Integrated performance, health, and inventory monitoring

    Emulation of Multiple Logically Independent

    fabrics on a single fat pipe

  • 9© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Storage Virtualization Storage Virtualization

    1. Generate Logical Volume from physical drives2. Use snapshots for backups and data migration 3. Use masking to control who see what 4. Enable high-availability using Mirroring, backup,

    and Multi-Pathing

    Physical Volumes

    GroupsLogical Volumes

    Snapshots

    Mask

  • 10© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    One Host card/driver, Many Storage optionsOne Host card/driver, Many Storage options

    High-performance Low-cost Native

    InfiniBand Storage

    Fibre Channel SAN

    IP SAN

    FCGbE

    IB HCA

    iSCSI RDMA

    Server

    SCSIEmulate Virtual Local storage for hosts

    Determine the right media option using software, on

    the fly

  • 11© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Router/Gateway Virtualization Router/Gateway Virtualization

    What it takes to Virtualize routers as one logical entity • Elect Master and Standby • Synchronize policy, configuration, and state using group

    communication • Dynamically distribute traffic across routers • Automatically fail-over when needed

    Enable simpler deployment, administration, and automatic fault recovery

    Use multiple gateways and routers to aggregate performance

    and provide high-availability

  • 12© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Managing GridsManaging Grids

    Grid management interfaces• Provide status of physical resources• Provide consolidated status of logical entities• Enable to dictate group policies • Enable to dynamically assign/migrate physical

    resources to logical groups/entities• Enable cloning and backup

    Service/Application level management and policy enforcement can be conducted by an external management platforms or applications

  • 13© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Building Computing Grids with Voltaire’s InfiniBand SolutionsBuilding Computing Grids with Voltaire’s InfiniBand Solutions

    HCA Adapters

    Complete SW Stack

    Low-Port Count Switch Router

    High-Port Count Switch Router

    InfiniBand to IP Router Blade

    InfiniBand to FC Router Blade

    Grid Management

  • 14© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Summary Summary

    Grids provide Efficiency For High-Performance Grids InfiniBand fabric is most suitableSolutions should include • Server, Fabric and Storage virtualization • Redundancy and fail-over• Management abstraction and automation

    Solutions should provide high-level of integration to be successful

  • BackupBackup

  • 16© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003

    Voltaire: Fast FactsVoltaire: Fast Facts

    Locations• Business HQ: Boston• R&D: Herzeliya Israel

    Headcount : 60Financing• Strategic Investors: Hitachi and Quantum• Well financed

    Recent Partnerships• Oracle• IBM• Hitachi• HP