Revolutionizing Data-Centric...

26
© 2016 OpenPOWER Foundation Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta Vice President, High Performance Computing and Analytics IBM Power Systems

Transcript of Revolutionizing Data-Centric...

Page 1: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

© 2016 OpenPOWER Foundation

Revolutionizing Data-Centric Transformation April 2016

Sumit Gupta Vice President, High Performance Computing and Analytics

IBM Power Systems

Page 2: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

2

Accelerated innovation through collaboration of partners

Accelerators for driving industry performance leadership

Vibrant ecosystem through open collaborative, development

Cloud Computing Hyperscale & Large scale

Datacenters

High Performance Computing & Analytics

Domestic IT Agendas

OpenPOWER Strategy

Processors Not Keeping up with Workload Performance

Needs

Numerous IT consumption models

Fast Growing Open Software Ecosystem

Market Shifts

OpenPOWER: Catalyst for Open Innovation

Page 3: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

OpenPOWER Development Community

3

Page 4: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

4

200+ OpenPOWER Members

Page 5: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

5

December Incorporated Foundation and elected officers 5 members

April Public launch in San Francisco and Beijing with 6 demos and first hardware from Google and Tyan 26 members

July IBM, with Google, released 420,00 lines of firmware code 44 members

October Offerings from Canonical, IBM, NVIDIA, OVH, Redis Labs, and Tyan 70 members

October China gov endorsed OP with formation of China Power Tech Alliance 70 members

November DoE chose OpenPOWER design for CORAL supercomputers; Nallatech CAPI developer kit released 77 members

2013 2014

December Rackspace declares Open Compute, OpenPOWER strategy; 7 work groups chartered 84 members

March First OpenPOWER Summit •50+ presentations and solution demos •15 hardware reveals •100+ projects 112 members

March SoftLayer announces 1st OpenPOWER bare metal as a service offering 112 members

2015

Fast Progress Leading to 200+ Members

May Chartered nine work groups; Member solutions unveiled at 6k attendee IT event 130 members

June £313m UK collaboration with STFC; 630+ attendees at China OP Summit 136 members

September GENCI OpenPOWER HPC investment; chartered 11 workgroups; 1600 ISVs developing Linux on POWER 153 members

November 46 member solutions at SC15, numerous accelerated computing announcements 170+ members

Page 6: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

New Chips &

Components

Components

& Systems

New Systems &

Platforms

Bringing It

All Together

6

First Open server specification and motherboard combining OpenPOWER, Open Compute and OpenStack (mock-up)

First GPU-accelerated OpenPOWER developer platform

Prototype of a new high-performance server on the path to exascale

First commercially available OpenPOWER server RedPower, the first China OpenPOWER

2-socket system coming in 2015 Inspur 2-socket POWER8 Server

ChuangHe China-branded OpenPOWER system with POWER8

Data Engine for NoSQL with 40TB CAPI-attached flash

Open Source Redis

Clustering 192 Vcores + CAPI

40TB in 2U

First China “local” POWER derivative chip, CP1 Convey’s CAPI developer kit based on the company’s Xilinix-based co-processors

DMI connection between an Altera Stratix V FPGA accelerator and a POWER8 CPU

First commercially available OpenPOWER third-party server

New CAPI-based solution: the ConnectX-4 adapter card by Mellanox

Nallatech’s OpenPOWER CAPI Developer Kit

24:1 Server consolidation for 3x lower cost per user

Page 7: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

7

11 Workgroups Evolving Infrastructure Standards

2014 2015 2016

Developer Platform

System SW

HW Architecture

Accelerator

Compliance

SP010 – Tyan OpenPOWER Customer Reference System

CAPI – Coherent Accelerator Processor Interface

AFU – Accelerator Function Unit

FSI – Field Replaceable Unit (FRU) Service Interface

25g IO Compatibility

Memory

OpenPOWER I/O

11 Work Groups

Charter Compliance Specification Draft Review WG Spec

Comp STD

Charter

OpenPOWER ISA Profile V1 IO Device Architecture V2 Coherent Accel Intf Arch

OpenPOWER ISA Profile V2 IO Device Architecture V3 Coherent Accel Intf Arch

Charter P8 SP010 Data

P8 2U2S Reference

P8+ 1U1S Reference

P8+ 2U2S Reference

OPMB Intf. Spec V1 Charter

Charter CAPI AFU Intf Spec V1

OpenCL SDK

CAPI AFU Intf Spec V2

Charter

CAPI Linux SDK

64b ABI Platform Ref

Sys I/O Enablement Guide Charter

Charter 25g IO Spec

OPMB – OpenPOWER Memory Bus

ABI – Application Binary Interface

FSI Specification FSI Spec Charter

SDK – Software Developer Kit

Charter Pers Med

Charter Integrated Solutions Integrated Solutions

Personalized Medicine

Page 8: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

8

continents

50+ Innovations members 200+

24 6 countries

OpenPOWER Foundation reach

Page 9: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

9

UNICAMP Brazil, SA http://openpower.ic.unicamp.br/mini

cloud/index.html

Oregon State North America

http://osuosl.org/services/powerdev

Brno University / RedHat. Czech Republic

https://fit-rhlab.rhcloud.com

SuperVessel USA and China www.ptopenlab.com

IIT Bombay, India

HPC Center University of Texas- TACC

OpenPOWER Open Software and University Cloud Environments

• OpenPOWER Platforms

• Open Stack Software

• University research

• Open Development &

Ecosystem Support

Page 10: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

OpenPOWER Developer

Ecosystem Growing Fast

Page 11: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

11

Engage in the OpenPOWER community

AC

TIO

N

OU

TC

OM

E

INT

ER

ES

T

Technology and Software

Innovators

Discuss areas of collaboration

and synergy in OpenPOWER.

Sign up for membership and

join a work group.

Build technical and business

relationships.

Develop

collaborative innovations with

compelling value

Innovators, Integrators,

and Partners

Deep understanding of workload

demands and consumption

preferences of end users.

Team with innovators and end

users to drive requirements,

engage in specific projects.

Deliver

collaborative innovations with

compelling value

End Users

Strategic imperatives and

workload demands for

performance and cost

optimization.

Require open software and

systems with choice and

flexibility.

Engage directly on system

design options.

Deploy collaborative innovations with

compelling value

Page 12: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

12

OpenPOWER For Data Analytics and High Performance Computing

Page 13: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

13

POWER8: Processor Performance Leadership

Memory Buffer

DRAM Chips

POWER8

12 Cores, 96 Threads 4 Level Large Caches Up to 1 TB per socket

Up to 230 GB/s sustained

Faster Cores 8 Threads Per Core

Larger Caches Direct Accelerator

Interconnect

3x Higher Memory Bandwidth, 1 TB

Memory per Socket

Page 14: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

14

POWER8

Graphics Memory

System Memory

Graphics Memory

PCIe GPU CPU

Graphics Memory

System Memory

16 GB/s

40

GB

/s

2.5x Faster CPU-GPU Connection via NVLink

GPUs Limited by PCIe Bandwidth From CPU-System Memory

NVLink Enables Fast Unified Memory Access between CPU & GPU Memories

NV

Lin

k

System

bottleneck

GPU

GPU

Page 15: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

15

US & UK Research Establishments Select OpenPOWER-Based Supercomputers

IBM, Mellanox, and NVIDIA awarded $325M

U.S. Department of Energy’s CORAL Supercomputers

IBM & UK’s STFC Partner for Big Data & Cognitive Computing Research in

£313M Partnership

CORAL: Leadership Class Supercomputers

5X – 10X HIGHER APP PERF THAN CURRENT SYSTEMS

Page 16: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

After: NoSQL POWER8 + CAPI Flash

Load Balancer

500GB Cache

Node

Backup Nodes

500GB Cache

Node 500GB Cache

Node 500GB Cache

Node 500GB Cache

Server Node

Before: NoSQL In-Memory (x86)

24U 4U

3x Lower Cost for NoSQL Databases using CAPI-Attached Flash

POWER8 Server

Flash Array w/ up

to 40TB

CAPI Device

Flash Acts As Extension of System Memory

Page 17: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

17

Application Benchmarks

Page 18: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

18

Compelling Solution Performance on Power

Data Engine for NoSQL with Redis Labs

• POWER8 + CAPI FLASH as RAM

• 24:1 server consolidation

• Up to 3x lower TCA

Turbo LAMP on Linux on Power

• Next generation integrated LAMP stack

• Accelerated Dev/Ops for Mobile Apps

• 53% less $$ per user / hour with Magento running on Turbo LAMP

MariaDB on Linux on Power

• Up to 2.2x better per core performance

• Up to 1.9x better per system performance

SAP HANA on Linux on Power

• Designed for mission critical 7X24 Enterprise customer operations

• Outstanding throughput per core

• Virtualization out of the box

Page 19: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

19

• In-memory distributed database using GPUs for processing

• Order of magnitude gains:

• Performance over CPU solutions

• Power reduction

• Cost savings

• Anticipate order of magnitude gains with POWER based NVLink solutions in 2016

GPUdb in-memory Accelerated Database

Ultrafast ingest and analysis of billions of objects

Page 20: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

20

Over 2350 Linux ISVs on Power

100,000+ Open-Source Packages

Big Data & Machine Learning

Cloud Mobile Enterprise

Major Linux Distros

HPC

miniDFT

CTH

BLAST

Bowtie

BWA

FASTA

HMMER

GATK

SOAP3

STAC-A2

SHOC

Graph500

Ilog

CHARMM

GROMACS

NAMD

AMBER

RTM

GAMESS

WRF

HYCOM

HOMME

LES

MiniGhost

AMG2013

OpenFOAM

Page 21: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

21

Superior Cloud Economics

SoftLayer Bare Metal POWER cloud

Rackspace declares Open Compute OpenPOWER system

Docker, OpenStack HEAT, and Chef Server for Power

Bluemix Cloud Integration and SQLDB Services with Power Systems for SOE/SOR integration

Power Cloud environments in Europe

IBM Watson Developer’s Cloud for cognitive computing www.ibm.com/smarterplanet/us/en/ibmwatson/developers.html

Page 22: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

New IBM “LC” Power Systems for Linux

812LC CPU

Memory

1x POWER8 CPU 10 cores, 2.9-3.3 GHz

Up to 1 TeraByte Memory 115 GB/s Memory Bandwith 14 Drives (84TB, HDD, SSD)

Optimized for Hadoop, Spark, In-Memory

Analytics

822LC

CPU

Memory

Optimized for Databases and Cloud Workloads

CPU 2x POWER8 CPU

10 cores each, 2.9-3.3 GHz Up to 1 TeraByte Memory

230 GB/s Memory Bandwith 2 Drives (2 TB, HDD, SSD)

822LC HPC

CPU

Memory Built for HPC and Deep

Learning

CPU 2x POWER8 CPU

10 cores each, 2.9-3.3 GHz Up to 1 TeraByte Memory

230 GB/s Memory Bandwith 2x NVIDIA Tesla K80 GPUs

GPU GPU

Page 23: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

© 2016 OpenPOWER Foundation 23

Leading Technology roadmap

2015 2016 2017

POWER8 POWER8 with NVLink POWER9 OpenPower CAPI Interface NVLink Enhanced

CAPI & NVLink

Connect-IB FDR Infiniband

PCIe Gen3

ConnectX-4 EDR Infiniband

CAPI over PCIe Gen3

ConnectX-5 Next-Gen Infiniband

Enhanced CAPI over PCIe Gen4

Mellanox Interconnect

IBM CPUs

NVIDIA GPUs Kepler PCIe Gen3

Volta Enhanced NVLink

Pascal NVLink

IBM Systems

Page 24: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

24

Portfolio of HPC & HPDA Offerings

• Platform LSF & Symphony workflow and resource management

• Compilers: gcc, IBM XLC, PGI Fortran/C/C++, Java, OpenACC, OpenMP

• Debuggers, Profilers, Math libraries, MPI & HPC apps

Processors & Systems

Cluster & Development

Software

High Performance File System &

Storage

• High Performance Processors & Systems

• Accelerator, networking, storage integration via CAPI & NVLink

• Innovative solutions like CAPI Flash

• Highest Performance HPC Storage: Elastic Storage Server

• High Performance Spectrum Scale (GPFS) Parallel File System

• Flash Storage

Page 25: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

Two tracks to challenge and win:

1. The Open Road Test

– Port and optimize for OpenPOWER

– Go faster with accelerators (optional)

2. The Spark Rally

– Train accelerated DNN and recognize objects

with greater accuracy

– Show you can scale with Spark

Key Dates

Register at openpower.devpost.com

Sun May 1st:

Submission periods opens

Tue Aug 2nd: Submission period closes

Grand prizes include a trip to Supercomputing 2016

Other prizes include iPads, Apple Watches

Join the conversation at

#OpenPOWERSummit

Page 26: Revolutionizing Data-Centric Transformationon-demand.gputechconf.com/gtc/2016/presentation/s6825-sumit-gupta... · Revolutionizing Data-Centric Transformation April 2016 Sumit Gupta

26

Thank you.