Build Lightning  FAST  Apps  with  Docker and  OpenPOWER

Indrajit Poddar,  STSM,  IBM  Systems

Seetharami  Seelam,  RSM,  IBM  Research

©  2016  IBM  Corporation

High performance with Big Data

2

Easy  scale-­out  with: But….Deep  Learning  and  Machine  Learning   training   is  hard  to  distribute

Training  can  take  hours,  days  or  weeks

Input  data  and  model  sizes  are  becoming  larger  than  ever  (e.g.  video  input,   billions   of  features  etc.)

Real-­time  analytics  with:

Unprecedented   demand   for  offloaded  computation,  accelerators,  and  higher  memory  bandwidth   systems

Resulting  in….

Moore’s  law  is  dying

©  2016  IBM  Corporation

OpenPOWER: Open Hardware for High Performance

3

Upto:  12  cores  per  cpu96  hardware  threads  per  cpu1  TB  RAM7.6Tb/s  combined  I/O  Bandwidth  GPUs  and  FPGAs  coming…

OpenPOWER

Traditional  Intel  x86

Systems  designed   for  big  data  analytics  

and  superior  cloud  economics  

http://www.softlayer.com/bare-­metal-­search?processorModel[]=8

©  2016  IBM  Corporation Demo  Shown  at  DockerCon Europe  2015

Docker Containers running on Power have Superior Density

Total:  10,011 Containers  on  One  System:  Ubuntu(8028),  Node.js(991),  Wordpress(992)

• Wider,  Faster  Memory  Interface,  Faster  Cores  with  More  Threads• Split-­Core  Mode  supports  Interactive  Web  style  Apps  better• 2x  Greater  Density  of  Containers  per  systems  lowers  Cost• >40%  better  Throughput  and  4x  better  Latency• OpenPower ecosystem  offers  wide  range  of  Open  HW  Platforms

Open  Source  Docker

4

©  2016  IBM  Corporation

A Consistent Developer Experience

5

docker  pull  ubuntu:latest  will  get  you  the  POWER/LinuxOne/X86  specific  ubuntu  image!!!   Base  Image

X86

Node.js  App

X86  Node.js  runtme

Base  ImagePower

Node.js  App

Power  Node.js  runtime  

Base  ImageZ

Node.js  App

Z  Node.js  runtime  

Docker  onX86

Docker  onPower

Docker  onZ

Node.js  App2 Node.js  App2 Node.js  App2

Container Container Container

Multi-­platform  Docker  images

©  2016  IBM  Corporation

OpenPOWER:  GPU  support

6

GPU

Credit:  Kevin  Klaues,  Mesosphere

IBM  Spectrum  Conductor   includes  enhanced   support  for  fine  grained  GPU  and  CPU  scheduling  with  Apache  Spark  and  

Docker

Mesos support  for  GPUs  coming!!

©  2016  IBM  Corporation

Machine Learning and Deep Learning analytics on OpenPOWERNo code changes needed!!

7

ATLAS  Automatically  Tuned  Linear  Algebra  Software)

©  2016  IBM  Corporation

Try out Machine Learning and the Developer ChallengeEnter to win exciting prizes!!

Huge  speed-­ups  with  GPUs  and  OpenPOWER!  

openpower.devpost.com

©  2016  IBM  Corporation

Learn More and Get Started…

9

Power-Efficient Machine Learning on POWER Systems using FPGA Acceleration

Machine and Deep Learning on Power Systems

Register  for  a  SuperVessel Account  and  take  deep   learning  notebooks  running   in  docker containers  a  spin!      

https://ny1.ptopenlab.com/bigdata_cluster

©  2016  IBM  Corporation

Live  Demo  at  the  Booth!!

Thank  you!In:  @ipoddar

@sseelam