IBM Cognitive Systems - NCSTechConnect.com 1... · Data Warehousing Big Data & ... IBM Cognitive...
Transcript of IBM Cognitive Systems - NCSTechConnect.com 1... · Data Warehousing Big Data & ... IBM Cognitive...
BOK Tuang SengSales LeaderIBM Cognitive Systems, ASEAN
IBM Cognitive Systems- A Machine Learning JourneyOutthink limits thru accelerated innovation, ecosystems and remodernization
Cognitive Solutions
Cognitive solutions ingest data of all forms, structured and unstructured, understandthat data, reason through it, learn from it, and interact with humans
Centralized Mainframes
Cognitive EraE-Business
Distributed Computing
Smarter Planet
Office Productivity
Client/Server
Personal Computer
Data Warehousing
Big Data &Predictive Analytics
Cognitive(AI – Machine Learning,
Deep Learning)
Data InsightContextTransactional
DatabaseBusiness
IntelligenceBig Data & Analytics
Actionable Insight in context
Reporting
Digital transformation drives new innovations
Influx of high data volumefrom various data sources- Devices, IoT, Social, etc
Machine Learning Journey
Machine Learning
Deep LearningBreak tasks into Artificial
Neural Networks
New Data SourcesIoT Devices, Big Data, NoSQL, Hadoop &Analytics
Human Intelligence Exhibited by MachinesCognitive/ML/DL
“Trained” using large amounts of data & ability to learn how to perform the task
Growing across Compute, Middleware, Network and Storage
New class of applicationsOpportunity in ML Training§ Pattern matching§ Image matching (Consumer Photos)§ Real-time decision support§ Complex workflows§ Data Lakes
Extend Enterprise applications § Finance: Fraud detection / prevention§ Retail: shopping advisors § Healthcare: Diagnostics and treatment§ Supply chain and logistics
Extend Predictive Analytics to Advance Analytics with AI
• Billions of intelligent devices & machines
• Recognition, reasoning, problem solving
• Inference: real-time accurate response
DEVICE INFERENCING
Deep Learning is new computing modelfor Machine Learning
Training
Device
Datacenter
• 10s of billions of image, voice, video queries per day
• GPU inference for fast response, maximize datacenter throughput
DATACENTER INFERENCING
TRAINING
• Billions of Trillions of Operations
• GPU train larger models, accelerating time to market
• Data intensive• Compute intensive• Develop a model for use
on the edge as inference
Cognitive Era demands datacenter innovationPr
ice/
Perfo
rman
ce
Full system stack innovation required
Moore’s Law
Innovation beyondprocessor and commodity server
Technology&
Processors
2000 2020
Firmware / OSAcceleratorsSoftwareStorageNetworkFull Stack
Acceleration(Lower is better)
Next era of innovation needsAccelerated Computing
thru Open Solutions & Ecosystems“We can't solve problems by using the same kind of thinking we used when we created them.” – Albert Einstein.
Accelerators
I/O Attach Devices
Software Optimization
IBM OpenPower Systems Offering
IBM Cognitive Systems Portfolio
IBM S822LC Serverfor Big Data
IBM S822LC Serverfor Commercial
Computing
IBM S822LC Server (”Minsky”)for HPC & AI (ML/DL)
IBM PowerAI Deep Learning Software Distribution
IBM Power HPC Software Stack
IBM Spectrum Computing Software
• IBM Spectrum LSF• IBM Spectrum Cluster Foundation• IBM Spectrum MPI
• IBM Spectrum Conductor• IBM Spectrum Symphony
IBM Data Storage• IBM Spectrum Scale Software • IBM Elastic Storage Server
IBM Systems Compilers• IBM XL C/C++• IBM XL Fortran Compiler
• IBM Parallel Performance Toolkit• IBM Engineering & Scientific Subroutine Library (ESSL)• IBM Parallel ESSL
IBM Accelerated Cluster Switch
Deep Learning Frameworks• Caffe• NVCaffe
• IBMCaffe• TensorFlow
• Torch• Theano
• Chainer• DL4J
Supporting Libraries• OpenBLAS • Bazel • NCCL • DIGITS • Distributed Frameworks
• Selected Systems Compilers + Spectrum Computing Software
AcceleratedNVLink
Linux
(GPU-GPU & GPU-CPU)
CognitiveComputes Systems
CognitiveHPC Enabler
Cognitive Software DefinedInfrastructure Solutions
Cognitive DataStorage Solutions
Cognitive High Performance Interconnect
IBM S812LC Server
IBM Research
IBM OpenPower
Development
IBMLinux
Technology Center
IBM Lab Services
IBM Technical Support Services
IBM Cognitive Cluster Offering
(aka IBM Power HPC Cluster)
Cognitive Workloads Artificial Intelligence (ML/DL)
High Performance Data Analytics (HPDA)
High Performance Computing (HPC)
IBM OpenPower Systems Offerings
S822LC For High Performance Computing8335-GTB (aka “Minsky”
•CPU-GPU NVLink, delivering >2.5X the bandwidth to GPUs
•PowerAI SW
•Power HPC Stacks
•Up to 4 integrated NVIDIA “Pascal” GPUs
S822LC For Big Data8001-22C
• Ideal for storage-centric and high data through-put workloads
•Brings 2 POWER8 sockets for Big Data workloads
•Big data acceleration with work CAPI and GPUs
S821LC8001-21C
S822LC8335-GCA
•Up to 2.2X memory bandwidth of Intel x86 systems
•Memory Intensive workloads
•2 POWER8 sockets in a 1U form factor
• Ideal for environments requiring dense computing
HPC & AI Big Data Commercial Computing
Linux
Systems designed to take Data/Compute Intense cognitive workloads to the next level
AI/ML/Deep Learning StrategyFor IBM Cognitive Systems
§ Embrace and Extend open source: add innovations, optimizations, new algorithms
§ Add system-level optimizations. Take advantage of NVLink on Power platform, better cluster (scale-out) performance, simplify the process of getting started
§ Build differentiated GPU-accelerated system solutions, using NVLink
IBM Version of DL Frameworks
Deep Learning Frameworks
New algorithmic techniques,
optimizations
Power / NVLink specific optimizations
Built with Collaborative Open InnovationOpenPOWER
299 OpenPOWER members contribute to 87 OpenPOWERready products and 17 servers delivering choice to industry
Close partnership with major AI/accelerator industry leader Nvidia
Open Frameworks for AI
Highly optimized & accelerated Cognitive/AI frameworks
Cognitive/AI SDK for deployment and deployment tools
Open Source Workloads
Now hyper-focused on expanding Cognitive industry applications
Enterprise Support/Subscription model
OpenCAPI
High bandwidth open interconnect to attach to accelerators and SCM
IBM PowerAI Platform
Deep Learning Frameworks
Supporting Libraries
PowerAI Software Distribution
DIGITS OpenBLAS Distributed Frameworks Bazel NCCL
IBM OpenPower S822LC, with NVLink(aka “Minsky Server”)
Breakthrough performance for GPU accelerated applications,including Deep Learning and Machine Learning.
Package of Pre-Compiled Major Deep Learning Frameworks
Easy to install & get started with Deep Learning with Enterprise-Class Support
Performance Optimized to Take
Advantage of NVLink
Enabled by High Performance Computing Infrastructure
Differentiated Value onIBM OpenPower S822LC (aka “Minsky Server”)
System Bottleneck
Graphics Memory
New POWER8
CPUDDR4
P100Tesla GPU
NVLink
115GB/s
80 GB/s
CPUDDR4
PCIe
32 G
B/s
Graphics Memory
Graphics Memory
POWER8 with NVLink delivers
2.8X the bandwidthPCIe Data Pipe
POWER8 NVLink Data Pipe
P100Tesla GPUGPU
Current CPU to GPU PCIe Attachment (x86)
New POWER8 with NVLinkProcessor Technology
Only IBM has NVLink for GPU-GPU direct communication
Cross-industries benefits of PowerAI
For Marketing executivesBetter understanding of client perspectives, recommendations, improve interaction.
For IT ExecutivesEnterprise class support, better price performance and a shared infrastructure.
For Data Scientists and DevelopersNVLink means new opportunities for innovation, faster access to larger memory, execute larger training models and more iteration … refine, improve.
Research ScientistsExplore new ways to understand existing datasets and faster access to results.
IBM OpenPower Systems- Best Systems for Cognitive and data-compute intensive workloads
High memory bandwidth and Processor designed to crush compute intensive workloads– AI (ML/DL), HPC & HPDA.
Truly open ecosystem and collaboration for extreme accelerator innovation with industry-leading technology partners
World-class service and support from IBM, the premier Cognitive Expert
Leading enterprise distribution and support for open-source machine and deep learning frameworks used to build cognitive applications
Outthink Limits with IBM Cognitive Systems