Accelerate Big Data Analytics

8/13/2019 Accelerate Big Data Analytics

1/44


2/44

© 2012 IBM Corporation2

™

Integration by

DesignDeeply in tegrat ing and

tuning h ardware and

sof tware – in a ready-to-go workload optimizedsystem

Built-in Expertise

Captur ing andautomat ing what

experts do – fromthe infrastructure

patterns to theapplication patterns

Simplified Experience

Making every part of th e IT l i fecycle easier - withintegrated management of the entire system and a

broad open ecosystem of optimized solutions

April 2012 - IBM announced a new family of expert integrated systems:

Systems with integrated expertise and built for cloud

TM


3/44


™

New announcements for the PureSystems family that change theeconomics and experience of IT and accelerate time to value

Infrastructure

Delivering Infrastructure Services

Application Platform

Delivering Platform Services

Data Platform

Delivering Data Services


4/44


™

For apps like E-commerce…

Database cluster serv ices opt imized for

t ransact ional throug hput and s calabi l i ty

For apps like Customer Analysis…

Data warehouse serv ices opt imized for

high -speed, peta-scale analyt ics and sim pl ici ty

For apps like Real-time Fraud Detection…

Operational data wareho use services optim ized to

balance high performan ce analyt ics and real-t ime

operat ional throughpu t

Powered by Netezza

technology

Meeting B ig Data Challenges –

Fast and Easy!IBM PureData System

System for Transactions

System for Analytics

System for Operational Analytics


5/44


™

Optimized fordata services:

Transactional

Analytics

Expert integrated:

Data platform

Infrastructure

Unified platformmanagement

Built-in expertise

IBM PureData System: Optimized exclusively for data services

Workload optim ized

performance

Integrated management

Integrated maintenance

Single point of supp or t

Data Platform

Delivering Data Services


6/44


™

The NEW PureData System for Analytics provides:

The FASTEST time to value on the market today

Optimized analytics performance

for Big Data

Simple administration for fast and agile deployment

Large library of analytic functions to accelerate analytic performance

NEW



7/44


™


Delivering data services

for analytics

IBM PureData System for AnalyticsOptimized exclusively for analytic data workloads

Speed 10-100x faster than traditional custom systems1

Patented, hardware accelerated MPP(Massively Parallel Processing)

Simplicity

Data load ready in hours No database indexes No tuning No storage administration

Scalability Peta-scale data capacity2

Smart Designed to runs complex analytics in minutes,

not hours

Richest set of in-database analytics

1 Based on IBM customers' reported results. "Traditional custom systems" refers to systems that are not professionally pre-built,pre-tested and optimized. Individual results may vary.

2 Peta Scale capacity offered in the N1001 model


8/44


™

Benefits of the IBM PureData System for AnalyticsThe fastest performance of Netezza technology to date!

1 Based on a comparison of the IBM PureData System for Analytics N2001 to the IBM PureData System for Analytics N1001. The performance speed refers to the query times onboth macro-analytic and mixed workload tests as conducted in IBM engineering lab benchmarks. The N2001 query times were an average of 3x faster than those of the N1001.Individual results may vary.

2 128 GB/sec scan rate assuming an average of 4x compression across the system. Individual results may vary.3 Capacity of IBM PureData System for Analytics N2001 compared to previous generation IBM PureData System for Analytics N1001.

Accelerate Performanceof An alyt ic Qu er ies

Inc rease Efficiency

of y ou r Data Center

Simpl ic i ty and

Ease of Admin istrat ion

3X faster performance1 for Big Data analytics

128 GB/sec effective scan rate per rack2

to tackle Big Data faster

Improved system management and resilienceto spend less time managing and more time

delivering value

50% greater data capacity per rack3helps optimize data center efficiency

More capacity and less power per rackthan both Oracle and Teradata


9/44


10/44


™

High scan rates drive analytic results- faster!

NYSE has replaced an Oraclerelational database with a

data warehousing appliancefrom Netezza allowing it toconduct rapid searches of 650terabytes of data.

- ComputerWeekly.com

Acc elerate Performanc e

of A nalyt ic Quer ies


11/44


™

Spend less on PureDatathan Oracle Exadata for faster performance!

Comparingdollars per GB per second…

Oracle will cost you morethan 500% more to scan the

same gigabyte of data!1

1 IBM PureData System for Analytics N2001 = $2,637,300 list price/128 GB per sec. = $20,603.91/GB/sec. 1 28 GB/sec scan rate assumes an average of 4x out of the box compression across the system. Oracle X3-2 = $11,384,280list price /100 GB/ per sec. = $113,842.80/GB/sec. Oracle scan rate from Oracle X3 datasheet at http://www.oracle.com/us/products/database/exadata-db-machine-x3-2-1851253.pdf and prici ng documents at

http://www.oracle.com/us/corporate/pricing/exadata-pricelist-070598.pdf and http://www.oracle.com/us/corporate/pricing/technology-price-list-070617.pdf. Individual results may vary. This comparison is based on out of boxconfigurations for both systems

1

553%

more

Acc elerate Performanc e

of A nalyt ic Quer ies


12/44


™

Increase data center efficiencyWith faster, more efficient systems

1 Teradata 2690 data sheet claims 8.8kW power per rack. IBM PureData System for Analytics N2001 is 7.5kW power per rack. 2 Oracle high performance drives provide 45TB per rack before compression per Oracle X3-2 datasheet. IBM PureData System for Analytics N2001 pre-compression capacity is 48 TB per rack.Claims are basedon out of the box configurations.3 300 GB drive capacity for Teradata 2690 is 18.2 TB before compression per http://www.teradata.com/News-Releases/2011/Fifth-Generation-Teradata-Data-Warehouse-Appliance-Delivers-Double-the-Performance-and-Triple-the-Data-Capacity/. IBM PureData System for Analytics N2001 pre-compression capacity is 48 T B per rack. Claims are based per rack and on out of the box configurations.

See Slide 9 for scan rate footer

PureData System for Analytics

Offers more than 160% greater capacity than Teradata 2690 Has more than a 200% faster scan rate than Teradata! Nearly 30% faster scan rate than Oracle X3-2 Uses less power than Oracle X3-2 using nearly 40% less

power than Teradata 2690

Increase Eff ic iency

of yo ur Data Center

Less floor space Less power per data center tile Less cooling per data center tile

PureData uses

Less Powerthan other systems1

PureData has

More Capacitythan other systems 2,3

PureData has

Out of the box Faster Scan Ratesthan other systems


13/44


™

Spend less time managing and more time innovating Simpl ic i ty andEase of

Administ rat ion

No dbspace/tablespace sizing and configuration

No redo/physical/Logical log sizing and configuration

No page/block sizing and configuration for tables

No extent sizing and configuration for tables

No Temp space allocation and monitoring

No RAID level decisions for dbspaces

No logical volume creations of files

No integration of OS kernel recommendations

No maintenance of OS recommended patch levels

No JAD sessions to configure host/network/storage

Data Experts , not

Database Experts

Easy Administration Portal No software installation

No indexes and tuning

No storage administration


14/44


™

Balanced Performance

How we did it, conceptually

FPGA Core CPU Core

500

MB/sec

800

MB/sec +

1 drive @

120 MB/sec

More Drives with

Faster Scan Rates

Leading to

Faster Perform ance

Faster FPGA Cores,

Dr iv ing Higher Performance

2.5 drives @

130 MB/sec

each

1000

MB/sec

1000

MB/sec +

CPU Core

• Analyze

FPGA Core

• Decompress• Project• Filter


15/44


16/44

© 2012 IBM Corporation

™

Leveraging the


17/44


™

Smarter Analytics should be your goal

CIOs rankAnalytics as the

#1 factorContributing to anorganization’scompetitiveness.1

1 IBM CIO Study 20092 IBM IBV/MIT Sloan Management Review Study 2011

Financialoutperformers are

64%more likely touse analytics toevaluate talentsupply and

demand on anongoing basis.3

Enterprises thatapply advancedanalytics have

33%More revenueGrowth and

12X more profitgrowth.4

3 IBM CHRO Study 20104 IBM CFO Study 2010

Organizations thatembrace analyticsare more than

2Xas likely tooutperform theirPeers.2


18/44


™

Achieve Smarter Analytics by using all types of analytics againstall types of data

SmarterAnalytics

Operat ional r eports

Analyt ic reports

Statist ical Analysis

Forecast ing

Predict ive Model ing

Optimization

Social Analyt ics

Web Analyt ics

Alerts

Transactional &

Appl ication Data

Machine &Sensor Data

Social Data

EnterpriseContent

Web Data

Documents

Spatial Analysis


19/44


20/44


™

Increasing

Variety of data

requires new techniques

Increasing

Velocity of data

requires higher performance

Increasing

Volume of data

requires growing capacity

35 ZB

by 2020

Today’s big data challenges for both transactions and analyticsare increasing demands on data systems

Millions oftransactionsper second

Mobile CloudSocial Big DataCommerce

2020

50x

2010

Analytics

Billions ofdevices &sensors


21/44


™

Built-in expertise makes this as simple as an appliance

Dedicated device

Optimized for purpose

Complete solution

Fast installation

Very easy operation

Standard interfaces Low cost


22/44


™

SimplifyMove analytics into the Data Warehouse

Integrate the server,storage and databaseinto one optimizedpackage

Move complex analyticsinto the database

Integrated, highperformance analytics

within the datawarehouse Server

Storage

Database

Analy t ics


23/44


™

Built-in Expertise No indexes or tuning

Data model agnostic

Hardware accelerated, fully parallel, optimized, In Database Analytics

Integration by Design Server, Storage, Database in one easy to use package

Automatic parallelization and resource optimization to scale efficientlyand economically

Enterprise-class security and platform management

Simplified Experience

Up and running in hours Minimal up front design and tuning

Minimal ongoing administration

Standard interfaces to best of breed Analytics, Business Intelligence,and data integration tools

Built-in, complex analytical capabilities allow users to derive insight fromtheir data quickly

Easy connectivity to other Big Data Platform components

IBM PureData System for AnalyticsThe Simple Appliance for Serious Analytics


24/44


™

Purpose-built analytics engine

Integrated database, server and storage

Standard interfaces

Low total cost of ownership

Speed: 10-100x faster than traditional systems

Simplicity: Minimal administration and tuning

Scalability: Peta-scale user data capacity

Smart: High-performance advanced analytics

IBM PureData System for Analytics

Transforms theUser Experience


25/44


26/44


™ Premier Healthcare

Alliance

improves patient

outcomes while reducing

spending by USD 2.85B

Need

• Improve patient outcomes through enhanced data

sharing and analytics

• Make data in different formats shared across

thousands of locations easier to access

Benefits

• 157 participating hospitals saved an estimated

23,000 lives and reduced healthcare spending by

USD 2.85B

• Reduced health spending by decreasing

unnecessary readmissions, ER visits andprocedures

• Improved access to data helps deliver the promise of

Accountable Care Organizations

2626Video Testimonial

http://www.youtube.com/watch?v=VYQDJVSE_qohttp://www.youtube.com/watch?v=VYQDJVSE_qo


27/44


™

What makes PureData System for Analytics different?

Speed

Simplicity

Scalability

Smart

Up to 2000X faster than before

Growing by 30% every month

“ Netezza has allowed us to reduce the complexity

of regulatory reporting and processing of

exchange data from days down to minutes.”

200X faster than Oracle systemROI in less than 3 months

Up and running 6 months

before having any training Allowing the business users access to theNetezza box was what sold it.

- Steve Taff, Executive Dir. of IT Services

1 PB on Netezza

7 years of historical data

100-200% annual data growth

NYSE … has replaced an Oracle IO

relational database with a data

warehousing appliance from Netezza,

allowing it to conduct rapid searches of

650 terabytes of data.

- ComputerWeekly.com

SUNY Buffalo researchers reduced

the time to perform quintillions of

computations from 27 hours to 12

minutes

Once we had the data on Netezza we were

able to do the same analysis and much more

complex analysis in minutes. The research

draws on medical records, lab results, MRI

scans, and patient surveys.”

- Dr. Murali Ramanathan, SUNY Buffalo


28/44


™

What’s new?Improved performance, energy efficiency and resiliency

IncreasedPerformance & Capacity

ImprovedEnergy Efficiency

50% greater capacity and

faster performance, with no

increase in floor space, power

or cooling requirements2

Uses less power than the

competition

Better capacity and power

requirements than

competition

Improved 3x faster

performance1

Faster disk scan rate-128

GB/sec effective scan rate

per rack

Improved Resiliencyand Fault Tolerance

More spare drives per

cabinet

Faster disk regeneration

due to smaller drives

70% Fewer service calls3

13x faster performance refers to the query times on both macro-analytic and mixed workload tests as conducted in IBM engineering lab benchmarks where the IBM PureData System for Analytics N2001 was shown to be an average of 3x faster than N1001. Individual results may vary.

2 50% greater capacity when compared to previous model PureData System for Analytics N1001. Power and cooling specifications within 97% of previous model PureData System for Analytics N1001.

3 Each N2001 rack contains 34 hot spare drives and 240 active drives for a ratio of 1 spare per 7 drives. Each N1001 rack contains 4 hot spare drives and 92 active drives for a ratio of 1

spare per 23 drives. The N2001 has 3.3x more spares per active drive. Frequency of disk related service calls expected to decrease by 70% assuming the same drive failure rates.


29/44


™

IBM DB2 Analytics AcceleratorSynergy and integration with IBM and partner products

Internal Use Only | Do Not Distribute

The PureData System for Analytics N2001 is also the

next generation DB2 Analytics Accelerator

Providing the sameimprovements to our DB2 forzOS customers


30/44


™

BI Reporting and

Ad-Hoc Analysis

What happened?

When and where?

How much?

Predictive

Analytics

What will happen? What will the impact be?

Optimization

What is the best

choice?


PureData System for Analytics takes analytics beyond reporting


31/44


32/44


™

Basic Math*

Permutation andCombination*

Greatest CommonDivisor and LeastCommon Multiple*

Conversion of Values*

Exponential and

Logarithm* Gamma and Beta

Functions

Matrix Algebra+

Area Under Curve*

Interpolation Methods*

Transformations MathematicalTime Series

Linear Regression+

Logistic Regression+

Classification

Bayesian

Sampling

Model Testing

Geospatial Data Type

Geometric Functions

Geometric Analysis

Predictive Geospatial * Fuzzy LogixDB Lytix

capabilities

+ Netezza

Analytics

and Fuzzy

Logix DB

Lytix

capabilities

Data Profiling /Descriptive Statistics+

General Diagnostics

Statistics+

Sampling

Data prep

Pre-built in-database analytics

Descriptive Statistics+

Distance Measures*

Hypothesis Testing*

Chi-Square &Contingency Tables*

Univariate &MultivariateDistributions+

Monte CarloSimulation*

Autoregressive+

Forecasting*

Association Rules+

Clustering+

Feature Extraction+

Discriminant Analysis*

Data Mining

Statistics


33/44


34/44


™

PureData System for Analytics optimization with other IBM offerings

System Z

Big Data

Platform

Business

Intelligence /

PerformanceManagement

InfoSphere Streams

InfoSphere BigInsights

System ML (Machine Learning)

IBM DB2 Analytics Accelerator (IDAA)

zLinux ODBC driver

Data

Integration

Information Server v9.1 InfoSphere Discovery v4.5 InfoSphere Data Architect v8.1 InfoSphere CDC Heterogeneous Replication InfoSphere Optim Data Archive 9.1

Industry Models v8.4 –

Banking, Insurance, Healthcare Industry Model Packs – Supply Chain, Customer, Market & Campaign Tivoli Storage Manager Vivismo Data Explorer v8.2

Coming Soon:

PureData System for Operational

Analytics

Guardium

Informix Data Warehouse Edition

SPSS v16

Cognos v10.2

Cognos TM1 v9.5

Guardium DB Monitoring v9

SPSS Modeler v15

Unica EMM Marketing Analytics 8.6

Unica NetInsights 8.6


35/44


™

Data In

Loading the PureData System for Analytics

Data Integration

Ab Initio

Cloudera

Composite Software

IBM Big Insights

IBM Information Server

IBM InfoSphere Streams

Informatica

Oracle Data Integrator Oracle GoldenGate

SAP Business Objects

S Q L

O D B C

J D

B C

O L E - D B


36/44


™

Querying the PureData System for Analytics

Repor t ing & A nalys is

IBM Cognos

IBM SPSS

IBM Unica

Information Builders

Kalido

KXEN

Microsoft Excel

MicroStrategy

Oracle OBIEE

SAP Business Objects

SAS

Actuate

Data Out

S Q L

O D B C

J D

B C

O L E - D B


37/44


™

Analytics without constraint

Big Data meets deep analytics

™


38/44


™

IBM Netezza Analytics: Built-in features and capabilities

BI Tools

Visualization

Tools

PureData for Analytics AMPP Platform

SoftwareDevelopment

Kit

IBMIn-Database

Analytics

3rd

PartyIn-Database

Analytics

IBMInfoSphere

Streams

Tanay GPU

Appliance by

Fuzzy Logix

IBM

InfoSphere

BigInsights

Cloudera

Apache Hadoop

IBM SPSS

SAS

Revolution

Analytics

Eclipse

Esri

™


39/44


™

Advanced

Analytics

Loader

ETL

BI

Applications

Host

Using advanced analytics with BI tools and SQL

Node

Host

…

Node

Node

SQL SnippetProcessor

IO StreamProcessor

SQL

Processor

SQL Snippet

Processor

IO Stream

Processor

SQL Snippet

Processor

IO Stream

Processor

ExtendedSQLSnippet

Snippet

Snippet

Accelerated

Result

Result

Snippet

Result

Snippet

Result

Snippet

™


40/44


™

Part of the IBM Big Data PlatformWorkload Optimized Solutions for all your analytic needs

Analytics & Decision Management

Solutions

Big Data Infrastructure

IBM Big Data Platform

Accelerators

Information Integration & Governance

Visualization

& Discovery

Application

Development

Systems

Management

StreamComputing

HadoopSystem

DataWarehouse

PureData

System for Analy t ics

™


41/44


™

Listen to what some other clients have to say

http://www.youtube.com/watch?v=Y0j1XSdMSDE http://www.youtube.com/watch?v=-6UBeGIIc98

http://www.youtube.com/watch?v=yKIGQuSYUd4

http://www.youtube.com/watch?v=uwn8HX0IM8o

http://www.youtube.com/watch?v=ySLiDYgObFc

41

™

http://www.youtube.com/watch?v=Y0j1XSdMSDEhttp://www.youtube.com/watch?v=-6UBeGIIc98http://www.youtube.com/watch?v=yKIGQuSYUd4http://www.youtube.com/watch?v=uwn8HX0IM8ohttp://www.youtube.com/watch?v=ySLiDYgObFchttp://www.youtube.com/watch?v=ySLiDYgObFchttp://www.youtube.com/watch?v=uwn8HX0IM8ohttp://www.youtube.com/watch?v=yKIGQuSYUd4http://www.youtube.com/watch?v=-6UBeGIIc98http://www.youtube.com/watch?v=-6UBeGIIc98http://www.youtube.com/watch?v=-6UBeGIIc98http://www.youtube.com/watch?v=Y0j1XSdMSDE


42/44


™

PureExperience ProgramLet us prove it at no charge:

www.ibm.com/PureExperience

1. Guided analysis of business value

2. PureSystems Technology Demonstration

3. On-Site Trial & Support

Free execution ofon-site service engagement

Continued use of the PureSystems

offering for 30 days

Access to a technical advocate

for usage questions and advice

Single point of IBM support and

maintenance

™

http://www.ibm.com/PureExperiencehttp://www.ibm.com/PureExperience


43/44


™

Take the next step….

Discover the value and begin you r journey with IBM PureSystems:

Visit ibm.com/puresystems to learn more

Join the conversation about this new categoryof computing:

‒ Twitter: @IBM PureSystems

Hashtag: #IBMPureSystems or #expertintsys ‒ YouTube Channel: expertintegratedsys

‒ Blog: expertintegratedsystemsblog.com

Developers – Get started today with our no charge trial offerings!ibm.com/developerworks/puresystems/try

Explore PureSystem partner solutionsibm.com/puresystems/centre

Take a Test Driveibm.com/PureExperience

™

http://www.ibm.com/puresystemshttp://localhost/var/www/apps/Temp/ibm.com/developerworks/puresystems/tryhttp://www.ibm.com/puresystems/centrehttp://localhost/var/www/apps/Temp/ibm.com/developerworks/puresystems/tryhttp://localhost/var/www/apps/conversion/tmp/scratch_6/ibm.com/PureExperiencehttp://localhost/var/www/apps/conversion/tmp/scratch_6/ibm.com/PureExperiencehttp://localhost/var/www/apps/Temp/ibm.com/developerworks/puresystems/tryhttp://www.ibm.com/puresystems/centrehttp://localhost/var/www/apps/Temp/ibm.com/developerworks/puresystems/tryhttp://www.ibm.com/puresystems


44/44

© International Business Machines Corporation 2012International Business Machines Corporation New Orchard Road Armonk, NY 10504IBM, the IBM logo, PureSystems, PureFlex, PureApplication, PureData and ibm.com are trademarks of International Business Machines Corporation,registered in many jurisdictions worldwide.
http://www.ibm.com/legal/copytrade.shtml

Accelerate Big Data Analytics

Documents

Transcript of Accelerate Big Data Analytics