From Systems of Record to Real Time Transactional Analytics

1 #SmarterEnterprise

OttawaOctober 9, 2014

#SmarterEnterprise


From Systems of Recordto Real Time Transactional AnalyticsSystem z and HTAP:Hybrid Transaction/Analytical Processing

John ReszitnykzChampion, System z Software

[email protected]


Imagine the possibility of leveraging all of your data assets

Traditional ApproachStructured, analytical, logical

Data Warehouse

Internal AppData

TransactionData

MainframeData

OLTP SystemData

Traditional Sources

ERP Data

StructuredRepeatable

Linear

Precise fraud & risk detection

Understand and act on customer sentiment

Accurate and timely threat detection

Predict and act on intent to purchase

Low-latency network analysis

DataRich, historical, private, structuredCustomers, history, transactions

The “Circle of Trust”

Data warehouse & business analytics moving closer to this data


Imagine the possibility of leveraging all of your data assets

Traditional ApproachStructured, analytical, logical

Data Warehouse

Internal AppData

TransactionData

MainframeData

OLTP SystemData

Traditional Sources

ERP Data

StructuredRepeatable

Linear

New ApproachCreative, holistic thought, intuition

Multimedia

Web Logs

Social Data

Sensor data:images

RFID

UnstructuredExploratory

Dynamic

Text Data:emails

Hadoop

Streams

NewSources

Data: Intimate, unstructured.Social, mobile, GPS, web, photos, video, email, logs

Precise fraud & risk detection

Understand and act on customer sentiment

Accurate and timely threat detection

Predict and act on intent to purchase

Low-latency network analysis

New ideas, new

questions, new answers

The real benefit is derived from integration of new data sources with traditional corporate data•How can you query across both realms? How can you preserve security and lower TCO? How can you avoid costs and risks of offloading?

DataRich, historical, private, structuredCustomers, history, transactions

The “Circle of Trust”

Data warehouse & business analytics moving closer to this data


45%

32%

35%

38%

42%

51%

48%

40%

Business transaction related data

Digitized corporate knowledge (process, procedures, best practices, internal

social media, etc.

Social media, Mobile, and internet generated customer and prospect data

Electronic data exchange

High Growth Growth

Source: A commissioned study conducted by Forrester Consulting on behalf of IBM, October, 2012Base: 207 Global enterprise data analytics professionals

Please answer each statement as it best describes the growth of different types of data in your firm

Where is the data to be analyzed? . . . many analytics use cases tend to draw heavily on traditional data sources (Systems of Record) often on z

Source: 2012 IBM Global Big Data Online SurveyGartner Survey Analysis: Big Data Adoption in 2013 Shows Substance Behind the HypePublished: 12 September 2013

Types of data analyzed

How strongly do you agree with the following statements about why your firm runs analytics on the mainframe?

Source: A commissioned study conducted by Forrester Consulting on behalf of IBM, October, 2012Base: 133 Global enterprise data analytics IT professionals

What types of data/records are you planning to analyze using big data technologies?

5


Relevant insights come from enriching your primary enterprise data


ReportAnalyze

Collect

CleanseTransformWarehouse

Problems: Significant effort spent copying and moving data –

resulting in veracity/security issues Business does not have access to the most current view Complicated, bifurcated infrastructure requiring multiple

skill types No single point of management Business continuity concerns

Advantages: Less movement of data, resulting in higher quality and less

risk of loss Integration with core systems delivers most accurate view to

the business Integrated architecture leveraging existing environment Single view simplifies management Business continuity inherited from core systems

Shifting to a “single view of the truth” can provide numerous advantages


System z strategy: deliver a single workload-optimized system that integrates operations and business critical analytics into one streamlined, end-to-end data lifecycle

Leverage System zOperational Data Store

Operational transactional dataOperational analytical data

ANALYZE

REPORT

TRANSACT

CLEANSE TRANSFORM WAREHOUSE

Better business response: Reduced data movement, reduced complexity, reduced configuration resources. More accurate, more secure, more available

Customer Interaction

Data In

Business Insight

Out


OLTP Transactions

Operational analytics

Real time data ingestion

High concurrency DB2 Native Processing

Standard reports

Complex queries

Historical queries

OLAP

More timely insights from data High-speed analytics Historical views are quickly analyzed Decision makers can perform business analysis Secured environment for highly sensitive data Speeds batch reporting cycle

Operational benefitsConfiguration simplificationSingle point of entryReduced data movementHigh fidelity dataDynamic routingSingle environment for security, logging, back-up, and recoveryCompetitive price/performance

System z: A Hybrid Transaction / Analytical Processing platformA single workload-optimized system for accelerating decisions to the speed of business

Everything is online: analytics inthe right place!

IBM

DB

2 Analytics Accelerator

Advanced analytics* Scoring

IBM PureData System

for Hadoop

orBigInsights on Linuz for z

Integrate


The hybrid approach: Hybrid Transaction/Analytical Processing Will Foster Opportunities for Dramatic Business Innovation

HTAP empowers application leaders to innovate via greater situational awareness and improved business agility

Opportunity to rethink business processes: analytics as an integral part of the process itself

o Transform business processes

o Enable business leaders to perform real-time analysis of their data

HTAP addresses the four major drawbacks of traditional IT approaches:

Architectural and technical complexity Analytic latency Synchronization Data duplication

Gartner Research Note, 28 January 2014


DB2 Analytics Accelerator:Derive business insight from z/OS transactional data

Business Value

–Derive additional business insight –Near Real-time analytics –Extremely fast ad-hoc reporting –Cross selling and up selling –Reduced fraud

IT Value –Reduce time-to-market–Improved price/performance –Reduce costs

Customer Examples

–NLB: Banking – Better support for retail e-banking

–Swiss Mobiliar: Insurance – Provide timely insight to a growing user community while keeping compute costs flat

Business Analytics

Already have access to operational applications

AutomatedProcess

or

External CustomersOnline account analysis

End User

SPSS Modeling

Real-time AnalyticsSPSS In-Database

Scoring for DB2 z/OS


CognosIDAA

InfoSphereIDAA

SPSSCPLEX

CICS/IMSWebSphereSAP, …

ODM/BPMScoring Rules/Processes

SPSS

x

yz

System z: improving the traditional transact/transform/report/analyze cycle while also delivering integration that targets advanced business problems

Best of breed Data Life Cycle Management for:Fighting fraud, preventing financial crimes, generating customer insights

Faster, more accurate scores Streamlined decisioning process

Faster transactions

Faster transformation of

dataFaster, more

accurate reporting

Faster, more accurate modeling


DB2 V11 Integration with Big Data Data Sources plusInfoSphere BigInsights on System z


Leveraging Hadoop with Mainframe data: What makes sense, when


•Easy to use ingestion engine•Native data collectors accessed via graphical interface•Light-weight; no programming required•Multiple z/OS data sources•Conversions handled automatically•Streaming technology leverages USS (no z/OS engines) with no DASD required for staging

•A secure pipe for data•RACF integration – no need for separate or special credentials•Data streamed over secure channel using hardware crypto•Combining with BigInsights for Linux on System z means data never leaves the box

Preview: IBM InfoSphere System z Connector for Hadoop


Real Time Transactional AnalyticsEnd to end Analytics Solution

with HTAP, BigInsights and System zMove the analytics computation to the data!!

Join us at IBM Insight 2014.

the largest big data conference in the world

sessions and innovativeStreams on Business Analytics,Enterprise Content ManagementAnd Information Management

foundnetworkingopportunitiesinvaluable

business- and industry-focused sessions featuringtop experts from around the world

technical sessions, hands- on labs and developer activities that include cloud, mobile, security, social, Watson and more

exhibitors at the EXPOIncluding showcasesfrom 250+ Business Partners

in training, certification, hands-on labs,networking, executive one-on-one meetings,expert talks and food and entertainment

client andBusiness Partner speakers fromacross all industries

IBM, the IBM logo, and ibm.com are trademarks of IBM Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at “Copyright and trademark information” at ibm.com/legal/copytrade.shtml.© Copyright IBM Corporation 2014.

attendees at the one-day Business Partner Summit

Attend IBM Insight to learn how big data and analytics can help you outperform your peers. With IBM business and technical solutions forbig data and analytics, you can turn cloud,mobile and social into competitive advantage.

http://www-01.ibm.com/software/events/insight/

http://www-01.ibm.com/software/events/insight/


Next Steps

1. Meet me in the Social Café to continue this conversation.

2. Visit the tablets in the Social Café to download additional Big Data content.

3. Visit ibm.com - http://www-01.ibm.com/software/os/systemz/en_US/?lnk=mprSO-szso-usen

From Systems of Record to Real Time Transactional Analytics

Data & Analytics

Transcript of From Systems of Record to Real Time Transactional Analytics