Mega trends in information management

Post on 20-Aug-2015

421 views 0 download

Transcript of Mega trends in information management

1 Software GroupConfidential

752: Mega trends in database and information management  

a.k.a. Dell Software Information Management – evolving to meet your data requirementsGuy HarrisonExecutive Director, R&D Information Management

2 Software GroupConfidential

3 Software GroupConfidential

4 Software GroupConfidential

5 Software GroupConfidential

7 Software Group

Dell Research Division

Mobility and Internet of Things

6. BYOD is changing from “secure the device” to “make it easy for me to use my device”

7. Internet of things. Opportunity for management, coordination and security of devices, opportunity for servers outside the data center

8. Wearable computing as next potential platform

Modern IT and Application Infrastructure

1. By 2018, majority of apps delivered as services, majority of data will be in cloud

2. Software defined data center – disrupts the network and storage leaders and allows the server leader to win with software on servers

3. Telco networks will transform to software on servers or as virtual appliances in cloud

4. App development moving to composite apps –stitching of existing SaaS and PaaS components

Security

9. New usage paradigms in a connected world needs new kinds of security – Dell opportunity is to develop end-to-end security across our products

10. Using analytics to detect abnormal user and application behavior – big opportunity for Dell to drive security analytics leadership

Dell Technology Outlook

8

Big Data and Data Analytics

5. Most industries will integrate “Big data” analytics into business processes to maintain competitive edge. Dell can be the enabler for the SMB through provision of infrastructure, analytic solutions and data.

Source: IDC, Gartner, Forrester, Everest Group, Company web sites, Dell internal.

8

9 Software GroupConfidential

Industry Mega-Trends

Mobility Cloud

Social BigData

10 Software GroupConfidential

Mobility

• Quad-core 1.4 GHz CPU

• 2GB RAM

• 32GB SSD

• 1080p display

• LTE/Bluetooth/WiFi

• 16MP & 2MP Camera

• GPS & Compass

11 Software Group

12 Software Group

13 Software Group

14 Software Group

15 Software Group

16 Software Group

17 Software Group

18 Software Group

19 Software Group

20 Software Group

21 Software Group

22 Software Group

23 Software Group

24 Software Group

25 Software Group

Data Input

26 Software Group

Siri

From now on, I’ll call you ‘An Ambulance’. OK?

“Siri call me an ambulance”

I found 14 bridges nearby:

“I want to jump off a bridge”

28 Software Group

29 Software Group

30 Software Group

Brain Control

31 Software Group

32 Software Group

33 Software Group

Muze

34 Software Group

35 Software Group

36 Software Group

The instrumented human

• Bluetooth Personal Area Network

• 3G/WiFi Wide Area Network

• GPS• Storage

• Pulse, temp monitor

• Silent alarms• Pedometer, sleep

monitoring

• Compass • Camera• Mike/earphones• Heads up display• Emotion/Attention

monitor

37 Software Group

Cloud and Internet of Things

38 Software Group

39 Software Group

40 Software Group

41 Software Group

42 Software Group

Internet of Things

Market Drivers• Declining device and sensor

costs

• Broad availability of network connectivity and CPU power for analytics

• Consumer Electronics (nest, etc)

• Regulations – e.g. Positive Train Control by 2015

• Surveillance Society

43 Software Group

Social

44 Software Group

“Social media create a revolution in communications and will define society’s evolution”

I need to pee

I peed

This is where I pee

Look at me peeing

Why do I pee?

I am good at peeing

45 Software Group

The culmination of cloud, social and mobile

46 Software Group

Will Big Data kill retail?

47 Software Group

Prevalence of Showrooming

Consumer Electronics

Home Improvement

0 10 20 30 40 50 60 70

Pct

Garter Research G00249458Survey Analysis: Focus on Customer Basics to Challenge Amazon, as 'Showrooming' Is Universal but Not UnbeatablePublished: 12 February 2013

48 Software Group

Some novel defences

49 Software Group

Battling showrooming

Selection

Stock

Faster

Cheaper

Dynamic Pricing

Predictive ordering

Assortment optimization

Predictive recommendations

Personalization

50 Software Group

Data and algorithms are the key to retain survival in the Big Data era

• Online has significant advantages

• Retailers can only survive by embracing online and emulating online practices– Dynamic pricing– Shelf optimization– Personalized service and selection

• Only big data analytics can provide these advantages

51 Software Group

There’s a similar story in every industry Web

Transport

Power Grid

Dating

Retail

Security

FinanceGovernment

Science

Healthcare

Insurance

Telecom

Advertising

52 Software Group

Generating competitive advantage through “Big Data analytics” Machine

LearningPrograms that evolve with “experience”

Collective IntelligencePrograms that use inputs from “crowds’ to seem intelligent

Predictive AnalyticsPrograms that extrapolate from existing data into the future

Big Data AnalyticsAKA Data Science

53 Software Group

Collective Intelligence

54 Software Group

55 Software Group

56 Software Group

57 Software Group

58 Software Group

59 Software Group

60 Software Group

61 Software Group

62 Software Group

Google Flu Trends

63 Software Group

64 Software Group

Collective Intelligence outsmarts Artificial Intelligence?

65 Software Group

66 Software Group

67 Software Group

68 Software Group

69 Software Group

Artificial Intelligence Strikes back

70 Software Group

71 Software Group

72 Software Group

73 Software Group

74 Software Group

Watson is big data AI – and was built on Hadoop

75 Software Group

Hadoop

76 Software Group

Pioneers of Big Data

77 Software Group

78 Software Group

79 Software Group

80 Software Group

81 Software Group

82 Software Group

Hadoop: Open Source Map-Reduce Stack

83 Software Group

Hadoop at Yahoo

Yahoo! Hadoop cluster:

• 4000 nodes• 16PB disk• 64 TB of RAM• 32,000 Cores

84 Software Group

Economies

Exadata

Hadoop

$0 $1,000 $2,000 $3,000 $4,000 $5,000 $6,000

$4,911

$750

Exadata vs Hadoop $$/TB (Hardware only)

85 Software Group

Schema on Read vs Schema on Write

Data

Analyse

Aggregate

Normalize

Cleanse

Code

ExtractLoad Transform Data

Warehouse

Data LoadHadoop

Analyse

Cleanse

Code

Utilize

Schema on Write

Schema on Read

Utilize

86 Software Group

Generating competitive advantage through “Big Data analytics” Machine

LearningPrograms that evolve with “experience”

Collective IntelligencePrograms that use inputs from “crowds’ to seem intelligent

Predictive AnalyticsPrograms that extrapolate from existing data into the future

Big Data AnalyticsAKA Data Science

87 Software Group

Predictive Analytics

0 20 40 60 80 100 120

-20

0

20

40

60

80

100

120

f(x) = 0.971521231456065 x + 0.71906459527154

• Linear regression• Non-linear (curve fit)• Multivariate• Time series• Logistical Regression• CART

88 Software Group

Classification• Create a model that

identifies/classifies new data

• Spam detection, churn risk, customer value

89 Software Group

Clustering• Group data without a

pre-existing classification scheme

• For instance, basket analysis

90 Software Group

SupervisedMachine Learning

Raw Data Clean

Validate

Model

Candidate

ModelTraining Set

Validation Set

Production

ModelNew Data

New Business

Existing Business

Prediction

91 Software Group

Inmaps.linkedin.com

Unsupervised learning

92 Software Group

93 Software Group

Big Data Analytics

Data Science

Search Optimization

Recommendation Systems

Security•Vulnerability•Penetration Detection

Fraud Detection

CRM•Churn •Defaults

Medical•Risk analysis•Diagnosis•Prognosis

Game optimization

Advertising•Targeting•Tailoring

94 Software Group

Data Science is hard

• Machine learning, collective intelligence, Hadoop, predictive analytics, R, Weka, Mahout, are HARD

• Small-medium businesses need help to compete

95 Software Group

Data Scientists to the rescue?

96 Software GroupConfidential

Dell Software Information Management

Matt WolkenVice President, Information Management Business

97 Software GroupConfidential

Agenda

• What is Information Management and how it fits in Dell Software

• The “data problem” aka why you should care

• Dell’s perspective and our solutions

– Analytics & integration

– Database management

98 Software GroupConfidential

Dell Software solutions

Data center & cloud

management• Endpoint management• Performance

management• Virtualization & cloud

mgmt• Windows server mgmt

• Application enablement/delivery

• Desktop virtualization• Mobile device mgmt• Mobile security

Information management

• Application & data integration

• Business intelligence & Big data analytics

• Database management

Mobile workforce management

• Email security• Endpoint security• Identity & access

management• Network security

Security Data protection• Application protection• Disaster recovery• Enterprise backup/recovery• Virtual protection

99 Software GroupConfidential

Information Management

Database management Application & data

integration Business intelligence and

Big data analytics

Manage data across structured

and unstructured

data sources

Integrate disparate

data stores, both on-premise and off-premise

Discover trends and

make informed decisions

with analysis

based on all data

100 Software GroupConfidential

Data is being created and consumed at a rapid pace

247 BillionEmails are sent everyday. 80% are spam.

$232 Billion dollars will be spent on Big Data through 2016.

$600 BillionDollars in waste annually for bad data or poor quality data.

4.4 MillionIT jobs globally will be created to support big data. Only 1/3 will be filled.

37.5%of large organizations said that analyzing big data is their biggest challenge.

70% of data is created by individuals. Enterprises are responsible for storing and managing 80% of it.

1.8 Zettabytes of business data in use in 2011, up by 30% from 2010.

48 Hoursof video are uploaded to YouTube every minute, resulting in 8 yrs of content daily.

100 BillionRFID tags estimated to be sold in 2015.

Sources: https://www.espatial.com/articles/20-shocking-facts-and-figures-about-big-data/

101 Software GroupConfidential

Historically, data was stored mostly in relational databases

Structured Data

Database

Extract, Transform, Load (ETL)

Data provisioning

Data warehouse

Database management

Data analysis

Trained StaffTool Chain

102 Software GroupConfidential

Petabyte

Exabyte

Zettabyte

Terabyte

Market situation: Data growth has skyrocketedMultiple data types from many sources

Transactional DataGenerated and stored in databases

• Structured

• Measured growth

Human FilesContent created outside databases

• Facebook, Twitter, RFID, cell phone etc.

• Multiple formats and different speeds of data creation

• Exponential growth

• Docs, Images, Video

• Multiple formats

• Fast growth

Social & Sensor dataIncreased exponentially

103 Software Group

The industrial Revolution of data

104 Software GroupConfidential

Market problem: Data silos ->fractured tool chain-> fragmented analysis

Structured

Database 1

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Trained StaffTool Chain

Database management

Analysis

Analysis

Analysis

Analysis

Analysis

Structured

Database 2

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Database management

Trained StaffTool Chain

Text

Data store

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Data management

Trained StaffTool Chain

Sensor

Data store

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Data management

Trained StaffTool Chain

Social

Data store

Extract, Transform, Load

(ETL)

Data provisioning

Data warehouse

Data management

Trained StaffTool Chain`

App & Data Integration

105 Software GroupConfidential

Dell Information Management solutions break data silos, manage, integrate and discover trends in all data

• Foster collaboration between IT and Line of Business

• Empower more people by offering self service access to data

• Make informed decisions today and into the future

One Vendor – Intuitive Tool Chain - All Data

Man

ag

e

Inte

gra

te

Structured, text, sensor, and social

Data store

Extract, Transform, Load (ETL)

Data provisioning

Data warehouse

Data management

Trained StaffTool Chain

Discover

106 Software GroupConfidential

Toad is a best of breed productivity tool for DBAs and developers

Oracle

SQL Server

Sybase

Hadoop

DB2

NoSQL

Cloud

Eclipse

MySQL

Repeatedly named #1 in database development and optimization by IDC1

Over 2 million users, and 3 million visitors to online community Toad World toadworld.com

Similar user experience across different DB platforms

1. Source: IDC, “Worldwide Database Development and Management Tools 2013-2017 Forecast and 2012 Vendor Shares” (Doc #242376)

107 Software GroupConfidential

SharePlex: Zero downtime migrations: DB, OS, Apps• Oracle database migrations

• Expired support on older versions

• New features / functionality in newer versions

• Change in edition: Standard / Enterprise

• OS migrations/change hardware

vendors• Moving to new servers (e.g. Solaris to Linux)

• Exadata, RAC, cloud or virtualized environments

• Provide a copy of data to a different platform (i.e. Oracle to Sybase, Oracle to Hadoop)

• Storage migrations• Replace with newer / faster disc array

• Reduce risk during application upgrades• Upgrade the application to a newer version

• Coincides with a hardware and / or database upgrade

Database

Operating

System

Application

CustomApps

108 Software GroupConfidential

Clo

ud

ap

ps

Boomi integrates apps and data stores

On

-pre

mis

e

128-bit encryption(metadata only)

Data

DataData

External firewall

109 Software GroupConfidential

Toad enables self-service BI

Toad Data Point (Querying and Data Prep)

Toad Intelligence Central

(Data mashups & Collaboration server)

Toad Decision Point

(Data discovery & visualization)

Presentation LayerShare workbooks

Data Sources

RDBMS Big Data Data warehouses

Desktop

Cloud apps

BI sources

Ensures IT governanceProvides rapid and governed access to all traditional and emerging data sources

Enables self service access Easily access underlying data sources using self service tools

Increases ROI of existing BIComplements existing tools and easily snaps into IT/BI and LOB systems

Fosters collaboration between IT and LOBBridges the gap between business users and IT with tools that enable collaboration

110 Software GroupConfidential

Leveraging Data & Analytics presents enormous potential for organizations

of CIO’s say they plan to expand Analytics this year or next

Ranking of Analytics & BI in Gartner CIO survey of top technology priorities (2013)

Employment opportunity. By 2015, 4.4M IT jobs globally will be created to support big data, 1.9M IT jobs in US alone!

#1 70% 1.8ZB#1 57%

of mid-market companies consider business analytics critical to operations

90% of all the data in the world has been generated over the last two years

111 Software GroupConfidential

The potential benefits are real and are already being experienced today!

Which statement best describes the value you’ve seen from your predictive analytics efforts?

We have measured positive top- and bottom-line impact

We have measured top-line impact only

We believe that we have become more effective, but can’t measure top-line

impact

We have measured a cost reduction only

We believe we have become more efficient, but cannot measure impact

We have gained more insight

36%

7%

18%

2%

12%

25%

Based on 126 active respondents.

Companies that rate themselves substantially ahead of their peers in their use of data are

more likely to rate themselves as substantially ahead in financial performance, according to findings from the Economist Intelligence Unit.

Information Week: State of Analytics report Dec 2013 www.cio.com/article/730457/Data_Driven_Companies_Outperform_Competitors_Financially?page=2&taxonomyId=3002

3X

112 Software GroupConfidential

Great data driven opportunities abound but problems emerge with data complexity…Data growth brings opportunity….

….but, there are new challenges

1 in 3

Organization leaders frequently make decisions based on Information they don’t trust, or don’t have

Organization leaders say they don’t have access to the information they need to do their jobs

Of CXOs agree they have more data than they can use effectively

1 in 2

60%

IDC, Gartner miscellaneous reports

113 Software GroupConfidential

Key co

mponents

to b

uild

end-

to-e

nd B

I/A

naly

tics

solu

tions

Dell’s offering was not complete…

Data Integration

Database Management

Advanced Analytics

Business Intelligence

Server and Storage

Server and Storage

TOAD & Shareplex

TOAD BI

Boomi

Kitenga

In order to address the demands that face mid-market customers, Dell must offer end-to-end solutions enabled with advanced analytic capabilities

114 Software GroupConfidential

• Highest Business Value and Complexity From Predictive Analytics

• There Remains a Dearth of Flexible, Configurable, and Reliable Predictive Analytics Solutions

Evolution of BI Solutions

Query, reporting, & search tools

OLAP

Dashboards, scorecards

Predictive analytics: IBM, SAS, StatSoft

Business Intelligence Technologies

[1] Source: Gartner 2012

115 Software GroupConfidential

Dell acquires Statsoft

Data Integration

Database Management

Advanced Analytics

Business Intelligence

Server and Storage

STATISTICA

Server and Storage

TOAD & Shareplex

TOAD BI

Boomi

Kitenga

Key co

mponents

to b

uild

end-

to-e

nd B

I/A

naly

tics

solu

tions

Dell + StatSoft = completes a strong end-to-end analytics driven information management value proposition

116 Software GroupConfidentialConfidential

StatSoft is well recognized in the industry“I see a significantly expanding market for predictive analytics software. The best strategy [for Stinger] might not be to go directly after SAS, but rather fill the need for all the new customers who are intimidated by SAS or IBM especially in the mid-market” Mike Gualteri at Forrester

1 Acquired by SAP Sep 2013

StatSoft

StatSoft

117 Software GroupConfidential117

Confidential

118 Software GroupConfidential118

Confidential

Data Visualization

119 Software GroupConfidential119

Confidential

Live scoring – integration into operational systems

120 Software GroupConfidential120

Confidential

Industry and cross-industry packaged solutions

121 Software GroupConfidential

Over 30 years of Information Management software experience

Tool for Oracle Application Development born in 90’s

Quest Software acquires TOAD in 1998

TOAD expands support for Microsoft SQL Server, Sybase, IBM DB2, and MySQL in 2000’s

In 2009, TOAD supports NoSQL, Hadoop, MongoDB, Cassandra, SimpleDB, Azure

Later in 2009 Toad Data Point is launched for data analysts

2010 Dell Acquires Boomi

2011 Toad Decision Point is launched for business users

2012 Toad Intelligence Central launched for collaboration

2012 Dell acquires Quest Software & Kitenga Big Data Analytics

2013 Toad BI Suite 2.0

Boomi Created in 2000

2013 Boomi MDM launched

Social Network Analytics Platorm

Quest creates SharePlex in 1999

Quest creates Spotlight in 2000

2012 Dell launches Quickstart Data Warehouse to solve needs of SMB

2014 Dell Acquires StatSoft

Dell & StatSoft founded in 1984

122 Software Group

Visit the Dell Software Booth

Enter for a chance to win a Dell Venue Pro 11 tablet

Draw is at 2:45pm Thursday

#C

14

LV#

C1

4LV

Please complete the session evaluation on the mobile appWe appreciate your feedback and insight

guy.harrison@software.dell.com@guyharrisonGuyharrison.net