Big Data LandscapeBig Data Landscape

Dr. Ohad Barzilay

Technology Management and Information SystemsTechnology Management and Information Systems

What do you mean when you say

Big Data?Big Data?

Lots of Data

• Geology

• Space

• Human body

• Digital life• Digital life

• The Internet

• Social networks

• 3 V’s of Big Data:– Volume

– Velocity

– Variety

Enterprise Information

Systems

• Storage

• Processing

• Communication

• Internet Scale• Internet Scale

• New paradigms

– Moving to the cloud

– Distributed computing

– NoSQL

Data => Information => Knowledge

• Applications of theoretical research which exists for years:– Data Mining

– Machine learning

Statistics

Machine learning

– Statistics

– Econometrics

• "By 2018, the United States alone could face a shortage of 140,000 to 190,000 people with deep analytical skills“

[Mckinsey, May 2011]

Data => Information =>

Knowledge => Decision Making

Sources: IDC: 2012 “Worldwide Big Data Technology and Services Forecast: 2011-2015,

Gartner: 2012 “Big Data Drives Rapid Changes in Infrastructure and $232 Billion in IT Spending Through 2016

“By 2018, the United States alone could face a shortage of 1.5 million managers

and analysts with the know-how to use the analysis of big data to make effective

decisions”

[Mckinsey, May 2011]

Big Data Technology Stack

Is Big Data Only a Buzz?

• A major criticism of Big Data say it is just a re-

branding of existing stuff

BUTBUT

• Big Data provides a managerial framework for

making data driven business decisions

• A scientific mindset

Data Does NOT Tell Any Story!

From Big Data to Data Science

Formulate hypotheses

Make decisions

Analyze it correctly, find

correlations, infer causality

• Capture the phenomena correctly

• Measure relevant data

correlations, infer causality

Process the data

What do people buy before a

hurricane?

Some insights

• As business grow there is too much data to

make sense of:

– Distributed organizations

– Distributed responsibilities– Distributed responsibilities

– Small adjustments have

large impact

Another Example: SportVU

• An Israeli startup acquired by STATS

• Player Tracking Technology

– Basketball

– Football (Soccer)– Football (Soccer)

• Lets examine SportVU technology on top of

the Big Data Technology Stack

SportVU and the

Big Data Technology Stack

SportVU and the

Big Data Technology Stack

SportVU and the

Big Data Technology Stack

SportVU and the

Big Data Technology Stack

Moneyball on steroids

http://grantland.com/features/expected-value-possession-nba-analytics/

http://grantland.com/features/the-toronto-raptors-sportvu-cameras-nba-analytical-revolution/

SportVU and the

Big Data Technology Stack

Live twitting

SportVU and the

Big Data Technology Stack

Sport Medicine

Thank you

ohadbr@tau.ac.ilohadbr@tau.ac.il