Personal bi to personal data science

78
Personal BI to Personal Data Science Mulkens Jan Hermans Kimberly Microsoft BI ConsultantData scientist Twitter: @JanMulkens Blog: www.janmulkens.be

Transcript of Personal bi to personal data science

Page 1: Personal bi to personal data science

Personal BI to Personal Data Science

Mulkens Jan Hermans KimberlyMicrosoft BI Consultant Data scientist

Twitter: @JanMulkensBlog: www.janmulkens.be

Page 2: Personal bi to personal data science

Thank you to our sponsors

Page 3: Personal bi to personal data science

Jan MulkensMicrosoft BI Consultant

Ordina Belgium

“I love the Power BI experience from desktop to mobile.Put on top of that the community and the continuous stream of high value releases and it’s clear why Power BI is the future.”

Page 4: Personal bi to personal data science

Kimberly Hermans

My favourite thing about Power BI is its ease to work with. Within hours I know what my data looks like, what story it tells and how I should start my

modelling phase.

Data Scientist & CRM consultant Ordina Belgium

Page 5: Personal bi to personal data science

Agenda• Introduction• Corporate BI & DS

• Goals • Solution

• Personal BI & DS • Goals • Solution

• Applying Power BI

“With Power BI, it’s simple. Everything becomes possible.”Philip Dean, Tees and Hartlepool National Health Services Trust

Page 6: Personal bi to personal data science

Introduction

Power BI can not only be used to democratize BI across

the enterprise, but also to democratize Data Science

across the enterprise.

Page 7: Personal bi to personal data science

2012 - Value vs difficulty

Page 8: Personal bi to personal data science

Action Decision

Interactive dashboardsWhy did it happen?

PredictionsWhat will happen?

RecommendationsWhat should I do?

Decision automation

Decision support

Data

Static reportsWhat happened? Manual process

ValueSource: Gartner (October 2014)http://www.gartner.com/newsroom/id/2881218

2014 - Data to action

Data Science

Traditional BI

Page 9: Personal bi to personal data science

End User

Everyone

The age ofClassic BI

End UserIT Analyst

The age ofSelf Service BI

The age ofData Culture

Data Culture

Page 10: Personal bi to personal data science

Corporate BI & DS

Page 11: Personal bi to personal data science

Corporate goals

Page 12: Personal bi to personal data science

Corporate goals

Page 13: Personal bi to personal data science

Corporate Solution

Solution created by IT.Established corporate context & is reusable, scalable and backed up.

Page 14: Personal bi to personal data science

Corporate Business Intelligence

... ?

Page 15: Personal bi to personal data science

Corporate Data Science

... ?

Page 16: Personal bi to personal data science

Corporate Data Science

Traditionalresearch

Dangerzone

MachineLearning

DATASCIENCE

Hacking

skills

Math

& st

at

know

ledg

e

Domainexpertise

Page 17: Personal bi to personal data science

Corporate Data Science

Up to15hrs / week

Up to15hrs / week

Up to15hrs / week

Data

Cleaning

Exploratory

Data Analysis

Full work week

Machine

Learning

ETL Up to 4 hrs / week

Source: Generalized from O’Reilly’s “2015 Data Science Salary Survey” (sep 2015)

ETL Data Cleaning Machine LearningExploratory Data Analysis

Page 18: Personal bi to personal data science

Personal BI & DS

Page 19: Personal bi to personal data science

Personal GoalsRemove frictions between users and data

• Business-driven vs IT-driven

• Rapid delivery

• “Less” governance

• Freedom vs Standardized

Page 20: Personal bi to personal data science

Personal Solution

BI solution created by a user.Context is only for user & exists as a document

Page 21: Personal bi to personal data science

Personal Business Intelligence

Page 22: Personal bi to personal data science

Personal Data Science

Page 23: Personal bi to personal data science

Applying Power BI

Page 24: Personal bi to personal data science

Personal Data Science1) Problem statement

Page 25: Personal bi to personal data science

Demand forecasting• Public biking system Washinton

• +/- 350 stations

• Peaks in demand & supply

• Goal of project: optimize planning of relocating bikes

Page 26: Personal bi to personal data science

Personal Data Science

2) Get Data1) Problem statement

Page 27: Personal bi to personal data science
Page 28: Personal bi to personal data science
Page 29: Personal bi to personal data science
Page 30: Personal bi to personal data science

Personal Data Science

2) Get Data3) Enforce Data Quality

1) Problem statement

Page 31: Personal bi to personal data science
Page 32: Personal bi to personal data science
Page 33: Personal bi to personal data science
Page 34: Personal bi to personal data science
Page 35: Personal bi to personal data science
Page 36: Personal bi to personal data science
Page 37: Personal bi to personal data science
Page 38: Personal bi to personal data science
Page 39: Personal bi to personal data science
Page 40: Personal bi to personal data science
Page 41: Personal bi to personal data science
Page 42: Personal bi to personal data science

Personal Data Science

2) Get Data

4) Exploratory Data Analysis3) Enforce Data Quality

1) Problem statement

Page 43: Personal bi to personal data science
Page 44: Personal bi to personal data science
Page 45: Personal bi to personal data science
Page 46: Personal bi to personal data science
Page 47: Personal bi to personal data science
Page 48: Personal bi to personal data science
Page 49: Personal bi to personal data science
Page 50: Personal bi to personal data science
Page 51: Personal bi to personal data science

Personal Data Science

2) Get Data

5) Feature engineering4) Exploratory Data Analysis3) Enforce Data Quality

1) Problem statement

Page 52: Personal bi to personal data science
Page 53: Personal bi to personal data science
Page 54: Personal bi to personal data science
Page 55: Personal bi to personal data science
Page 56: Personal bi to personal data science
Page 57: Personal bi to personal data science
Page 58: Personal bi to personal data science
Page 59: Personal bi to personal data science
Page 60: Personal bi to personal data science
Page 61: Personal bi to personal data science
Page 62: Personal bi to personal data science
Page 63: Personal bi to personal data science

?

Page 64: Personal bi to personal data science

Personal Data Science

2) Get Data

5) Feature engineering4) Exploratory Data Analysis3) Enforce Data Quality

1) Problem statement

6) Form hypotheses

Page 65: Personal bi to personal data science

Patterns per station

Page 66: Personal bi to personal data science
Page 67: Personal bi to personal data science

Pattern similarity between stations

Page 68: Personal bi to personal data science

Pattern similarity between stations

Page 69: Personal bi to personal data science

Personal Data Science

2) Get Data

5) Feature engineering4) Exploratory Data Analysis3) Enforce Data Quality

1) Problem statement

6) Form hypotheses7) Machine Learning

Page 70: Personal bi to personal data science
Page 71: Personal bi to personal data science

Takeaway

1) BI vs DS2) Personal BI & DS3) Power BI!

Page 72: Personal bi to personal data science
Page 74: Personal bi to personal data science

https://app.powerbi.com/visuals

Gallery• Made for the Community

by the Community• Use in Power BI

Desktop or online at Power BI.com

• Create new custom visual with Developer Tools

Page 75: Personal bi to personal data science

Gallery

Page 76: Personal bi to personal data science

Questions?

Page 77: Personal bi to personal data science

Thank You!

Page 78: Personal bi to personal data science