How to Build a Successful Data Team - Florian Douetteau (@Dataiku)
-
Upload
dataiku -
Category
Technology
-
view
7.272 -
download
3
Transcript of How to Build a Successful Data Team - Florian Douetteau (@Dataiku)
![Page 1: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/1.jpg)
How to build A Successful Data Team
March 2016
![Page 2: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/2.jpg)
Hi ! I’m FLORIAN DOUETTEAU, CEO of Dataiku
x 54 +
x 1+
+ 58++It’s Me !!
It’s our software !!
![Page 3: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/3.jpg)
…and our software is
The most complete Data Science platform
Deployment
![Page 4: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/4.jpg)
Dataiku - Data Tuesday
Meet Hal Alowne
4Big Guys• 10B$+ Revenue• 100M+ customers• 100+ Data Scientist
Hal AlowneBI ManagerDim’s Private Showroom
Hey Hal ! We need a big data platform
like the big guys.Let’s just do as they do!
‟”Average E-commerce Web site
• 100M$ Revenue• 1 Million customer• 1 Data Analyst (Hal Himself)
Dim SumCEO & Founder Dim’s Private Showroom
Big DataCopy Cat Project
![Page 5: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/5.jpg)
5
Technology Disconnect
![Page 6: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/6.jpg)
Welcome to Technoslavia !
6
![Page 7: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/7.jpg)
LOL PLATFORM ANTI-PATTERN
7
Test and Invest in Infrastructure == Skilled Peopleor
Go For Cloud / Packaged Infrastructure
Your Brand New Hadoop Clusteris perceived as slow, not so used and not reliable
![Page 8: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/8.jpg)
TECHNO MISMATCH ANTI-PATTERN
8
Assume Being Polyglotor
Be a Dictator
VS
VS
The PythonClan
The RTribe
The Old ElephantFraternity
The New ElephantClub
![Page 9: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/9.jpg)
PREDICTIVE ANALYTICS DEPLOYMENT STRATEGY
9
Website 2000’ winners
Companies that were able to release fast
"Artificial Intelligence with Data for Internet of Things" 2010’ winners
Companies able to put intelligence in production
?
Design a way to put “PREDITICTIVE MODELS” IN PRODUCTION
![Page 10: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/10.jpg)
10
PEOPLE DISCONNECT
![Page 11: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/11.jpg)
Classic Business Intelligence Team Organization
Business Leader Data Consumer
Line-of-business Data Consumer
Business ProjectSponsor BI Solution Architect
Model Designer
ETL Developer
Dashboard / Report Designer
DBA / IT Data Owner
Specs
![Page 12: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/12.jpg)
Data Science Team Organization
Business Leader Data Consumer
Line-of-business Data Consumer
Business ProjectSponsor Data Team Manager
Data Engineer
Data Analyst
Data System Engineer / Data Architect
Specs
Data Scientist
![Page 13: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/13.jpg)
Built From Scratch
13
Business Leader Data Consumer
Line-of-business Data Consumer
Business ProjectSponsor
DBA / IT Data Owner
Specs
DATA SCIENTISTS EVERYWHERE
![Page 14: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/14.jpg)
Built From Engineering
14
Business Leader Data Consumer
Line-of-business Data Consumer
Business ProjectSponsor
Specs
DATA ENGINEERS
DATA ANALYSTS
![Page 15: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/15.jpg)
Built From Analysts
15
Business Leader Data Consumer
Line-of-business Data Consumer
Business ProjectSponsor
Specs
![Page 16: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/16.jpg)
Manage Expectations
16
Data Plumberer
DataEngineer
Data Scientist
Data Waiter
DataCleaner
DataAnalyst
REALJOB
DREAMJOB
![Page 17: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/17.jpg)
Perfectly Natural Hidden thoughts
17
Business ProjectSponsor
Data Team Manager
Data EngineerData Analyst
Data Scientist
![Page 18: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/18.jpg)
Managing Extreme Personalities
18
Data SCIENTIST
Highly Creative
Passionate
Hard to hire ?
Hard to manage ?
Want to take your job ? Ambitious
![Page 19: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/19.jpg)
Paired for Data
19
Data AnalystDiscover Patterns
Data EngineerMake things work
Fightdata entropy
Entropytech
entropy
![Page 20: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/20.jpg)
When do you prefer ?
20
One AnalystOne EngineerOne Data Scientist That work together ?
Four data scientists
![Page 21: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/21.jpg)
21
Data Disconnect
![Page 22: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/22.jpg)
What is the main reason for data project to fail ?
22
DATA NOT
AVAILABLE
![Page 23: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/23.jpg)
BUT FOR ONLY INCREMENTAL GAIN
0% 25% 50% 75% 100%
50 30 20
Contribution to the overall project performance
Business Goal Definition and Data Feature Engineering Algorithm
![Page 24: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/24.jpg)
How to Get Data if you don’t have it
24
THE GRASSHOPER THE SPIDER THE FOX
![Page 25: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/25.jpg)
![Page 26: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/26.jpg)
The Cicada : Optimistic and Opportunistic Data
26
THE CICADA
As a startup
As a group inside a company
- Build a new product using open data
- Benefit from the data sharing initiative within your company
- Wait for data to be available in your data lake
![Page 27: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/27.jpg)
The Spider: Power of the Network
27
THE SPIDER
As a startup
As a group inside a company
- Create a network of (web trackers | sensors)
- Make it available for free
- Build your service on people’s collected data
- Make a web service available to collect data
- Promote it internally so that people use it
![Page 28: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/28.jpg)
The Fox: Hunt for the Big Money first
28
THE FOX
As a startup
As a group inside a company
- Hunt for a Business Group within a large company with a problem
- Build a SaaS solution using their data
- Replicate to competitors
- Take in a charge a critical problem as per the CEO’s request
- Build your own integrated tech team to solve it
- Use those ressources to reset data services internally
![Page 29: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/29.jpg)
29
PRODUCT DISCONNECT
![Page 30: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/30.jpg)
What is Big Data about ?
30
![Page 31: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/31.jpg)
The Age Of Distributed Intelligence
31
Global, Personalised and Real Time Data Driven Services
![Page 32: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/32.jpg)
32
Data to Visualize or Data to Automate ?
2013 2014 2015 2016 2017 2018
Automated Decision VIsualize To Decide
Moving to a world of automated decision making
![Page 33: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/33.jpg)
Involve product team
33
Product FeaturePersonalised Item Ranking
Product FeatureNotify User Only when Needed
Product Feature:Historical Data For Path Optimisation
Have Product Management Deeply Involved In the Data Team
![Page 34: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/34.jpg)
Where is your added value ?
34
Is the problem at the Core of my Business Process?
Is it a common problem / with share data ?
Go for Best of Breed SAAS
Solution
Can I Solve it on my own ?
Really ?
Build by the data team
Build by the data team ?
Build by the data team
Hire Consultants and Learn
Yes
Yes No
I can’t Ok, I can try
Yes!
No!
No
![Page 35: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/35.jpg)
Be aware of the confort zone
35
MissionCritical
SmallStructured Large
Diverse
Sheer Curiosity
Reporting for Financein Any Industry
Analyze Each Tweet
Web NavigationFor E-Merchant
Ticket DataFor Discountsin Retail
Phone Call Logs for Security
RTB Data For Advertising
Customer Consumption For Anti-Churn in Utilities
Optimization
FilingsFor Fraud in Insurance
Not EnoughData To Learn From ?
Not Enough“Hard" Examples So that you can learn
![Page 36: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/36.jpg)
Create an "API" Culture
36
Do not share• Random Piece of Code• Flat File
Do share• Reproductible documented workflows• Clean, documented APIs
![Page 37: How to Build a Successful Data Team - Florian Douetteau (@Dataiku)](https://reader034.fdocuments.us/reader034/viewer/2022042515/588368671a28ab536b8b5b81/html5/thumbnails/37.jpg)
Food for thoughts www.dataiku.com/blog
Free Data Science Software
www.dataiku.com/dss
THANK YOU !
Data Science Is no longer a science