Agile Data Science

50
@dhianadeva AGILE DATA SCIENCE Agile Tour 2015 - Niterói

Transcript of Agile Data Science

Page 1: Agile Data Science

@dhianadeva

AGILE DATA SCIENCE

Agile Tour 2015 - Niterói

Page 2: Agile Data Science

AGENDA

Goal:

Encourage you to be agile using data science on your project.

● About me● Machine Learning● Similarities● Misconceptions● Non-agile Stories● Agile meets Data Science● Brighter Days

Page 3: Agile Data Science

ABOUT MEElectronics Engineering, Software Development and Data Science… Why not?

Page 4: Agile Data Science

DHIANA DEVA

Page 5: Agile Data Science

NEURALTB

Page 6: Agile Data Science

CERN

Page 7: Agile Data Science

NEURALRINGER

Page 8: Agile Data Science

DJBRAZIL

Page 9: Agile Data Science

DAILY SMALL DATA

Page 10: Agile Data Science

HIGGS CHALLENGE

Page 11: Agile Data Science

HIGGS CHALLENGE

Page 12: Agile Data Science

MACHINE LEARNINGIt's all about learning!

Page 13: Agile Data Science

CLASSIFICATION

?

A

B

Page 14: Agile Data Science

REGRESSION

? 8 15 7 1

11 13 6 3

Page 15: Agile Data Science

CLUSTERING

Page 16: Agile Data Science

DIMENSIONALITY REDUCTION

Page 17: Agile Data Science

SIMILARITIESWe're born to be <3

Page 18: Agile Data Science

LEARNING

Page 19: Agile Data Science

NEURAL NETWORKS

Page 20: Agile Data Science

SELF-ORGANIZING MAPS

Page 21: Agile Data Science

OCCAM'S RAZOR

Among competing hypotheses, the one with the fewest assumptions

should be selected.

Page 22: Agile Data Science

NON-AGILE STORIESWish I knew Martin Fowler back then!

Page 23: Agile Data Science

MEMORY LEAK AT CERN

Page 24: Agile Data Science

CODE AT CERN

Page 25: Agile Data Science

DJBRAZIL?

Page 26: Agile Data Science

MISCONCEPTIONSAgile is not for data science...

Page 27: Agile Data Science

BIG UPFRONT INVESTMENTS

Page 28: Agile Data Science

IT TAKES TOO LONG

Page 29: Agile Data Science

ONLY FOR PHDs

Page 30: Agile Data Science

SILOS

Page 31: Agile Data Science

VANITY METRICS

Page 32: Agile Data Science

HIPPO

Page 33: Agile Data Science

AGILE MEETSDATA SCIENCEAgile and data science: a match made in heaven!

Page 34: Agile Data Science

COLLABORATION

Page 35: Agile Data Science

CONTINUOUS DEVELOPMENT

Page 36: Agile Data Science

STRONG ENGINEERING PRACTICES

Page 37: Agile Data Science

EARLY INSIGHTS

https://www.thoughtworks.com/big-data-analytics

Page 38: Agile Data Science

ACTIONABLE INSIGHTS

https://www.thoughtworks.com/big-data-analytics

Page 39: Agile Data Science

VALUE DRIVEN

https://www.thoughtworks.com/live/2014/europe/different-approaches-to-agile-analytics-and-customer-engagement

Page 40: Agile Data Science

DATA LAKE

http://martinfowler.com/bliki/DataLake.html

Page 41: Agile Data Science

AGILE ANALYTICS

Page 42: Agile Data Science

BRIGHTER DAYSWe're living it!

Page 43: Agile Data Science

MASSIVE ONLINEOPEN COURSES

Page 44: Agile Data Science

OPEN SOURCE TOOLS

Page 45: Agile Data Science

PAY-AS-YOU-GO SERVICES

Page 46: Agile Data Science

A/B TESTING TOOLS

Page 47: Agile Data Science

ANALYTICS TOOLS

Page 48: Agile Data Science

VISUALIZATION TOOLS

Page 49: Agile Data Science

WANT MORE?

Page 50: Agile Data Science

THANK YOUQuestions?

Dhiana Deva

[email protected]