AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent...

25
AI RELOADED - AI APPLICATIONS IN THE INDUSTRY Dr. Christoph Windheuser Global Head of Intelligent Empowerment Berlin, November 1st 2018

Transcript of AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent...

Page 1: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

AI RELOADED - AI APPLICATIONS IN THE INDUSTRYDr. Christoph WindheuserGlobal Head of Intelligent EmpowermentBerlin, November 1st 2018

Page 2: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

6000 technologists with 42 offices in 15 countries

Partner for technology driven business transformation

Page 3: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

SHAPING THE INDUSTRY AS A THOUGHT LEADER

Page 4: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

AI IS ON THE RISE

“About 30 percent of organizations with more than 1,000 employees have adopted AI, and an additional 25 percent plan to adopt the technologies in the next 12 months.”

Spiceworks Survey 2018(https://www.spiceworks.com/press/releases/spiceworks-survey-tech-spending-expected-rise-budgets-stabilize-2018/)

4

Page 5: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

● Empower and augment human intelligence

● Enable machines to work with humans “hand-in-hand”

● Help humans to become more efficient and work with higher quality

● Automate routine work and give humans more time for difficult and strategic work

● “Forklift for the Brain”

INTELLIGENT EMPOWERMENT

Page 6: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

AGENDA

● It is all about data

● What can AI do today?

● Continuous Intelligence

6

Page 7: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

EMPOWER YOUR DATA

7

● ”Data First” is not just another module – but the redesign of the entire IT Data Architecture

● A “Data Lake” is not the solution!

● Data Management and Data Governance are required

Page 8: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

THE DATA-INFORMATION-INSIGHT-ACTION CYCLE

How data flowsthrough your organization

data

informationinsight

decision

action

Page 9: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

data

acquire

THE DATA-INFORMATION-INSIGHT-ACTION CYCLE

Values attributed to parameters

Page 10: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

data

information

acquire

store, clean, manage, featurize

THE DATA-INFORMATION-INSIGHT-ACTION CYCLE

Values attributed to parameters

Data which has a meaning to a recipient, resolves uncertainty

Page 11: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

data

informationinsight

acquire

store, clean, manage, featurize

model

THE DATA-INFORMATION-INSIGHT-ACTION CYCLE

Values attributed to parameters

Data which has a meaning to a recipient, resolves uncertainty

Understandingand forecasting

Page 12: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

data

informationinsight

decision

acquire

store, clean, manage, featurize

model

productionize

THE DATA-INFORMATION-INSIGHT-ACTION CYCLE

Values attributed to parameters

Data which has a meaning to a recipient, resolves uncertainty

Planning and deciding actions

Understandingand forecasting

Page 13: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

data

informationinsight

decision

actionacquire

store, clean, manage, featurize

model

productionize

execute

THE DATA-INFORMATION-INSIGHT-ACTION CYCLE

Values attributed to parameters

Data which has a meaning to a recipient, resolves uncertainty

Planning and deciding actions

Changing the real world

Understandingand forecasting

Page 14: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

AGENDA

● It is all about data

● What can AI do today?

● Continuous Intelligence

14

Page 15: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

NARROW AI IS COMPOSABLE

15

● Today AI is narrow● ML modules

can be composedlike microservices

● The gradient can be back propagated through the different modules (end-to-end learning)

AI Building Block

Example

Regression:Predict a number

● How much will this house sell for?● How many dresses will sell next week in this shop?

Categorization:Predict a category

● Is this customer NEW, LOYAL, FICKLE, …?● What‘s the probability that this transaction is fraud?● Recommend what a client is most likely to buy next

based on his buying history

Recognize and generate sequences formed by rules

● What is the utterance of this sentence?● What is the sentiment of this sentence?● Translate from language A to B

Learn a strategy of actions to reach a goal(Reinforcement Learning)

● Win Atari Games, Chess, Go● Drive a car● Control an air condition to minimize energy

consumption

Page 16: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

Construction: WOOD

EXIF Location

Bedrooms 3

Photo

Price: $1M

Bedrooms:3

Distance to city: 10km

PROJECT EXAMPLE: REAL ESTATE COMPANY (1 / 2)

Page 17: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

Construction: WOOD

Location Distance to city: 10km

Condition:GOOD

Photo

Price: $1.1M

Bedrooms:3

PROJECT EXAMPLE: REAL ESTATE COMPANY (2 / 2)

Page 18: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

18

PROJECT EXAMPLE: CHAT BOT

Word2Vec

LSTM

Page 19: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

AGENDA

● It is all about data

● What can AI do today?

● Continuous Intelligence

19

Page 20: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©2017 ThoughtWorks Inc. Confidential - please do not distribute.

Wikipedia

Principles of Continuous Delivery(*)

● Create a Repeatable, Reliable Process for Releasing Software● Automate Almost Everything● Build Quality In

(*) From Jez Humble, David Farley: Continuous Delivery, Addison-Wesley, 2011

“Continuous delivery (CD) is a software engineering approach in which teams produce software in short cycles, ensuring that the software can be reliably released at any time.”

CONTINUOUS DELIVERY

Page 21: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

©ThoughtWorks 2018

Data Science,Model Building Java Code JAR File

(JVM)

TrainData

Val.Data

Val.Data

ValidationResult 1

ValidationResult 2

IF validation result 1 is equal validation result 2then deploy

equal

IF

Deployment

Java Code JAR File

PROJECT EXAMPLE - PRICE ESTIMATION

Page 22: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

22

PROJECT EXAMPLE - CHATBOT

Page 23: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

● dvc is git porcelain for storing large files using cloud storage

● dvc connects model training steps to create reproducible workflows

23

master

change-max-depth

try-random-forest

model.pkl

decision_tree.pymodel.pkl.dvc

GCP

dvc - data science version control

Page 24: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

24

● We can put data science work into a Continuous Delivery workflow

● Proper data/model versioning tools enable reproducible work to be done in parallel

● Result: Continuous, on-demand AI development and deployment, from research to production, with a single command

● Benefit: production AI systems that are always as smart as your data science team

CONTINUOUS INTELLIGENCE

Page 25: AI APPLICATIONS IN THE INDUSTRY AI RELOADED · 2018-11-12 · AI IS ON THE RISE “About 30 percent of organizations with more than ... Data Architecture A “Data Lake” is not

THANK YOU!Dr. Christoph WindheuserGlobal Head of Intelligent Empowerment