HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc ›...

21
Copyright © 2015, SAS Institute Inc. All rights reserved. HOW TO TURBOCHARGE YOUR MODELING, GO FROM ZERO TO HERO DR MARK CHIA PRACTICE LEAD, ADVANCED ANALYTICS

Transcript of HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc ›...

Page 1: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

HOW TO TURBOCHARGE YOUR MODELING, GO FROM

ZERO TO HERO

DR MARK CHIA

PRACTICE LEAD, ADVANCED ANALYTICS

Page 2: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

OVERVIEW

• Introduction

• Factory Miner

• Summary

• Q & A

Page 3: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

INTRODUCTION

Page 4: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

TODAY THE FUTURE

DA

TA

SIZ

E

ARE YOUR DECISIONS

KEEPING UP WITH

YOUR DATA GROWTH?

Page 5: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

EXTRACTING BUSINESS VALUE FROM THE DATA

Decisions

with

Confidence

• Reduce

Uncertainty

• More Accurate

• More Timely

• Optimize

Page 6: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

• Using ALL the Relevant Data

• Creating More Attributes

• More Models

• More Granular Segments

• More Predictive Machine

Learning Algorithms

• Model Tournaments

• Enable Non-Technical

Users

• Integration

• Embedded Analytics

• Move Insights Closer to

the Decision Maker

• Combine Models with

Business Rules

DECISIONS AT SCALE

Automation

Page 7: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

CREATING EVEN MORE GRANULAR MODELS

Summed customer transactions

Customer type

Community type

Distance

Spend

frequency

Creating a hierarchy of

models, choosing the “best”

model at each level

DATA

Page 8: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

Entire

Customer

Population

New Stable @Risk

RuralMetro

Lives <= 5 mi. retail

store

Lives > 5 mi. retail

store

Spent >= $50

last 6 mo.

Spent < $50

last 6 mo.

Spent >= $100 & < $300 last

12 mo

Spent < $100

last 12 mo.

Spent > $200

last 12 mo.

Spent <= $200

last 12 mo.

Spent >= $300 last 12 mo.

Fico >= 620 Fico < 620

All 17 potential segments are modeled and “the best”

algorithm and prediction level is chosen for each branch.

Now, what if

we want to

do this

analysis by

state?

Creating Even More Granular Models

Page 9: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

850 Potential Models to Evaluate

Page 10: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

FACTORY MINER

Page 11: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

SAS® FACTORY

MINER

Page 12: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

SAS®

FACTORY

MINERAUTOMATED, WHITE BOX MODELING

• Run model tournaments on segments

in your data

• Define as many model process flows as

required

• Test ideas with statistical and machine

learning algorithms in unified environment

• Identify champion model by segment

using customizable assessment statistics

• Identify and fine-tune underperforming

models fast

• Edit any model pipeline in easy to use

interface

Page 13: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

SAS®

FACTORY

MINERSHARABLE BEST PRACTICE PROCESS TEMPLATES

• Sharable projects

• Global data source metadata

• Model templates with building

blocks

• Include variable engineering and

reduction

• Customizable and shareable

• Generate best-practice building

blocks for organizational model

process

Page 14: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

SAS®

FACTORY

MINERMODERN MACHINE LEARNING

• Modern machine learning algorithms

• Decision trees, Random forests, Gradient

boosting, Neural networks, Bayesian

networks,

• Support vector machines, Regression,

Generalized linear models

• Automated data transformation

• Principal component analysis

• Unsupervised and supervised variable

selection

Page 15: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

SAS®

FACTORY

MINERSCALABLE ANALYTICS

• Train models using multithreaded

procedures on SAS servers

• Train models using asynchronous

processes via SAS Grid Manager for

workload balancing and scheduling

• Train models in memory using SAS

High-Performance Data Mining on

database appliance or on Hadoop

• Same user experience from single

machine to SAS grids and In-memory

computing

TERADATA

CLIENT

ORACLE

HADOOP

GREENPLUM

Page 16: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

SUMMARY

Page 17: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

SAS®

FACTORY

MINERMANUAL VERSUS AUTOMATED MACHINE LEARNING

Manual Approaches Automated approach

Productivity 1-10 models per week 100s to 100s models per week allow testing

of more what-if scenarios and higher

confidence in answers

Modeling at scale Need to sample Use all records and all features to identify

optimal driving factors for models

Accurate Small number of iterations limit

confidence in accuracy

Scalable testing capabilities allow for highest

accuracy in acceptable time frame

Self-Service Manual steps through process

required deep analytical skills

Guided self-service approach extends

analytical talent pool

Collaboration Analyst often working in silos Analysts sharing insights, process and best

practices

Easy access Install and maintain software

across large number of desktops

Easy access through web based interface

Page 18: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

EXTEND ORGANIZATIONAL TALENT POOL

Analytics CollaborationData Scientist Superhero

SAS®

FACTORY

MINER

Business Analyst (Citizen Data

Scientist)

Data Miner

Data Scientist

Builds model

workflow templates

Adapts model

workflow templates

Uses model

workflow templates

Page 19: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

!!!???!!!

The ‘IT’ folksThe ‘Analytics’

folks

I just built 850 new

models. When

can you put them

into production?

NOW YOU HAVE LOTS OF MODELS.

WHAT NOW?

Page 20: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

Q & A

Page 21: HOW TO TURBOCHARGE YOUR MODELING, GO … › content › dam › SAS › en_my › doc › sas-forum...Title SAS Forum KL - How to Turbocharge Your Modeling Author Mark Chia Created

Copy r ight © 2015, SAS Insti tute I nc . All r i ghts r eserved.

THANK YOU