Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux...
Transcript of Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux...
![Page 1: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/1.jpg)
SevenDeadlySinsofBigData
RichardDeVeauxWilliamsCollege
FTCOctober5,2017
1
![Page 2: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/2.jpg)
TheOriginalSevenSins
• Lust• Gluttony• Greed• Sloth• Wrath• Envy• Pride
ThankstoEwan’sCorner,SourceUnknown
2
![Page 3: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/3.jpg)
WhatisBigData?
3
![Page 4: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/4.jpg)
HowBigIsBig?
4
![Page 5: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/5.jpg)
WhatmakesBigdataBig?
5
![Page 6: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/6.jpg)
OriginsofBigData
6
![Page 7: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/7.jpg)
Whatisitreally?
7
![Page 8: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/8.jpg)
Whatisitreally?
8
![Page 9: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/9.jpg)
Whatisitreally?
So,WhataretheSevenDeadlySinsofBigData?
9
![Page 10: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/10.jpg)
1.FailingtoDefinetheProblem
10
![Page 11: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/11.jpg)
ProductionAnalysis
✦Statisticianstudiespropertiesfor74000recentsamplesfromproduction✦Viscosity✦Maxtemperaturetofailure✦Maxpressuretofailure✦Density✦Loadatfailure✦Stressatfailure
11
![Page 12: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/12.jpg)
12
![Page 13: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/13.jpg)
13
![Page 14: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/14.jpg)
14
![Page 15: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/15.jpg)
ThreeGroups!!!
“Doyouknowwemake3products?”15
![Page 16: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/16.jpg)
NotFullyUnderstandingtheProblem
§Ingot cracking•3935 30,000 lb. Ingots•Up to 25% cracking rate•$30,000 per recast•90 potential explanatory variables
•Water composition (reduced)•Metal composition•Process variables•Other environmental variables
16
![Page 17: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/17.jpg)
Ingots–FirstTree
CountMeanStd Dev
39350.23560.4244
All Rows
CountMeanStd Dev
30050.1590.3661
Alloy (6045,7348,8234,2345,3234)CountMeanStd Dev
9300.4817
0.4999
Alloy (5434,5894,2439)
We know that!! – some alloys are hard to make. That’s why we gave you the data in
the first place.
17
![Page 18: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/18.jpg)
SecondTree
CountMeanStd Dev
3935All Rows
CountMeanStd Dev
30550.16730.3723
MG<3.9
CountMeanStd Dev
8800.47270.4999
MG>=3.9
What do you think is in those alloys?
0.42440.2356
18
![Page 19: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/19.jpg)
OneMoreTime
Oh, that’s funny!-Issac Asimov
§Looks like Chrome (!?)
§Really?
§Did that “solve” the problem?•No, but... experimental design•Enabled us to focus on the important variables
19
![Page 20: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/20.jpg)
MosaicPlot
20
![Page 21: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/21.jpg)
ByHour…To
0.00
0.25
0.50
0.75
1.00
3578910 11 12 13 14 15 16 17 18 19 20 21 22 23 0 1 2Hour
21
![Page 22: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/22.jpg)
2.UnderestimatingDataPreparation
22
![Page 23: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/23.jpg)
DataPreparation
60%to95%ofthetimeisspentpreparingthedata
87.1%ofallstatisticsaremadeup
23
![Page 24: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/24.jpg)
WhyisThisHard?
ªPVAisaphilanthropicorganization,sanctionedbytheUSGovttorepresentthedisabledveterans
ªTheysendout4million“freegifts”,every6weeks- Andhopefordonations
ªDatawereusedfortheKDD1998cup- 200,000donors(100,000training,100,000test)- 479(!)demographicvariables
-Pastgiving,income,ageetcetcetc- Recentcampaign(onlyfortrainingset)
-Didtheygive?(TargetB)
ªWhoshouldgetthecurrentmailing?-What’sacosteffectivestrategy-Howmuchdidtheygive(TargetD)
24
![Page 25: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/25.jpg)
What’sHardExactly?
25
![Page 26: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/26.jpg)
T-Code
26
![Page 27: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/27.jpg)
ZoomofBoxplot
27
![Page 28: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/28.jpg)
Transformation?
28
![Page 29: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/29.jpg)
MaybeCategories?
29
![Page 30: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/30.jpg)
Whatisit,Anyway?T-Code
0 _ 16 DEAN 48 CORPORAL 109 LIC. 1 MR. 17 JUDGE 50 ELDER 111 SA.
1001 MESSRS. 17002 JUDGE & MRS. 56 MAYOR 114 DA. 1002 MR. & MRS. 18 MAJOR 59002 LIEUTENANT & MRS. 116 SR.
2 MRS. 18002 MAJOR & MRS. 62 LORD 117 SRA. 2002 MESDAMES 19 SENATOR 63 CARDINAL 118 SRTA.
3 MISS 20 GOVERNOR 64 FRIEND 120 YOUR MAJESTY 3003 MISSES 21002 SERGEANT & MRS. 65 FRIENDS 122 HIS HIGHNESS
4 DR. 22002 COLNEL & MRS. 68 ARCHDEACON 123 HER HIGHNESS 4002 DR. & MRS. 24 LIEUTENANT 69 CANON 124 COUNT 4004 DOCTORS 26 MONSIGNOR 70 BISHOP 125 LADY
5 MADAME 27 REVEREND 72002 REVEREND & MRS. 126 PRINCE 6 SERGEANT 28 MS. 73 PASTOR 127 PRINCESS 9 RABBI 28028 MSS. 75 ARCHBISHOP 128 CHIEF
10 PROFESSOR 29 BISHOP 85 SPECIALIST 129 BARON 10002 PROFESSOR & MRS. 31 AMBASSADOR 87 PRIVATE 130 SHEIK 10010 PROFESSORS 31002 AMBASSADOR & MRS. 89 SEAMAN 131 PRINCE AND PRINCESS
11 ADMIRAL 33 CANTOR 90 AIRMAN 132 YOUR IMPERIAL MAJESTY11002 ADMIRAL & MRS. 36 BROTHER 91 JUSTICE 135 M. ET MME.
12 GENERAL 37 SIR 92 MR. JUSTICE 210 PROF.12002 GENERAL & MRS. 38 COMMODORE 100 M.
13 COLONEL 40 FATHER 103 MLLE. 13002 COLONEL & MRS. 42 SISTER 104 CHANCELLOR
14 CAPTAIN 43 PRESIDENT 106 REPRESENTATIVE 14002 CAPTAIN & MRS. 44 MASTER 107 SECRETARY
15 COMMANDER 46 MOTHER 108 LT. GOVERNOR 15002 COMMANDER & MRS. 47 CHAPLAIN
Title
30
![Page 31: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/31.jpg)
3.IgnoringWhat’sNotThere
31
![Page 32: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/32.jpg)
DepressionClinicalTrialStudy
• Designedtostudyantidepressantefficacy•MeasuredviaHamiltonRatingScale
• Sideeffects• Sexualdysfunction•Miscsafetyandtolerabilityissues
• 428patients• Twoantidepressants+placebo
32
![Page 33: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/33.jpg)
TheUsualSuspects
33
![Page 34: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/34.jpg)
What’sMissing?
34
![Page 35: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/35.jpg)
NowAutomatic
35
![Page 36: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/36.jpg)
4.FallinginLoveWithYourModels
36
![Page 37: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/37.jpg)
PredictingMalignancy• Breastcancerdatafrommammograms• Errorratesbytrainedradiologistsarenear25%forbothfalsepositivesandfalsenegatives
• Newerequipmentisprohibitivelyexpensiveforthedevelopingworld• Earlydetectionofbreastcanceriscrucial• CumulativetypeIerroroveradecadeisnear100%leadingto
needlessbiopsies• Treesdidevenworsethanradiologists
37
![Page 38: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/38.jpg)
CombiningModels• Bagging(BootstrapAggregation)• Bootstrapadatasetrepeatedly• Takemanyversionsofsamemodel(e.g.tree)
• RandomForestVariation
• Formacommitteeofmodels• Takemajorityruleofpredictions
• Boosting• Createrepeatedsamplesofweighteddata• Weightsbasedonmisclassification• Combinebymajorityrule,orlinearcombinationofpredictions
38
![Page 39: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/39.jpg)
RandomForestWins
False Positives False NegativesSimple Tree 32.20% 33.70%Neural Network 25.50% 31.70%Boosted Trees 24.90% 32.50%Boostrap Forest 19.30% 28.80%Radiologists 22.40% 35.80%
39
![Page 40: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/40.jpg)
5.UsingBadData
40
![Page 41: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/41.jpg)
WhereDoTheyComeFrom?
✦TheTimesofLondonreports63.2kgbat• Themysteriousmovingdecimal
✦40%ofdoctorsbornonVeteran’sDay1911• DataEntry
✦MarsLanderlost--$125M• Confusionofaccelerationunits(metric–newtons/secvs.Englishpound/sec)Everywhere
✦OvarianCancercurepublishedinLancet• Differencesduetolabpractice,nottreatment
41
![Page 42: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/42.jpg)
DataQuality
42
![Page 43: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/43.jpg)
DataQuality
43
![Page 44: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/44.jpg)
DataQuality
44
![Page 45: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/45.jpg)
WhatCanTheyDo?
✦StudybyLargeCreditCardIssuer
✦Entireeffectwasduetoonecustomerwhocharged$3M
45
![Page 46: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/46.jpg)
6.ConfusingCorrelationandCausation
PCMI2016 7/1/201646
![Page 47: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/47.jpg)
PoorGeorgeGeorgeBox
“Allmodelsarewrong,butsomeareuseful”
PeterNorvig “Allmodelsarewrong,andincreasinglyyoucansucceedwithoutthem.”
Really?
ChrisAnderson “Withenoughdata,thenumbersspeakforthemselves”
47
![Page 48: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/48.jpg)
TheEndofScience
48
![Page 49: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/49.jpg)
Didyouknow?
• Shorter men have greater risk of heart attack
49
![Page 50: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/50.jpg)
Didyouknow?• Who is more likely to have a heart attack in 10 yrs?
50
![Page 51: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/51.jpg)
Didyouknow?• High popsicle sales are strongly correlated with shark
51
![Page 52: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/52.jpg)
• People who believe in alien abductions prefer Pepsi to Coke
Didyouknow?
52
![Page 53: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/53.jpg)
7.NotTakingYourAnti-Hubristines
53
![Page 54: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/54.jpg)
DataScience
54
![Page 55: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/55.jpg)
Or?
55
![Page 56: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/56.jpg)
GooglePredictsFluBeforeCDC!!
56
![Page 57: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/57.jpg)
Or…DidThey?
57
![Page 58: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/58.jpg)
TheSevenVirtues
✦DefinetheProblem✦PreparetheData• UseDomainKnowledge
✦BeOpentoNewMethodsandModels✦BeAwareofMissingData✦EnsureDataQualityandEthicalUseofData✦UseModels,notjustAssociations✦WorkinTeams• AcknowledgelimitstoBigDataAnalysis
58
![Page 59: Seven Deadly Sins - Fall Technical Conference · Seven Deadly Sins of Big Data Richard De Veaux Williams College FTC October 5, 2017 1. The Original Seven Sins ... PCMI 2016 7/1/2016](https://reader031.fdocuments.us/reader031/viewer/2022021718/5b81c2c57f8b9a32738d1d79/html5/thumbnails/59.jpg)
Thankyou!!
59