Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma...

24
Lies, damned lies and statistics Stewart Adkins Stewart Adkins Advisors Limited/PharmaForensic Ltd

Transcript of Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma...

Page 1: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

Lies,damnedliesandstatistics

StewartAdkinsStewartAdkinsAdvisorsLimited/PharmaForensic Ltd

Page 2: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

ThePharmaIndustryisAwashwithData

1

Page 3: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

Data

DataData Data Data

Data Data

Data

CRMSystem

CRM

ACRMisParticularlyGoodatCollectingData

2

Page 4: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

CRM

ButNotSoGoodatDeliveringUsefulInformation

3

Page 5: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

ThereisaGenuineLackofTalentinDataScience

4

Page 6: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

HittingtheSweetSpotisDifficult

EmploymentSweetSpot

5

Page 7: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

CorrelationandCausationcanbeConfusing

6

Page 8: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

7

Page 9: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

IsPharmaRuledbyDashboardsandKPIs?

8

Page 10: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

Introduction– APeekintoaDisruptiveFuture• Thepharmaceuticalindustryisdatarich(commercialdata)butreluctant(oratleastglaciallyslow)toembraceitsmyriadpossibilities.• Notconfidentinthedataintegrity?• Tooacceptingoflinearrelationshipsbetweenvariables?• Confusescorrelationandcausality?AbigproblemwithBigData.• ToofocusedondashboardsanderroneousKPIs?• Lackingaccesstotalent?

• Makingdataacorecompetencewithintheindustryoffersenormousupside.• Competitiveadvantageforfirstmovers• Bettersalesandmargins• ScopetoreinvestsavingsinR&Dorlowerpricesforsocietalgood.

9

Page 11: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

MakeDataaCoreCompetenceforCompetitiveAdvantage

10

Page 12: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8
Page 13: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

BenefitsofDataasCoreCompetence

• Bettersales• Highermargins• Lessvolatilityinheadcount• HigherMarketValue• Optionality• Cutpricesbutpreservemargins• BoostR&Dbutpreservemargins

11

Page 14: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

ABitofFunwithCorrelation

• Correlationdoesnotimplycausality• Forsomethingtobeshowntobecausal

a) AmustprecedeBb) TheremustbeaplausiblemechanismforAtoleadtoBc) Allotherpossibleorprobablecausesmustbeabletobediscounted.

• Thisrequirescomplextechniquesandgoodqualitydatameasuredovertime.

12

Page 15: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

Correlation:0.992558

CanAnyoneClaimaCausalLink?

13

Page 16: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

Correlation:0.992082

HowAbouttheCausationHere?

14

Page 17: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

“…all modelsarewrongbutsomeareuseful”*

*GeorgeE.P.Box15

Page 18: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

“…all modelsarewrongbutsomeareuseful”*

*GeorgeE.P.Box16

Page 19: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

TheUseofLinearRegressionhereExaggeratestheRelationshipbetweenCallsandSales

17

Page 20: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

What’sWrong?• MostPharmaceuticaldataviolatestheassumptionsthatunderpinlinearregression.• Excelbasedmodelsfrequentlyoverestimateresults.• Thismeansthat• SalespredictionsforROIheavilyoverestimatetheeffectofactivities.• Non-significantactivitiesarereportedassignificant

• Inthisverysimpleexampletheincorrectmodelinflatestheslopebyafactorof9.

18

Page 21: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

Anscombe’s QuartetSoundsaDiscordantNote

19

R2=0.67,Y=3+0.5xForeachdataset!!

Page 22: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

050000100000150000200000250000300000350000400000

MarketCappreandpostadjustmentaftercutting15%ofSG&A

MarketCap$bn Additionalmarketcap=additionalearningsxPEmultiple

TheBenefitsofSmartAnalyticsSavingjust15%ofSG&Acanadd$2-34bnofMarketCap

20

Page 23: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

TheBenefitsofSmartAnalyticsTranslatestoadding4-39%toMarketValue(dependingonPEmultiple)

00.20.40.60.81

1.21.41.6

MarketCapadjustedforSG&Asavingsin%

MarketCap Additionalmarketcap=additionalearningsxPEmultiple

21

Page 24: Lies, damned lies and statistics - · PDF fileLies, damned lies and statistics ... The Pharma Industry is Awash with Data 1. Data Data ... Is Pharma Ruled by Dashboards and KPIs? 8

Conclusion• Analyticscanaddenormousvaluetoacompanyanditscompetitiveposition.• Useofthewrongmodelcanleadtoerroneousconclusionswithexpensiveresults– lostsalesandlowermargins.• ThePharmaceuticalindustryneedstomakeanalyticsacorecompetence• Establishstrongrelationshipswithuniversitiestoencouragemorestudents• Showleadershipinpromotinganalyticsasanexcitingcareerchoiceintegraltothecommercialorganisation.• DemonstratetopayershowlesswastedspendingcanbereinvestedinR&Dorlowerpricesforthebenefitofpatientsandsocietyasawhole.

22