Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

31
Prediction in Critical Care Science, Art or Foolishness David Pilcher @Intensive Dave The Alfred Hospital & ANZICS CORE

description

Tools for success. David Pilcher examines the plethora of available tools for outcome prediction in critical care.

Transcript of Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Page 1: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Prediction in Critical CareScience, Art or Foolishness

David Pilcher@Intensive DaveThe Alfred Hospital & ANZICS CORE

Page 2: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Michael

65 yrs

83kg 174cm

Sepsis

Page 3: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

23rd October 1998634 BC

1st January 200021st December 2012

26th April 2026

Predictions are common.

Page 4: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Predictions are common.

Page 5: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

“I do a bit of modelling….”

Predictions are common.

Page 6: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

“I do a bit of modelling….”

Predictions are common.

Page 7: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

Page 8: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

Sen

siti

vity

1- specificity

Binary Outcomes Only

Page 9: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

Sen

siti

vity

1- specificity

Binary Outcomes Only

Page 10: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

Sen

siti

vity

1- specificity

Binary Outcomes Only

Page 11: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

Sen

siti

vity

1- specificity

Binary Outcomes Only

Burns

Page 12: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

Sen

siti

vity

1- specificity

BurnsArea under Receiver Operator

Characteristic = 0.92

Page 13: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

50yrs

+ = 50%40%

Mortality

Sen

siti

vity

1- specificity

BurnsArea under Receiver Operator

Characteristic = 0.92

Page 14: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

50yrs

+ = 50%60%

Mortality

Sen

siti

vity

1- specificity

Area under Receiver Operator

Characteristic = 0.92 Burns

Page 15: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

Sen

siti

vity

1- specificity

0%

5%

10%

15%

20%

Mo

rtal

ity

Year

Predicted Mortality from APACHE III

Observed Mortality

APACHE

Acute Physiology and Chronic Health

Area under Receiver Operator

Characteristic = 0.88

Page 16: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

2%

4%

6%

8%

10%

12%

14%

Year

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

Sen

siti

vity

1- specificity

APACHE III

Observed Mortality

ANZ Risk of Death

Area under Receiver Operator

Characteristic = 0.90

Page 17: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

2%

4%

6%

8%

10%

12%

14%

Year

Discrimination Calibration Validation

0%

20%

40%

60%

80%

100%

0% 20% 40% 60% 80% 100%

Sen

siti

vity

1- specificity

Observed Mortality

ANZ Risk of Death

Area under Receiver Operator

Characteristic = 0.90

ANZROD

Page 18: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Michael

65 yrs

83kg 174cm

Sepsis Is your ICU any good?

Page 19: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Is your ICU any good?

Observed DeathsPredicted Deaths=Standardised

Mortality Ratio

Michael

65 yrs

83kg 174cm

Sepsis

Page 20: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Is your ICU any good?0.0

0.2

0.4

0.6

0.8

1.0

1.2

1.4

1.6

0 200 400 600 800 1000 1200 1400

Number of admissions

More deaths than predicted

Less deaths than predicted

Stan

dar

dis

ed M

ort

alit

y R

atioMichael

65 yrs

83kg 174cm

Sepsis

Page 21: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Is your ICU any good?0.0

0.2

0.4

0.6

0.8

1.0

1.2

1.4

1.6

0 200 400 600 800 1000 1200 1400

Number of admissions

More deaths than predicted

Less deaths than predicted

Stan

dar

dis

ed M

ort

alit

y R

atioMichael

65 yrs

83kg 174cm

Sepsis

Page 22: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

23rd October 1998634 BC

1st January 200021st December 2012

26th April 2026

Predictions are common.

Page 23: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

23rd October 1998634 BC

1st January 200021st December 2012

26th April 2026

Page 24: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

5%

10%

15%

20%

25%

30%

35%

40%

Mo

rtal

ity

Year

Declining Mortality for Sepsis & Septic Shock in ANZ ICUs

Page 25: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

5%

10%

15%

20%

25%

30%

35%

40%

Mo

rtal

ity

Year

Declining Mortality for Sepsis & Septic Shock in ANZ ICUs26th April 2026

Page 26: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

5%

10%

15%

20%

25%

30%

35%

40%

Mo

rtal

ity

Year

Declining Mortality for Sepsis & Septic Shock in ANZ ICUs

Page 27: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

5%

10%

15%

20%

25%

30%

35%

40%

Mo

rtal

ity

Year

Declining Mortality for Sepsis & Septic Shock in ANZ ICUs

Page 28: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

5%

10%

15%

20%

25%

30%

35%

40%

Mo

rtal

ity

Year

Declining Mortality for Sepsis & Septic Shock in ANZ ICUs

Page 29: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

5%

10%

15%

20%

25%

30%

35%

40%

Mo

rtal

ity

Year

Declining Mortality for Sepsis & Septic Shock in ANZ ICUs

Page 30: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

0%

5%

10%

15%

20%

25%

30%

35%

40%

Mo

rtal

ity

Year

Declining Mortality for Sepsis & Septic Shock in ANZ ICUs

Page 31: Pilcher, David — Prediction in Critical Care: Science, Art or Foolishness?

Predictions are important. They tell us where are now and where we could be in the future.

Thank you@IntensiveDave

Calibration ValidationDiscrimination