The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to...

20
Research Triangle Institute RTI International is a trade name of Research Triangle Institute. www.rti.org The Use of Conjoint Analysis to Elicit Patient Preferences in Selecting Treatment Endpoints F. Reed Johnson, PhD Distinguished Fellow and Principal Economist Research Triangle Institute Integrating Stakeholder Preferences in Comparative Effectiveness Research August 27, 2012 1

Transcript of The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to...

Page 1: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

Research Triangle Institute

RTI International is a trade name of Research Triangle Institute. www.rti.org

The Use of Conjoint Analysis to Elicit

Patient Preferences in Selecting

Treatment Endpoints

F. Reed Johnson, PhD Distinguished Fellow and Principal Economist

Research Triangle Institute

Integrating Stakeholder Preferences in

Comparative Effectiveness Research August 27, 2012

1

Page 2: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Comparative Effectiveness Research

Compares the benefits and harms of alternative

interventions

Assists patients, physicians, and regulators to make

informed decisions

Institute of Medicine, 2009

2

Page 3: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Comparisons for whom?

Comparing benefits and harms and making informed

decisions requires identifying relevant endpoints

Increased concern about patient involvement in protocol

development

“When asking the public to assist in determining health

priorities, we should use techniques that allow people to

reveal their true preferences. If not, why bother asking

them at all?” Gafni, Social Science and Medicine, 1995

3

Page 4: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Health-State

Utilities

Standard

Gamble/Time

Tradeoff

EQ-5D Tariffs

QALYs

CEA,

reimbursement

Stated

Preferences

Discrete Choice

Tailored

Preference

Weights, HTE,

MAR, MAB, WTP

CEA, CBA,

licensing,

adherence, clinical

guidelines

Elicitation

Formats

Example

Instruments

Uses

Patient-

Reported

Outcomes

Likert Scale

SF-36

HRQoL Scores

CEA, licensing

Types of Self-Reported Data

Metrics

4

Page 5: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Health-State Utility versus Preference Utility: Determinants

PREFERENCE UTILITY

Clinical Outcomes

Duration

Treatment factors – Side Effects/Tolerability

– Dosage Method/Frequency

– Cost

Process factors

– Health-Care Setting

– Physician interactions

Personal factors

– Age, gender, education, etc.

– Health history

– Financial circumstances

HEALTH-STATE UTILITY

Clinical outcomes

Duration

5

Page 6: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Labels

Conjoint (consider jointly) analysis

Discrete-choice experiments

Stated-choice surveys

6 6

Page 7: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

7

Choice-Experiment Methods

Treatment alternatives consist of combinations of

features.

Preferences among treatment alternatives depend on

the relative importance of features.

Respondents state preferences for series of

constructed, hypothetical treatment alternatives.

Statistical model estimates preference weights

consistent with observed choices.

Preference weights quantify relative importance as the

willingness to accept tradeoffs. 7 7

Page 8: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

page 8

Example Benefit-Risk Tradeoff Question Osteoarthritis

Feature Treatment A Treatment B

PAIN

STIFFNESS

STOMACH PROBLEMS

Occasional mild symptoms.

Treat with over - the - counter medicines

Frequent moderate symptoms.

Treat with a prescription medicine

RISK OF BLEEDING ULCER

1 patient out of

100 (1 %) will

have a bleeding

ulcer

5 patients out of

100 (5 %) will have

a bleeding ulcer

RISK OF HEART ATTACK or STROKE

5 patients out of

100 ( 5 %) will

have a stroke

15 patients out of

100 ( 15 %) will

have a heart attack

No Stiffness Extreme Stiffness

No Stiffness Extreme Stiffness

No Pain Extreme Pain

No Pain Extreme Pain

Eff

ica

cy

Mild

-

Mo

de

rate

Sid

e E

ffects

Se

rio

us

Sid

e-E

ffe

ct

Ris

ks

Which treatment would you choose if these were the only options available?

8

Page 9: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

1.00

0.72

0.0

0.2

0.4

0.6

0.8

1.0

"Best" "Satisfactory" 1/day 2/day

Why are T2DM patients inadherent?

9 9 9

Glucose control

= +0.28

Page 10: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Why are T2DM patients inadherent?

10 10 10

1.00

0.72

0.89

0.28

0.0

0.2

0.4

0.6

0.8

1.0

"Best" "Satisfactory" 1/day 2/day

Glucose control Number of Injections

= +0.28

= -0.61

Hauber AB, Mohamed AF, Johnson FR, Falvey H. Treatment preferences and medication adherence of people

with type 2 diabetes using oral glucose-lowering agents. Diabet Med. 2009;26:416-24.

Page 11: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Physician Versus Patient Preferences Hepatitis B

11

Lescrauwaet B, Mohamed AF, Johnson FR, Hauber AB. Do patients and physicians have similar preferences for health care

decisions involving uncertain outcomes for chronic hepatitis B in Germany and Turkey? Poster presented at the International

Society for Pharmacoeconomics and Outcomes Research 16th Annual International Meeting; May 2011. Baltimore, MD.

Page 12: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Physician Versus Patient Preferences Hepatitis B

12

Lescrauwaet B, Mohamed AF, Johnson FR, Hauber AB. Do patients and physicians have similar preferences for health care decisions involving uncertain

outcomes for chronic hepatitis B in Germany and Turkey? Poster presented at the International Society for Pharmacoeconomics and Outcomes Research

16th Annual International Meeting; May 2011. Baltimore, MD.

Page 13: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Physician Versus Patient Preferences Hepatitis B

13

Lescrauwaet B, Mohamed AF, Johnson FR, Hauber AB. Do patients and physicians have similar preferences for health care decisions involving uncertain

outcomes for chronic hepatitis B in Germany and Turkey? Poster presented at the International Society for Pharmacoeconomics and Outcomes Research

16th Annual International Meeting; May 2011. Baltimore, MD.

Most important Least important

German patients Renal toxicity Weight of evidence

German physicians Efficacy Weight of evidence

Turkish patients Weight of evidence Fracture risk

Turkish physicians Renal toxicity Fracture risk

Page 14: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Maximum Acceptable Risk Calculation Renal Cell Carcinoma

14 Wong MK, Mohamed AF, Hauber AB, Yang J-C, Liu Z, Rogerio J, et al. Patients rank toxicity against progression-free survival in second-line

treatment of advanced renal cell carcinoma. J Med Econ. 2012 Jul 3. doi: 10.3111/13696998.2012.708689. [Epub ahead of print].

Page 15: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Maximum Acceptable Risk Calculation Renal Cell Carcinoma

15 Wong MK, Mohamed AF, Hauber AB, Yang J-C, Liu Z, Rogerio J, et al. Patients rank toxicity against progression-free survival in second-line

treatment of advanced renal cell carcinoma. J Med Econ. 2012 Jul 3. doi: 10.3111/13696998.2012.708689. [Epub ahead of print].

= +0.84

Page 16: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

= 0.84

Maximum Acceptable Risk Calculation Renal Cell Carcinoma

16 Wong MK, Mohamed AF, Hauber AB, Yang J-C, Liu Z, Rogerio J, et al. Patients rank toxicity against progression-free survival in second-line

treatment of advanced renal cell carcinoma. J Med Econ. 2012 Jul 3. doi: 10.3111/13696998.2012.708689. [Epub ahead of print].

= +0.84

Page 17: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Maximum Acceptable Breast-Cancer Risk Vasomotor Symptoms

17

Severe to

no symptoms

Severe to

mild symptoms Severe to

moderate symptoms

0.025

Maxim

um

Accep

tab

le R

isk

0.020

0.015

0.010

0.005

0.000

Absolute Risk

Relative Risk

Johnson FR, Ozdemir S, Hauber AB, Kauf T. Women's willingness to accept risk for perceived vasomotor symptom

relief. J Womens Health. 2007;16(7):1028-40.

Page 18: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Maximum Acceptable Breast-Cancer Risk Vasomotor Symptoms

18

Severe to

no symptoms

Severe to

mild symptoms Severe to

moderate symptoms

WHI Risk

0.025

Maxim

um

Accep

tab

le R

isk

0.020

0.015

0.010

0.005

0.000

Absolute Risk

Relative Risk

Johnson FR, Ozdemir S, Hauber AB, Kauf T. Women's willingness to accept risk for perceived vasomotor symptom

relief. J Womens Health. 2007;16(7):1028-40.

Page 19: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Some Methodological Challenges

Hypothetical bias

– Inexperience with condition

– Socially acceptable responses

– Stated preference/revealed preference experiments

Cognitive challenges

– Effective description of clinical endpoints

– Surrogate markers

– Risk concepts

Consensus among researchers

– Experimental design

– Statistical analysis

19 19

Page 20: The Use of Conjoint Analysis to Elicit Patient Preferences ... · “When asking the public to assist in determining health priorities, we should use techniques that allow people

RTI International Research Triangle Institute

Discussion

Effective incorporation of patient perspectives in protocol

development requires quantification.

Idea of treating patient-preference measures as

evidence is novel for most clinicians.

DCE methods offer methods for quantifying relative

values of health endpoints.

Good validity and reliability for relatively simple trade-off

problems. Applications to more difficult problems is an

active area of research.

20