Signal detection in electronic medical records · Signal detection in electronic medical records...

27
Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT WP3 sub-package 10 Feb 19, 2015

Transcript of Signal detection in electronic medical records · Signal detection in electronic medical records...

Page 1: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Signal detection in electronic medical records

PROTECT Symposium

Niklas Norén, PhD

Uppsala Monitoring Centre

On behalf of PROTECT WP3 sub-package 10

Feb 19, 2015

Page 2: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Are we fine-tuning an outdated model?

Page 3: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

14 year old

presented with

elevated anxiety

Page 4: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Are we fine-tuning an outdated model?

Can longitudinal observational data offer an alternative?

Page 5: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Pharmacovigilance

Page 6: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

What would real-world signal detection in electronic medical

records look like and what value can it bring?

Page 7: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

7

!

Statistical signal detection is just the first step!

Page 8: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Recommendation

“Safety signal detection in longitudinal observational data should include clinical, pharmacological, and epidemiological review of identified temporal associations”

Page 9: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

6

Nifedipine Flushing

7 20 x x

Sibutramine Oedema

assessors drugs per assessor

events per drug

Page 10: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Comparator + self-control

Page 11: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

OMOP comparison of methods – Phase I

Page 12: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

820

Preliminary results

Page 13: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

820

311

509

Not relevant terms

38%

Preliminary results

Page 14: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

820

311

509

Not relevant terms

127 Already known

382 38% 25%

76%

Preliminary results

Page 15: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

820

311

509

Not relevant terms

127 Already known

382

291 Dismissed

91

Merit further evaluation

38% 25% 76%

Preliminary results

Page 16: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Skin sensation disturbance with salmeterol

Page 17: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Epiphora with amiloride

Page 18: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

820

311

509

Not relevant terms

127 Already known

382

291 Dismissed

91

Merit further evaluation

38% 25% 76%

Preliminary results

Page 19: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Confounding by underlying disease

Page 20: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Protopathic bias?

Page 21: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Recommendation

“Longitudinal observational data should be further explored as a complement to individual case reports for safety signal detection, but are not in a position to replace individual case reports for this purpose”

Page 22: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT
Page 23: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

65% of the drugs have less than 100 prescriptions in total in THIN

- Not marketed in the UK at the time - Used in secondary care

Page 24: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

Denominators

Longitudinal Data not collected

for causality assessment

Restricted scope ’Objective’

No clinical suspicion

Longitudinal observational data

Page 25: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

14 year old

presented with

elevated anxiety

Page 26: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

14 year old

presented with

elevated anxiety

¨2 days later he devel

Subsequently

He had started

A regimen of 2

Daily for two weeks

Upon withdrawal

14 year old

Causality assessmnt

By the centre suggested

That not only had

But so to had

Page 27: Signal detection in electronic medical records · Signal detection in electronic medical records PROTECT Symposium Niklas Norén, PhD Uppsala Monitoring Centre On behalf of PROTECT

References

1. Edwards IR. What are the real lessons from Vioxx? Drug Safety, 2004. 28(8):651-8.

2. Norén GN, Hopstadius J, Bate A, Star K, Edwards IR. Temporal pattern discovery in longitudinal electronic patient records. Data Mining and Knowledge Discovery, 2010. 20(3):361-387.

3. Norén GN, Hopstadius J, Bate A, Edwards IR. Safety surveillance of longitudinal databases: results on real-world data. Pharmacoepidemiology and Drug Safety 2012; 21(6):673-675.

4. Norén GN, Bergvall T, Ryan P, Juhlin K, Schuemie MJ, Madigan D. Empirical Performance of the Calibrated Self-Controlled Cohort Analysis within Temporal Pattern Discovery: Lessons for Developing a Risk Identification and Analysis System. Drug Safety 2013; 36(S1):107-121.

5. Cederholm S, Hill G, Asiimwe A, Bate A, Bhayat F, Persson Brobert G, Bergvall T, Ansell D, Star K, Norén GN. Structured assessment for prospective identification of safety signals in electronic medical records: evaluation in The Health Improvement Network. Drug Safety, 2015; 38(1):87-100.