MDEpiNet: Accomplishments and Capabilitiesmdepinet.org/wp-content/uploads/01-Marinac-Dabic... ·...
Transcript of MDEpiNet: Accomplishments and Capabilitiesmdepinet.org/wp-content/uploads/01-Marinac-Dabic... ·...
MDEpiNet:AccomplishmentsandCapabilities
DanicaMarinac-Dabic,MD,PhD,MMSc,FISPE
Director,DivisionofEpidemiology,CDRH/FDAOnBehalfofMDEpiNet
2
Summary• BriefMDEpiNet history/inthecontextofFDAvisionforthenationalsystem
• ScalableDomains• ExamplesofPartnerships/Capabilities:AStrategiclook
3
2010 2011 2012 2013 2014 2015 2016 2017
MDEpiNetLaunch
InternationalConsortia(e.g.ICOR,ICCR)
Reports:• Planning
Board• MDEpiNet
RegistryTaskForce
• IMDRF
MDEpiNetMethodologyCenteratHarvard
MDEpNetScienceandInfrastructureCenteratCornell
MDEpiNetPartnershipCoordinatingCenteratDuke
Developandtestdrivenovelmethodsandscientificinfrastructurefordeviceevidencegenerationsynthesisandappraisalnationallyandinternationally
THEVISIONFORNATIONALSYSTEMLAUNCHEDFDA4- dayPublicMeetingDay1.LaunchofFDAstrategyDay2.MDEpiNetAnnualDays3-4.Registries
4
MDEpiNet– QuickFacts• Over130partneringpublicandprivatesectororganizationsfromthedevice
ecosystemglobally(academia,professionalassociations,registries,industry,patientorganizations,healthsystemsandmore);
• Over100national/regionalregistriesfrom37countries;• 11NationalCRNsand4InternationalRegistryConsortia;• Over750clinicalexpertsacrossclinicalareas;• Over150methodologists(statisticians,epidemiologists,datascientists,
informaticians,healthcareresearchersandmore);• NationalandStateclaimsdata(e.g.CMS,NYSPARCS)• NationalandInternationalEHRs(e.g.PCORNet,Sentinel,VA,UK,Australia)• IntegratedHealthCareDeliverySystems(e.g.Kaiser)• Over60demonstrationprojectsincludingprojectswithPCORNetand
Sentinel• HighPerformanceIntegratedVirtualEnvironment(HIVE)collaborativespace
withpetabytesstoragespaceandanalyticaltools
Accesstoover30millionpatient/deviceencountersinregistries
Accesstohundredsofmillionsofclaimsrecords
www.fda.gov
6
GlobalMDEpiNet
FutureMDEpiNetChapter
AcademicCenters
DataSources
ExistingMDEpiNetChapter
7
RegistryDevelopmentNational/InternationalConsortiaDevelopment
ElectronicDeviceDataCapture(UDI)TaskForce-CoordinatedRegistryNetworks(CRNs)
PASSIONInitiative
ActiveSurveillanceComparativeEffectiveness
EvidenceSynthesisClaimsValidation
LinkagewithotherDataSourcesBigDataAnalytics
TranslationalEpidemiology
AugmentingRegistrieswithPROsandExplantAnalysisforPrecisionMedicine
AssessingMinimallyImportantDifference(MID)forimplantsPatientandFamilyEngagementCommittee
Patient-ledDevice/DiseaseSpecificRoundTable
Infrastructure
Methods
PatientEngagement
MDEpiNetWorkStreams
8
ScalableDomainsofMDEpiNet
Tools
Infrastructure
Methodology
Partnerships
9
Tools
10
DataExtractionandLongitudinalTrackAnalysis(DELTA)
• DELTAsoftwarewasproducedbycollaborativeworkandsupportfromFDA,NLM,HarvardandLeahyatTufts.
• ItwasfirstvalidatedonoutcomesandclinicaltrialdatabasesandshowntoefficientlyidentifyverylowfrequencyeventsutilizinganarrayofBayesianandfrequentistinferencemethods.
• Itnowsupportsmultiplesimultaneousanalyses,trackingtheaccumulatingexperienceofmultipledevices,whilemonitoringmultipleindependentdatasetssimultaneously.
• Scalabilitydemonstratedthroughseriesofretrospectivethenprospectivestudies:
a. HealthCareSystemLevel- includingPartnersHealthcareinBostonb. Statelevel– includingMAAngioplastyRegistrysiteslinkedto
MassachusettsinpatientClaimsDB,andMAVitalStatisticsc. Nationallevel– NCDRCathPCIregistry(e.g.vascularclosuredevices).• BytheendoftheyearitisexpectedtobeinstalledinICDregistryandTVT
registry• Earlierthisyear– DELTAbecameanopensourceavailabletoall
stakeholdersatnocost.
11
UDIasaKeyComponentofMDEpiNetMethodologyWork
RAPIDRegistryAssessmentofPeripheral
InterventionalDeviceshttp://mdepinet.org/rapid/
BUILDBuildingUDIIntoLongitudinalDataSetsforMedicalDeviceEvaluation
CARDIOVASCULARDEVICESSeehttp://mdepinet.org/build/
UDI– partofRealWorldData
UseDItopulldatafromGUDIDandauto-populatefields
12
maxi-HIVE
location: White Oak /CDRH HPCstorage: ~2 Petabytescpu:3000 cores, extensible to 5000wan : 10Gb Þ Internet2lan: 40Gb Þ Infinibandplatform: metal + SunGrid
goal: ATO approved regulatory next-gen support platform for long term storage and large scale computations; to support regulatory submissions for NGS and standardization portal for NGS evidence submissions
mini-HIVE
location: White Oak/CBER server roomstorage: ~1 Petabytescpu: ~1500 coreswan: 10Gblan: 56 GBplatform: barebone metal
goal: research and scientific NGS portal with cutting edge production quality tools
Public HIVE as MDEpiNet Resource
Public-elastic HIVE
location: ColonialOne/Ashburn datacenterstorage: extensible to Petabytescpu:+1000 coreswan : 10Gb Þ Internet2lan: 10Gb Þ Infinibandplatform: Lustre open source
goal: to become extensibility platform for public HIVE users for their large scale computational needs for large clinical research projects.
Public-HIVE
location: GWU Dr Mazumder’s labstorage: ~300 Terabytescpu: ~400 coreswan: 1Gblan: 10 GBplatform: metal
goal: support and integrate wider community of researchers into HIVE process, allow access to cutting edge regulatory complaint tools and standards, perform pilot free projects with academic, industry and government entities to promote and ease the access to novel NGS techniques. To incorporate HIVE into education.
HIVE-ZONElocation: virtual cloudstorage: ~extensiblecpu: ~extensiblewan: ~extensiblelan: ~extensible
goal: support large scale sporadic surge usage patterns for extra large clinical computations through openFDA .gov initaitve for FDA and for openHIVE platform for wider scientific research and education community.
Amazon
HIVE is an ecosystem of hardware/software/expertise allowing developers and users to implement variety of infrastructures/ tools/ visual interfaces manipulate large amount of complex data through sophisticated computational pipelines in this “sandbox” like environment.
13
Methods
14
ExamplesofExpertise• Causalinferencewithhigh-dimensional,complex,observational
data:– Bayesianpropensityscoreusingregularizingpriordistributions– Robust likelihoodapproachesforcomparingmanydevicesviaSuper
Learning– MakingbetteruseofclaimscodesviaBayesianhierarchicalprior
distribution• Meta-analysisofindividualparticipantdataforidentificationof
device-effectheterogeneity andforOPC construction• Devicesurveillancethatincorporateregulatorlossfunctions• HandlingmissingdatainCRNsthatuseadistributedsystem• CommonDataElements(CDE)• Distributedmodels• Andmuchmore!!!
15
Infrastructure
16
• Approachistofacilitateand/orleveragenationalinvestmentsinregistriesandotherrelevantdatasystems(dualpurposing)tocreate‘NationalMedicalDeviceEvaluationSystemonafairlyimmediatebasis,greatlyminimizingthecostordevelopmentresourcesneeded’– Major‘Qualityandsafety’registriesinitiatedbyprofessionalsocieties,
states,healthcaresystems,NIH/AHRQ,other– CMSclaimsincludingPartA,B,C,D– Commercialclaims– PCORICDRNs– AllpayerStatedatabases– ComprehensiveEHRs
CRNs
Focusistoprovidetimelyinformationondeviceexperiencesfordecisionmakingbypatients,physicians,regulatorsandallotherstakeholders
17
Evolving CRN Portfolio National• OrthoCRN(akaICOR- USA• VascularCRN– VISION• CardiacCRN• NeurologyCRN– DAISI• GastrointestinalCRN– Obesity• SPAREDCRN– Prostateablation• RoboticSurgeryCRN• TMD/TMJ• VANGUARD• Women’sHealthTechnologies–
UterineFibroids,PelvicFloorDisorders,SterilizationDevices,
• BreastImplants(NBIRpilotunderway)
• AbdominalHerniaCRN
International• InternationalConsortiumOrthopedics
Registries(ICOR)• InternationalConsortiumVascular
Registries(ICVR)• InternationalConsortiumofCardiac
Registries(ICCR)• InternationalCollaborationofBreast
RegistriesActivities(I-COBRA)
18
www.fda.govResearchers
HealthCareProviders
Patients
HospitalsIntegratedDeliverySystems
EHRVendors
Government
ONC
StructuredDataCapture(SDC)
EHRStatesData
Harmonization/Interoperability
DeviceIndustry
Addressecosystemquestionsefficiently
CoordinatedRegistryNetwork(CRNs)aspartofNEST
Registry Registry Registry
19
SelectedDataSources• 10-20yearsofclinicalregistriesdata(national/international)• Hospitaldischargedata• Statedata• Medicare/Medicaiddata• AHRQdatasources• Truvendata• RoPR - Searchablecentrallistingofpatientregistries• GeneExpressionOmnibus(GEO/NCBI)• IngenuityPathwayAnalysis(IPA)• ElectronicMedicalRecordsandGenomicsNetworkatthe• NationalHumanGenomeResearchInstitute(eMERGE/NHGRI)
includingMCRI– MarshfieldClinicResearchInstitute)• Andmore!
20
Partnerships
21
Example1. RAPID/VISION:AScalableFrameworktoEfficientlyConductReal-worldEnabledVascularClinicalTrials
• TwoMDEpiNetprojectsVISION(ledbyCornel)andRAPID(ledbyDuke)werelaunchedtocomplementeachother
• VISION- todevelopNationalVascularImplantsSurveillanceandOutcomesNetworkbylinkingVQIregistrytoclaimsandotherdatasourcesforlongitudinalassessment
• RAPID- todevelopedacoredataelement(CDE)setinformedbymultipleregistries,EHRsystems,andstakeholders.
• LeveragingbotheffortstheSPEEDpilotisnowbeingdesignedtodemonstratehowclinicaltrialssufficienttosupportregulatorydecision-makingcanbeefficientlyimplementedintoexistinghealthcaresystemsforexpandingtheindications
• TheSPEEDtrialthatwillinvolve12600patientsfromtheVQIregistrywith(estimated4200prospectiveand8400retrospectivepatientsdataand2940patientswith1yearfollow-updataavailablefordevelopingObjectivePerformanceCriteria– OPCs
• TheprojectsleveragetheGUDIDDatabasetoenablecomparativeeffectivenessresearchofperipheralvasculartechnologies.
• ItwillinvolvedatarefinementandanalysestodevelopcontemporaryOPCsusingRWE,datasharingwithindustrystakeholdersforpotentiallabelingmodification(e.g.,longerlesions,heavycalcifiedlesions,diabeticpatients).
• Thenewparadigmisthatindustrywillhaveaccesstotheconglomerateofdataplustheirowndata.Thus,ifpre-specifiedstatisticalplanismetforagivensubgroupanalysispopulationasperexamplesabove,alabelingmodificationcouldberequested/granted.
21
22
Example2.GrowthAcrossClinicalAreas
23
Example3.InternationalRegistries• 2011MDEpiNet/ICORregistrylaunchedinorthopedics• 2012-2014– internationaleffortsreplicatedincardiacand
vascularspace- ICCRandICVR• 2014– MDEpiNetproposedtoIMDRFtocreateIMDRF
RegistryWG– andproduceessentialprinciplesdocuments• 2015and2017– ThreeIMDRFregistryprinciplesdocuments
produced(theconceptofinternationalCRN(iCRNs)endorsedbyIMDRFalongwiththeproposedmethodologypilots)
• TheMDEpiNet/ICVRisnowworkingwithmanufacturers,regulatorsandprofessionalassociationstochampionthefirstinternationalpilottoforexpandingtheindicationsforrAAAdeviceswhileapplyingtheprinciplesofIMDRFregistrydocuments
• ThegoalistofinalizetheprotocolbyDecember2017