Importance of Data Quality Anova ESI

7/31/2019 Importance of Data Quality Anova ESI

1/36

THE IMPORTANCE OF DATA

QUALITY

Data Symposium

Crowne Plaza, Rosebank21 May 2012

Rentia Voormolen


2/36

Background of ESI Project

Implemented by JSI John Snow Incorporate Funded by USAID

ESI Project Enhancing Strategic Information

To contribute towards reducing the burden ofHIV and AIDS in Southern Africa by enhancingthe use of information for evidence based

decision making


3/36

Content of Presentation

1. Basic principles of Data Quality

2. Using the DHIS to optimise Data Quality

3. DQ pivot tables on Timeliness and

Completeness of data in DHIS


4/36

WHAT IS DATA QUALITY?The REAL world

In the real world, project/program activities areimplemented in the field.These activities aredesigned to produce resultsthat are quantifiable.

Data Management System

An information systeme.g.DHIS, represents theseactivities by collecting theresults that were producedand mapping them to arecording system.

Data Quality: How well the DMS represents the real world

Data

Management

System

RealWorld

?

4


5/36

Accurate, timely and accessiblehealth care

data play a vital role in the planning,

development and maintenance of health care

services.

Quality improvement and the timely

dissemination of quality data are essential if

health authorities wish to maintain health care

at an optimal level

(WHO, 2003).


6/36

WHY IS DATA QUALITY IMPORTANT?

Good Quality RAW data = Good Quality INDICATORS

Evidence that can be trusted enables managers to optimizehealth care coverage, quality and ultimately health status by :

forming accurate pictures of health needs, programs &services in specific areas

informing appropriate planning and decision making

allocating and using resources effectively and efficiently

supporting ongoing monitoring to identify best practices tolearn from and areas where support and correctivemeasures are needed

improve quality of care


7/36

Daily-Collectionduring eachpatient/client

contact

- Validation& sub-totals

Weekly

Interimaggregation &

validation

1st

Validated clinician/service point summarised to facility manager

7thValidated facility summary submitted for capturing

10th

Export of facility captured data sent to next level

15th

Capturing, import, validation & export completed

20th

Districtimport, validation & export completed

30th

Provincial import, validation & export completed

10th of following month

National import, validation & saving on server

Feedback in 5 days

Feedback in 5 days

Feedback in 5 days

Feedback in 5 days

Do the right things right the first time!

Monthly

Data flow timelines:DHMIS Policy

DQWHERE, WHEN & WHO ?


8/36

CRITERIA FOR DATA QUALITY

Validity

Reliability

Integrity

Precision

Timeliness

Correct

Complete

Consistent

Comprehensive

Comparable


9/36

ACCURACY CHECKS raw data

Eyeballing visual scanning

missing data values / gaps

inconsistencies / unlikely values calculation errors

unusual month to month variation / fluctuations

duplication

preferential end-digits

data entered in the wrong box


10/36


11/36

Min / Max out of range Graph


12/36

Colour Coding Values out of range


13/36

Validate in Data Entry


14/36

Data Completeness Report


15/36

Data marked for Checking Report


16/36

Absolute Validation Rules


17/36

Statistical Validation Rules


18/36


19/36

Gap and Outlier Analysis


20/36


21/36

Data Integrity Check


22/36

What does the DHIS data tell us

about Data Quality?Data quality pivot tables

Monitor Timeliness and Completeness of Monthly

DHIS health facility data submitted to NDoH

Developed by ESIAccepted by HIS task team

Currently for internal useTo be incorporated in DHIS Pivot tables forexternal use


23/36

Definitions of timeliness and

completeness

Timeliness is the % of expected health carefacilities that reported into the DHIS database

for the last reporting month (DHMIS policy 60days)

Completeness is the average % of expectedhealth facility reports that were captured intothe DHIS for the last 12 reporting months

PROXY INDICATOR TO MEASURE


24/36

PROXY INDICATOR TO MEASURETIMELINESS AND COMPLETENESS

Indicator: Reporting rate (%) Target 95%

Numerator: Number facilities which

reported/captured data on a specific element

Denominator: Number facilities for whichthis data element is activated for capturinginto the DHIS

P d t l t d t id tif


25/36

Proxy data elements used to identifyfacilities

PHC total HeadcountClinic, CHC, Mobile & Satelite clinics

Delivery in facilityCHC, MOU, District, Regional, Tertiary &Central Hospitals

Usable beds

District, Regional, Tertiary & Central Hospitals


26/36

Ranges used for colour coded pivot

tables

< 70 (69.5) % - Critical

70 (69.5) to 94 (94.4) % -improvement needed

95 (94.5) to 100% - target met


27/36

GP: Hospital Reporting Rates T 95%

Month-Year

Ekurhuleni

MM

Johannesburg

MM

Sedibeng

DM

Tshwane

MM

West

Rand

DM AverageFeb-11 100 100 100 100 100 100

Mar-11 100 100 100 100 100 100

Apr-11 100 100 100 100 100 100

May-11 100 100 100 100 100 100

Jun-11 100 100 100 100 100 100

Jul-11 100 100 100 100 100 100Aug-11 100 100 100 100 100 100

Sep-11 100 100 100 100 100 100

Oct-11 100 100 100 100 100 100

Nov-11 100 100 100 100 100 100

Dec-11 100 100 100 100 100 100

Jan-12 100 100 100 100 100 100

Average 100 100 100 100 100 100

Timeliness reporting rate for the last reporting monthCompleteness average reporting rate for the last 12 reporting months


28/36

GP: PHC Reporting Rates T 95%

Month-Year EkurhuleniMM JohannesburgMM Sedibeng DM Tshwane MM West RandDM Average

Feb-11 97 98 100 96 98 97

Mar-11 95 98 100 96 98 97

Apr-11 95 98 100 96 98 97

May-11 95 98 100 96 98 97

Jun-11 95 98 100 97 98 97

Jul-11 94 98 100 97 98 97

Aug-11 98 98 100 97 98 98

Sep-11 97 96 97 97 96 96

Oct-11 98 98 100 96 98 98

Nov-11 98 98 100 95 98 97

Dec-11 99 96 100 95 98 97

Jan-12 99 96 97 95 98 97

Average 97 97 100 96 98 97


29/36

GP: PHC Reporting Rates - PMTCT

0 10 20 30 40 50 60 70 80 90 100

Antenatal client eligible for HAART

Antenatal client initiated on HAART

Postnatal care mother within 6 days after delivery

Antenatal client initiated on AZT

Antenatal client HIV 1st test positive

Antenatal client CD4 1st test

Antenatal 1st visit before 20 weeks

Cervical smear in woman 30 years and older

Antenatal client HIV 1st test

Antenatal 1st visit

PHC total headcount

PHC Facility reporting rates - selected PMTCTdata elements (Target 95%)


30/36

GP: PHC / District - PMTCT

DataElementName

Ekurhuleni

MM

Johannesburg

MM

Sediben

g DM

Tshwan

e MM

WestRand

DM

Averag

eAntenatal 1st visit 95 96 95 93 97 95

Antenatal 1st visit before 20 weeks 94 94 92 92 93 93

Antenatal client CD4 1st test 94 91 92 85 90 90

Antenatal client eligible for HAART 82 41 68 49 66 59

Antenatal client HIV 1st test 95 95 96 91 97 94

Antenatal client HIV 1st test positive 94 91 91 86 89 90

Antenatal client initiated on AZT 93 90 93 86 88 90

Antenatal client initiated on HAART 78 47 67 58 62 62

Cervical smear in woman 30 yearsand older 92 93 93 94 96 93

Medroxyprogesterone injection 96 98 100 97 100 98

Norethisterone enanthate injection 97 99 100 97 99 98

Oral pill cycle 97 99 100 97 99 98

Postnatal care mother within 6 daysafter delivery 14 80 90 85 74 65

Average 86 87 91 86 88 87


31/36

GP: Hospital Reporting Rates - PMTCT

0 10 20 30 40 50 60 70 80 90 100

Sterilisation - male

IUCD inserted

Maternal death in facilityOral pill cycle

Norethisterone enanthate injection

Medroxyprogesterone injection

Sterilisation - female

Antenatal client on AZT before labour

Termination of Pregnancy performedLive birth to HIV positive woman

Caesarean section in facility

Antenatal client Nevirapine taken during labour

Delivery in facility under 18 years

Delivery in facility

Usable beds - total

Antenatal client on HAART at delivery

Hospital reporting rates - selected PMTCT data elements (Target 95%)


32/36

GP: PHC Reporting Rates - ART

0 10 20 30 40 50 60 70 80 90 100

Children under 15 years remaining on ART at

Adult patients remaining on ART at end of theNew child under 15 years started on ART during

HIV positive child under 15 years eligible for ART

Female condoms distributed

HIV positive adult patient eligible for ART

Adult patient started on ART during this month -

HIV positive new patient started on INH

Suspected TB case smear positive - treatmentSTI partner treated - new

Suspected TB case smear positive

HIV positive new patient started on Co-

Sputum results received within 48 hours

STI treated - new episode

Male condoms distributed

Suspected TB case with sputum sent

PHC total headcount

PHC facility reporting - selected ART data elements (Target 95%)


33/36

GP: PHC / District - ART

DataElementNameEkurhuleni MM

JohannesburgMM

Sedibeng DM

Tshwane MM

WestRandDM Average

Adult patient started on ART during this month - new 89 66 83 74 81 78Adult patients remaining on ART at end of the month - total 0 0 0 0

Children under 15 years remaining on ART at end of themonth - total 0 0 0 0

Female condoms distributed 70 60 64 68 77 67

HIV positive adult patient eligible for ART 87 63 83 71 81 76

HIV positive child under 15 years eligible for ART 30 15 49 27 36 28

HIV positive new patient started on Co-trimoxazoleprophylaxis 85 88 96 84 93 88

HIV positive new patient started on INH prevention therapy 73 77 90 78 90 79

Male condoms distributed 95 97 97 96 98 97

New child under 15 years started on ART during thismonth 29 14 46 25 33 27

Sputum results received within 48 hours 92 96 98 92 96 94

STI partner treated - new 92 84 84 85 86 87STI treated - new episode 93 97 99 97 98 96

Suspected TB case smear positive 90 88 89 85 80 87

Suspected TB case smear positive - treatment start 86 83 85 82 77 83

Suspected TB case with sputum sent 96 97 99 96 98 97

Average 79 76 83 76 81 78


34/36

GP: Hospital Reporting Rates - ART

0 10 20 30 40 50 60 70 80 90 100

HIV positive new patient started on INH prevention

Female condoms distributedSuspected TB case smear positive - treatment start

Sputum results received within 48 hours

STI treated - new episode

HIV positive new patient started on Co-trimoxazole

Male condoms distributed

HIV positive child under 15 years eligible for ART

Suspected TB case smear positive

Suspected TB case with sputum sent

New child under 15 years started on ART during

HIV positive adult patient eligible for ART

Adult patient started on ART during this month - new

Usable beds - total

Adult patients remaining on ART at end of the

Children under 15 years remaining on ART at end

Hospital reporting rates - selected ART elements (Target 95%)


35/36

The best way to

improve Data

Quality is to USEthe data!


36/36

THANK YOU

SIYABONGA

REALEBOGA

BAIE DANKIE.

Importance of Data Quality Anova ESI

Documents

Transcript of Importance of Data Quality Anova ESI