Public 1

MER Structured Dataset Release Notes for Data Entry Close on 8/15/2019

(with pre-cleaning, FY19 Q3 Data)

Contents Summary .....................................................................................................................................................................2

Available FY19 Q3 Datasets ........................................................................................................................................2

Resolved Issues, Known Issues, Updates, and Organization Hierarchy Changes: ......................................................2

Resolved Issues .......................................................................................................................................................2

Known Issues ..........................................................................................................................................................3

Updates: General Announcements ........................................................................................................................4

Updates: Structural Changes ..................................................................................................................................4

Updates: Additional Structural Changes for only the PSNU by IM and Site by IM Reports ...............................5

Organization Hierarchy Changes: ...........................................................................................................................5

Additional Information: ..............................................................................................................................................6

Datasets Cannot be Directly Imported into MS Excel ............................................................................................6

Consistency Checks.....................................................................................................................................................7

Comparison of MER Structured Datasets and Panorama Backend Data ...............................................................7

Comparison of MER Structured Datasets and Final.DATIM ...................................................................................8

Comparison of current MSD and FY2019 Q2 Post-Cleaning Release with updates on 7/11/2019 MER

Structured Datasets. ............................................................................................................................................ 10

Release Package ...................................................................................................................................................... 10

Public 2

Summary The PRIME Systems Team, in collaboration with the ICPI Data Access and Quality (DAQ) Team, is posting the

MER Structured Datasets (MSDs) on PEPFAR Panorama. These datasets will be available with the Panorama

Release on 8/22/2019 at 7:00 PM EST (8/23/2019 at 1:00 AM Johannesburg time). The 8/22/2019 MER

Structured Datasets reflect data from the pre-cleaning, FY19 Q3 data entry period, which closed on August 15th.

These release notes provide high-level descriptions of known issues with the content of the 8/15/2019 MER

Structured Datasets. If there are any differences between the MSDs and other data, these notes will contain

information about them.

This document also includes critical information about the handling of sensitive site names, including DOD-

funded military sites and sites that serve key populations1. Anyone using the Site by IM MER Structured Datasets

should read the Critical Site by IM Nuances section of this document prior to conducting any analyses.

Available FY19 Q3 Datasets Time Period: DATIM FY19 Q3 pre-cleaning data entry close on August 15th, 2019.

Results Included: FY17 - FY19 results

Targets Included: FY17 (COP16) - FY19 (COP18) targets

Historical Data: The FY15-16 datasets are now available.

Datasets now available on Panorama:

Operating Unit (OU) x Implementing Mechanism (IM)

OU x Priority Sub National Units (PSNU)

OU x PSNU x IM (posted both as a single file containing all OUs and as separate files for each OU)

DREAMS PSNU x IM

Site x IM (one dataset for each OU)

MER Nat / SubNat report with PLHIV data for FY15-20

Resolved Issues, Known Issues, Updates, and Organization Hierarchy Changes:

Resolved Issues Prior Issue: In FY19 Q2, DATIM began using the ‘OU Level’ mechanism to collect AGYW_PREV data.

However, data for certain indicators was incorrectly entered against this mechanism for five OUs: India, Tanzania, Kenya, South Africa, and Botswana. This was an issue because the data suggested discrepancies between systems when discrepancies did not exist.

o Resolution: The Data Management Team contacted the affected OUs, all of which requested the

data be deleted from DATIM. The data has been deleted from DATIM, and can no longer be seen

in Panorama, Spotlight, PEPFAR Analytic Workspaces, Genie or MSDs. In some cases, this could

lead to a slight decrease in what users are used to seeing.

Prior Issue: Two OUs had data for semi-annual indicators in the wrong quarter; all semi-annual indicator data should be in Q2.

o Mozambique had data for TB_STAT in 2017 Q1 for mechanism 13583.

1 Detailed descriptions of the Most Complete Age-Sex Disaggragate (MCAD), the StandardizedDisaggregate variable, and calculated indicators have been moved to the MER Structured User’s Guide and Data Dictionary which can be found on Panorama.

Public 3

o Tanzania had data for TB_PREV and TX_TB in 2017 Q3 for mechanisms 14536 and 17986 Resolution: The Data Management Team contacted the affected OUs, all of which

requested the data be deleted from DATIM. The data has been deleted from DATIM,

and can no longer be seen in Panorama, Spotlight, PEPFAR Analytic Workspaces, Genie

or MSDs. In some cases, this could lead to a slight decrease in what users are used to

seeing.

Prior Issue: Nigeria had low-value TB_STAT data incorrectly mapped to MOH mechanism 00100 in 2019 Q1. TB_STAT is a not a MOH indicator.

o Resolution: The Data Management Team contacted Nigeria’s PPM, who requested the data be

deleted from DATIM. The data has been deleted from DATIM, and can no longer be seen in

Panorama, Spotlight, PEPFAR Analytic Workspaces, Genie or MSDs. In some cases, this could

lead to a slight decrease in what users are used to seeing.

o

Prior Issue: Zimbabwe had FY19 Q1 and Q2 results data entered against mechanism 16515. The data should be entered against mechanism 70465.

o Resolution: The FY19 Q1 and Q2 results data entered against mechanism 16515 has been

deleted from DATIM. FY19 Q1 and Q2 results data are now entered against 70465. The data is

now associated with the correct mechanism in Panorama, Spotlight, PEPFAR Analytic

Workspaces, Genie or MSDs.

Known Issues

Issue: Zambia requested a change to FY19 Targets at the site level. The change was made, but these values were not de-duplicated.

o Action: Users of MSDs and Panorama should exercise caution when analyzing Zambia’s FY19

targets. Because this data has not been de-duplicated, the values in the MSDs and Panorama

will be higher than the actual target data.

Expected Resolution: This data will be de-duplicated in the future, most likely in the

FY19 Q3 Data Cleaning period. In this case, the data should be correct (i.e., de-

duplicated) in the MSDs and Genie data by September 27th, 2019.

Issue: Nigeria requested a change to FY19 targets in order to assign them to a new mechanism. However, the import file with the changed data was missing CDC and DOD data. As a result, Nigeria’s FY19 targets are the same values as June 21st, 2019.

o Action: Users of MSDs and Panorama should exercise caution when analyzing Nigeria’s FY19

target data.

Expected Resolution: This data will be updated when Nigeria submits a complete,

updated site tool, most likely in the FY19 Q3 Data Cleaning period. In this case, the data

should be correct the MSDs and Genie data by September 27th, 2019.

Issue: Data without global approval is not included in MER Structured Datasets or Panorama during the following periods for the specified OUs:

o FY 2019 Targets: Papua New Guinea

o FY 2018 Targets: Cameroon, Cote d’Ivoire, Ethiopia, India and Tanzania

Public 4

o FY 2017 Targets: Asia Regional Program, Ghana, South Sudan and Zambia

o FY 2016 Targets: South Sudan

Action: Users of MSDs and Panorama for the following OUs in the given periods should

expect discrepancies between their MSDs and DATIM pivot tables for these OUs during

these periods.

Expected Resolution: The systems team is working with PRIME to review and

approve the target data listed above. The timeline has not been decided.

Issue: The indicator “HRH_STAFF” has been renamed “HRH_STAFF_NAT” in DATIM. The name has not

yet been changed in other systems. However, the data for "HRH_STAFF_NAT" in DATIM is equivalent to

the data for "HRH_STAFF" in the MER Structured Datasets, Genie, and Panorama (including the SIMS

dashboards).

o Action: If you are comparing data for any of these indicators across systems, please be aware

that HRH_STAFF_NAT is currently only available in DATIM, and appears as HRH_STAFF in other

systems.

Expected Resolution: All systems will use the indicator name "HRH_STAFF_NAT" after

the FY2019, Q4 Data Entry Open (10/1/2019)

Updates: General Announcements No actions are required for these changes:

The following calculated indicators have been removed for all periods:

o PMTCT_STAT_KnownatEntry_POSITIVE

o PMTCT_STAT_NewlyIdentified_POSITIVE

o PMTCT_STAT_NewlyIdentified_Negative

There are new derived indicators:

o PMTCT_HEI_POS_ART and PMTCT_HEI_POS_2MO have been added as “Total Numerator” data.

o PMTCT_EID_POS_2MO was collected in DATIM through FY16. Derived data is now available for

this indicator for FY17 - current.

o TX_TB_D_NEG and TX_TB_D_POS have been added as “Total Denominator” data.

The derived data for PMTCT_EID denominator is now calculated for FY17 - current.

The derived data for CXCA_TX denominator has been updated to only data where the CXCA_SCRN

contained "Cervical Cancer - Positive". Any of the values for “Cervical Cancer – Suspected” have been

removed from the CXCA_TX denominator for all time periods.

Please review if you import data using code, an action may be required to handle a change by the September

27th release:

For the FY19 Q3 Clean release on September 27, please note all downloads for the MER Structured

Datasets (MSDs) as well as all downloads from the Genie tool will have all column / field headers as

lowercase.

Updates: Structural Changes Columns Removed: The following columns are no longer included in Genie extracts:

o MechanismUID

Public 5

Reason: field is not used and analysts rely on the Mechanism Code field instead as a

unique identifier.

o use_as_aggregate

Reason: field is not used and not as effective as Total Numerator or Total Denominator

disaggregates.

Columns Added: The following columns were added to the Genie extracts:

o pre_rgnlztn_hq_mech_code

Reason: for COP 2019, Operating Units that are regions will have mechanisms specific to

country level, so old mechanism codes will change as they are moved or split. This

column will include the original code.

o prime_partner_duns

Reason: there was no existing column to capture the Data Universal Numbering System

or DUNS for the business entity for each PEPFAR Implementing Partner. Because the

DUNS is unique for partners, this column will assist in analyzing partner performance.

o award_number

Reason: there was no existing column to capture the partner’s contract award number.

Partners may operating across multiple counties with different mechanisms, but may be

tied through one contract award number. This column will assist in analyzing partner

performance.

o population

Reason: this column is presently populated with key population type (e.g., MSM, TG,

FSW) to allow easy analysis across all indicators that report key populations. In the

future, this column may be used for other population demographics as well.

o hiv_treatment_status

Reason: includes values of “New” or “Already” to clarify whether observations are

newly enrolled on ART or had been previously enrolled

Columns Renamed: The following columns are renamed in the Genie extracts:

o MechanismID becomes mech_code

Reason: this field is more commonly called “mechanism code” in DATIM and Panorama,

so the rename allows for continuity across PEPFAR systems.

o ImplementingMechanismName becomes mech_name

Reason: this field name was very long and the new name should match the other

mechanism-related column headers.

Updates: Additional Structural Changes for only the PSNU by IM and Site by IM Reports

Columns Added: The following column are added to the Genie extracts:

o DREAMS

Reason: this Yes / No (“Y”/”N”) field allows for an easy filter on DREAMS organizations.

In a future release, a DREAMS filter will be added in Genie. Presently, this points to COP

18 DREAMS classifications, and cannot be used for prior DREAMS classifications. It

cannot be used for prior or future DREAMS classifications (i.e., COP 19).

Organization Hierarchy Changes: Cote d’Ivoire: 12 duplicate sites were merged.

Mozambique: 1 duplicate site was merged.

Public 6

Additional Information:

Datasets Cannot be Directly Imported into MS Excel Please note that the OU x IM, PSNU, PSNU x IM and some individual Site by IM datasets include over 1.1 million rows of data and can no longer be directly imported into MS Excel. In order to work around this limitation, there is a folder containing individual PSNU x IM datasets for each OU. These datasets are often small enough to import into Excel following the instructions outlined in the User’s Guide and Data Dictionary. Otherwise, before importing into MS Excel, the OU x IM, PSNU, PSNU x IM and some individual Site by IM datasets will need to be trimmed down by one of several parameters chosen by the user (e.g: “indicator,” “disaggregate,” “fundingagency,” “primepartner,” etc.). Additionally, statistical software can be used to open and manipulate the full MSD datasets. Reference code for

R and SAS is available in the ICPI Data Store.

Public 7

Consistency Checks

Comparison of MER Structured Datasets and Panorama Backend Data The current MER Structured Datasets are consistent with the data displayed in Panorama. The calculations are

made using the same logic and there are no differences.

Comparison of MER Structured Dataset and Panorama, FY2019 (1 of 2)

Comparison of MER Structured Dataset and Panorama, FY2019 (2 of 2)

Public 8

Comparison of MER Structured Datasets and Final.DATIM Differences between the MER Structured Datasets and DATIM are highlighted here for users’ awareness, but no

action is needed. OGAC is in the process of reconciling these differences and will update users when the items

below are resolved.

Nigeria has TX_TB denominator data for FY2019 Q3 even though this should be semi-annual data. DATIM team to investigate. This will be suppressed from Panorama and downstream reporting.

For prior years, the HRH_STAFF data does not compare to DATIM due to the data rename in DATIM to

HRH_STAFF_NAT. This will be resolved after October 1, 2019 in downstream systems.

Comparison of MER Structured Dataset and Final.DATIM (1 of 1)

Data without global approval is not included in MER Structured Datasets or Panorama. Users of MSDs for

the following OUs in the given periods should expect discrepancies between their MSDs and DATIM pivot

tables due to missing global approval:

o FY2019 Targets: Papua New Guinea

Public 9

Comparison of MER Structured Dataset and DATIM

o FY2018 Targets: Cameroon, Cote d’Ivoire, Ethiopia, India and Tanzania

o FY2017 Targets: Asia Regional Program, Ghana, South Sudan and Zambia

Public 10

o FY2016 Targets: South Sudan

Comparison of current MSD and FY2019 Q2 Post-Cleaning Release with updates on 7/11/2019

MER Structured Datasets. We are working with the DATIM team to further investigate Ethiopia 2018 Targets and Namibia for 3 prior

quarters:

HTS_TST 2018 Targets - Ethiopia

VMMC_CIRC 2018 Targets - Ethiopia

HTS_TST 2018 Q3 & Q4 - Namibia

PrEP_NEW 2018 Q3 & Q4 - Namibia

(many indicators) 2019 Q2 - Namibia

OVC_SERV 2019 Q2 - Uganda

Release Package Please login to PEPFAR Panorama to access all of the below locations. The folder name within PEPFAR Panorama

Downloads is listed under “Location” below.

Public 11

Item Description Location

FY17-19 Datasets

The FY17-19 datasets are available from PEPFAR Panorama’s Download location as zip files.

PEPFAR Panorama Folder: “MER FY2019 Q3 Pre-Cleaning”

Historical FY15-16 Datasets

FY15-16 datasets are available from PEPFAR Panorama’s Download location as zip files.

PEPFAR Panorama Folder: “MER FY2019 Q3 Pre-Cleaning”

MER Structured User’s Guide and Data Dictionary

This document provides data analysts: background about the MER Structured Datasets, how to access the data, how to import and use the datasets in Excel, known nuances with frozen instance, and a data dictionary table.

PEPFAR Panorama Folder: “MER FY2019 Q3 Pre-Cleaning”

Data Consistency Check and Release Notes

The excel spreadsheet quantifies any differences between the current MER Structured Dataset (8/15/2019) and the Previous MER Structured Dataset (7/11/2019). This document is also posted to give a high-level description of MER Structured consistency checks, known issues with any content, critical nuances related to the datasets.

PEPFAR Panorama Folder: “MER FY2019 Q3 Pre-Cleaning”

Training Modules

Training modules are still available in the PEPFAR.net ICPI Data Store to show methods for analysis on various aspects of the MER Structured datasets

ICPI Data Store – Training