Dena S. Puskin, Sc.D., Carlos Mena, Monica Cowan and Larry Bryant

Health Resources and Services Admin.Office of Health Information TechnologyOffice for the Advancement of Telehealth

Federal Telehealth Program Performance Evaluation

American Telemedicine Association12th Annual Meeting

May 14, 2007

HRSA - OHITHRSA - OHIT

Associate AdministratorCheryl

Austein Casnoff

Division of HIT Policy Johanna

Barraza Cannon

Office for the Advancement of

Telehealth Dena Puskin

Division of State and Community Assistance

Susan Lumsden

HRSA Administrator

Office for the Advancement of Telehealth (OAT)

NO MATTER WHO YOU ARE OR

WHERE YOU AREYOU GET

THE HEALTH CARE YOU NEEDWHEN YOU NEED IT

What We Will Cover

•OMB Requirements and Data UsesGovernment Performance and Review Act – GPRAProgram Assessment Rating

Tool Data Collection Tool

What is GPRA?Government Performance and Government Performance and

Results Act of 1993Results Act of 1993

• Requires all federal agencies to develop strategic plans

describing their overall goals and objectives

• Requires annual performance reports containing quantifiable measures of their progress in meeting those objectives

Objectives for Measurement System

• Collect uniform, consistent data to allow OAT to measure program performance using web-based tool

• Provide assistance to grantees on data collection to measure the performance

• Overcome “small numbers” problem in telehealth evaluations

Evaluation FrameworkEvaluation Frameworkfor Measurement Systemfor Measurement System

• Establish a priori questions or hypotheses

• Determine Indicators• Establish data

elements

OAT Measures for Program Assessment Rating

Tool (PART)

Telehealth vs. Telemedicine

Telemedicine

Telehealth

HealthProfessionsEducation

Administration

EvaluationResearch

Homeland Security

PublicHealth

ConsumerEducation

RegionalHealth Inform.Sharing

Access to Mental Health Services (Long-term/Annual – Output)

Increase the number of communities that have access to pediatric and adolescent, and adult mental health services where access did not exist in the community prior to the Telehealth Network Grant Program award (TNGP).

Telehealth Chronic Disease Management (Annual – Outcome)

Increase the proportion of diabetic patients enrolled in a telehealth diabetes case management program with ideal glycemic control (defined as hemoglobin A1C at or below 7%) in each year of the three-year grant cycle.

Telehealth Chronic Disease Management cont’d (Long-term – Outcome)

Increase the proportion of diabetic patients enrolled in a telehealth diabetes case management program with ideal glycemic control (defined as hemoglobin A1C at or below 7%).

A “NEW” form has been added to the www.oatdata.org website that will collect three numbers from the Telehealth Network Grant Program Grantees, in order to meet these “Chronic Disease Mgmt.” measures:

(1) Number of individuals served (unique, unduplicated patients) in the 6 month period.

(2) The number of diabetics served in the past 6 months who were getting care through your program for at least 3 months - your chronic disease management diabetic patients

(3) The number of these diabetic patients whose HgA1c is <7% (i.e. whose blood glucose is under control). If you don't serve diabetic patients, you will not need to provide these last two

numbers.

Expand the Number of Telehealth Sites & Services (Annual - Outcome)

Expand the number of telehealth services (e.g., dermatology, cardiology) and the number of sites where services are available as a result of the TNGP program. This is calculated as the cumulative number of services and sites across all grantees in each year of a three-year grant.

Efficiency of Telehealth Sites & Service (Annual)

Expand the number of services and/or sites that provide access to health care as a result of the TNGP program per federal program dollar expended. This will be expressed as the number of services + sites per $1 million program dollars," which is calculated as follows:

Numerator = The number of sites+services provided in each year divided by the Denominator = Annual federal appropriation for the TNGP grants.

Sustainability of Telehealth Programs (Long-term – Output)

The percent of TNGP grantees that continue to offer services after the TNGP funding has ended.

Data Collection PeriodData Collection Period

• Six month reporting periods

• Most recent reporting period: September 1, 2007 – February 28, 2007

• System opened on March 1, 2007 and closing on April 17, 2007.

• Gives a little over 6 weeks to complete process of entering all data.

Instructions   Contact Us    Reports    Sign Out    Instructions   Contact Us    Reports    Sign Out   

                                                              Performance Measurement ToolPerformance Measurement Tool

Current Report Period: 3/1/2006 through 8/31/2006Current Report Period: 3/1/2006 through 8/31/2006

      

                                                    

  

  

Program HomeProgram HomeClick here to view/download the User's GuideClick here to view/download the User's Guide   

Data Collection Period: Data Collection Period:

Click here to configure your sites and specialties for this Click here to configure your sites and specialties for this reporting period.reporting period. CompleteComplete

Data Entry Forms to CompleteData Entry Forms to Complete

1. Volume of Specialties and Services, by Setting1. Volume of Specialties and Services, by Setting CompleteComplete

2. Service Availability in Remote Communities2. Service Availability in Remote Communities CompleteComplete

3. Patient Travel Saved3. Patient Travel Saved CompleteComplete

4. Number of Practitioner Referrals, by Source of Referral4. Number of Practitioner Referrals, by Source of Referral CompleteComplete

7. Other Uses of System7. Other Uses of System CompleteComplete

9. Telehealth Consultants Continuing Participation9. Telehealth Consultants Continuing Participation CompleteComplete

10. Referring Practitioners Continuing Participation10. Referring Practitioners Continuing Participation CompleteComplete

12. Outcome Measures for Chronic Conditions12. Outcome Measures for Chronic Conditions Not StartedNot Started

14. Dermatology14. Dermatology CompleteComplete

15. Patients15. Patients Configuration Not Configuration Not CompleteComplete

Home Computer of the FutureHome Computer of the Future19541954

CONTACT US

Dena Puskin, Sc.D.5600 Fishers LaneRoom 7C-26Rockville, MD 20857Phone: (301) 443-3682Fax: (301) 443-1330 FaxE-Mail: dpuskin@hrsa.gov