EVALUATION OF THE SHAPE THE COMMUNITY SPORT

DEVELOPMENT PROGRAM: A COLLABORATION

Presenters:

Mr. Larry Romany, Trinidad and Tobago Olympic Committee (TTOC)

Ms. Jay Mafukidze, University of Trinidad and Tobago (UTT)

Ms. Jennie Petersen, Trinidad and Tobago Olympic Committee (TTOC) and Commonwealth Games Canada

(CGC)

PRESENTATION OUTLINE Background Information

The Need and the Opportunity Point Fortin as the Pilot Community The SCSD Program

Evaluation of the SCSD Program Collaboration with UTT and CGC Clarification of Program Goals/ Objectives Evaluation Plan Development - Methods Results to Date and Challenges

Next Steps Implications Lessons Learned Long-term Evaluation and Measurement

BACKGROUND: SOME STATISTICS ON T&T

Population: 1.3 Million (Stewart, 2009)

In 2008, there were over 500 murders, massacres and missing personsSignificant proportion of these crimes

committed by youth ages15-18 (Stewart, 2009)

In 2007, there were 14,000 people living with HIV/AIDS (Population Reference Bureau & UNAIDS, 2007)

In the Caribbean, 1 in 10 school-going adolescents have been sexually abused (World Bank, 2003)

BACKGROUND ON SCSD: THE NEED Physical Education in Trinidad and Tobago (T&T)

Structured programming offered on an ad-hoc basis in schools

Prevalence of overweight/obesity in the Caribbean: Increased from 7% in men and 20% in women in the

1970s to 22% in men and 58% in women, in the 1990’s (Alleyne, 2005)

Community Sport Club Structure Development across T&T Limited out of school sports programming available Limited pool of coaching/recreational leader resources

A Vehicle for Community Development Increasing crime rates, teenage pregnancy, poor

academic performance

BACKGROUND: THE OPPORTUNITY

Partnership OpportunityNational Sport OrganizationsSchoolsLocal Community OrganizationsUniversitiesGovernment Bodies

Sponsorship OpportunityAtlantic LNG

TTOC as the Linkage

BACKGROUND: POINT FORTIN AS THE PILOT Small community in

southwest Trinidad

Population: ~19,000

Ten Primary Schools

~3000 primary school students

May be characterized as a ‘high needs’ community, but also a community with many opportunities...

BACKGROUND: THE SCSD PROGRAM

Vision“To develop Community Sport & Recreation by

integrating T&T National Sporting Organizational intellect with community coaches, sport leaders and corporate partners.”

Program start: October 2008

3 sports originally chosen in conjunction with community partnersProgram offered through the schools Initially offered tennis, gymnastics, and

swimming Recently added football and volleyball

BACKGROUND: THE SCSD PROGRAM

Community Coaching StructureTTOC administrators based in Point FortinLocal community members trained as coaches~35 Community Coaches trained to date

Trained by local National Sporting Organizations

EVALUATION OF THE SCSD PROGRAM

A collaboration between the TTOC and the UTTTTOC contracted the UTT for the

evaluation

A collaboration also in association with Commonwealth Games Canada (CGC)A CGC intern working with TTOC

acts as the link between the UTT and the TTOC

CLARIFICATION OF PROGRAM GOALS/ OBJECTIVES

Goal #1 To improve health and well being of school age

children by increasing their opportunities for sport, recreation and physical education.

Goal #2 To provide the local community with a cadre of

certified personnel capable of independently developing and maintaining sport programs in the community.

Goal #3 To enrich community life by developing a community

ethos where sport, recreation and physical education is viewed by all stakeholders as a key component in the development of the economic, social and physical well being of society.

Goal #4To build long-term capacity for sport,

recreation and physical education opportunities in the community by forging working relationships between all stakeholders in the community and establishing linkages across sporting organizations.

Goal #5 Increase awareness of the importance of

sport, recreation and physical education across the broader population of Trinidad and Tobago

CLARIFICATION OF PROGRAM GOALS/ OBJECTIVES

EVALUATION OBJECTIVES

1. To determine the level of success or impact of the SCSD on the community

2. To determine areas for improvement and develop a set of programmatic recommendations for further program developments

3. To determine whether the program was implemented as planned and identify potential areas for improvement

IMPACT EVALUATION PLAN – PHASE 1

Impact on students - individual level outcomes (Goal 1)Pre-post design

Fitness Testing

Anthropometric Measures

Surveys – Most Significant ChangeStudents, Teachers, Parents, Coaches

Student life skills and academic assessment

TimelineMarch to June 2010

IMPACT EVALUATION PLAN – PHASE 2

Impact on community - community level outcomes (Goal’s 2-5)Retrospective design

Surveysteachers, coaches

Focus Groupsteachers, coaches, parents

Individual Interviewsprincipals, National Sporting Organizations

TimelineMarch to July 2010

PROCESS EVALUATION

Purpose1. To determine program implementation

integrity2. To identify potential areas for improvement3. To examine whether standardized processes

are in place to achieve a sustainable program

Data CollectionSubjects

TTOC Administrators, coaches, teachers, National Sporting Organizations

Method Surveys, Focus Groups, Interviews

TimelineMarch to June 2010

PARTICIPATION – 2009/2010 SCHOOL YEAR

School M F Gym. Swim. Ten. Volley Foot.

TOTAL (% of total school

pop.)

AC School 60 65 22 32 27 24 20 125 (23%)

Asja 54 67 25 34 24 33 28 121 (40%)

Egypt 30 12 21 23 0 0 0 42 (18%)Cap-de-

Ville 40 54 1 11 24 33 27 94 (46%)

RC 70 60 3 22 65 23 22 130 (24%)

Salazar 58 32 39 24 17 0 24 90 (74%)Fanny Village 58 55 22 29 25 28 23 113 (35%)Vance River 54 47 25 21 23 25 30 101 (25%)

SDA 44 31 25 29 0 10 32 75 (54%)

Guapo 24 19 0 26 22 0 0 43 (24%)

TOTAL 492 442 183 251 227 176 206 934 (31%)

WHERE ARE WE AT NOW?

Still collecting data!

Pilot testing

The Challenges:Complexities of Large-scale

Programs and Evaluation PlanningCultural ChallengesHuman Resource ChallengesEthics ApprovalOrganizational/ Administrative

Challenges Attendance/ Tracking

LESSONS LEARNED Start evaluation planning when you start

planning your program

Be clear about what you are trying to achieveClear goals and objectives

A Logic Model is a very helpful tool to identify and plan all evaluation processesHelps ensure your program goals/ objectives

and the evaluation goals are aligned

Continually make everyone is on the same page as you plan and conduct your evaluation

LESSONS LEARNED CONTINUED

Conduct an ‘Evaluability’ AssessmentKnow who your key stakeholders, their

prime interest in your program and what they want to know about the impact of the program

Very important to take into consideration of the culture for program AND evaluation planningPlan around cultural festivals/eventsPlan around school schedulesFace to face interactionsLiteracy

PROGRAMMATIC IMPLICATIONS

Impact on the students and on the development of the community

Recommendations for further program developmentsExpansion to other parts of Trinidad and

Tobago Improvements to existing programs in

Point Fortin

Sustainability assessment

BROADER IMPLICATIONS Insight on relations between key

stakeholders in the sporting community and changes as a result of the program

Insight and recommendations for other international sport development programs

Insight on the integration of structured sports/ physical activity programming into the school system

NEXT STEPS: LONG-TERM EVALUATION

Integrated as a regular part of the programRegular data collection

Beginning and end of school yearPotential for long-term study

Evaluation of additional communitiesBeginning September 2010Mayaro, Trincity

ACKNOWLEDGEMENTS

Atlantic LNG

Oasis Water

Commonwealth Games Canada

TTOC Staff and Coaches

UTT Student Testers