First 5 Kings County
description
Transcript of First 5 Kings County
First 5 Kings CountyEvaluation Services Request for ApplicationBidders Teleconference – February 22, 2012
ObjectivesProvide a summary of the
approach First 5 Kings County has chosen to conduct Evaluation Activities
Review components necessary for submission of application
Answer questions from perspective applicants.
The Big Picture
The First 5 Kings County Children and Families Commission is seeking qualified applicants to conduct program specific evaluation of its funding investments. The selected Evaluator will use data collected and corresponding charts established from funded programs and other information to assess the contribution of program outcomes to community-level improvements for young children. The Evaluator will be required to assess the impact of programs and services on targeted groups in Kings County and to make suggestions for program and system improvements.
First 5 Kings County Evaluation Approach
Historical ContextFrom it’s inception until 2009, the
Commission utilized external contractors to complete local evaluation efforts.
In 2009, in an effort to save money, the Commission embarked upon a process meant to establish a peer evaluation System.
First 5 Kings County Evaluation Approach
External Contractors Used CSU Bakersfield – the commission engaged in
a multi-county endeavor for evaluation services across valley First 5 organizations. This contract ended when the lead researcher departed and established an independent research firm.
Pathways and Insights – the commission hired this firm to complete formative evaluation services for Kings County. The contractual relationship ended when the partners within the firm terminated the organization.
First 5 Kings County Evaluation Approach
External Contractors Used Applied Research Center – the commission hired
this firm to complete evaluation services for Kings County. The contractual relationship ended when a competitive RFP was published and UCLA Center for Healthier Children, Families, and Communities was chosen as the successful proposal.
UCLA’s Center for Healthier Children, Families, and Communities – the Commission maintained a relationship with this contractor for 3 years, and has as a result completed evaluations on all major Initiatives/Programs of the Commission. This contractual relationship ended in September 2009.
First 5 Kings County Evaluation Approach
Historical ContextIn 2009, in an effort to save money,
the Commission embarked upon a process meant to establish a peer evaluation System.
First 5 Kings County Evaluation Approach
Peer Evaluation SubcommitteeDetermined evaluation would occur at
the programmatic levelDetermined only programs funded over
$100,000 per year would be evaluatedDetermined that programs would be
evaluated every other year (bi-annually).Determined that programs would be
responsible for data collection and creation of all charts/tables necessary for analysis.
First 5 Kings County Evaluation Approach
Peer Evaluation SubcommitteeUtilized a significant portion of the
existing evaluation framework (as established by UCLA) to develop a plan for future efforts.
Worked with contracted providers to determine what data could be reasonably collected/managed given diminished resourced
Established funding threshold which would trigger evaluation, and timeframe of each evaluation effort.
First 5 Kings County Evaluation Approach
Current ApproachCommission identified the need to
utilize an external evaluator to conduct actual analysis and produce evaluation reports.
First 5 Kings County Evaluation Approach
Expectations for Evaluation Services: Conduct evaluation methodologies that are
based upon goals, results, performance measures and indicators as outlined in the First 5 Kings County Evaluation Plan (Appendix 4).
Act as the Evaluation liaison with funded programs, gathering all necessary information on program implementation and program impact to enable recipients to demonstrate the effectiveness, efficiency, and systemic collaboration of the program to the First 5 Kings County Commission.
First 5 Kings County Evaluation Approach
Expectations for Evaluation Services:Measure program and service performance,
producing an annual evaluation report which includes (but is not limited to) the following:
Outcomes-based accountability that range from formative program evaluation and process improvement, to summative profiles of intended versus actual performance, and result and impact studies.
Provides program costs and benefit measurements with like programs as designated.
Produce at least quarterly progress reports to program personnel and key decision makers.
First 5 Kings County Evaluation Approach
Compensation for Evaluation Services:$25,000 per year for a total of 2 yearsMaximum amount of funding available
not to exceed $50,000.
Application Components
Preparing an ApplicationApplications must be typewritten in a
12 point font on 8 ½ by 11 paper.In order for your application to be
considered, it must supply all of the information requested, in the order requested, in the RFA.
Application Due Date: March 9, 20094:00 p.m.
Application Components
Cover LetterExecutive SummaryNarrativeReferencesSample of Previous Evaluation
Work Product
Application Components
Cover LetterPlease utilize the format presented in
Appendix B of the RFA document.
Application Components
Executive SummaryProvide a one page summary of the
application.
Application Components
NarrativeCan be no longer than 10 pagesMust address each question posed in
the RFA in the order requested. Applicant/Organizational Capacity Evaluation Experience Staffing
Can include additional information, but must be contained within the 10 page limitation.
Application Components
ReferencesPlease provide three references,
include name and telephone number.
Application Components
Sample Work ProductPlease provide written evaluation
report(s) the applicant/organization has completed
Selection Process
Complete applications will be scored by a group of two or more readers.
Applications scoring 70% or higher will be considered for the interview panel.
Selection Process
Application Review CriteriaApplicant/Organization Capacity (25%)Evaluation Experience (50%)Staffing (25%)
Selection Process
Application Interview PanelAn Interview Panel, which may be
comprised of First 5 Kings County Commissioners and/or other panel members as designated, will interview the applicant’s who have met the scoring requirement.
A formal recommendation will be made by the interview panel to the full Commission on April 3, 2012
Selection Process
Contract/Evaluation Activities Begin:Contract to be negotiated in AprilActivities to begin July 1, 2012
Questions?