Post on 09-Dec-2014
description
October 24 - 30 2005 CES/AEA Conference 1
Taking AIM:
Demonstration
Statewide Web-Based Planning, Reporting & Evaluation System
AIMS Copyright 2002 – 2005 University of Arkansas Cooperative Extension Service
October 24 - 30 2005 CES/AEA Conference 2
Taking AIM:
Presenters•Dr. Karen Ballard, Extension Evaluation Specialist
•Mrs. Nina Boston, Director of Information Technology
•Mr. Steve Hall, Computer Specialist
•Mrs. Mary Poling, AIMS Support Manager
October 24 - 30 2005 CES/AEA Conference 3
Taking AIM:
Administrative Vision for AIMS:
• Web-based planning, reporting and evaluation system
• Consolidation of most reporting requirements
• Capacity for on-demand data extraction
October 24 - 30 2005 CES/AEA Conference 4
Taking AIM:
Evaluation is the link between what we PROVIDE & what we EXPECT . . .
Data can answer:
Are we doing the RIGHT things &
WHAT are the RIGHT things?
October 24 - 30 2005 CES/AEA Conference 5
Taking AIM:
Planning -Program POW
-Individual IPOW
Scheduling -Methods & Events
Reporting -Scheduled Events
-General Program Data
-Benchmark Indicators
Evaluation -Inputs & Outputs
-Benchmark & Impact Reports
October 24 - 30 2005 CES/AEA Conference 6
Taking AIM:
Value of the Logic Model for AIMS
• Shows the “chain of events”
• Summarizes the key elements of the program
• Clarifies differences between activities & outcomes
• Signals “what to evaluate”
• Builds consensus around what the program is
October 24 - 30 2005 CES/AEA Conference 7
Taking AIM:
Logic Model: AIMS Design Components:
Program
Investments
-Staff time
-Curricula
-Volunteers
-Salary Costs
Activities
(Methods)
-Products
-Classes
-Training
-Mailings
-Articles
- Participation
LEARNING
-Knowledge
-Awareness
-Skills
-Opinions
-Attitudes
ACTION
-Behavior
-Decisions
-Practice
IMPACT
Ultimate
Benefit =
-Economic
-Policy
-Social
-Environ.
-Health
October 24 - 30 2005 CES/AEA Conference 8
Challenges:
1. Development Time Line 2. Complexity of Organization3. Inconsistent Terminology & Definitions4. Development Team Staffing Resources5. Attitudes of end users6. County computers7. User time required to learn the system8. Enhancements that will need to be made
Taking AIM:
October 24 - 30 2005 CES/AEA Conference 9
Taking AIM:
System Features:
•Individualized plan of work formatted for all Extension programs
•Ability to develop IPOW for any “other” programs
•Scheduled programs automatically posted to Groupwise
October 24 - 30 2005 CES/AEA Conference 10
Taking AIM:
System Features:
•Collection of data on development time, direct & indirect contacts
•Viewable itinerary
•Proxy Access
•Reports can be pulled by end-user as needed
October 24 - 30 2005 CES/AEA Conference 11
Taking AIM:
Evaluation System Capacity:
•Management reports for supervisors
•Ability to view reports by employee, county, district, statewide, or program by month, quarter, and/or year
•Real time access to process evaluation data
October 24 - 30 2005 CES/AEA Conference 12
Taking AIM:
Nina Boston
Director of Information Technology
October 24 - 30 2005 CES/AEA Conference 13
Taking AIM:
Driving Principles•Provide one source for all reporting
•Centralize data management
•Roll out updates more uniformly
October 24 - 30 2005 CES/AEA Conference 14
The previous model was standalone,
linear and inflexible.
October 24 - 30 2005 CES/AEA Conference 15
A separate program captured civil rights data.
October 24 - 30 2005 CES/AEA Conference 16
Taking AIM:
Past Reporting Was Dis
Before AIMS, narrative success stories were e-mailed at the end of the year instead of when they occurred.
jointed
October 24 - 30 2005 CES/AEA Conference 17
Taking AIM:
What did we do right?User support was put at the top
Faculty and staff were at the table together
We began with outputs needed and worked backwards
After rollout, the programmer received only technical calls
October 24 - 30 2005 CES/AEA Conference 18
Taking AIM:
What did we do wrong?AIMS was rolled out in 80 days with no pilot testing
The DEMO web was a late arrival
Checkboxes would have eased benchmark selection
User support team was hired after rollout, not before
October 24 - 30 2005 CES/AEA Conference 19
Taking AIM:
Special Features Faculty are e-mailed each month with entry reminders
When events are planned, appointments post to thefaculty member’s GroupWise calendar
Development team access DEMO directly from AIMS
Reports are dynamically generated for independentretrieval of data
October 24 - 30 2005 CES/AEA Conference 20
Taking AIM:
Growing Pains•Initial home was a production server holding many
other web applications
•The AIMS monthly entry deadline sent traffic soaring
•Constant changes to AIMS the first year affected thestability of the production server
•A dedicated server was purchased in August 2003
October 24 - 30 2005 CES/AEA Conference 21
Taking AIM:
AIMS required behavioral changeThe basic computer skills of faculty were overestimated
[Prior to AIMS, some agents had secretaries print their e-mails and send all responses]
Secretaries previously entered data for agents
Reporting was required at least monthly
October 24 - 30 2005 CES/AEA Conference 22
Taking AIM:
The Future•Professional Development module integrates with
AIMS, our accounting and training systems
•Platform moving to Oracle
•Centra Symposium, Educator and NetworkStreaming are tools to educate and support users
October 24 - 30 2005 CES/AEA Conference 23
Taking AIM:
Specifications•Software
Microsoft Visual Interdev 6.0 Visual FoxPro 6.0
•HardwareGateway 960 Series, dual 2.4GHz
processors2GB memory36GB SCSI hard driveDDS-4 tape drive
AIMS Copyright 2002 – 2005 University of Arkansas Cooperative Extension Service
October 24 - 30 2005 CES/AEA Conference 24
Taking AIM:
Mrs. Mary Poling
AIMS Support Manager
October 24 - 30 2005 CES/AEA Conference 25
Taking AIM:
Shooting for the Bullseye:Planning
Scheduling
Reporting
Results
October 24 - 30 2005 CES/AEA Conference 26
Taking AIM:
Creating Plan of Work
October 24 - 30 2005 CES/AEA Conference 27
Select Food Stamp Nutrition Education (FSNE)
October 24 - 30 2005 CES/AEA Conference 28
Select Goal
October 24 - 30 2005 CES/AEA Conference 29
Staff Days
October 24 - 30 2005 CES/AEA Conference 30
October 24 - 30 2005 CES/AEA Conference 31
Preview IPOW prior tonotifying supervisor
October 24 - 30 2005 CES/AEA Conference 32
Taking AIM:
Scheduling & Reporting
October 24 - 30 2005 CES/AEA Conference 33
Scheduling & Reporting Events
October 24 - 30 2005 CES/AEA Conference 34
October 24 - 30 2005 CES/AEA Conference 35
October 24 - 30 2005 CES/AEA Conference 36
Select School to Report
October 24 - 30 2005 CES/AEA Conference 37
October 24 - 30 2005 CES/AEA Conference 38
October 24 - 30 2005 CES/AEA Conference 39
Select Teachers
October 24 - 30 2005 CES/AEA Conference 40
October 24 - 30 2005 CES/AEA Conference 41
October 24 - 30 2005 CES/AEA Conference 42
October 24 - 30 2005 CES/AEA Conference 43
October 24 - 30 2005 CES/AEA Conference 44
October 24 - 30 2005 CES/AEA Conference 45
Taking AIM:
Retrieving Results
October 24 - 30 2005 CES/AEA Conference 46
Select Program Results
October 24 - 30 2005 CES/AEA Conference 47
October 24 - 30 2005 CES/AEA Conference 48
October 24 - 30 2005 CES/AEA Conference 49
October 24 - 30 2005 CES/AEA Conference 50
October 24 - 30 2005 CES/AEA Conference 51
October 24 - 30 2005 CES/AEA Conference 52
October 24 - 30 2005 CES/AEA Conference 53
October 24 - 30 2005 CES/AEA Conference 54
October 24 - 30 2005 CES/AEA Conference 55
October 24 - 30 2005 CES/AEA Conference 56
October 24 - 30 2005 CES/AEA Conference 57
October 24 - 30 2005 CES/AEA Conference 58
Detail Report by Individual or Unit Name
October 24 - 30 2005 CES/AEA Conference 59
Unit Summary Report
October 24 - 30 2005 CES/AEA Conference 60
October 24 - 30 2005 CES/AEA Conference 61
October 24 - 30 2005 CES/AEA Conference 62
October 24 - 30 2005 CES/AEA Conference 63
October 24 - 30 2005 CES/AEA Conference 64
October 24 - 30 2005 CES/AEA Conference 65
Taking AIM:
Reporting Impacts
October 24 - 30 2005 CES/AEA Conference 66
October 24 - 30 2005 CES/AEA Conference 67
October 24 - 30 2005 CES/AEA Conference 68
October 24 - 30 2005 CES/AEA Conference 69
October 24 - 30 2005 CES/AEA Conference 70
October 24 - 30 2005 CES/AEA Conference 71
October 24 - 30 2005 CES/AEA Conference 72
October 24 - 30 2005 CES/AEA Conference 73
Taking AIM:
October 24 - 30 2005 CES/AEA Conference 74
October 24 - 30 2005 CES/AEA Conference 75
Taking AIM:
October 24 - 30 2005 CES/AEA Conference 76
October 24 - 30 2005 CES/AEA Conference 77
Taking AIM:
Questions?