Assessment Web Applications: Characteristics and Benefits to the
28
Assessment Web Applications: Characteristics and Benefits to the Institutional Effectiveness Process Divya Bhati, Ph.D. Patrice Lancey, Ph.D. Carlos Martinez Office of Operational Excellence and Assessment Support University of Central Florida
Transcript of Assessment Web Applications: Characteristics and Benefits to the
Assessment Web Applications: Characteristics and Benefits to the Institutional
Effectiveness Process
Divya Bhati,Ph.D.PatriceLancey,Ph.D.CarlosMartinez
OfficeofOperationalExcellenceandAssessmentSupport
UniversityofCentralFlorida
Overview UCFInstitutionalEffectivenessassessment
process Modelingthebusinessprocess UCFWebapplication
o Structure&designo Functionalityo Benefitso Challenges
2
University of Central FloridaBasicCarnegieclassification:researchuniversities(highresearchactivity)
UCFalsoachievedCarnegieCommunityEngagementClassification
2ndlargestuniversityinU.S.with56,337students10regionalcampusesandnumerousotherinstructionalsites
12colleges,includingamedicalcollege216degreeprograms(91bachelor’s,92master’s,3specialist,29doctoral,1professional)
UCF’s Integrated Approach to Institutional Effectiveness
4
Linkages• shareinformation• informbudgetprocess
Differences• differentcycles• additionaldataelements• differentpurposes
o continuouso improvemento evaluationo planning
InstitutionalEffectivenessAssessment
UnitandProgramReview
StrategicPlanning
Assessment Leadership
Coordinators
DRCMembers
UAC
ProvostVPsandDeans
President
5
Assessment Scope and Schedule
354programsandunitsreporto Yearroundprocesso Centralizedonlinereportingsystemo OngoingreviewsandfeedbackbyDRC
Over800usersinvolvedinconductingassessmentorganizationchart
September– Coordinatorssubmitfinalresultsandplans
October– DRCsreviewresultsandplans
NovembertoDecember– UACfinalreview
6
Structure and Design of Institutional Effectiveness Assessment Web Application
7
UCF IE Assessment Web Application: Structure and Design
Step1:Understandthebusinessprocesso Identifyextraneousand/orredundantstepso Identifychecksandbalancesneededforregulatory
compliance Step2:Conductactivityanalysis
o Identifytheusersanddifferentlevelsofaccesstothedata
o Identifytheinformationthatwouldhelptheusersdotheirjobeffectively
8
UCF IE Assessment Web Application: Structure and Design
Step3:DevelopRequirementsDocumento Shouldbeasspecificaspossibleo Shouldbeoutlineinaneasytounderstandformato Takeintoconsiderationthelimitationsoftime,
experience,database,programminglanguagetobeused
o Sign‐offfromkeystakeholders,especiallythedevelopers
o Originalflowcharto Finalflowchart
9
UCF IE Assessment Web Application: Structure and Design
Step4:DatabaseDesignandDevelopmento MicrosoftSQL2005(Now2008)o BasedonrelationshipsbetweenDRCs,
program/units,usersandtheirroles AssessmentCoordinators DivisionalReviewCommitteeMembers DivisionalReviewChair AssessmentSupportStaff
o Parameterscollectedfortheassessmentplan/resultsandtheirreviews
o Additionalparameterscollectedforstrategicplanningandaccreditation
10
UCF IE Assessment Web Application: Structure and Design
Step5:ApplicationDesignandDevelopmento MicrosoftASP.net/VB.net2.0Framework(Now3.5)o MasterPagecontainingglobalvariableso BasedonRequirementsDocument UserRolesandSecurity CollectionofAssessmentPlan/ResultsandReviews Validationandverification Additionalparameterscollected Reports Staffmanagementfunctions
11
UCF IE Assessment Web Application: Structure and Design
Step6:Testingo Workflowo Functionalityo Validationofdatao Design,developmentandtesting
Step7:Deploymento Turnovero Documentationo Support
12
UCF IE Assessment Web Application Template
13
UCF IE Assessment Web Application: Structure and Design
14www.assessment.ucf.edu
UCF IE Assessment Web Application: Structure and Design
15
UCF IE Assessment Web Application: Structure and Design
16
17
UCF IE Assessment Web Application:Structure and Design
18
UCF IE Assessment Web Application:Structure and Design
Functionality, Characteristics and Benefits of IE Assessment Web Application
19
UCF IE Assessment Web Application: Functionality
Primarymediumusedto:o submitassessmentplansandresultso reviewandprovidefeedbacko captureuserinformationo monitorprogresso platformforreviewerinterventiontoincreasethequalityofassessmentplansandresults
Abletocopyoverfrompreviousyear’sassessmentplano wholeorcomponentso edit
20
UCF IE Assessment Web Application: Functionality
Provides“n”numberofresultsorplansubmissionsafterreviewandfeedback
Passwordprotectedo usersinvolvedintheassessmentprocessmustlogintouseit
Automatedverificationprocessandfeedbacktotheusero numberofoutcomesandmeasureso academiclearningcompactso implementedandplannedchangeso resultsandreflectivestatemento resultstobesubmittedbeforeplan
21
UCF IE Assessment Web Application: Characteristics
Multi‐raterreviews Collaboration
o automatedemailnotification Reportingandqueries
o UAC,DRCmemberandstaff Documentuseofdataandnextsteps Resourcecenterwithintheapplicationbyrole AdministrationoftheDRCs
o usersandroleso namesoftheunitsandprogramso mergesandsplits
22
UCF IE Assessment Web Application: Characteristics
Easynavigation Helpbuttonforeachtab
o definitionsoftermsandinstructionstocompletethetasks
Enhancedtextbox– cutandpasteandotherMicrosofttoolbarcapabilities
Uploadattachmentslinkedtostudentlearningoutcomes
Archiving Security
o useofbestpracticestopreventattacks
23
UCF IE Assessment Web Application: Benefits
Focusesonassessingwhatis:o meaningfulo manageableo measureable
Assistsuserstoembracechangeasaprocess Trackshealthovertime
o academicprogramorunito collegeordivision
Integratesprocesseso accreditationo strategicplanning
24
UCF IE Assessment Web Application:Benefits
Customizable Transportable Userfriendly Timemanagement ITcompliant Datamining Buildreportsdependingonneed
25
Proposition of Building vs. Buying
Qualityimprovementinrealtimeo Reportsforexternalaccreditationagencieso Loginforexternalrevieweranduniversityofficial
Continuetocustomize Mapstobusinessprocess Flexibilitytoproducereporttodeepenthequalityofwork
Costeffective Responsivenesstoexternalrequests
26
UCF IE Assessment Web Application: Challenges
Realistictimeline Resourcestobuildandmaintain Commitmentofstafftime
o requirementsdocumento testingo helpcontentandinstructions
Iterativerollouto adjustuserexpectations
27
Contact InformationDr.DivyaBhati Dr.PatriceLanceyAssociateDirector [email protected] [email protected]
OperationalExcellenceandAssessmentSupportwww.oeas.ucf.edu
28
