Needs Assessment: Collecting information, making decisions, and

accomplishing results

Ryan Watkins, Ph.D.George Washington University

Maurya West MeiersWBI Evaluation Group

Presentation to the Knowledge and Learning BoardDec. 11, 2007

2

Needs Assessments Help Us…

Collect useful information that can inform our decisions

Link the results we want to accomplish to our decisions about “what to do”

Consider our alternatives and options Verify that our activities will lead to desired results Create consistency in decision making by

implementing systematic processes

3

Needs Assessments Help Us Avoid…

“What we really need is training on XYZ.” “But that is the way we have always done it

here.” Training that isn’t aligned with World Bank

priorities Solutions in search of problems

Answers that are simple, straightforward, acceptable, understandable… and yet wrong

4

Why Needs Assessment Provides a systematic process to guide

decisions.

Provides justification for decisions before they are made.

It is scalable for any size project, time frame, or budget.

Offers a replicable model that can be applied by novices or experts.

Provides a systemic perspective for decision makers.

Allows for interdisciplinary solutions for complex problems.

5

Many Needs Assessments

Disciplines– Medical (Health) Needs Assessments– Community Needs Assessments– Organizational Needs Assessments– Individual-Decision Needs

Assessments

6

Three Types of Organizational Needs Assessments Strategic Needs Assessment

– Focus on needs of those external to the organizational (e.g., clients, communities, countries)

– Alignment of societal goals with organizational objectives

Tactical Needs Assessments– Focus on organizational performance and contributions– Alignment of organizational objectives with programs and projects

Operational Needs Assessments– Focus on individual or team performance– Alignment of program and projects with individual or team

performance objectives– Guide the development of pragmatic learning plans

7

Needs Assessments and Results Chains

Gap

The Results We Should Be Accomplishing

The Results WeAre Accomplishing

CurrentResults

DesiredResults

Impacts

Outcomes

Activities

Outputs

Inputs

Impacts

Outcomes

Activities

Outputs

Inputs

Gap

Gap

Gap

Gap

Strategic Needs Assessment

Tactical Needs Assessment

Operational Needs Assessment

8

Needs Assessments and Results Chains

Performance Expectations(Individual or Team)

DevelopingLearning Plans

Calendar of Learning Events

Performance Expectations(Organization)

Performance Expectations(Societal)

Impacts

Outcomes

Activities

Outputs

Inputs

Plan

Plan

Plan

Plan

Measure

Measure

Measure

Measure

9

No more starting with…

We need to train them on… You need to buy the latest release of… We need a course on… They need a new attitude about… We really need do be doing…

10

Aren’t we already doing this?

Maybe– Example, “My team should go to training X this year

because they will have to be able to do Y next year.”

Systematic and consistent needs assessments are, nevertheless, better since they…– Systematically align desired results with plans and

activities – Use performance expectations to guide decisions– Examine training and non-training alternatives– Provide consistent processes from manager to

manager

11

Where to Begin

Phases of Needs Assessment Pre-Assessment

– Planning for success Assessment

– Collecting data– Turning data into information

and knowledge Post-Assessment

– Making decisions

12

Continuum of Assessments

Not every needs assessment has to be complex

Scope of the assessment should be based on the scope of the project

Small needs assessment Large needs

assessment

Small Project Large Project

13

Tools for Collecting Information and Making Decisions

Focus Groups - DACUM Focus Groups - Delphi Focus Groups - Nominal Focus Groups – Straw Votes Interviewing Task Analysis Cognitive Task Analysis Card Sorts Tabletop analysis SWOT + Causal Utility Dual-response surveys

Johari WindowConcept mappingFault Tree DiagramsFishbone DiagramsMulti-attribute Utility AnalysisForce Field AnalysisRisk and Resilience AnalysisScenariosSystematic Document ReviewPerformance ObservationGuided Expert Review

14

Performance System

WHAT

WHY WHATHOW

WHAT

RequiredResults

CurrentResults

NeedsAssessments

Analysis PerformanceExamples: Program, Project, Learning Plan,

Learning Activity, Mentor, Recruitment Plan

Objectives

15

Training Sessions: Principles and

Practice

Knowledge Base

Consulting Services & Team Support

Training Sessions: Practical

Application

Needs Assessment Series: Multi-Method Approach

16

Training Sessions

Basics of conducting needs assessment Framework for conducting a needs assessment Aligning needs assessment with program logic Managing the process of needs assessment Multiple strategies for using needs assessment to

accomplish intended results

Principles and Practice

17

Training Sessions

Focus: Practice with data collection and analytical tools for decision-making

– SWOT with Causal Utility Analysis– Dual-Response Surveys– JOHARI Window– Task Analysis– Qualitative Data Analysis

Practical Application

18

Support for Implementation

Materials posted for just-in-time learning Readings: tools and techniques FAQ and Discussion Boards Coming attractions (e.g., sample surveys, question

database, etc.)

Online Knowledge Base

19

Support for Implementation

WBI Evaluation Group team, first stop for advice

Consultant available for advisory services With HRSLB, support to teams on learning

plans

Consulting Services & Team Support