Evaluating behaviour change programs - WasteMINZ · PDF fileEvaluating behaviour change...

Evaluating
behaviour change
programsprograms
Liz Ampt
Concepts of Change

What are we measuring?
- Whether people are
doing things differently
WasteMinz Roundup 2014was WasteMINZ Roundup 2014
doing things differently

How can we measure it?
- Measuring changes in levels of reducing/ reusing/
recycling
- Observing/recording behaviours
- Asking about change
- Each is a form of survey or data collection exercise

SampleDesign
PilotSurvey
Conductof
Selection ofSurvey Method
SurveyInstrument
Design
PreliminaryPlanning
ofSurvey
DataCoding Data
Editing
Data Managementand Analysis
Data Correctionand Expansion
Presentationof Results
Tidying-Up
The survey
process
Richardson, Ampt,
Meyburg 1995

Each is a form of survey Method of measurement Aspects of survey design needed
Measuring changes in levels of
reducing/ reusing/ recycling
- Sample selection
- Pilot
- Survey
- Expansion/weighting
- Analysis
Observing/recording behaviours - Sample selection
- Pilot
- Survey
- Analysis
Asking about change - Sample selection
- Survey design
- Pilot
- Survey
- Analysis

Key elements of survey design
1. Preliminary planning
2. Selection of method
3. Sample design
4. Survey instrument design
5. Pilot
5. Pilot
6. Survey implementation
7. Expansion/weighting
Analysis over to you..

1. Preliminary planning
Define survey objectives
Very specific: what, by whom, over what period, where
Review of existing information
Useful methodologies from elsewhere; use of stated
preference?
preference?
Define terms
From your objectives and from respondents perspective
Survey content
Dot points
7

Exercise
Think of 2 terms you would want to use in a survey
related to your work
Write down clear definitions for both
Ask another person (not from your organisation) to do the
same with your terms
Compare

2. Selection of a Survey Method for Measurement
Observation surveys
Intercept surveys
Self-administered surveys
Telephone surveys
Personal interview surveys
Personal interview surveys
Internet/online surveys
9

Observation methods
Chosen when
Possible to count accurately
Possible to count all or select a representative sample
Can be manual, automatic, video
WasteMinz Roundup 2014was WasteMINZ Roundup 2014 10

Intercept Surveys
Intercepting people
At an activity centre (e.g. workplace, transfer station, shopping centre)
Possible methods
distribution - mail-back/on-line
personal interview
collect phone no.
Always needs a total classification count
11

Intercept Surveys
Advantages
Able to reach specific populations
Can combine with observational counts
Can use multiple survey methods
Disadvantages
Generally low response rates (20-30% for self-completion)
Generally low response rates (20-30% for self-completion)
Hurried conditions
Must allow for non-random sampling
No follow-up possible in most cases
12

Self-administered Surveys
Possible targets
households
activity centres/workplaces/transfer stations
Method of Distribution
mail-out vs. hand delivered
Method of Collection
mail-back vs. hand collection
13

Self-administered Surveys
Advantages
Can get extensive geographical coverage
No interviewer effects
Can obtain considered responses
Hand-collection to good response rate
Disadvantages
Disadvantages
Layout and wording must be clear - hard to design
No probing possible
Answers not independent
Response rates lower than face to face
14

Telephone Interviews
Advantages
Wide geographic coverage
Intermediate costs
Good supervision - CATI
Multilingual capabilities
Computerised

Telephone Interviews
Disadvantages
Sample usually weak
Low phone ownership for some groups
Answer-phones, mobile phones, screening devices
Hard to know how it represents the population
Hard to know how it represents the population
Credibility of interviewer (confusion with telemarketing)
Low response rate
No follow-up for refusals

Personal Interviews
Can be paper or computer
Advantages
Generally higher response rates (60-90%)
Flexibility of information
Presence of interviewer
Maintain interest
Maintain interest
Spontaneous answers

Personal Interview
Disadvantages
High costs
Interviewer influence
personal characteristics
interrupt household/work routine
opinions of interviewers
opinions of interviewers
interpretation of vague answers
Considered response difficult

On-line Surveys
Advantages
Low costs
Can use elaborate visual effects
Can use adaptive techniques (can give different scenarios
for different responses)
Good for workplaces if sufficient follow-up
Good for workplaces if sufficient follow-up
Disadvantages
Usually very biased sample
Low response rate
Hard to get all people in household if needed

Exercise
Think of a behaviour you would like to measure
Discuss with a partner
Best method of collection
Strengths
Weaknesses
Weaknesses

3. Sample Design in the Survey Process
SampleDesign
PilotSurvey
Conductof
Survey
Selection ofSurvey Method
SurveyInstrument
Design
PreliminaryPlanning
DataCoding Data
Editing
Data Managementand Analysis
Data Correctionand Expansion
Presentationof Results
Tidying-Up
Sampling Methods

Preliminary Concepts
What is a sample?
a collection of things which is some part of a larger population and which is selected so as to be representative of some or all of that population
Target Population
who are we trying to survey?
Sampling Units
what are we going to sample?
Sampling Frame
where are we going to get a list of these things?
Sampling Methods

Sampling Frame
a base list to identify the sampling units
should contain all the sampling units
examples,
all households on a street (e.g. Council records)
telephone directories
telephone directories
mailing lists
maps
electoral rolls
blocklists
Sampling Methods

Sampling Frame Problems
inaccuracy
incompleteness
duplication
inadequacy
out-of-date
out-of-date
Must check the reason for which the list was
originally compiled to understand likely deficiencies.
Sampling Methods

Sampling Error & Sampling Bias
Samplin

Evaluating behaviour change programs - WasteMINZ · PDF fileEvaluating behaviour change...

Documents

Transcript of Evaluating behaviour change programs - WasteMINZ · PDF fileEvaluating behaviour change...

Update: AASHTO TP 107 AMPT Cyclic Fatigue · PDF fileUpdate: AASHTO TP 107 AMPT Cyclic Fatigue FHWA Mixture and Construction Expert Task Group May 1, 2017 Ames, Iowa

WasteMinz 2011 In Search of A Representative Soil Sample

The Green and Ampt Infiltration Model Accounting for Air

IPC Global AMPT/SPT Asphalt Mixture Performance fileIPC Global’s AMPT can also perform Indirect Tensile Dynamic Modulus, Overlay Test and Uniaxial Fatigue with optional hardware

WASTEMINZ Towards a national waste data framework

Ampt Communications Unit · PDF file The Ampt communication unit is used with Ampt optimizers. Before installing or using an Ampt optimizer, read all the instructions and safety messages

[1] The Role of Behaviour Change in Reducing CO 2 Emissions Liz Ampt Sinclair Knight Merz, Adelaide Written while at Steer Davies Gleave

Govt 3 Waste Minimisation Update Natasha Lewis WasteMinz, Nov ‘08

Asphalt Mixture Performance Tester (AMPT) Techbrief

AASHTO TP 107: AMPT Cyclic Fatigue - National Asphalt · PDF file 2016-12-12 · AASHTO TP 107: AMPT Cyclic Fatigue Proposed Revisions Y. Richard Kim, Sonja Pape NC State University

Your logo here WasteMINZ Mid-Year Roundup 2013. Wellington

My Green-Ampt is Better Than Your Curve Number: Physically ... · PDF file My Green-Ampt is Better Than Your Curve Number: Physically Based Soil Characterization is Better Than the

AMPT Asphalt Mixture Performance Tester (AMPT) - Tech Brief

Ampt Communication Unit · PDF file String Optimizer and the Ampt CU, and other variables common with wireless communications. To maximize radio wave range, avoid mounting the Ampt

Scaling properties of multiplicity fluctuations in heavy-ion collisions simulated by AMPT model

Optimal parameters for the Green-Ampt infiltration model

Product Catalog - Webflow · PDF file 2018. 2. 26. · t414, t421, rear tractor industrial t428, twin ampt t421, twin ampt t423, tb40, th400, twin ampt t428 twin forestry t404, t428,

Wasteminz Conference October 2010 Dr Jill Sherwood Nelson Marlborough DHB Public Health Service

Modeling Ampt String Optimizers in · PDF fileWhen running a simulation in PVsyst with Ampt String Optimizers, it is important for the

Comparison of Green-Ampt and Curve Number Infiltration ...swat.tamu.edu/media/77464/i31- · PDF fileComparison of Green-Ampt and Curve Number Infiltration Methods in a single-gauged