Guidelines for the Eva luation of M obility M anagement Programmes EvaMM
-
Upload
stephen-hester -
Category
Documents
-
view
19 -
download
0
description
Transcript of Guidelines for the Eva luation of M obility M anagement Programmes EvaMM
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH
Guidelines for the
Evaluation of Mobility Management Programmes
EvaMM
Handlungsleitfaden für dieEvaluation von
Mobilitätsmanagement-Programmen
EvaMM
Timo Finke
Timo Finke Department of Traffic ManagementCity of Düsseldorf
ECOMM 2009
San Sebastián
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián2
Aim of EvaMM
Set up guidelines for practitioners to evaluate MM programmes
• to demonstrate success of MM to programme provider, sponsors, critics and public
• to support the programme manager in daily work
• to include all facets of MM into its evaluation (e.g. awareness campaigns, MM services)
• to sum up programme costs for comparison with alternative measures
• to allow comparison of success between programmes by standardised evaluation
• to document your success!
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián3
Definition Mobility Management
[EPOMM, 2008]
Mobility Management (MM) is a concept to promote sustainable transport and manage the demand for car use by changing travellers' attitudes and behaviour.
At the core of MM are „soft“ measures like information and communication, organising services and coordinating activities of different partners.
„Soft” measures most often enhance the effectiveness of „hard“ measures withing urban transport (e.g. new tram lines, new roads and new bike lanes). Mobility Mangement measures (in comparison to „hard“ measures) do not necessarily require large financial investments and may have a high benefit-cost ratio.
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián4
Phases of Behaviour Change
Pre-Contemplation
Contemplation
Preparation
Actionand
Maintenance
Decision
Initiation
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián5
Assessment Levels of EvaMM
Pre-Contemplation
Contemplation
Preparation
Actionand
Maintenance
A
B
Awareness raising – problems + solutions
Acceptance of personal responsibility
C
D
E
Use of MM-Services
Satisfaction with MM-Services
General acceptance of travel alternatives
F
G
Alternative individual travel behaviour
Satisfaction with travel alternatives
Decision
Initiation
M1 Intention to change behaviour
M2 Start of alternative travel behaviour
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián6
Assessment levels of EvaMM
A Awareness rising - problems + solutions
Are the target groups aware of the problems their current travel behaviour creates?
Are the target groups familiar with the offered MM measures and travel alternatives?
Indicators Measurable target Method of data collection
Number/share of touristswho are aware of prob-lems their car journey
causes at the destination
Problem awareness at 50%
of all tourists until 2010survey
Number/share of employees who know thePT-ticket or carpool offer
50% awareness oneyear after setting up
a company mobility plansurvey
Number/share of citizenswho know the
Mobility Center.
25% awareness amongstcitizens 2 years after
openingsurvey
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián7
EvaMM step by step
Monitoring
Evaluating
EvaluationPlan
Name and describe target groups
Specify indicators & measurable targets
Record input and output
Record framework conditions
Assess impacts
Evaluate success
Specify MM-measures
Formulate mission statementI
V
VI
VII
VIII
II
III
IV
Evaluation Report
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián10
EvaluationPlan Specify indicators and measurable targetsIV
Fact sheetDescriptionof Indicator
Awareness for the daily congestion caused by the employees and the limited number of company's parking spaces.Knowledge of the MM measures offered to solve these problems
Assessment Level Awareness rising through MMA
Target group Employees
Description of Indicator and its relevance for the assessed MM-ProgrammeBasis for a behaviour change is the awareness of problems and knowledge of solutions offered. Company'sMM should make sure that employees are aware of the daily congestions in the proximity of the company andthe limited number of parking spaces that lead to illegal parking on public streets. At the same time, it shouldshow measures to solve these problems.
The higher the share of employees that are aware of these problems and solutions offered by the MMprogramme the more successful measures of awareness rising could be assessed and the more likely asuccess of the MM programme will be.
How is success measured?What is assessed?
Assessed is the current awareness of the addressed problems and offered solutionsamongst employees and its past development.
What data arerequired?
Number of employees, who developed an awareness for the addresses problems andoffered solutions.
How are datacollected?
Interview of employees:
„Do you know the company's Mobility Coordinator?
If YES, How did you learn about him/her?What is his/her task?
Do you know about the measures of the company' MM programme?
If YES, please name those measures you know.“
Target value andtime frame
X % awareness of problems and solutions amongst the employees after 1 year,Y % awareness of problems and solutions amongst the employees after 3 years.
What data areavailable?
-
Former development of indicatorA former survey of the staff council addressed problems of the company's accessibility for staff, customers,visitors and suppliers. Can results be used?
What else should be taken into account?Note Give employees the chance to report their own view of problems additionally to what is
addressed by the MM programme.
Backgroundinformation
Due to residents' protests paid parking is planned in the company's proximity. This willlead to an increased use of public transport.
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián11
Awareness raising – problems + solutions
Acceptance of personal responsibility
Use of MM-Services
Satisfaction with MM-Services
General acceptance of travel alternatives
Permanent alternative travel behaviour
Satisfaction with travel alternatives
Start of alternative travel behaviour
Intention to change behaviour
A
B
C
D
E
F
G
M1
M2
Traffic impacts to be achieved:reduced motorised trips: 11.000 p.a.= reduction of 50 parking lots
Set target:Reduction of CO
2
emissions: 40 tons p.a.
80% of employees knowproblems and solutions
80% of those who developed an awareness for the problems
80% of those who plan to changetheir travel behaviour
90% of users are satisfied
120 employees accept theoffered alternatives
55 employees change permanently
90% of those who changed theirtravel beaviour are satisfied
100 employees start to changetheir travel behaviour
50% of those who acceptedpersonal responsibility
EvaluationPlan Specify indicators and measurable targetsIV
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián12
Monitoring Record input and outputV
Input
Record of all ressources used based on the principles of cost and activity accounting.
Output
Record of all measures and products provided.
Info
rmat
ion
Kind of service provided Start-time End-time
X PT info 08 : 15 08 : 17
X Bike rental 08 : 19 08 : 23
X Railway ticket 08 : 24 08 : 27
X Carsharing 08 : 31 08 : 46
Co
nsu
ltin
g
Sal
e
Res
erva
tio
n
Oth
er
X Lost properties 08 : 47 08 : 49
__ : __ __ : __
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián13
Monitoring Record framework conditionsVI
1. Record initial situation:as basis for the development of MM programme
2. Distinguish between: Changes as result of MM... demonstrate MM's success.
Changes based on factors outside MM programme... can not be influenced by MM priogramme, but might have influence on the MM programme.
Identify causality between trigger and behaviour change in surveys.
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián14
Evaluating Assess impactsVII
Awareness raising – problems + solutions
Acceptance of personal responsibility
Use of MM-Services
Satisfaction with MM-Services
General acceptance of travel alternatives
Permanent alternative travel behaviour
Satisfaction with travel alternatives
Start of alternative travel behaviour
Intention to change behaviour
A
B
C
D
E
F
G
M1
M2
Impacts achieved by MM:- transport related- ecological- individual
Share of those who are aware ofproblems and offered solution.
Share of those who accepttheir own responsibility.
Share of those who useMM services.
Share of those who aresatisfied with MM services.
Share of those who acceptthe offered alternatives.
Share of those who practise newtravel behaviour permanently.
Share of those who changed their travelbehaviour and are satisfied with it.
Share of those who starta new travel behaviour.
Share of those who intend tochange their own travel bahaviour.
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián16
Evaluating Evaluate successVIII
Effectiveness• Collection of achieved impacts• Comparison of measurable targets and achieved performance (target-performance comparison) for
Output Impacts
Efficiency• Collection of consumed ressources• Comparison of available ressources with measurable
targets• Evaluate achieved results vs. consumed ressources for
Output (costs per service unit) Changes in framework conditions Impacts (costs per impact unit)
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián17
EvaMM step by step
Monitoring
Evaluating
EvaluationPlan
Name and describe target groups
Specify indicators & measurable targets
Record input and output
Record framework conditions
Assess impacts
Evaluate success
Specify MM-measures
Formulate mission statementI
V
VI
VII
VIII
II
III
IV
Evaluation Report
Guidelines for the Evaluation von MM Programmes
EvaMM
Timo Finke
RUTH ECOMM 2009, San Sebastián20
Guidelines for the
Evaluation of Mobility Management Programmes
EvaMM
Thank you!
Timo Finke
Department of Traffic ManagementCity of Düsseldorf