[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for...

12
[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ 19.03.20 07 Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses of Evaluation.

Transcript of [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for...

Page 1: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] 19.03.2007

Bonn, 19 March 2007

Effective Evaluation for Complex Communication

Management.The Uses and Abuses of Evaluation.

Page 2: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

2

Evaluation of Communication

is important because it is the only way to control if you are reaching

your goals and have used your resources effectively;

costs money so that you have to make sure that the costs and

benefits

are in the right relationship;

is complex because the communications processes themselves are

extremely complex.

Page 3: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

3

Listening, Understanding, Accepting

Listening is the first of three hurdles that a message has to overcome.

Understanding is following the line of argument and forming an attitude.

Understanding can lead to Acceptance.

If you are accepted you will be extended long-term trust, you will be believed

and you will also be able to generate active support for your objectives.

If the addressees are convinced, they might act in the way you hoped and

anticipated.

Page 4: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

4

Evaluation as signpost

Evaluation is not only an instrument to determine, after the fact, whether I

have reached my objective,

Evaluation is a steering instrument

Evaluation is important during and after all phases of the management cycle

Page 5: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

5

Evaluation and Transparency

Evaluation causes transparency

Transparency through evaluation is the basis for the legitimisation

of communications work,

Transparency is necessary internally and externally.

Page 6: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

6

Three types of Evaluation

Process evaluation - Investigates whether the right people do the right

things at the right time. Processes should be evaluated in an on-going

fashion.

Are we doing the right things?

Efficiency analysis - This focuses on the relationship between the

effectiveness and the resources used.

Are we doing the things right?

Analysis of the effects and the effectiveness –

How can I measure what effects of my measures are?

Page 7: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

7

Effects and effectiveness

The effects are described changes in cognitive, emotional and behavioural

fields.

Effects in communications are all the resultant changes, intended or not.

I need a benchmark t evaluate my measure

Effectiveness is the extent to which a measure had achieved thr objectives.

Page 8: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

8

Abuse

Checklists do not guarantee that communication measures will be more

effective.

instruments like the balanced scorecard gain in popularity,

there is an increasing tendency to employ them incorrectly.

The result is a return to simple communications measures because they are

known and measurable.

The apparent objectivity of numbers and percentages draws people to

making rushed interpretations.

The obsessive collection of figures can quickly become extremely expensive.

Page 9: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

9

Use

Favourite evaluation instruments.

Monitoring media resonance.

Quantitative analysis

Qualitative analysis

Evaluation of topics

Evaluation as monitoring system

Checking messages

Checking Output /Outgrowth level

Evaluation of agenda-setting

Evaluation of framing

Analysis of Image

Page 10: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

10

Output:Message in TV,Newspaper etc.

Outgrowth:understand,

plausible, retain facts in memory

Outcome:Images

Contact

Direct Impact

Indirect effect

low

high

Input

modification/validationof PR-strategy/PR-tactics

Page 11: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

11

Effective evaluation of communication

Five steps

1. Set up an evaluation plan right at the start, try to identify the neuralgic points of the

communications strategy.

2. Set goals and agree on the performance parameters. Then will you be able to carry

out on-going checks.

3. Make use throughout of small efficient instruments. Evaluate them so that you can

introduce improvements during an on-going process.

4. You need to know about your reference groups. Keep checking whether this

knowledge is adequate and correct.

5. Communications management is also “Management of uncertainty”.

Strategic communication involves not only state-of-the-art methodology but also

common sense and gut feelings.

Page 12: [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Bonn, 19 March 2007 Effective Evaluation for Complex Communication Management. The Uses and Abuses.

[ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ Effective Evaluation for Complex Communication

12

Effective evaluation of communication

Thank you for your attention