Communications Controlling - SUPRIO – Conférence des...

69
Measuring in Communication SUPRIO / 23.Oktober 2014 2014 Communications Controlling

Transcript of Communications Controlling - SUPRIO – Conférence des...

Page 1: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Measuring in Communication SUPRIO / 23.Oktober 2014 2014

Communications Controlling

Page 2: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Some initial reflections

Page 3: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

4

„Methods of checking and verification are diverse,

sometimes perverse, sometimes burdensome,

and always costly.“

Michael Power: The Audit Society. Rituals of Verification, Oxford 1997

Page 4: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

We are constantly measuring exactly…

5

Page 5: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

…but not in communications. Why?

6

Page 6: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Historic perspective

7

Page 7: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

8

Source: amecorg.com/Global-Survey-Communications-Measurement

Page 8: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Measuring is easy!

9

Page 9: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

The Theory

Page 10: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Transactional Model of Communication

11

Page 11: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Be in line!

12

Page 12: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

The strategy pyramid

13

Page 13: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Some dimensions of a Communications Strategy

14

Page 14: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Academic and practical debate

15

Steuerung und Kontrolle der Unternehmenskommunikation (A. Zerfaß 2007)

Page 15: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Levels of Impact-Model

16

Page 16: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Outputs Contact/response level

Reach, content

Business Results

Business level Added value

Outcomes Perception/

behavioral level Knowledge, opinions,

attitudes

Frequency

Visits Prominence

Reader contacts Tonality

Message impact Share of voice

Journalist inquiries …

Awareness Comprehension

Recollection Recognition Credibility

Image changes Recommendations

Purchasing intentions ...

Revenue/turnover Contracts closed Reputation value

Brand value Price-Effort Ratio

Market share Stock price

Employee Retention ...

Measuring communications on three impact levels

Impact on media/channels

Impact on target groups

Impact on organizations

Page 17: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

What is good measurement?

18

Page 18: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

The Barcelona Principles: Seven Principles of PR Measurement

1. Importance of Goal Setting and Measurement 2. Measuring the Effect on Outcomes is Preferred to Measuring

Outputs 3. The Effect on Business Results Can

and Should Be Measured Where Possible 4. Media Measurement Requires Quantity

and Quality 5. AVEs are not the Value of Public Relations 6. Social Media Can and Should be Measured 7. Transparency and Replicability are Paramount to Sound

Measurement

Page 19: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Why should we measure?

Page 20: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Traceability and Calibration Steering and Optimizing Show ROI Prove strategig value of communications

21

Page 21: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

22

Source: amecorg.com/Global-Survey-Communications-Measurement

Page 22: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

What should we measure?

23

Page 23: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Numbers or letters?

24

Page 24: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

The most important thing

25

Page 25: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Defining Objectives

• Objectives have to be solution neutral

• Define objectives SMART Specific: specify target and intended outcome Measurable: quantify objectives to measure its achievements Agreed: all stakeholder should agree with the objective Realistic: objectives are achievable Time constrained: time of delivery is clearly defined

Prioritise objectives (must-have/ restrictions vs. should be) • Consider conflicts of objectives and interests

Page 26: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Set Goals First Before Measuring Communications

Page 27: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Communications Goals

Reach Awareness Comprehension Attitude Behavioral

Page 28: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Your start: the point of reference

29

Page 29: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

The Tripple Bottom Line

30

Page 30: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

How should we measure?

31

Page 31: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Wirkungsstufen-Model

32

Page 32: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Balanced Scorecard

33

Page 33: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

34

Source: amecorg.com/Global-Survey-Communications-Measurement

Page 34: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Useful resources - International Association for Measurement and Evaluation of

Communication (AMEC) www.amecorg.com

- Dr. Ansgar Zerfass / www.communicationcontrolling.de

35

Page 35: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Methods for measuring media relations SUPRIO / 23.Oktober 2014

Media Monitoring

Page 36: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Measure Media Quantity and Quality, Not AVEs

Page 37: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

A sufficient tool?

38

Page 38: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Why Ban AVEs?

• Cannot capture the outcome of a PR campaign, limiting PR to its placements in the media.

• Cannot measure the variety of messages delivered in the media in relation to the tamed messages in advertisements.

• Cannot measure the value of keeping a client out of the media spotlight.

• Cannot properly distinguish between placements in noteworthy columns or sections of a publication and generic or less desirable areas of a publication.

• Cannot measure social media forms, such as blogs and message boards.

Because an AVE is the Cost of Advertising, Not the Value of Earned Media

Page 39: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Media results – Approach

Overall clip counts and general impressions are usually meaningless

Media analyses, whether of traditional or online channels, should focus on the quality of the media coverage

Goal-definition and benchmarking are vital for robust results and to track changes over time

Experimenting and testing are potentially successful approaches, for example in the development of (new) key figures/ indicators

Circulation, reach

Share-of-voice

Tonality

‘Message’ penetration

Visits, fans, followers

Audience engagement

Sentiment ratio

Active advocates

Traditional media

Social media

Page 40: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Man vs. Machine

41

Page 41: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

What Good Media Analysis Looks Like: Philips March February Monthly Net Change (+/-)

Total # of articles 285 234 51 Total # of impressions 216,899,003 198,840,298 18,058,705 AMS (from -100 to 100) 51.43 60.96 -9.53

Net Promoter Score (NPS)* 7.57 8.05 -0.48 Message Penetration (% with 2+ messages) 68.4% 51.5% 16.9%

Tone (positive coverage) 54.0% 65.0% -11%

Page 42: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Output Focused Clients

Media Results -- Approach

Overall clip counts and general impressions are usually meaningless

Media analyses, whether of traditional or online channels, should focus on the quality of the media coverage

Goal-definition and benchmarking are vital for robust results and to track changes over time

Experimenting and testing are potentially successful approaches, for example in the development of (new) key figures/ indicators

Clips Count.

Clips Have to be Good.

Page 43: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Outcome Focused Client

Market and Opinion research – Aims Basis for communications

Providing important information about relevant target groups Input for communications

Generation of topics and content for press releases Control of communications

Evaluation of long-term effects of PR activities

Use of online/offline surveys in communications processes

They Like Me.

They Do Something Different.

Page 44: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Organizational Results Focused Client

Money Matters.

Page 45: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Measurable criteria

Corporate goals

Evaluation goals

Communication goals

What is the overarching business goal that is to be supported by communications?

What are the desired (measurable) changes in the target group as the result of communications?

Coverage: Number of articles in target group (media), penetration of messages

Perception: Brand awareness, recollection of topics

Comprehension: Credibility of content, connection to company

Attitude: Brand loyalty, increased employee motivation

Behavior: Purchase decisions, project involvement

Who? What? How much? By when? Goals should be defined as quantitative as possible

Communications vs. evaluation goals

Page 46: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Possible tools

47

Source: amecorg.com/Global-Survey-Communications-Measurement

Page 47: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Social Media Can and Should be Measured

Page 48: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

49

Page 49: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Social Media: Monitoring vs. Measuring Monitor

Look for issues to which your organization or brand might want to react

Identify trends in consumer opinion, desired content/features, etc.

Provide a qualitative analysis of content

Measure Quantify reach, tone,

recommendations, etc. Identify top users Benchmark in advance of

interactive activity to track changes over time

Page 50: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

51

Social Media: what we measure “What matters is everything that happens after you post/tweet/participate!” •Conversion Rate -> # of audience comments / posts

•Amplification Rate -> #of shares / update

•Applause Rate -> # of likes / favorites / etc. per post -> a measure of quality, relevance and

value

Page 51: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Big Data vs. Analytics Big Data = the exploding amount of data Analytics = what to make of it Data-based decisions will be daily routine in

more than only tech companies Dealing will data, analysing it, deciding based

upon it will be a core competence like using standard applications as MS word

52

Page 52: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Outcomes Are Better Than Outputs

Page 53: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Market and Opinion Research – Aims

Basis for communications Providing important information about relevant target groups

Input for communications Generation of topics and content for press releases

Control of communications Evaluation of long-term effects of PR activities

Use of online/offline surveys in communications processes

Page 54: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Corporate Brandbuilder – Dow “Human Element”

Brand Equity +25% Stock Price +29% Media Matters

Communications Exposure

Reputation Score

None Average

Advertising

Media

Internet

Page 55: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

The 10 Golden Rules of Media Measurement

1. Establish written goals 2. Measure the quantity and quality of media 3. Understand the same principles apply to traditional and social media 4. Do not use AVE as the value of PR 5. Add PR questions to tracking surveys to easily capture outcomes 6. Collect media data in a manner usable for market mix modeling 7. Recognize that analytics is the future of PR measurement—ROI is the answer 8. Make sure all measurement is transparent 9. Use measurement to track progress and to design programs better 10. Realize that communications experts are not necessarily measurement experts

Page 56: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Reflections on a giant topic SUPRIO / 23.Oktober 2014

Issues Management and Reputation

Page 57: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Reputation management is complex

58

Page 58: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

The power of communicating purpose

Page 59: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

In the end, it comes down to…

60

Page 60: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Have your ear on the ground!

61

Page 61: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

E V I D E N C E - B A S E D C O M M U N I C AT I O N S

Monitoring is key!

(And resilience rules)

Page 62: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

E V I D E N C E - B A S E D C O M M U N I C AT I O N S

Time matters! Attention spans shrink!

Page 63: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Dialogue is a must

Page 64: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Transparency is King

Page 65: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Image is all

Page 66: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

E V I D E N C E - B A S E D C O M M U N I C AT I O N S

Hand over the message to your audience!

Page 67: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Crisis and issues management in the new “always on” era

Page 68: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

10

http://www.youtube.com/watch?v=JiTo13fPKVk

Page 69: Communications Controlling - SUPRIO – Conférence des ...suprio.ch/wp-content/uploads/2014/10/communication_controlling.pdf · Effect on Outcomes. is Preferred to Measuring Outputs

Thank you! Matthias Graf, CEO Burson-Marsteller AG Grubenstrasse 40, 8045 Zürich T +41 44 455 84 20 , M +41 79 300 03 93 [email protected]

70