Frequencies and early analysis Survey of members and newsletter recipients

2008-2013 Strategic and Marketing Plan (SMP) Review

Produced by Lisa O'Reilly for CESBCY | UVic

October 14, 2011

Response rates

not statistically significant

Population (n=382)

177 CES members in BC & Yukon

4 CES members outside BC & Yukon

201 People on the mailing list

Respondents (n=59)

47 CES members in BC & Yukon

2 CES members outside BC & Yukon

10 People on the mailing list

Confidence level 95% (+/- 11.75)

+/-12.29 CES members in BC & Yukon

moot CES members outside BC & Yukon

moot People on the mailing list

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

CESBCY members only (n=47)

Years a member?

Statistics

Total Responses 47

Sum 64.0

Average 2.1

StdDev 1.44

Max 4.0

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

CESBCY members only (n=47)

Where in BC / Yukon ?

Value Count Percent %

Vancouver (Lower mainland) 20 42.6%

Fraser Valley 1 2.1%

Vancouver Island (South) 16 34%

(North) 1 2.1%

Interior (Okanagon) 4 8.5%

(North) 1 2.1%

Yukon (Whitehorse) 4 8.5%

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

Type of employer (n=59)

Value Count Percent %

Federal Government /Agency 1 1.7%

Provincial/Territorial Govt/Agency 10 16.9%

Municipal Govt/Agency 1 1.7%

College/University 11 18.6%

Healthcare 7 11.9%

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

Prior training (n=59)

Have you received any…

Yes No Total

formal and specific academic training in program

evaluation? (e.g. university /college courses)

62.7% 37

37.3% 22

100% 59

on-the-job training in evaluation 84.7%

50 15.3%

9 100%

59

continuing education courses/workshops on

evaluation? (e.g. at conferences or other areas outside universities or colleges)

86.4% 51

13.6% 8

100% 59

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

Evaluation at work (n=59)

To what extent are you involved in program evaluation in your present position ?

Value Count Percent %

Primary focus 21 35.6%

Major Focus 1 25.4%

Minor Focus 16 27.1%

Not at all 7 11.9%

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

How did you find out about the CES?(n=59)

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

0% 25% 50% 75% 100%

Mentoring opportunities

Opportunities to collaborate on projects

Awareness of contracting and employment

opportunities

Networking with colleagues who share

professional interests

Professional credibility

Affiliation with a professional association

Access to professional development and

training opportunities

Understanding of current practices and the

state of research for evaluation in Canada

Not important Somewhat important Very important

0% 25% 50% 75% 100%

Mentoring opportunities

Opportunities to collaborate on projects

Awareness of contracting and employment

opportunities

Networking with colleagues who share

professional interests

Professional credibility

Affiliation with a professional association

Access to professional development and

training opportunities

Understanding of current practices and the

state of research for evaluation in Canada

minimal somewhat considerable

2.1%

1

46.8%

22

51.1%

24

4.3%

2

42.6%

20

53.2%

25

8.5%

4

46.8%

22

44.7%

21

10.6%

5

46.8%

22

42.6%

20

12.8%

6

46.8%

22

40.4%

19

14.9%

7

36.2%

17

48.9%

23

25.5%

12

48.9%

23

25.5%

12

27.7%

13

38.3%

18

34.0%

16

27.7%

13

53.2%

25

19.1%

9

17.0%

8

55.3%

26

27.7%

13

17.0%

8

53.2%

25

29.8%

14

36.2%

17

53.2%

25

10.6%

5

31.9%

15

38.3%

18

29.8%

14

34.0%

16

51.1%

24

14.9%

7

74.5%

35

17.0%

8

17.0% 8.5%

8 4

70.2%

33

27.7%

13

27.7% 2.1%

13 1

Member benefits, now and in the future

What benefits do you currently derive from the CESBCY? (n=47) Looking forward, please rate how important the following benefits of CES membership are to you. (n=47)

This slide is data rich (and a bit busy). Further analysis and explanation of that information will follow in the next iteration of updates provided.

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

Credentials Have you considered applying to be a Credentialed Evaluator (CE) through the Canadian Evaluation Society? (n=59)

Have you begun the application process? (n=38)

8 30

39 20

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

Applicability of 2008 Goals

The Chapter developed a strategic and marketing plan in 2007. Five goals were developed under this plan.

We would like to know whether these goals continue to be important to the membership.

Please rate the importance of each goal, from low to high.

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011

Success so far for 2008 objectives The objectives of the workplan associated with the SMP are the following, please rate how successful you feel we have been in achieving these outcomes?

The relevance of evaluation to good decision-making is understood and recognised in sectors that could benefit. 20.30% 6.80% 1.70% 71.20%

BC has appropriate provincial policies on evaluation. 28.80% 1.70% 0.00% 69.50%

Non-profits in BC can implement evaluation effectively, relevant to their needs 18.60% 8.50% 3.40% 69.50%

CESBCY members who wish to do so, can find and contact each other 8.50% 59.30% 1.70% 30.50%

Evaluation stakeholders can share information with CESBCY and each other 10.20% 45.80% 1.70% 42.40%

Evaluation stakeholders can learn from each other 8.50% 42.40% 1.70% 47.50%

Evaluation stakeholders are aware of career opportunities and service providers in BC 11.90% 42.40% 1.70% 44.10%

CESBCY has a high profile in the BC evaluation community of practice 16.90% 33.90% 1.70% 47.50%

CESBCY's management is representative of the leaders in the evaluation community 10.20% 30.50% 1.70% 57.60%

CESBCY membership is growing and satisfied 8.50% 15.30% 1.70% 74.60%

Understand professional development needs. 11.90% 35.60% 3.40% 49.20%

Continue to offer standard CES training. 8.50% 64.40% 8.50% 18.60%

Develop/support new professional development offering based on need. 20.30% 35.60% 1.70% 42.40%

Ensure that CES professional designations are relevant and accessible to CESBCY members 13.60% 18.60% 3.40% 64.40%

Encourage and support junior evaluation stakeholders 22.00% 15.30% 0.00% 62.70%

CESBCY has clear strategy. 8.50% 37.30% 0.00% 54.20%

CESBCY has provincial and local structures that allow it to pursue its strategy. 10.20% 28.80% 1.70% 59.30%

CESBCY has the human resources to carry out the work. 8.50% 13.60% 0.00% 78.00%

CESBCY has the tools to carry out the work. 5.10% 15.30% 0.00% 79.70%

This slide is data rich (and a bit busy). Further analysis and explanation of that information will follow in the next iteration of updates provided.

Pro

du

ced

by

Lis

a O

'Rei

lly

for

CE

SB

CY

| U

Vic

O

cto

ber

14

, 2

011