LOVING YOUR DATA:THE GALLUP ALUMNI SURVEY, DATA TOOLS, &

AIR DATA SUPPORT

2017 MSI MEASURING COLLEGE VALUE GRANTEE MEETING

October 2-4, 2017

Indianapolis

TODAY’S AGENDA

2

1 Getting Ready for the Gallup Alumni Survey

2 Making the Most of Data and Data Tools

3 Support from AIR for Evaluation Needs

GETTING READY FOR THEGALLUP ALUMNI SURVEY

REMIND ME: WHAT’S THE GALLUP ALUMNI SURVEY, AGAIN?

The Gallup Alumni Survey is designed to gather data about

the collegiate and workforce experiences of all living

undergraduate alumni at your institution.

It allows institutions to make powerful statements about the

well-being of their alumni on five domains—purpose, social,

financial, community, and physical—and the relationship

between well-being and undergraduate experiences.

Opens the door to new conversations about college value that

include, but go beyond, earnings and satisfaction.

4

REMIND ME: WHAT’S THE GALLUP ALUMNI SURVEY, AGAIN?

The Gallup Alumni Survey is designed to gather data about

the collegiate and workforce experiences of all living

undergraduate alumni at your institution.

It allows institutions to make powerful statements about the

well-being of their alumni on five domains—purpose, social,

financial, community, and physical—and the relationship

between well-being and undergraduate experiences.

Opens the door to new conversations about college value that

include, but go beyond, earnings and satisfaction.

5

SHARE: Who are these audiences, and what do you want to be able to tell them?

A REMINDER OF WHAT THE GALLUP SURVEY IS NOT

The Gallup Alumni Survey is not expected to serve as a way

to evaluate your action plan—the timing does not make sense.

But beyond its usefulness as a communications tool, it can be

another piece of data in your “reflective toolbox” to drive

transformation on campus.

CONSIDER: What questions would you ask, and steps

might you take, if you had more data on alumni well-

being?

6

WHAT WE’VE LEARNED IN CONVERSATION WITH YOU

Earlier this fall, Matt and Randy had

conversations with site teams as you were

finalizing your action plans.

We heard one thing loud and clear: you are

worried about reaching your alumni based on

currently available e-mail addresses.

For an e-mail-based survey, that’s a problem!

7

A SLIGHT IMPROVEMENT IN OUR PLANS!

It doesn’t make sense to launch the Gallup survey in 2017, or

even early 2018, if we do not have good e-mail coverage

rates.

But this resource is too good to pass up!

So, starting right now, we are going to think about how to use

the next 9 months to improve your alumni contacting data.

8

TIMELINE FOR GALLUP SURVEY ADMINISTRATION

9

October 2017 throughMay 2018 E-mail coverage effort begins … TODAY!

November 13, 2017 Webinar: Progress on Coverage, Getting Started on MarketingHomework: Actual, up-to-date counts of email coverage and final grid due to Matt and Lorenzo by November 6th.

February 2018 through July 2018 Pre-survey marketing effort begins

February 1, 2018 Progress Report DueWill include: Questions on latest email coverage and efforts on pre-survey marketing

August 1, 2018 Progress Report Due and Alumni Email Addresses “Locked Down”Will include: Questions on final email coverage and efforts on pre-survey marketing

September 1, 2018 Gallup Alumni Survey begins, closes on or about October 1, 2018.

GETTING AHEAD OF OURSELVES

Your alumni and development colleagues are

absolutely critical to the Gallup Alumni Survey

and maximizing its effectiveness … we will not be

successful if we try to go it alone!

We do want to start some thinking today,

however, so we can leverage the wisdom in the

room!

10

BRAINSTORMING ACTIVITY: GETTING TO 100 (1/4)

The first step in a successful e-mail survey is locating every

potential respondent.

We want valid emails for 100% of your alumni!

(We’ll deal with getting them all to respond to the survey once

we’ve reached them later.)

11

BRAINSTORMING ACTIVITY: GETTING TO 100 (2/4)

AT YOUR TABLE IN SCHOOL GROUPS:

Locate your “Getting to 100” worksheet.

FIRST: On a separate piece of paper, list major

opportunities you have to connect with alumni by month;

SECOND: For each activity in a given month consider …

How does this interaction occur already?

How might this interaction be supplemented with other

communication forms?

In either planned or potential communication forms, consider

how they might be modified to also capture emails!

THIRD: Fill in your worksheet! We’ll keep a copy.

12

13

Getting to 100 Improving Email Coverage Institution: ________EXAMPLE________ Team Members: ________________________

Inte

ract

ion

Type

Major Activities, By Month

OctoberStart N=

NovemberN=

DecemberN=

JanuaryN=

FebruaryN=

MarchN=

AprilN=

MayGoal N=

In-PersonHomecoming. Set up “update your email”

booth.

Graduation clearance. Have advisors capturenon-school email

addresses.

Spring fling. Set up “update your email”

booth.

Graduationceremonies. Set up “update your email”

booth.

Telephone College of Arts & Sciences phone-a-thon. During calls,

ask for e-mail address.

Facebook Homecoming. Addpost during

homecoming announcing e-mail

drive.

Linked In Winter career fair. As part of marketing,

include Gallup teaser and encourage e-

mail updating.

Other Homecoming. On on-line registration form, ask for email address

and share with alumni office.

Happy New Year Mailing. Include a

return postcard that collects email

address.

NPHC CelebrationWeek. Coordinate

with NPHC groups to include email update

teaser.

14

Inte

ract

ion

Type

Major Activities, By Month

OctoberStart N=

NovemberN=

DecemberN=

JanuaryN=

FebruaryN=

MarchN=

AprilN=

MayGoal N=

In-Person

Telephone

Facebook

Linked In

Other

Getting to 100 Improving Email Coverage Institution: _________________________ Team Members: ________________________

BRAINSTORMING ACTIVITY: GETTING TO 100 (3/4)

LET’S SHARE!

Listen … are there strategies you haven’t considered that

you might?

Query … are there things you’d like explained further, or

suggestions you’d like to offer?

Refine … once all groups have presented, spend 5

minutes with your team:

What changes, if any, should you make to your worksheet?

Who are the key contacts you need to connect with on

campus to advance “Getting to 100”?

How can we support your progress?

15

BRAINSTORMING ACTIVITY: GETTING TO 100 (4/4)

LET’S SHARE!

Listen … are there strategies you haven’t considered that

you might?

Query … are there things you’d like explained further, or

suggestions you’d like to offer?

Refine … once all groups have presented, spend 5

minutes with your team:

What changes, if any, should you make to your worksheet?

Who are the key contacts you need to connect with on

campus to advance “Getting to 100”?

How can we support your progress?

16

SHARE: What could work for you?

TIMELINE FOR GALLUP SURVEY ADMINISTRATION

17

October 2017 throughMay 2018 E-mail coverage effort begins … TODAY!

November 13, 2017 Webinar: Progress on Coverage, Getting Started on MarketingHomework: Actual, up-to-date counts of email coverage and final grid due to Matt and Lorenzo by November 12th.

February 2018 through July 2018 Pre-survey marketing effort begins

February 1, 2018 Progress Report DueWill include: Questions on latest email coverage and efforts on pre-survey marketing

August 1, 2018 Progress Report Due and Alumni Email Addresses “Locked Down”Will include: Questions on final email coverage and efforts on pre-survey marketing

September 1, 2018 Gallup Alumni Survey begins, closes on or about October 1, 2018.

LET’S STAND UP AND STRETCH!(AND GET READY TO MOVE.)

MAKING THE MOST OF DATA TOOLS

MAKING THE MOST OF PROJECT DATA TOOLS

All teams were asked to select three data tools they would use

as part of the project. (Remember: the Gallup-based is

required to be one of those three.)

Our review of action plans suggested that not everyone was

sure how to make best use of the tools they had selected

…and that may be because not all are equally informative.

We want to be sure you’re using tools that make sense for the

activities you’re planning.

20

A NEW POSSIBILITY (1/2)

If you would like to rethink your proposed tools, that

option is available to you … please confirm your choices

by the end of October.

To make time for that thinking—or any other

consultation—we will have office hours available every

Friday afternoon. To sign up, simply send an Outlook

meeting request to Matt at msoldner@air.org.

We also think a different type of tool might be in order!

21

A NEW POSSIBILITY (2/2)

Specifically:

Our review of final action plans suggested that there

might be an additional information gap that we hadn’t

anticipated: what you were able to know about current

students’ work habits, and how they might already be

integrating work and learning.

We think that’s pretty important data in the context of

projects that are trying to improve graduates’ workforce

outcomes.

22

A QUICK POLL

Please raise your hand if you currently have information about

which of your students are working right now.

Please keep them up if you know where and how much they

are working.

Please keep them up if you know whether students are

integrating their work and learning in any way.

So, does it seem like some way to get these data might be a

need? As well as a tool to analyze the results?

23

ACTIVITY: SURFACING WHAT MATTERS ABOUT STUDENTS’ WORK (1/5)

AIR would like to design and host this survey

for your use in this project.

But we need expert input on what it should

include. That’s where you come in!

To get started, I need everyone here who

had a job in college to come to the front of

the room.

24

ACTIVITY: SURFACING WHAT MATTERS ABOUT STUDENTS’ WORK (2/5)

For those of you sitting down, please count

off from ONE to FOUR. Once you have

numbered off, please relocate to your

assigned tables.

Ready for your instructions?

25

ACTIVITY: SURFACING WHAT MATTERS ABOUT STUDENTS’ WORK (3/5)

1. Each table has two Storytellers. The First

Storyteller is going to spend about 3 minutes

telling you about their experience of work

during college.

2. While the First Storyteller is telling their

story, the Listeners should be taking notes

about what was said but should not interrupt

or ask questions. When done, both

Storytellers should come back up to the

front!

26

3. After the First Storyteller is finished, each

Listener should go through his or her notes

on their own to identify major themes:

they heard;

they expected to hear about but didn’t.

4. Once each Listener has finished their

individual work, Listeners at a table should

combine all themes of both types into two

lists: a “Top 10 Most Important” themes,

followed by “Everything Else.”

27

Student Work Survey10 Key Themes Worksheet Team Members: _____________________________________________________

# Theme Probing Question12345678910

(Please use the back of this sheet to record your “Everything Else” list.)

ACTIVITY: SURFACING WHAT MATTERS ABOUT STUDENTS’ WORK (4/5)

5. On a piece of paper, Listeners should now

turn their Top 10 themes into questions they

can use to interview the Second Storyteller.

You have 10 minutes!

6. When Listeners are complete, Second

Storytellers should return to their tables.

Listeners will take turn asking their

questions to the Second Storytellers.

28

7. After Second Storytellers answer each

question:

First Storytellers should ask them how

easy or hard the question was to

answer, and why.

Listeners take note. (And take notes!)

8. When complete, the whole group should

refine their top 10 questions and record

them in the Worksheet. Other themes go on

the back!

ACTIVITY: SURFACING WHAT MATTERS ABOUT STUDENTS’ WORK (5/5)

Excellent work, you just designed a survey.

Let’s have each table share.

Please turn in a copy of the Worksheet to

Matt. (We’ll give it back!)

29

AIR SUPPORT

TYPES OF AIR SUPPORT (1/2)

Many hands make light work, so call on us.

To discuss concerns about your data tool

use, schedule an office hour any time!

Please schedule an office hour with Matt to

talk through your “Getting to 100” Worksheet

prior to October 27.

31

TYPES OF AIR SUPPORT (1/2)

We also want to be sure you have a plan to

gather the types of data needed to have a

meaningful evaluation. Schedule an office

hour between November 1 and December 15

with Matt and Jillian to begin these

conversations, which will focus on milestones

you will report on in February.

Remember, almost any Friday afternoon is

up for grabs. Email me at msoldner@air.org

to set an appointment.

32

Questions? And Thank You!