Data Placemats: Construction and Practical Design Tips

57
Construction & Practical Design Tips Data Placemats Veena Pankaj @VeenaPankaj Friday, November 13, 2015 Evaluation 2015, Chicago Illinois @InnoNet_Eva l

Transcript of Data Placemats: Construction and Practical Design Tips

Page 1: Data Placemats: Construction and Practical Design Tips

Construction & Practical Design Tips

Data Placemats

Veena Pankaj@VeenaPankaj

Friday, November 13, 2015Evaluation 2015, Chicago IllinoisAmerican Evaluation Association

@InnoNet_Eval

Page 2: Data Placemats: Construction and Practical Design Tips
Page 3: Data Placemats: Construction and Practical Design Tips

Participants

Round 1 Round 2 Round 3

WKCF 143 154 168

GKCF 34 45 102

Page 4: Data Placemats: Construction and Practical Design Tips

Planning

Analysis & Reflection

Action & Improvement

Data Collection

Page 5: Data Placemats: Construction and Practical Design Tips

ParticipatoryEvaluation

StakeholderInvolvement

EvaluationUse

Page 6: Data Placemats: Construction and Practical Design Tips

The Learning JourneyData Placemats

Pankaj & Emery, in press.

Page 7: Data Placemats: Construction and Practical Design Tips
Page 8: Data Placemats: Construction and Practical Design Tips

Created by Scott Lewisfrom the Noun Project

Page 9: Data Placemats: Construction and Practical Design Tips

Created by Michela Tannoia, GBfrom the Noun Project

Information Architect

Page 10: Data Placemats: Construction and Practical Design Tips

Created by EliRatus, ILfrom the Noun Project

Information Anxiety

Page 11: Data Placemats: Construction and Practical Design Tips

Created by EliRatus, ILfrom the Noun Project

Information Anxiety

Data Knowledge

Page 12: Data Placemats: Construction and Practical Design Tips

Unstructured Information Structured Information Knowledge

Page 13: Data Placemats: Construction and Practical Design Tips

The Learning JourneyThe Learning Journey

12

3Before the data interpretation meeting

During the data interpretation meeting

After the data interpretation meeting

Page 14: Data Placemats: Construction and Practical Design Tips

The Learning JourneyThe Learning Journey

12

3Before the data interpretation meeting

During the data interpretation meeting

After the data interpretation meeting

Page 15: Data Placemats: Construction and Practical Design Tips

Before the Data Interpretation

Meeting

Page 16: Data Placemats: Construction and Practical Design Tips

Phases

A Preliminary planning

B Mapping, organizing and analyzing data

C Designing the data placemat

Before the Data Interpretation Meeting

Page 17: Data Placemats: Construction and Practical Design Tips

Preliminary PlanningA

Page 18: Data Placemats: Construction and Practical Design Tips

Building a Data PlacematPreliminary PlanningA

Page 19: Data Placemats: Construction and Practical Design Tips

What year did you participate in the fellowship program? (n=120)

Class Total

Class 10 (Year '03-04)19 out of 23

fellows

Class 11 (Year '04-'05)19 out of 24

fellows

Class 12 (Year '05-'06)23 out of 24

fellows

Class 13 (Year '06-'07)20 out of 22

fellows

Class 14 (Year '07-'08)19 out of 19

fellows

Class 15 (Year '08-'09)20 out of 20

fellows

Year of Participation (n = 120)4

Demographics and Involvement

Constituency Size1

Before I entered the fellowship I was undecided about what I wanted to do …but being in DC and interviewing professionals doing policy work, I [realized] that I wanted to work at the neighborhood/community level. -Alumnus, Class 1 (Interviewee)

Learning from the field and about policy was invaluable. I realized that while working at the DC policy level is a needed aspect of doing…social change work, I am better suited to do direct service and field organizing. -Alumnus, Class 2 (Interviewee)

The program helped me realize my potential as a leader. As a person of color and a person who has experienced poverty first-hand, the program gave me the courage and skills necessary to utilize and share my experiences constructively with others to diversify the discourse of anti-hunger and anti-poverty. – Alumnus class 5, Survey Respondent

Impact of Fellowship on CareerImpact of Fellowship on Career2

Facebook likes over time 5 Toolkit Utilization (n=120)6

Involvement with Programming3

Page 20: Data Placemats: Construction and Practical Design Tips

Activities or

ServicesOutputs

Short-Term

Outcomes

Interim Outcom

es

Long-Term

Outcomes

Outcomes Evaluation Questions

Data Collection Method

Data Source

Preliminary Planning

Page 21: Data Placemats: Construction and Practical Design Tips

1.What are the characteristics of program participants?

2. To what degree did socioeconomic status impact participation?

3. To what extent did geography play a role in the overall participant journey?

4. What were the barriers to participation?

Evaluation Questions

Created by Blake Thompson, USfrom the Noun Project

Page 22: Data Placemats: Construction and Practical Design Tips

Mapping, Organizing and Analyzing Data

B

Page 23: Data Placemats: Construction and Practical Design Tips

2

1

3

4

Mapping and Organizing Data

Data Collection Instruments

Survey

Interview Protocol

123

123

What are the characteristics of program participants?

To what degree did socioeconomic status impact participation?

To what extent did geography play a role in the overall participant journey?

What were the barriers to participation?

Evaluation Questions

Page 24: Data Placemats: Construction and Practical Design Tips

Mapping and Organizing Data

Page 25: Data Placemats: Construction and Practical Design Tips

Survey Data

Open-ended Responses Interview Analysis

Pivot Tables and Graphs

Analyze Data

Page 26: Data Placemats: Construction and Practical Design Tips

Designing the Data PlacematC

Page 27: Data Placemats: Construction and Practical Design Tips

Choose which pieces of databelong on your placemat

Page 28: Data Placemats: Construction and Practical Design Tips

Pankaj & Emery, in press.

Determine how to use color

Page 29: Data Placemats: Construction and Practical Design Tips

Header/theme

Supporting data

Chart/graph titles

Chronological labels for placemat elements

Components of a data placemat

Page 30: Data Placemats: Construction and Practical Design Tips

1 are a means to an end

Keep in mind, data placemats …..

2 are a communication tool

4 offer an opportunity to collect additional context about the data

3 provide a chance to test initial evaluator assumptions

Page 31: Data Placemats: Construction and Practical Design Tips

Sample Data Placemats

Page 32: Data Placemats: Construction and Practical Design Tips

Accessibility and Satisfaction

Page 33: Data Placemats: Construction and Practical Design Tips
Page 34: Data Placemats: Construction and Practical Design Tips
Page 35: Data Placemats: Construction and Practical Design Tips
Page 36: Data Placemats: Construction and Practical Design Tips
Page 37: Data Placemats: Construction and Practical Design Tips

During the DataInterpretation

Meeting

Page 38: Data Placemats: Construction and Practical Design Tips

Phases

A Facilitative capacities of the evaluator

B Facilitation tips

Guiding questions

During the Data Interpretation Meeting

Sample data placemats

Page 39: Data Placemats: Construction and Practical Design Tips

Technical Capacities Analyzing data Designing data placemats

Page 40: Data Placemats: Construction and Practical Design Tips

Adaptive Capacities Perceiving and interpreting Flexibility Nurture productive dialogue Rely on intuition and instinct

Page 41: Data Placemats: Construction and Practical Design Tips

Purpose

Format

Page 42: Data Placemats: Construction and Practical Design Tips

Walk through each Placemat

Page 43: Data Placemats: Construction and Practical Design Tips

What does this data tell you?

Page 44: Data Placemats: Construction and Practical Design Tips

What surprises you about this data?

Page 45: Data Placemats: Construction and Practical Design Tips

What factors may explain some of the

trends we are seeing?

Page 46: Data Placemats: Construction and Practical Design Tips

Does this lead to any new questions?

Page 47: Data Placemats: Construction and Practical Design Tips

come prepared with your back pocket themes

ask questions and gather additional context

During the data interpretation meeting …

make a list of all the additional analyses that you will conduct following the meeting

Created by Scott Lewisfrom the Noun Project

Page 48: Data Placemats: Construction and Practical Design Tips

After the DataInterpretation

Meeting

1 23

Page 49: Data Placemats: Construction and Practical Design Tips

Phases

A Conduct additional analyses

B Prepare final deliverable

After the Data Interpretation Meeting

Page 50: Data Placemats: Construction and Practical Design Tips

Additional Analysis

Created by Mark Shorter, US; Creative Stall, PK; Milky Digital innovation, FR from the Noun Project

Page 51: Data Placemats: Construction and Practical Design Tips

Prepare Final Deliverable

Page 52: Data Placemats: Construction and Practical Design Tips

The Learning JourneyThe Learning Journey

12

3Before the data interpretation meeting

During the data interpretation meeting

After the data interpretation meeting

Page 53: Data Placemats: Construction and Practical Design Tips

The Learning JourneyThe Learning Journey

Before the data interpretation meetingPreliminary planningMapping, organizing and analyzing data

Designing the placemat

Page 54: Data Placemats: Construction and Practical Design Tips

The Learning JourneyThe Learning Journey

During the data interpretation meetingFacilitative capacities of evaluatorFacilitation tips

Page 55: Data Placemats: Construction and Practical Design Tips

The Learning JourneyThe Learning Journey

After the data interpretation meetingConduct additional analysesPrepare final deliverable

Page 56: Data Placemats: Construction and Practical Design Tips

Benefits of Participatory Data Analysis

Interest & Engagement1

2

3 Evaluation Use

High Quality Analysis

Page 57: Data Placemats: Construction and Practical Design Tips

Data Placemats: Construction & Practical

Design Tips

Thank You!

Veena Pankaj@VeenaPankaj

Friday, November 13, 2015Evaluation 2015, Chicago IllinoisAmerican Evaluation Association

@InnoNet_Eval