Team-Based InquiryMaking Evaluative Thinking Part of Your

Work

Network-Wide MeetingDecember 2012

Team-Based Inquiry• Scott Pattison, OMSI,

spattison@omsi.edu• Gabby Burlacu, OMSI,

gburlacu@omsi.edu• Sarah Cohn, SMM, scohn@smm.org• Liz Kollman, MOS, lkollman@mos.org• Ali Jackson, Sciencenter,

ajackson@sciencenter.org • Sookram Ramsaroop, NySci,

sramsaroop@nysci.org

Team-Based Inquiry

1. Question

2. Investigate

3. Reflect

4. Improve

Team-Based Inquiry

1. Question

2. Investigate

3. Reflect

4. Improve

• Led by non-evaluation professionals

• Collaborative and team-based

• Small scale and focused

• Embedded in ongoing work

• Systematic

Team-Based Inquiry

• Improving products and practice

• Fostering effective teams and organizations

• Building evaluation capacity

1. Question

2. Investigate

3. Reflect

4. Improve

Team-Based Inquiry

1. Question

2. Investigate

3. Reflect

4. Improve

Question

1. Question

2. Investigate

3. Reflect

4. Improve

Asking Questions

Maybe you have TONS of questions

Team-Based Inquiry Questions can…1) NOT be easily answered,2) be ACTED upon immediately, and 3) be INVESTIGATED, given current resources (time, money, visitors, etc.)

Asking Questions

Product Question

Why is this question interesting / important to you and your team?

What sources of data would you need to answer this question?

What resources would you need to answer this question?

How long will it take to answer this question?

Based on all of this, how high a priority is this question?H=High, M=Medium, L=Low, E=Eliminate H M L E

H M L E

H M L E

Program Goals and Objectives: ____________________________

Investigate

1. Question

2. Investigate

3. Reflect

4. Improve

Visitor SurveyInitials: ______ Date:__________ Program title: ________________ Survey Number: _____

Help us improve the program you just saw!

Please take a few minutes to share your opinions below.

1. What did you like most about this activity? 2. What are some ways this activity could be improved? 3. In your own words, what would you say is the goal of this activity? 4. What is your age? ______ 5. What is your gender? ___________ 6. Who did you come with to the museum today? (Check one)

I am here alone. I am with a school or tour group. I am here with family or another social group that includes children and adults. I am here with family or another social group that includes adults only.

Thank you for your time and feedback!

Before you leave, please return your completed survey to a museum employee.

Reflect

1. Question

2. Investigate

3. Reflect

4. Improve

13

Once you’ve identified your TBI question and collected your data, you can discuss that data as a team to identify:

• Themes• Interesting or unusual

data points

After this discussion, you can apply those themes to your data and begin to think about how they might inform or improve your practice .

Data Reflection

1. Question

2. Investigate

3. Reflect

4. Improve

14

Data Reflection Steps

1) Describe and clarify2) Observe and discuss3) Immerse and notice4) Categorize and explain5) Reflect

15

Activity Instructions

• Take a moment to read over the data on your handout.

• Around your table, discuss1) One piece of data you find interesting and why2) One theme you see occurring in the data

16

Data Reflection Steps

1) Describe and clarify2) Observe and discuss3) Immerse and notice4) Categorize and explain5) Reflect

Improve

1. Question

2. Investigate

3. Reflect

4. Improve

“Horton Senses Something Small”

Data collection• Observations of participants• Surveys with caregivers and parents• Debrief with program developers

Lessons learned• Program works best for ages 3-5• Prompt participation during the story

Does the program engage young children? How could it be improved?

NanoDays 2012 Posters

Data collection• Interviews with 30 visitors at

three museums• Informal observations by team• Debrief with educators

Lessons learned• Visitors liked the graphics and

suggested improvements• Educators felt graphics attracted

attention and defined space

Are educational posters worth including in the NanoDays 2012 kit?

Improve

1. Question

2. Investigate

3. Reflect

4. Improve

TBI Report Template

Questions and Discussion?

This presentation is based on work supported by the National Science Foundation under Grant No. 0940143.Any opinions, findings, and conclusions or recommendations expressed in this presentation are those of the author(s) and do not necessarily reflect the views of the Foundation.

Team-Based Inquiry• Scott Pattison, OMSI,

spattison@omsi.edu• Gabby Burlacu, OMSI,

gburlacu@omsi.edu• Sarah Cohn, SMM, scohn@smm.org• Liz Kollman, MOS, lkollman@mos.org• Ali Jackson, Sciencenter,

ajackson@sciencenter.org • Sookram Ramsaroop, NySci,

sramsaroop@nysci.org