A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study...

30
A Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching Elizabeth Patitsas University of Toronto November 15, 2013 Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 1 / 30

Transcript of A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study...

Page 1: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

A Case Study of the Development of CS TeachingAssistants and Their Experiences with Team Teaching

Elizabeth Patitsas

University of Toronto

November 15, 2013

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 1 / 30

Page 2: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Teaching assistants

Graduate students who participate in course delivery (some ugrad)

Closed labs

Tutorials

Assistance with in-lecture activities

Grading, office hours

Most heavily used in North America

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 2 / 30

Page 3: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Introduction

TAs play a big role in teaching CS at many institutions; have effecton student grades [1], retention [2], diversity [3]

30-50% of the contact hours at American research-oriented unis [4]

Most professors get their first teaching experience as TAs [4]

Challenge: understand how to support CS TAs

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 3 / 30

Page 4: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Teacher development

Teachers of all varieties develop in stages [5]

Knowledge transfer is “pull transfer” not “push transfer” [6]

Motivation: we want to understand TA development to improve TAtraining/support

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 4 / 30

Page 5: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Context

UBC: labs are taught by pairs of TAs

20-30 students in a lab, 2-3 hours in length

200 TAs in the department (grad and undergrad); teach about half ofthe contact hours in first/second year CS

Convention: TAs who have taught a course are rehired to that course

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 5 / 30

Page 6: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Methods

TAs sampled to get a range of experience

Focus on first and second year courses

Semi-structured interviews with nine TAs

Lab observations of those TAs + eight additional TAs

We sorted TAs into three stages (Novice/Intermediate/Expert) basedon Sprague’s stages of TA development (see paper for more)

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 6 / 30

Page 7: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Part I

How do first-time TAs differ from experienced

TAs in terms of teaching technique?

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 7 / 30

Page 8: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Preparation

Novice TAs were diligent about preparing, but had a hard time

They would read through the labs, but not do themThey lacked the PCK to tell where students would stumble

Intermediate TAs were less diligent! TAs who had taught a coursemore than once would be lazy about preparation.

TAs of all levels benefit from weekly TA meetings where the TAs gothrough the labs: first-timers learn how to prepare; experienced TAsare kept fresh on the material

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 8 / 30

Page 9: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Triage

First time TAs did not discriminate between student questions

Experienced TAs would carefully triage questions

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 9 / 30

Page 10: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Teamwork with fellow TA

Recall: TAs teach in pairs.

First time TAs would ignore their partners, feeling “too overwhelmed”with student questions (see: triage!).

Experienced TAs would collaborate with their partners (more on thatlater), and seek help from them when stuck.

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 10 / 30

Page 11: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Authority

First-time TAs reported a hard time with maintaining authority

For many this was the hardest part of the job.

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 11 / 30

Page 12: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Approach to answering questions

First time TAs were more focused on answering the question;

If they did not know the answer, they would minimize the question or“make something up”They were afraid for their status as an authorityThey could take a long time to answer questions if they had to workthrough it themselvesWould not ask their partner for help.

Experienced TAs were more Socratic

Would tailor their approach based on the student.

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 12 / 30

Page 13: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Communication skills

First-time TAs also reported being stuck on communication skills

They were worried they weren’t speaking loud or slowly enough

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 13 / 30

Page 14: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Difficulties

For Novice TAs:

Lack of PCK when preparing forlabs

Inability to triage

Maintaining authority

Communication skills

For Intermediate TAs:

Hubris in preparation

Shifting to a more Socratic,personalized approach toanswering questions

Effective collaboration with theirpartners (and other course staff)

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 14 / 30

Page 15: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Part II

How do first-time TAs differ from experienced

TAs in terms of perception of the job?

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 15 / 30

Page 16: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Changes in perception

Least favourite part of the job: students failing vs. structural parts ofthe course

Examples of the latter: 8am staff meetings, Blackboard, unhelpful profs

Relationship with students: being a friend vs. being a mentor

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 16 / 30

Page 17: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Part III

What promotes growth from the Novice stage

to Intermediate stage and Intermediate to

Expert?

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 17 / 30

Page 18: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Novice to Intermediate Intermediate to Expert

Practice on same course

Useful staff meetings, guidancefrom instructors and senior TAs

Encouragement

Student feedback

Teaching a different course

Mentorship from instructors andsenior TAs

Critical feedback

Collaboration and reflectionwith partners in lab

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 18 / 30

Page 19: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Part IV

How do TAs work together in the lab?

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 19 / 30

Page 20: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

How TAs Work Together in Lab

Active observation: seeing the other TA explain issues

Strategizing: how to handle difficult students, questions, etc

Debugging the lab handouts

Clarifying TAs’ own (mis)understandings of the lab, logistics

Socializing

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 20 / 30

Page 21: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Knowledge Transfer

Alpha TA to Beta TA

Alpha TA would take the lead in class announcements; Beta wouldask them for support more than vice versa

Consistent through term

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 21 / 30

Page 22: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Social learning from the Alpha

The beta TA learns from the alpha TA: “I would not [be as good aTA] had I not the lab with [alpha TA] and access to what she wasdoing”

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 22 / 30

Page 23: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Who is the alpha?

The member of the dyad who has more experience with the labswould wind up as alpha

A first-time TA who has a lab earlier in the week would be alpha in ateam with an expert TA who is new to the course!

The TAs respond to who has more course PCK – not who has moreteaching ability!

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 23 / 30

Page 24: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

TAs enjoyed working in pairs

Division of labour: “makes the lab more efficient”

Security: “it’s nice to have somebody covering your back”

Teamwork: having another TA to socialize with during lulls inquestions, or “bounce ideas off of”

Diversity: “sometimes you just can’t see something and you needanother view”; “we could combine our knowledge”

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 24 / 30

Page 25: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Conflict can happen

Sources of conflict:

Differences in markingDiffering standards for punctuality, professionalism and preparation

Expert TAs would be proactive about these issues

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 25 / 30

Page 26: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Implications for TA training

Two-stage training: Novice to Intermediate, Intermediate to Expert

Stage 1: focus on communication, triage, authority, preparationStage 2: focus on instructional techniques, managingpartners/instructors, adapting to new material

Evidence that 1-on-1 observations are more effective than trainingsessions [8]

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 26 / 30

Page 27: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Implications for course management

Run staff meetings for the benefit of TAs; give them advice,encouragement, and solicit their feedback

Weekly TA meetings where TAs work through the labs(recommended: have a head TA run this)

Consider experience and development when assigning TAs to tasksand lab sections

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 27 / 30

Page 28: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Conclusions

TA quality can be improved by improving TA support

TAs develop; novice TAs are focused on things like communication,not instructional technique

Effective TA training needs to happen at multiple points in a TA’sdevelopment, not just the beginning

Staff meetings are an important source of TA support; instructorsneed to view TA-training as part of their role

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 28 / 30

Page 29: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

Acknowledgements

Thanks to the study participants!

Meghan Allen, Patrice Belleville, Michelle Craig, Steve Easterbrook,Kimberly Voll, Steve Wolfman

Travel funding: National Science and Engineering Research Council ofCanada

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 29 / 30

Page 30: A Case Study of the Development of CS Teaching Assistants ...patitsas/koli_2013_tas.pdfA Case Study of the Development of CS Teaching Assistants and Their Experiences with Team Teaching

References

Cassandra Paul, Emily West, David Webb, Brenda Weiss, and Wendell Potter.

Important types of instructor-student interactions in reformed classrooms, 2010.American Association of Physics Teachers Summer Meeting.

Christopher O’Neal, Mary Wright, Constance Cook, Tom Perorazio, and Joel Purkiss.

The impact of teaching assistants on student retention in the sciences: Lessons for TA training.Journal of College Science Teaching, 36(5):24–29, 2007.

Eric Roberts, John Lilly, and Bryan Rollins.

Using undergraduates as teaching assistants in introductory programming courses: an update on the Stanford experience.SIGCSE Bull., 27(1):48–52, March 1995.

S. S. Bomotti.

Teaching assistant attitudes toward college teaching.Review of Higher Education, 17(4):371–393, 1994.

Peter Kugel.

How professors develop as teachers.Studies in higher education, 18(3):315–328, 1993.

Sally Fincher and Josh Tenenberg.

Warren’s question.In Proceedings of ICER ’07, ICER ’07, pages 51–60, New York, NY, USA, 2007. ACM.

Jo Sprague and Jody D Nyquist.

TA supervision.New directions for teaching and learning, 1989(39):37–53, 1989.

Ben Stephenson.

University of calgary’s ta mentorship program, 2013.Invited talk at UToronto.

Elizabeth Patitsas (University of Toronto) Case Study on Compsci TAs November 15, 2013 30 / 30