Click to edit Master title stylePLCs in the 21st Century: Partnerships for Powerful Learning

Sheryl Nussbaum-BeachDoctoral Candidate at William & Mary

CEO, Powerful Learning Practice

Dr. Sofia PardoLead Researcher, ideasLAB

Click to edit Master title styleMaking the Case for Change

• The world is changing.• Kids are using social

technologies.• No one is teaching them.• Traditional professional

development doesn't work.• Powerful Learning Practice takes

a different, unique approach to professional learning.

“The research tells us that teachers need to learn the way other professionals do—continually, collaboratively, and on the job. The good news is that we can learn from what some states and most high-performing nations are doing.”

~Linda Darling Hammond

Click to edit Master title stylePLP Professional Development Design…

• Seek out 20 schools/districts willing to invest some time in exploring the challenge of 21st Century Learning.

• Ask the schools to identify small teams of 5-6 educators who are ready for this exploration.

• With the support of our PLP Community Managers, Cohort Community Leaders,PLP Fellows, Experienced Voices, and Team Leaders we begin that exploration together.

• …With the eventual goal of "scaling up" the exploration in each participating school.

"I didn't realize how far along we'd come until the end. My whole life has changed and this whole new world has opened up to me."

- Melanie Hutchinson, - International Cohort

http://

Click to edit Master title style

WorkshopsTwo all day

workshops that build capacity, community

and develop 21st Century skills.

WebinarsLive meetings where teams meet, listen and then reflect in

small groups.

Virtual Learning Community

Where we deepen understanding, network,

share resources and grow as a community

of practice.

Professional Learning TeamsJob embedded teams who meet face-to-face and work towards scale and alignment of 21st Century skills with school improvement goals

PLP Model

Click to edit Master title style

PLP takes a 3-pronged approach to PD

- Professional Learning Communities (PLC)- Global Communities of Practice or Inquiry (CoP)- Personal Learning Networks (PLN)

We coined the phraseConnected Learning Communities to encompass the 3 pronged approach.

Click to edit Master title styleCommunity is the New Professional Development

Cochran-Smith and Lytle (1999a) describe three ways of knowing and constructing knowledge that align closely with PLP's philosophy and are worth mentioning here.

Knowledge for Practice is often reflected in traditional PD efforts when a trainer shares with teachers information produced by educational researchers. This knowledge presumes a commonly accepted degree of correctness about what is being shared. The learner is typically passive in this kind of "sit and get" experience. This kind of knowledge is difficult for teachers to transfer to classrooms without support and follow through. After a workshop, much of what was useful gets lost in the daily grind, pressures and isolation of teaching.

Knowledge in Practice recognizes the importance of teacher experience and practical knowledge in improving classroom practice. As a teacher tests out new strategies and assimilates them into teaching routines they construct knowledge in practice. They learn by doing. This knowledge is strengthened when teachers reflect and share with one another lessons learned during specific teaching sessions and describe the tacit knowledge embedded in their experiences. 

Click to edit Master title styleCommunity is the New Professional Development

Knowledge of Practice believes that systematic inquiry where teachers create knowledge as they focus on raising questions about and systematically studying their own classroom teaching practices collaboratively, allows educators to construct knowledge of practice in ways that move beyond the basics of classroom practice to a more systemic view of learning.

We believe that by attending to the development of knowledge for, in and of practice, we can enhance professional growth that leads to real change.

Cochran-Smith, M., & Lytle, S.L. (1999a). Relationships of knowledge and practice: Teaching learning in communities. Review of Research in Education, 24, 249-305.

Passive, active, and reflective knowledge building in local (PLC), global (CoP) and contextual (PLN) learning spaces.

Click to edit Master title styleThe PilotJune• Met virtually and planned• Created marketing materials• Recruited teams, fellows & community leaders• Trained Fellows & Team Leaders in ElluminateJuly• F2F training for Fellows, Community and Team Leaders• KickoffAugust – September-October• Webinars• Online community involvementNovember• Culminating F2F• SurveyDecember- April• Content Analysis• Concluded pilot work

Research collaboration in 2009 between ideasLAB in Australia and Powerful Learning Practice in USA

Click to edit Master title styleNING and Pulse

Pulse Burst Icon

Click to edit Master title stylePurpose of Study

The purpose of our study is to identify the:

nature

evident outcomes

of professional conversations among educators in an asynchronous, team-based, online community of practice.

The conversations took place in a white list application for social network creation called NING

Click to edit Master title styleResearch Questions

• Flow: What is the flow (i.e., direction) and frequency of the posts among differing roles within the learning community?

• Function: What is the function (i.e., purpose) and frequency of the posts among posts differing roles within the learning community?

• Content: What is the content (i.e., topics) and frequency of the posts among posts differing roles within the learning community?

Click to edit Master title styleContent Analysis Methodology

• Created function categories*• Identified content categories**• Developed codebook in Google Docs• Created Analysis Tool- Pulse• Piloted coding while training coders in Skype

(we started with 5, then 4, then 3)

• Calculated inter-rater reliability(http://dfreelon.org/utils/recalfront/recal3/)

* Adapted from Bonk & Kim's (2008) 12 forms of mentoring & Gunawardena, Lowe & Anderson (1997) online knowledge construction analysis model** Adapted from Australian e-potentials survey (2008)

Click to edit Master title styleContent Analysis: Interrater Reliability

File size: 112 bytes N coders: 3 N cases: 16

N decisions: 48

Average Pairwise Percent Agreement

Average % Agreement

AverageCohen's Kappa

Flow 95.8 % 0.941

Content 95.8 % 0.921

Function 81.25 % 0.606

AVERAGE 90.97 % .82

Flow: file:///C:/Users/snbeach/Desktop/FLOW.php.htm Function: file:///C:/Users/snbeach/Desktop/FUNCTION.php.htmContent: file:///C:/Users/snbeach/Desktop/CONTENT.php.htm

Click to edit Master title styleContent Analysis Methodology

• Unit of Data Collection Discussion thread within an online connected learning community

• Unit of Data Analysis Individual posting to discussion thread within a forum, blog post, or group

room in an online connected learning community. Flow was analyzed from context of thread

• Type of Evidence: Manifest vs. Latent Manifest or explicit meaning that can be objectively derived from the words

used and the thoughts expressed in the postings.

Click to edit Master title styleMean, Median, Mode, SD, Range

Mean Median Mode SD Range

Member 6.2 3 2 6.18 36

Team Leader 12.8 11

19 & 2 (Bimodal) 11.18 45

Fellow 28.6 27 14 21.3 69

Comm Leader 43.3 19.5No mode 47.1 129

Exp Voice 10 1 1 12.4 25

Click to edit Master title styleFrequency and Direction of Posts

Member

Fellow

Community Leader

Team Leader

ExperiencedVoice

Broadcast

Team LeaderFlow

Click to edit Master title styleFLOW Who is talking to whom?

1215 is 76% of entire posts (1636)

Percentage of comments posted by role N=1215

4%

21%

21%

19%

35%

Experienced voices

Community Leaders

Fellows

Team leaders

Members

Click to edit Master title styleFLOW (cont.)

Where are these conversations taking place?

644

203

57

123135 117115

179232

Experiencedvoices

CommunityLeaders

Fellows Teamleaders

Members

Public vs Group Postings by RolePublic Spaces Group Spaces

Click to edit Master title styleFlow (Frequency and Directions of Posts

Click to edit Master title styleFlow (Frequency and Directions of Posts

Click to edit Master title styleFlow (Frequency and Directions of Posts

Click to edit Master title styleFlow (Frequency and Directions of Posts

Click to edit Master title styleFlow (Frequency and Directions of Posts

Click to edit Master title styleFLOW (cont.)

Member; 16

Community Leader; 45

Total ; 55

Directional Reciprocity

Team Leader; 10

Fellow; 31

Total; 41

Community Leader; 18

Exp Voice; 2

Total; 20

Click to edit Master title styleFLOW (findings) • Majority of comments were broadcasted with slightly

higher numbers in public (384) than group spaces (358).• Members posted mostly in group spaces yet they were

addressed more often in public spaces.• Fellows addressed team leaders three times more than team

leaders did to fellows. (Directional Reciprocity)• Out of 130 community members, 20% chose not to post

and just observe (lurk).• While the community was designed with loose

governance, the higher the perceived leadership role the comments took on a more specific direction.

Click to edit Master title styleFLOW (cont.) Content Area Descriptors

LT - Learning and Teaching- if they talk about students good chance it should be coded here.

• Creativity and Innovation- • Critical Thinking and Problem Solving-• Communication and Collaboration - • Lesson planning and delivery (methods)• Differentiation • Pedagogy• Active Engagement• Teacher performance• Teacher role• Digital literacy

AR - Assessment and Reporting • Testing: assessment intended to measure the students' knowledge, skills or other abilities• Surveys: Instruments used to collect student data • Portfolios: Collection and display of students work• Analysis of data (e.g. scores, feedback)• Data driven decision making• Need for changing current assessment practices/methods• Selection of appropriate assessment • Creation or implementation of assessment

Click to edit Master title styleFLOW (cont.) Content Area Descriptors

COM - Classroom Organization and Management

• Physical layout: Positioning of desks/areas of work in the classroom or other spaces within the school• Student grouping for learning in physical or virtual environments• Organizes for effective teaching• Rapport building with students or other student relationship aspects• Effective use of time• Includes management of electronic environments

ET - ICT Ethics • Digital citizenship (cybersafety, copyright, acceptable use, privacy, cyberbullying, digital rights, digital footprint and responsibilities, ) A digital citizen commonly refer to a person that participates in society using a certain amount of information technology• Digital Access and Digital divide: The digital divide is the gap between people with effective access to digital and information technology and those with very limited or no access at all.• Intellectual property

Click to edit Master title styleFLOW (cont.) Content Area Descriptors

R - Resources • Creating/sharing/remixing resources• Tools/gadgets for tools sake• Quality/vetting of resources• Locating resources• Access of resources

PL - Professional Learning • Participating in and applying, planning, sharing experiences around ICT PD or other educationally relevant learning• Reflecting on frequency, type and effectiveness of ICT PD • Formal and informal professional development opportunities (such as PLNs, online meetings, inservices)• Shared norms and community building (local or global)• Professional learning on the part of the teacher in a connected learning environment• Learning how to make effective use of time in digital environments• Formal or informal personal learning on the part of the teacher to improve over time

Click to edit Master title styleFLOW (cont.) Content Area Descriptors

L - Leadership • Sharing ideas, resources at school with other educators/networks • Supporting and facilitating in the CoP• Supporting or advocating change• Influencing school policies and practices• Teacher leadership• Instructional leadership• 21st Century administrator• Professional learning communities: A professional learning community (PLC) is an extended learning opportunity to foster collaborative learning among colleagues within a particular work environment or field. It is often used in schools as a way to organize teachers into working groups.• Shared vision/mission

Click to edit Master title styleContent of Discussions by Role

Click to edit Master title styleContent of Discussions by Role

Learning and Teaching

Click to edit Master title styleContent of Discussions by Role

Professional Learning

Click to edit Master title styleContent of Discussions by Role

Resources

Click to edit Master title styleCONTENT• While it was expected to have a high concentration of

comments in T&L and Professional Dev areas, we were surprised at the number of comments around resources.

• While members posted mostly in group spaces, the topic of L&T was discussed more in public areas of the community.

• However, the opposite happened with professional learning as it occurred more often in the smaller, intimate setting of the groups-with the exception of the CL role.

• Members talked about resources everywhere (both public and private) however, Fellows discussed resources more in groups. CL continued to be public in their leadership role.

Click to edit Master title styleContent of Discussions by Role Knowledge Functions Indicators

N/A Not Applicable Things we do not need to code because they do not fit a function. Or responses such as "Me too" "I agree" "I do" "Exactly" "Yes/No"

S Seeking specific information/clarification/or general advice

Questions that seek specific information (How do you...) (Has anyone... Question or statement that invites explanation or clarification (How did you do ... Could you explain how this works...)Question, statement or experience that invites other people’s opinions (Help?... Ideas?...) This is an individual trying to get help-- not just something with a question mark.

ShI Sharing information (e.g. tool, urls, articles) Sharing a resource such as articles, blog, tools, websites, samples of work. Or sharing a fact that is not supported with point of view, or similarities and differences between points of view or supported with lessons learned and actions taken, or thoughts and feelings.

GA Guided Advice Suggestions like (Let me know how it goes... or let me know if you want to talk about it..) (Course of action- if the person, even in asking for information, includes a course of action for keeping things from being "this way" )Offers support (Is there anything I can do?) (Let me help you)

Click to edit Master title styleContent of Discussions by Role Knowledge Functions Indicators

SPV Sharing a point of view Shares own point of view on discussion topic. No mention of another's point of view. If only the writer's opinion is present code here. (I think that... I believe that...)

CPV Contrasting points of view Identifies similarities/differences between own point of view and others or between others point of view. You need to be able to identify at least two people giving a points of view (even if they agree). If "I agree" "yes, absolutely" Or Yes, that's right" is in the statement it should be coded here. (I agree with this person’s... the argument seems to have two sides...)

SE Sharing/contrasting experiences Sharing positive as well as problematic experiences that account for actions taken, associated thoughts and feelings and/or lessons learned and reflections (I did this with my students...) This could be any form of action- not necessarily something of value (eg. reading an email) but it is an actual description of experience rather than an opinion.

ME Mentoring Asking facilitating kinds of questions meant to help the learner think deeply or metacognate. Mentoring and nurturing kinds of suggestions like (Let me know how it goes... or let me know if you want to talk about it..) (Offering moral support)This is a coaching role and encourages reflection.

Click to edit Master title styleContent of Discussions by Role Knowledge Functions Indicators

NM Negotiation of meaning Discussing meaning of terms, concepts or ideas, negotiation of the relative weight of ideas from an individual perspective. You should be able to pinpoint the concept or idea that is being discussed. If it blurry then it probably isn't negotiation of meaning. - (My interpretation of... This idea could mean...) Must include meaning or description of the concept so that meaning is illuminated clearly as well as pinpointing concept to be scored here. Theoretical ideas and concepts, not just opinions. Does the speaker try to create deeper meaning around the concept rather than just share/contrast opinions and experiences. There may be questions that guide folks to thinking more deeply about the concept. "Let's think about Norm building together..." Does this post seem to be in a different league of depth than the other posts in this thread that were scored point of view or experiences?

TK Testing and modification of knowledge (aka Professional Growth)

Contrasting new knowledge against existing cognitive schema, personal experience and other resources. Allusion to the relationship between the new knowledge/practice and the old knowledge/practice must be clearly articulated   (My thinking has been challenged... I previously did this but now I do...)Need to see clearly both thinking before and thinking after.

Click to edit Master title styleFunction of Discussions by Role

Click to edit Master title styleFUNCTION • The three most utilized levels of knowledge building

were sharing info, sharing/contrasting exp, and sharing point of view.

• The content they were sharing, contrasting, or giving a point of view on aligned nicely with the top content areas as well.

• Least used knowledge functions were the highest order skills- negotiation of meaning and professional growth, with negotiation of meaning only occurring at the CL level.

• Most mentoring took place in the CL role. The content being mentored was PL, Leadership, and L&T

Click to edit Master title style• International perspectives deepened the professional conversation that took place by those involved in the coding. However, because of the under utilization of the EV (international visitors) further study needs to occur as to make the most of the opportunity for diverse conversations at the community level.

• Tools were mastered within the context of knowledge building for the most part, with the exception of resource sharing.

• More focus to the development of a shared vision for community outcomes needs to happen at the start of the project.

• Job-embedded PD that results in significant shift doesn’t occur in 4 months.

• Pulse holds tremendous potential for unlocking emprical truths in CMC because of the ease of use and authenticity of data placement

Click to edit Master title styleReferences Bonk, C. J., & Kim, K. A. (1998). Extending sociocultural theory to adult

learning. In M. C. Smith, & T.Pourchot (Eds.) Adult learning & development: Perspectives from educational psychology. Mahwah,

NJ, USA: Erlbaum Associates.

Freelon, D.G. (2010) ReCal: Intercoder Reliability Calculation as a web service. International Journal of Internet Science 5 (1), 20-33.

Gunawardena, C. Lowe, C & Anderson, T. (1997). Analysis of global online detabe and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing. Journal of Educational Computing Research 17(4), 37-431.

DEECD (2008). ePotential Teacher ICT Capabilities Survey; Powerfuil Learning Enabled by ICT.

Click to edit Master title styleWhat is PULSE?

Pulse is a unique online content analysis tool that enhances the capacity of students, teachers and researchers to document, manage, understand and assess distributed online content by associating rich meta-data with it. It is an embedded contemporary assessment tool that provides a platform for assessing 21st century skills in a meaningful and authentic manner.”

Click to edit Master title styleRoadmap

• Beta testing cycle completed on February 2011

• Product and/or service available to public March 2011

Expressions of interest : pulse@ideaslab.edu.au