Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008...
-
Upload
peregrine-berry -
Category
Documents
-
view
216 -
download
0
Transcript of Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008...
![Page 1: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/1.jpg)
Social Network Analysis for Evaluation:
Open and Closed Approaches
Carl HanssenNovember 6, 2008
American Evaluation Association
The Milwaukee Mathematics Partnership (MMP) is supported with funding from the National Science Foundation.
![Page 2: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/2.jpg)
www.hanssenconsulting.com 2
Agenda
Context
Open & Closed Approaches
Strengths & Limitations
![Page 3: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/3.jpg)
www.hanssenconsulting.com 3
Context
Milwaukee Math Partnership Comprehensive Work in multiple schools Goal: Distributed Leadership
Life Sciences for a Global Community Institute partnership Work with 3 cohorts of 30 teachers Goal: Teacher leader network
![Page 4: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/4.jpg)
www.hanssenconsulting.com 4
Open Approach
Respondent pool defined by the organization
Clean slate
Interested in network members inside and outside the organization
Interested in specific individual roles
![Page 5: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/5.jpg)
www.hanssenconsulting.com 5
Low
Student Achievement:2007: 66% Proficient3-year trend: -9%
School n Total Named
Network density
Density in school
MTL Role--In Degree
MTS Role--In Degree
K 11 57 3.8% 13.7% 7.6 0.4
Average 23 66 4.8% 10.7% 16.5 3.4 SD 9.3 24 1.7% 2.5% 6.4 4.1 Median 23 64 4.1% 11.0% 15.0 1.4
![Page 6: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/6.jpg)
www.hanssenconsulting.com 6
High
Student Achievement:2007: 53% Proficient3-year trend: +3%
School n Total Named Network density
Density in school
MTL Role--In Degree
MTS Role--In Degree
G 32 79 5.0% 12.1% 16.3 5.4
Average 23 66 4.8% 10.7% 16.5 3.4 SD 9.3 24 1.7% 2.5% 6.4 4.1 Median 23 64 4.1% 11.0% 15.0 1.4
![Page 7: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/7.jpg)
www.hanssenconsulting.com 7
Closed
Respondents defined by cohort
Fixed slate
Interested in collaboration within network
Similar expectations for all members
![Page 8: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/8.jpg)
www.hanssenconsulting.com 8
Cohort 1
![Page 9: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/9.jpg)
www.hanssenconsulting.com 9
District A
Red diamond—institute participantGreen box – science teacherGreen square – other teacher (English, math, etc.)
![Page 10: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/10.jpg)
www.hanssenconsulting.com 10
Strengths
Open Flexible Reduces bias Focus on roles Track evolution over
time Informs action
Closed Clean data collection All participants are
equal Track evolution over
time Informs action
![Page 11: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/11.jpg)
www.hanssenconsulting.com 11
Limitations
Open Messy data Non-responses
Closed Limited scope Requires clean subject
lists Non-responses
![Page 12: Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics.](https://reader035.fdocuments.us/reader035/viewer/2022062421/56649e255503460f94b15202/html5/thumbnails/12.jpg)
www.hanssenconsulting.com 12
Contact Information
Carl Hanssen, Ph.D.
Hanssen Consulting, LLC
1324 Lake Dr. SE, Suite 6
Grand Rapids, MI 49506
616-808-2867