Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. ·...
Transcript of Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. ·...
![Page 1: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/1.jpg)
Computational Thinking: Assessment in Alice
Class Overview
![Page 2: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/2.jpg)
The Fairy Performance Assessment
How do we assess Computational Thinking?
2 year study using Alice with Middle Schoolers
Premise: Debug faulty programs based on design patterns learned in class
Computational Thinking 2
![Page 3: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/3.jpg)
Alice
Computational Thinking 3
![Page 4: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/4.jpg)
Purpose
Assess Knowledge
Why is there variation among students?
• -> Strengthen efforts to engage K-12 in CT
Computational Thinking 4
![Page 5: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/5.jpg)
Demographic Data
325 students - 311 assessed
60% in-school
36% female
52% white, 37% latin[oa]
Computational Thinking 5
![Page 6: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/6.jpg)
Other Factors
Age, Gender, Race/Ethnicity, Language, Parents computer
usage, Parental education
levels, Grades, Favorite subject
Confidence with Computers,
Attitude towards Computers,
Frequency and Type of Computer Use,
Simple Alice Content Attendance Data, Hours spent paired
programming
Computational Thinking 6
![Page 7: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/7.jpg)
Semester Protocol
Challenges
* First Half
* Self-paced
* 11 + 6 bonus
* Debug programs
Free Design
* Second half
* Complete control
Fairy Assessment
Computational Thinking 7
![Page 8: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/8.jpg)
Fairy Assessment
Computational Thinking 8
![Page 9: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/9.jpg)
Computational Thinking Definition
“Thinking Algorithmically”
“Making effective use of Abstraction and Modeling”
“Considering and Understanding Scale”
Computational Thinking 9
![Page 10: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/10.jpg)
Assessment Progression
First Fairy Walks into Forest
Manipulating Parameters
Use Fairy regrows when key is pressed
Removing/Adding Instructions
Modify The two fairies escape
Coding their own method, plus manipulating and using
•“complex conditionals”,
•“methods with multiple parameters”, and
•event handling
Create
Computational Thinking 10
![Page 11: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/11.jpg)
Results
Paired Programming -> Better results
More computer usage -> Better results
Higher grades -> better results
Confidence with Computers -> better results
…
Computational Thinking 11
![Page 12: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/12.jpg)
More important results
Assessment was motivating (90% return rate)
Claim that it was positively correlated with another assessment of content knowledge
• But no details provided!
Computational Thinking 12
![Page 13: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/13.jpg)
Criticisms
Very narrow definition of CT
Only focused on programming
How do we know it measured anything?
Computational Thinking 13
![Page 14: Computational Thinking: Assessment in Alicekafura/CS6604/Slides/Bart... · 2013. 11. 14. · Attendance Data, ... Fairy regrows when key is pressed Removing/Adding Instructions Modify](https://reader036.fdocuments.us/reader036/viewer/2022071510/612f377b1ecc515869434d00/html5/thumbnails/14.jpg)
Mediated Transfer: Alice 3 to Java
2 year study of CS1 to Java
Eclipse Plugin to convert Alice code to Java
Exam scores went up ~20%
Bridging vs. Hugging
Computational Thinking 14