I21 Data Report

12

Click here to load reader

description

Report made for SDUSD on i21 survey data

Transcript of I21 Data Report

Page 1: I21 Data Report

SDUSD's i21 Survey Results

Amber Lunde, Melissa Richardson, and Cathy TranNovember 10, 2009SDSU – ED 795A

Page 2: I21 Data Report

Overview of Participants

Of the i21 teachers who were invited to participate in our survey, 330 teachers completed the survey (although not every question required an answer). Here is the breakdown of the teachers who submitted their responses:

Q: At which grade level(s) do you teach?

46.1% (n=152) Elementary (K - 5th)35.2% (n=116) Middle (6th - 8th)18.8% (n=62) High (9th - 12th)

Page 3: I21 Data Report

Most Selected Answers

Q: Which subject(s) do you teach?

51.8% Multiple subjects28.8% Math13.9% English

Q: Now that you've completed the i21 training, how confident are you in your abilities to utilize the new equipment in your classroom?

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)49.8% Somewhat29.6% Very13.4% Not at all7.2% Extremely

52.2% Somewhat28.4% Very16.4% Not at all3.0% Extremely

49.0% Somewhat30.8% Very11.5% Not at all8.7% Extremely

45.3% Somewhat30.2% Very15.1% Extremely9.4% Not at all

47.6% Somewhat28.6% Very15.5% Extremely8.3% Not at all

40.5% Very 38.1% Somewhat14.3% Not at all7.1% Extremely

*Green indicates results differ slightly from ALL of the teachers.

Q: Following is a list of areas where further training and support resources might be useful to you. Please check the three that most appeal to you.

Incorporating the new technology with your current curriculumTroubleshooting technical issuesManaging the students and the equipment while students are using it

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)78.5% Incorporating60.4% Troubleshoot58.4% Managing

78.5% Incorporating64.4% Troubleshoot56.3% Managing

80.8% Incorporating66.3% Managing59.6% Troubleshoot

74.1% Incorporating51.9% Troubleshoot48.1% Managing

80.0% Incorporating55.3% Troubleshoot55.3% Managing

81.0% Incorporating69.0% Managing57.1% Troubleshoot

*Purple indicates a tie.

Page 4: I21 Data Report

Q: Following is a list of specific equipment where further training and support resources might be useful to you. Please check the three that most appeal to you.

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)79.2% St. Netbooks59.0% Pro. Board57.3% Tablet PC

86.7% St. Netbooks64.4% Pro. Board57.8% Tablet PC

77.9% St. Netbooks57.7% Pro. Board53.8% Tablet PC

63.0% St. Netbooks63.0% Tablet PC48.1% Pro. Board

68.2% St. Netbooks58.8% Tablet PC45.9% Pro. Board

76.2% St. Netbooks54.8% Pro. Board50.0% Tablet PC

*Green indicates results differ slightly from ALL of the teachers. *Purple indicates a tie.

Q: Some teachers have expressed concern about visiting (substitute) teachers using the Promethean Board and DVD/VCR/HDTV Tuner; these issues are listed below. Please check the two that best represent your own reservations.

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)69.6% Care for 41.3% Turn on 41.0% Troubleshoot

65.9% Care for52.6% Turn on45.2% Troubleshoot

70.2% Care for40.4% Troubleshoot33.7% Turn on

77.8% Care for31.5% Troubleshoot27.8% Turn on

78.8% Care for37.6% Troubleshoot31.8% Turn on

64.3% Care for 42.9% Turn on 35.7% Troubleshoot

Q: Prior to the roll out of the Student Netbooks, which of the questions listed below best represent concerns that you anticipate having. Please check the top three.

How will I be able to monitor the students and keep them on-task?Will students know how to use the technology or will I have to teach it in addition to my curriculum? Will students know how to troubleshoot technical issues?Will students know how to care for the equipment?

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)70.0% Monitor64.8% Use51.2% Troubleshoot

74.1% Use74.1% Monitor54.8% Troubleshoot

67.3% Monitor64.4% Use53.8% Troubleshoot

64.8% Monitor61.1% Care42.6% Use

69.4% Monitor60.0% Care52.9% Use

64.3% Monitor57.1% Use50.0% Troubleshoot

*Red indicates results differ more than slightly from ALL of the teachers.

Page 5: I21 Data Report

Q: Are you interested in more specialized training on using technology in the classroom?

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)89.4% Yes10.6% No

91.9% Yes8.1% No

87.5% Yes12.5% No

87.0% Yes13.0% No

87.1% Yes12.9% No

90.5% Yes9.5% No

Q: Following are four areas for which specialized training is being considered. Please rank order your interest in them, with #1 being your top choice and #4 your last choice.

Based on average rating:How to integrate technology effectively into my specific curriculum How to use the equipment effectively for instructionHow to use the various computer applications available to me The nuts and bolts of using the equipment

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)1.90 Technology2.18 Equipment2.66 Applications3.27 Nuts and bolts

1.91 Technology2.16 Equipment2.70 Applications3.24 Nuts and bolts

1.87 Technology2.20 Equipment2.58 Applications3.36 Nuts and bolts

1.93 Technology2.18 Equipment2.70 Applications3.18 Nuts and bolts

1.80 Technology2.25 Equipment2.72 Applications3.23 Nuts and bolts

1.97 Technology2.16 Equipment2.53 Applications3.34 Nuts and bolts

Q: When would you prefer to have additional training? Please rank order your interest in them, with #1 being your top choice and #4 your last choice.

Based on average rating:ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)1.95 School day2.06 After school2.89 Summer3.08 Weekend

1.91 School day2.13 After school2.93 Weekend3.00 Summer

1.92 School day2.01 After school2.81 Summer3.24 Weekend

2.00 After school2.09 School day2.79 Summer3.17 Weekend

1.93 After school2.08 School day2.77 Summer3.25 Weekend

1.92 School day2.16 After school2.68 Summer3.27 Weekend

*Green indicates results differ slightly from ALL of the teachers.

Page 6: I21 Data Report

Q: Who would you like to be trained with? Please rank order your interest in them, with #1 being your top choice and #3 your last choice.

Based on average rating:ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)1.60 School site/team2.16 Content area2.24 Grade level

1.43 School site/team1.89 Grade level2.68 Content area

1.74 Content area1.78 School site/team2.48 Grade level

1.57 Content area1.70 School site/team2.68 Grade level

1.66 Content area1.71 School site/team2.61 Grade level

1.63 Content area1.76 School site/team2.61 Grade level

*Green indicates results differ slightly from ALL of the teachers.

Q: Would you be interested in attending informal user groups after school? If so, please rank order your interest in them, with #1 being your top choice and #4 your last choice.

Based on average rating:ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)2.14 Content2.17 Grade level2.34 Topic-based3.32 Cluster

1.61 Grade level2.31 Topic-based2.70 Content3.34 Cluster

1.65 Content2.32 Topic-based2.62 Grade Level3.41 Cluster

1.57 Content2.53 Topic-based2.85 Grade level3.03 Cluster

1.65 Content2.56 Topic-based2.58 Grade level3.26 Cluster

1.64 Content2.29 Topic-based2.73 Grade Level3.29 Cluster

*Red indicates results differ more than slightly from ALL of the teachers.

Q: How likely would you be to participate in additional training if you could not be compensated for attending?

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)41.7% Somewhat27.4% Not at all17.5% Very13.5% Extremely

42.0% Somewhat30.3% Not at all16.8% Very 10.9% Extremely

41.6% Somewhat23.6% Not at all18.0% Very16.9% Extremely

40.9% Somewhat27.3% Not at all18.2% Very13.6% Extremely

39.4% Somewhat28.2% Not at all21.1% Very11.3% Extremely

34.2% Somewhat26.3% Not at all21.1% Extremely18.4% Very

Page 7: I21 Data Report

Q: Following are five delivery modalities for which additional supports (job aids) are being considered. Please rank order your interest in them, with #1 being your top choice and #5 your last choice.

Based on average rating:ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)2.33 Online vid/aud2.74 Paper-based2.76 Online PDFs3.42 Online vid/text3.74 Podcasts

2.13 Online vid/aud2.73 Paper-based2.85 Online PDFs3.60 Online vid/text3.72 Podcasts

2.25 Online vid/aud2.84 Online PDFs2.87 Paper-based3.22 Online vid/text3.84 Podcasts

2.35 Online PDFs2.50 Paper-based3.00 Online vid/aud3.40 Online vid/text3.60 Podcasts

2.58 Online PDFs2.67 Online vid/aud2.78 Paper-based3.28 Online vid/text3.62 Podcasts

2.28 Online vid/aud2.55 Paper-based2.90 Online PDFs3.46 Online vid/text3.86 Podcast

*Green indicates results differ slightly from ALL of the teachers. *Red indicates results differ more than slightly from ALL of the teachers.

Q: Following is a list of application choices. Please check up to five where further training and support resources might be useful to you.

Promethean ActivInspire Windows 7 Student responders Microsoft Movie Maker Microsoft PowerPoint United Streaming Google Sketchup 7 Comic Life

ALL (n=330) Elementary (n=152) Middle (n=116) High (n=62) Math (n=95) English (n=46)64.5% Pro. ActivIns. 49.3% Windows 7 46.8% St. responders 45.7% MS Movie M. 33.3% MS PPT 33.3% Un. Streaming

68.2% Pro. ActivIns.58.1% Windows 747.3% St. responders47.3% MS Movie M.36.4% MS PPT

67.6% Pro. ActivIns.56.9% MS Movie M.45.1% St. responders40.2% Windows 735.3% Un. Streaming

49.0% Pro. ActivIns.49.0% St. responders45.1% Windows 733.3% MS PPT29.4% G. Sket. 7

54.9% Pro. ActivIns.50.0% St. responders42.7% Windows 734.1% Un. Streaming30.5% MS PPT

73.2% MS Movie M.70.7% Pro. ActivIns.51.2% St. responders41.5% Comic Life36.6% Un. Streaming

*Purple indicates a tie.

Page 8: I21 Data Report

Open-ended Questions

Q: What do you like about the handouts (job aids) you received at the training? Were they clear, easy to understand, useful for teachers as well as students, comprehensive, sturdy?

General • Clear• Easy to understand/ use• Useful/ helpful• Comprehensive

Specific • Screenshots/ visual references• Word, Excel, and PowerPoint handouts• Examples • Step-by-step instructions• Table of contents• Hard copy to refer to

*Teachers also indicated that: 1) They haven't needed them. 2) They don't have the equipment yet to use them.3) They haven't received any.4) Handouts are needed for the 6-hour training.

Page 9: I21 Data Report

Q: What do you think would improve the current handouts (job aids) so that they are more effective? Easier to use? More helpful?

Format/Look and Feel • Step-by-step approach for programs and tutorials• Binder w/ tabs or laminated with metal ring• Place in categories/ specify subject area (better organization)• Color-coded• Have small laminated cards that are attached to the specific piece of equipment• Videos• Make them more tutorial-like• Colored booklet (easier to see)• Simpler

Content • Common troubleshooting strategies• Need handouts for ActivInspire, new Word for Windows 7• Address the current needs of the teachers• More examples (specifically math)• List of things that can't be done w/ equipment (no downloads, etc.)• Handouts with the little and hidden tricks that are used• More screenshots• Video of teacher using equipment

Other • Need to test job aids to find mistakes/missing steps • Provide them at 6-hour training• Have a training where JAs are used• Provide user manual (training was too fast)

*Teachers are not aware of what supports are available to them and/or where to look. They have asked for:1) FAQ's section2) List of contacts3) Have them available on a website to download (waste of paper)

Page 10: I21 Data Report

Q: Are there any other concerns that you have that haven’t been addressed?

General Statements • Need time to:◦ learn technology, practice with equipment◦ work with dept/ other teachers to develop lessons

• How do I design/ align lessons that meet standards for students? • My classroom does not have the equipment yet. I may need a refresher when it gets here.• Too much information at one time. I am overwhelmed.

Access • Need to be able to:◦ install programs onto tablet PCs and netbooks (Geometer Sketchpad for students & teachers, TI

connect, graphing calculators, Inspiration ver8, Equation Editor, etc.)◦ print documents from the ActivInspire for IEP students since I do not have an admin code to add my

printer ◦ connect my tablet to my wireless router at home

• Why is the Promethean Board installed in the middle of the whiteboard? (Please allow substitute access. I have almost no whiteboards for them to use since the Promethean board covers them all!)

Equipment/ Maintenance/Troubleshooting

• Protocol when equipment breaks or is lost or stolen:◦ Repaired or replaced?◦ Who is responsible? (teachers, students, VTs, etc.)

• Inefficient process for getting help (need to fill out blue form, then wait for call to schedule an appt.)• Issues with:

◦ bluetooth mouse◦ pen calibration◦ tablet being too small to read

• Too many wires (should be wireless)• Those who teach Math or another language need help on how to get special characters in the new

programs. The computers don't seem to recognize "math" talk - higher level math concepts - derivatives, limits, and integrals.

• Need to be able to use clickers with Math and Science lessons• Battery life? 2 hours? Is there enough power to recharge all the netbooks?• Networking the Thinkpad to a laser printer until our individual ones come on board • How do I get my Mac programs over to my tablet PC?• Mac related programs. We need to have the abilities to load printer software in our computers.

Page 11: I21 Data Report

Additional Support • Be able to watch a teacher use the equipment during a lesson• Additional training next year and beyond?• More hands-on w/ instructors

Visiting (Substitute) Teachers

• Many teachers have said they would NOT let VTs use the equipment. Had this been an option, more may have chosen it.

• Teachers would be in possession of the Tablet PC anyway, so VTs wouldn't be able to use the equipment.

• VTs will not:◦ know how to use the equipment (Will they be trained?)◦ have a password

• VTs will use the wrong pens on the board.Students • What about using it with cognitively low-skilled students? Or modifications for special needs students?

• Security • Will the time it takes for the students to overcome technical issues interfere with the lessons?• When will student netbooks & training for them be available?• Will students check out the netbooks? Parents trained as well?

*Teacher would like to be contacted: “Will the software we use be installed on them??? Specifically the new math adoption and ST math. HUGE CONCERN Call me 619 823 9272 or [email protected]

Page 12: I21 Data Report

Suggestions for Next Steps

Additional Analysis • If teachers will not be paid to attend additional trainings, will it make more sense to focus on the needs of those teachers who indicated that they are extremely or very likely to attend?

• Since math teachers were the primary focus of high school teachers this year, another survey should be conducted next year with the teachers in the new content area.

Job Aids • Top delivery modalities:◦ Online videos w/ audio – elementary, middle, and English◦ Online PDFs – high and Math

• Areas of focus:◦ Incorporating the new technology with the current curriculum (main issue for all teacher

categories). Suggestions include:

• bell work• quick write• formative assessment• checking for understanding

◦ Although student netbooks was the number one equipment choice for additional support, since they are not yet available, job aids should be created for Promethean Boards and tablet PCs.

◦ Promethean ActivInspire• number one application choice for elementary, middle, high, and Math teachers• second choice for English teachers

• Revise the current job aids to make it more user friendly with suggestions from the survey (tabs, color coding, etc.)

Training • By grade levels for elementary teachers: K - 2nd and 3rd - 5th • By content area for middle and high school teachers• After school, unless funding is available for teachers to get training during school

Visiting (Substitute) Teachers

• Provide training (“certification”) to VTs • District policy (lock up equipment or allow VTs to use at their own risk)