UWS Assessment Familiarity Survey 1. What is your level of … · 2010-12-10 · What is your level...

13
1 UWS Assessment Familiarity Survey 1. What is your level of knowledge regarding assessment of student learning? (Check one.) # Answer Response % 1 Excellent. I believe I have a high level of current knowledge regarding assessment. 9 13% 2 Good. I believe I have an appropriate level of knowledge regarding assessment, but could benefit from additional training on current practices in assessment. 31 44% 3 Fair. I believe I have a fair level of knowledge regarding assessment, but need to update my knowledge and skills in basic assessment. 18 26% 4 Poor. I believe I do not have the level of knowledge needed to effectively assess student learning. 5 7% 5 I have not learned about the assessment of student learning. 7 10% Total 70 100% 2. What is your level of comfort with assessment? (Check one.) # Answer Response % 1 Very comfortable. I have knowledge of and use assessment in various areas; I enjoy it! 12 17% 2 Comfortable. I have knowledge of and use assessment as it relates to my work. 34 49% 3 Somewhat comfortable. I have knowledge of and use assessment, but am not fully comfortable in implementing it. 13 19% 4 Not comfortable. 11 16% Total 70 100%

Transcript of UWS Assessment Familiarity Survey 1. What is your level of … · 2010-12-10 · What is your level...

1

UWS – Assessment Familiarity Survey

1. What is your level of knowledge regarding assessment of student

learning? (Check one.)

# Answer

Response %

1 Excellent. I believe I have a high level of current knowledge regarding assessment.

9 13%

2

Good. I believe I have an appropriate level of knowledge regarding assessment, but could benefit from additional training on current practices in assessment.

31 44%

3

Fair. I believe I have a fair level of knowledge regarding assessment, but need to update my knowledge and skills in basic assessment.

18 26%

4 Poor. I believe I do not have the level of knowledge needed to effectively assess student learning.

5 7%

5 I have not learned about the assessment of student learning.

7 10%

Total 70 100%

2. What is your level of comfort with assessment? (Check one.)

# Answer

Response %

1 Very comfortable. I have knowledge of and use assessment in various areas; I enjoy it!

12 17%

2 Comfortable. I have knowledge of and use assessment as it relates to my work.

34 49%

3

Somewhat comfortable. I have knowledge of and use assessment, but am not fully comfortable in implementing it.

13 19%

4 Not comfortable.

11 16%

Total 70 100%

2

3. Where did you FIRST learn about assessment and related

activities? (Check one.)

# Answer

Response %

1 While attending graduate school.

24 34%

2 At a UW - Superior Center for the Excellence of Teaching and Learning book club.

0 0%

3 At a UW - Superior Center for the Excellence of Teaching and Learning new faculty orientation.

4 6%

4 At a UW - Superior Faculty Enhancement Day.

4 6%

5 At a UW - Superior Opening Week activity (other than Faculty Enhancement Day).

6 9%

6 At a professional meeting or conference (not at UW - Superior).

9 13%

7 On my own.

7 10%

8 I have not learned about assessment.

5 7%

9 Other:

11 16%

Total 70 100%

Other:

Graduate studies

undergraduate education courses

Probably in some converstaion sometime with an administrator

undergraduate degree

At an earlier job, through their CETL-type center's events

Teaching Driver Education

teacher certification courses

NSTA workshop run by Jim Minstrell

My previous career was as an educational diagnostician.

Dept. meeting

3

4. Do you currently use assessment activities in your curricular

(academic courses) or co-curricular (such as sports, residence life,

student clubs) activities on the UWS campus? (Check one.)

# Answer

Response %

1 Yes

57 81%

2 No

13 19%

Total 70 100%

5. What types of assessment activities do you use? (Check all that

apply.)

# Answer

Response %

1 Grading

44 63%

2 Advisement meetings

22 31%

3 Student evaluations of a learning activity

32 46%

4 Student evaluations of a course

44 63%

5 Student evaluations of a co-curricular activity or event

14 20%

6 Pre- and post-tests

20 29%

7 Exit interviews

17 24%

8 Reflective papers from students on their learning (such as minute papers)

30 43%

9 Anecdotal information from student meetings, classes, and/or activities

36 51%

10 I don't use assessment activities

12 17%

11 Other:

13 19%

4

Other:

Regular meetings with student volunteers in organizations to determine learning objectives, skill development.

I have students that intern with me. I give them tasks to do and then evaluate their work and discuss their work with them.

feedback from students working for me

Qualatative Assessment of Senior Thesis Papers and Presentations

student self and peer evaluations

I'd like to do more of the above

Pointed conversations with students, faculty, and staff inform us in informal ways about the programs and services we offer in residence life

program impact studies

NSTA workshop with Jim Minstrell

outside review by "experts" of student accomplishment

Formative Quizes after each unit before they take midterms and final exams.

6. Why do you use assessment activities? (Check all that apply.)

# Answer

Response %

1 To determine student learning

51 73%

2 To determine learning in a group of students

26 37%

3 To improve a course

47 67%

4 To improve an activity

45 64%

5 To increase my understanding of my teaching

37 53%

6 I don't use assessment activities.

11 16%

7 Other

5 7%

Other

federal requirement

to determine whether a student should "test out of" my course

To Improve the Major Curriculum

provide rationale to other units for doing certain activities, to ascertain funding or knowledge about a certain question or activity, to gain information as to satisfaction rates, retention rats, etc.

to imporeve participant learning in a program

5

7. Could you provide an example of an assessment method or

technique you use in your curricular or co-curricular activity? Name

and briefly describe.

Text Response

minute papers, an evaluation discussion at the end of specific activities and the course

Rubrics for grading written assignments and oral presentations.

Event evaluations - after events. Goal setting and feedback with student volunteers in organizations. Student entertainment surveys - to assess trends/interest for booking future entertainment.

Explaining a policy to a student, having them draft a policy paper, and then reviewing that policy paper with the student and talking about what they learned and how their work impacts the campus.

Problem-Based Learning (PBL) lab in which students assess the effectiveness of the group

multi-layered assessment model provided by feds

focus group, along with many others

Reflections on labs -- I ask students to write a brief description/evaluation of labs over the semester.

one on one meeting with a student/athlete at the end of the school year

Satisfaction Surveys of Intramural Sports and Special Events participants. We offer them randomly to students after participation in an event.

We have a standard evaluation form that we use after all workshops. We also conduct an overall impact evaluation of our certificate and leadership program every three to five years. We also try to do exit surveys on Surveymonkey for our Certificate grads.

pre and post event interviews

I do mid-term evaluations in which students describe what is going well/not going well in the course. I go over the general results with students and explain any changes that will be implemented as a result. I am explain why certain changes will not be implemented.

grading, advisement

students are asked to write papers applying and reflecting on their knowledge/learning

muddiest point and crystal clear point made in class session

We conduct exit interviews with all graduating students in the major. We also assess senior thesis projects according to progrommatic learning goals. We then meet once a year to collate and interpret this data to measure program effectiveness and identify areas to work on for improvement

This does not apply to my area.

I use minute papers to assess areas of success and 'sticky points' that need to be re-addressed in a future class meeting.

course evaluation at end of course that measures learning before and after

anecdotal written comments during student discussions

"Taking the temperature of the class": I often ask students to turn in short anonymous responses to questions about how the course is going: have they done the reading, what questions do they have about the material, what concerns about the class, etc. I also often ask students to write short responses and turn them in with their names on them, to assess individual issues.

6

Reflective writing exercise with feedback from a peer and the instructor.

Reflection papers after major assigments and projects

Instruction in Archery. We ask students to model the steps to shooting in Archery, we video tape them and ask them review the video and to write a short reflective paper on their skill, things done well and things that need improvement. We then ask them to create an instructional video, usually 1-2 minutes long, to be used to teach the steps to shooting an arrow. A rubric is then used to assess the video for content and creativity.

Graduate students include a section of narrative reflection (on readings, course dynamics, requirements, and assignments) in their final course paper

Exit interviews in residence life to find out why they are leaving the residence halls, what their experience has been life, etc. Also, we use reflection papers as a method of both assessment of learning and behavior change as well as understanding of policy/procedure through the conduct process with students.

student evaluations of group members' work in a project

We utilize end of semeter evaluations for continual improvement for our AS-L partnerships/projects.

program impact study, orogram or course evaluations

Writing Proces: students write multiple drafts of their papers, each time seeking to improve them. They are able to compare their changes when they compile everything in their portfolios.

No

Online Survey sent to participant emails where we incorporate the learning objectives and satisfaction with the event

Peer evaluations on group activities. Students have the opportunity to evaluate the quality and quantity of each member of their group. This feedback is then used to calculate a final grade for the project.

On line interactive discussions.

Assess how faculty/staff/students are comfortable with PS by the number of requests for change or the complaints filed.

Group discussions on in-class projects & the student's views of the most useful and least useful aspects of their projects.

Ask students to write a "quick" paper on their opinion of the value of a learning activity (usually a discussion of certain ideas in a music history class).

I include at least one 'reflective' question about what was learned within assignments that appear merely 'technical' in nature.

I begin by defining four kinds of evaluation: formative evaluation, summative evaluation, peer-evaluation, and self-evaluation. I emphasize that each type serves a function in student learning and ask them to engage in guided self-assessment of "what they've learned" from their writing. These assessments involve reflection on and discussion of general knowledge gained, personal knowledge gained, task-specific knowledge gained, and text-specific knowledge gained. Usually, by the end of the semester, beginning writers appreciate the truth that writing involves cognition/knowing, process/doing, and artifact/product.

Group Presentation

Students are provided a case study of a student with a disability and then take (or are assigned, depending on the class) a "role" on an IEP (individual education Plan) team and participate in a meeting

7

-- they must use the skills and information from the class regarding ethical, social. legal and managements conduct during an IEP team planning meeting while participating. I have a rubric which I use for scoring the activity and which I then share with individuals and the entire team. i use the rubric as a teaching tool as we reflect on the whole activity and I also use it to improve the activity for the next class.

We do an end of the summer assessment of our summer program. It includes both qualitative and quantitative measures.

I use rubrics for all major assignments. I then examine each dimension of the rubric to see if all dimensions are being addressed well by the entire group or whether a particular dimension(s) is seemingly not well understood.

Formative Quizzes that the students are not graded on but rather to allow them to see their own progress or lack their of. This gives them a chance to imporve their learning before it "counts."

Exit interviews, exit surveys...

Provide hands-on projects and service learning opportunities

One-on-one assessment at every weekly applied lesson -- constant interaction and feedback from student.

Statistic Value

Total Responses 48

8. How often do you use assessment activities, on average? (Choose

the answer that best describes what you do.)

# Answer

Response %

1 Never

10 14%

2 Daily

4 6%

3 Three to four times a week

3 4%

4 One to two times a week

12 17%

5 Three to four times a month

16 23%

6 One to two times a month

16 23%

7 One to two times an academic semester or athletic season

5 7%

8 One to two times a year

4 6%

Total 70 100%

8

9. What role do you believe assessment plays in student

learning? (Check all that apply.)

# Answer

Response %

1 It provides me with a greater understanding of what (ideas, concepts) students are learning.

54 77%

2 It provides me with a greater understanding of how (thinking process) students are learning.

42 60%

3

It provides me with a greater understanding of what affects student learning (strengths, stressors, environmental factors).

40 57%

4

It provides me with a tool to assess my own effectiveness in my role with students (such as faculty, coach, student service support).

57 81%

5 It provides me an opportunity to get to know students better.

36 51%

6 It provides me with the opportunity to do research related to the scholarship of teaching and learning.

14 20%

7 Other:

14 20%

Other:

It should do all those things if the instructor can construct an assessment tool that will measure them.

Provide with data on student interests - entertainment.

It's required for documentation purposes, "playing the game," if you will. I value assessment, but I also am wary of how it is often used (e.g., for job retention decisions) and also how it is indicative of our ever-increasing workload, the accountability required imposed on educators, and so on.

N/A

It helps me determine what to do next with my students.

Comment: This isn't to say that all of these are realized in my use of assessment; I'm reading this question as a general one.

It allows me to compare my effectiveness (and my unit) with others across the UW system and other professional orgs

provides me with an understanding as to how the program changed particpants' behaviors

Not an instructor

9

10. Please rate your degree of interest in learning more about

assessment and best practices through workshops or trainings at UW -

S. (Check one.)

# Answer

Response %

1 I am very interested in learning more, just tell me when!

17 24%

2 I am somewhat interested in learning more, depending on the topic.

31 44%

3 This area is not a high priority for me.

11 16%

4 I am not interested in learning more.

2 3%

5 I would not attend a workshop.

9 13%

Total 70 100%

10

We have five liberal education learning goals in place at UWS. They

are:

The ability and inclination to think and make connections across

academic disciplines.

The ability and inclination to express oneself through multiple

forms.

The ability and inclination to analyze and reflect upon multiple

perspectives to arrive at a perspective of one’s own.

The ability and inclination to engage as a global citizen.

The ability and inclination to engage in evidence-based problem

solving.

11. Are you familiar with the liberal education learning goals listed

above? (Check one.)

# Answer

Response %

1 Yes

57 81%

2 No

13 19%

Total 70 100%

11

12. Where did you FIRST hear of the liberal education learning goals?

(Check one.)

# Answer

Response %

1 At an Academic Affairs Committee meeting.

2 3%

2 At a Faculty Senate meeting.

1 1%

3 At another campus committee meeting (including chairs).

15 21%

4 At a departmental meeting.

23 33%

5 At a program meeting (including an academic discipline or co-curricular program).

6 9%

6 Through the Faculty/Student Digest.

1 1%

7 I’ve never heard of the liberal learning goals before seeing them in this survey.

8 11%

8 Other:

14 20%

Total 70 100%

Other:

Freshman Faculty Orientation?

UWS website

Through reading the UWS website through my own job search/interview process (I just started at UWS two months ago)

During the NCA reassessment process 10 years ago, I think.

I found them on the website to use for an in-class writing activity

Through conversation with peers

My colleagues

during job interview

Read them

I was on the team developing them

In this survey.

12

13. What activities are you involved with regarding student learning?

(Check all that apply.)

# Answer

Response %

1 Academic coursework.

47 67%

2 Co-curricular activities, including student clubs, athletics, Yellow Jacket Union, and residence life.

22 31%

3 Advisement.

35 50%

4 University administration.

15 21%

5 Other:

16 23%

Other:

Support

None

Student internships

Five Liberal Arts Initiatives

CEE workshops

Tutoring services

N/A

university judicial processes

continuing education programming

student worker(s)

library instruction

13

14. What is your PRIMARY role on campus? (Check one.)

# Answer

Response %

1 Faculty (tenure-track or tenured)

28 40%

2 Instructional academic staff (including adjunct faculty)

10 14%

3 Non-instructional academic staff

17 24%

4 Classified staff

8 11%

5 Adminstration

4 6%

6 Other:

3 4%

Total 70 100%

Other:

Program Manager

Upward Bound-College prep for H.S.

Research

15. How long have you been employed at UWS?

# Answer

Response %

1 Less than one year.

7 10%

2 Between 1 to 4 years.

22 31%

3 Between 5 to 8 years.

9 13%

4 Between 9 to 12 years.

9 13%

5 Between 13 to 16 years.

10 14%

6 Between 17 to 20 years.

2 3%

7 More than 20 years.

11 16%

Total 70 100%