Listening to our Students, Tutors, and Faculty: Applying assessment results to Learning Assistance...

Listening to our Students, Listening to our Students, Tutors, and Faculty:Tutors, and Faculty:

Applying assessment results Applying assessment results to Learning Assistance Center to Learning Assistance Center

program improvementprogram improvement

Nadine Rosenthal, Chair, Nadine Rosenthal, Chair, Learning Assistance Department Learning Assistance Department

City College of San Francisco City College of San Francisco 50 Phelan Avenue, R207, San Francisco, CA 50 Phelan Avenue, R207, San Francisco, CA

[email protected]@ccsf.edu

415.452.5505415.452.5505Spring 2003Spring 2003

mailto:[email protected]

22

Learning Assistance Center Learning Assistance Center Mission StatementMission Statement

Mission StatementMission StatementLearning Assistance DepartmentLearning Assistance Department

Our mission is to provide a supportive environment that promotes active Our mission is to provide a supportive environment that promotes active learning and encourages collaboration among members of our diverse learning and encourages collaboration among members of our diverse community.community.

Toward this goal, we assist students in achieving their academic, Toward this goal, we assist students in achieving their academic, vocational, and personal goals through our academic-support program vocational, and personal goals through our academic-support program offerings: college success courses and workshops, peer-cooperative small offerings: college success courses and workshops, peer-cooperative small groups, student-centered peer and professional tutoring, and open-access groups, student-centered peer and professional tutoring, and open-access computer labs.computer labs.

Student Learning OutcomeStudent Learning OutcomeCollege Success CoursesCollege Success Courses

Students in our college and career courses learn to apply a variety of active Students in our college and career courses learn to apply a variety of active learning strategies to their personal growth and values, academic study learning strategies to their personal growth and values, academic study skills, critical and creative reasoning proficiency, and career exploration skills, critical and creative reasoning proficiency, and career exploration and development.and development.

33

Assessment ToolsAssessment Tools

Slide # Slide # FacultyFaculty

SWOT AnalysisSWOT Analysis 44 Faculty Needs SurveyFaculty Needs Survey 5-5-

66

StudentStudent Student Needs SurveyStudent Needs Survey 77 L.A.C. Student EvaluationL.A.C. Student Evaluation 8-98-9

TutorTutor Tutor Learning OutcomesTutor Learning Outcomes 1010 VTEA Learning OutcomesVTEA Learning Outcomes 11-1211-12

Office of Research & PlanningOffice of Research & Planning Algebra Survey Algebra Survey 1313 Morale Survey Morale Survey 14-1714-17 FTES/WSCH/Positive AttendanceFTES/WSCH/Positive Attendance 1818

44

SWOT AnalysisSWOT AnalysisSWOT Analysis is an effective way of identifying Strengths and Weaknesses of the SWOT Analysis is an effective way of identifying Strengths and Weaknesses of the LAC, LAC, and of examining the Opportunities and Threats the LAC may face. and of examining the Opportunities and Threats the LAC may face. This analysis using the SWOT framework will enable us to focus our activities into This analysis using the SWOT framework will enable us to focus our activities into areas where we are strong, and where the greatest opportunities lie. areas where we are strong, and where the greatest opportunities lie.

Strengths:Strengths:What are our advantages?What are our advantages?What do we do well? What do we do well? What do other people see as our strengthsWhat do other people see as our strengths

Consider this from the LAC view and from the Consider this from the LAC view and from the point of view of the people we deal with. We point of view of the people we deal with. We shouldn’t be modest hereshouldn’t be modest here

Weaknesses: Weaknesses: What could we improve? What could we improve? What do we do badly? What do we do badly? What should we avoid? What should we avoid?

Consider this from an internal and external Consider this from an internal and external basis. Do other people seem to perceive basis. Do other people seem to perceive weaknesses that we do not see? weaknesses that we do not see?

Opportunities:Opportunities:

Useful opportunities and action plans) can Useful opportunities and action plans) can come from such things as: come from such things as: Changes in technology and markets on both Changes in technology and markets on both a broad and narrow scale a broad and narrow scale Changes in city, school, or department Changes in city, school, or department policy that may affect us. policy that may affect us. Changes in social patterns, student Changes in social patterns, student population profiles, lifestyle changes, etc. population profiles, lifestyle changes, etc. Local Events and interesting trendsLocal Events and interesting trends

Threats: Threats: What obstacles do we face? What obstacles do we face? What is our competition doing? (Do we have What is our competition doing? (Do we have competition?)competition?)Are the required specifications for our Are the required specifications for our services changing? services changing? Is changing technology threatening our Is changing technology threatening our position? position? Do we have budgetary problems? Do we have budgetary problems?

55

Learning Assistance CenterLearning Assistance CenterFaculty Needs Survey – Faculty Needs Survey – 1st slide1st slide

CCSF Learning Assistance CenterCCSF Learning Assistance CenterFaculty Needs Faculty Needs

Thank you for your support for the programs and services in the Learning Thank you for your support for the programs and services in the Learning Assistance Center. Thanks to you, Assistance Center. Thanks to you, we are a vibrant and successful department at City College. To assist us in our we are a vibrant and successful department at City College. To assist us in our search for new and innovative ways to best support you and your students, would search for new and innovative ways to best support you and your students, would you please fill out this short survey and return it to R207you please fill out this short survey and return it to R207

Check the appropriate box that reflects your impression Check the appropriate box that reflects your impression of the following initiatives. Feel free to add additional of the following initiatives. Feel free to add additional comments on the back of this form.comments on the back of this form.

Excel-Excel-lentlentIdeaIdea

Good Good IdeaIdea

Needs Needs more more workwork

Not Not feasi-feasi-bleble

Learning Strategies Workshop Series – Drop-in workshops Learning Strategies Workshop Series – Drop-in workshops in the LAC on specific study strategies.in the LAC on specific study strategies.

97%97% 3%3%

Supplemental Instruction Groups – Peer-led, instructor-Supplemental Instruction Groups – Peer-led, instructor-supervised study groups specific to your own course supervised study groups specific to your own course content.content.

80%80% 20%20%

Curriculum Support – College Success faculty assist you in Curriculum Support – College Success faculty assist you in integrating learning strategies into your specific integrating learning strategies into your specific curriculum.curriculum.

80%80% 20%20%

Adjunct Study Courses - .5 unit group tutorial course Adjunct Study Courses - .5 unit group tutorial course taught along side your specific course.taught along side your specific course.

67%67% 33%33%

66

Learning Assistance CenterLearning Assistance CenterFaculty Needs Survey – Faculty Needs Survey – 22ndnd slide slide

Tutor Training in Content Areas – You act as a guest Tutor Training in Content Areas – You act as a guest lecturer in the LAC tutor-training course.lecturer in the LAC tutor-training course.

65 65 %%

35 35 %%

Classroom Presentations – 15 minute and 45 minute Classroom Presentations – 15 minute and 45 minute presentations in your classroom on a specific learning presentations in your classroom on a specific learning strategy led by LAC faculty or staffstrategy led by LAC faculty or staff

61 61 %%

39 39 %%

Study Buddies – LAC staff members assist you in Study Buddies – LAC staff members assist you in matching up your students into study partners and matching up your students into study partners and leaderless study groups. (Not a dating service.)leaderless study groups. (Not a dating service.)

60 60 %%

40 40 %%

Learning Styles – College Success faculty assist you in Learning Styles – College Success faculty assist you in assessing and working with your students’ learning assessing and working with your students’ learning styles.styles.

58%58% 42%42%

Online Learning Strategy Support – Students work on Online Learning Strategy Support – Students work on prepared online materials to develop their study prepared online materials to develop their study techniquestechniques

57%57% 43%43%

Instructors as Tutors – You lead study groups in your Instructors as Tutors – You lead study groups in your general content area in the LAC.general content area in the LAC.

57 57 %%

43 43 %%

LAC Office Hours – You schedule a portion of your office LAC Office Hours – You schedule a portion of your office hours in the LAC.hours in the LAC.

55 55 %%

45 45 %%

Online Tutoring – Use of commercially developed software Online Tutoring – Use of commercially developed software to tutor on lineto tutor on line

49%49% 51%51%

77

Learning Assistance CenterLearning Assistance CenterStudent Needs SurveyStudent Needs Survey

CCSF Learning Assistance CenterCCSF Learning Assistance CenterStudent Needs Questionnaire Student Needs Questionnaire

We are trying to increase the services that we provide through the Learning Assistance We are trying to increase the services that we provide through the Learning Assistance Center. Center. Please help us understand the kinds of services you would use if offeredPlease help us understand the kinds of services you would use if offered

Check the box that best tells us about your Check the box that best tells us about your interest in each idea.interest in each idea.Feel free to add your comments on the bottom of Feel free to add your comments on the bottom of this form. this form.

Excellent Excellent Idea.Idea.

I would I would use it.use it.

Good Good Idea for Idea for othersothers

Needs Needs more more workwork

Not good.Not good.

Learning Strategies Workshop Series – Learning Strategies Workshop Series – Drop-in workshops in the Learning Assistance Drop-in workshops in the Learning Assistance Center on specific study techniques and learning Center on specific study techniques and learning strategiesstrategies

96%96% 4%4%

Study Groups – Study Groups – Student-led study groups specific to the course Student-led study groups specific to the course content of your particular class.content of your particular class.

80%80% 20%20%

Adjunct Study Courses – Adjunct Study Courses – ½ unit study course taught as a class you take ½ unit study course taught as a class you take along with your specific class.along with your specific class.

80%80% 20%20%

Online Tutoring – Online Tutoring – Use of commercially developed software to tutor Use of commercially developed software to tutor on lineon line

68%68% 32%32%

Online Study Skills Programs – Online Study Skills Programs – You work on prepared online materials to develop You work on prepared online materials to develop your techniquesyour techniques

64%64% 36%36%

88

Learning Assistance Center Learning Assistance Center Student Evaluation – Student Evaluation – 11stst slide slide

CCSF Learning Assistance CenterCCSF Learning Assistance CenterStudent Evaluation SurveyStudent Evaluation Survey

This semester I used the LAC mostly for:This semester I used the LAC mostly for:English/ESLEnglish/ESL Math Accounting Math AccountingHealth-Related Computer Technology Health-Related Computer Technology Chemistry Anatomy/Physiology Chemistry Anatomy/Physiology Architecture Biotechnology Architecture Biotechnology Graphic Arts Foreign Language Graphic Arts Foreign Language OtherOther

My major goal for studying at CCSF:My major goal for studying at CCSF:4-yr. degree 2-yr. degree or certificate career 4-yr. degree 2-yr. degree or certificate career skills otherskills other

My LAC experience helped me toward my My LAC experience helped me toward my goal.goal.usually often sometimes rarelyusually often sometimes rarely

Did the LAC help you succeed in your Did the LAC help you succeed in your course(s)?course(s)?Yes A Lot A Little NoYes A Lot A Little No

I recommend the LAC to other students.I recommend the LAC to other students.usually often sometimes rarelyusually often sometimes rarely

I would join a study group, if offered.I would join a study group, if offered.Yes Probably Maybe NoYes Probably Maybe No

The LAC helped me in these job-related The LAC helped me in these job-related areas:areas:-develop skills I can use in a job. -develop skills I can use in a job. usually often sometimes rarelyusually often sometimes rarely

-organize my time better. -organize my time better. usually often sometimes rarelyusually often sometimes rarely

-practice problem-solving skills.-practice problem-solving skills.usually often sometimes rarelyusually often sometimes rarely

-recognize areas for improvement.-recognize areas for improvement.usually often sometimes rarelyusually often sometimes rarely

-add new information to my current knowledge.-add new information to my current knowledge.usually often sometimes rarelyusually often sometimes rarely

Grade I expected BEFORE using the Grade I expected BEFORE using the LAC:LAC:A B C D or F Drop or WA B C D or F Drop or W

Grade I expect AFTER using the LAC:Grade I expect AFTER using the LAC:A B C D or F Drop or WA B C D or F Drop or W

99

Learning Assistance Learning Assistance Center Center

Student Evaluation – Student Evaluation – 2nd 2nd slideslideCCSF Learning Assistance CenterCCSF Learning Assistance Center

Student Evaluation Survey: ResultsStudent Evaluation Survey: Results

Of 47 surveys completed during the 15th week of the Spring 04 semester:Of 47 surveys completed during the 15th week of the Spring 04 semester: 22 students are studying towards a 4-year degree and 18 students are studying 22 students are studying towards a 4-year degree and 18 students are studying

towards a 2-year degree.towards a 2-year degree. 46 students agreed that their Learning Assistance Center experience 46 students agreed that their Learning Assistance Center experience

usually/often helped towards their goal.usually/often helped towards their goal. 45 students agreed that their Learning Assistance Center experience helped 45 students agreed that their Learning Assistance Center experience helped

them succeed in their courses.them succeed in their courses. 10 students expected a grade of A or B BEFORE using the Learning Assistance 10 students expected a grade of A or B BEFORE using the Learning Assistance

Center, while 39 students expected a grade of A or B AFTER using the Learning Center, while 39 students expected a grade of A or B AFTER using the Learning Assistance Center.Assistance Center.

The Learning Assistance Center usually/often helped students The Learning Assistance Center usually/often helped students Develop job skills – 27Develop job skills – 27 Organize time – 24Organize time – 24 Practice problem-solving skills – 36Practice problem-solving skills – 36 Recognize areas for improvement – 36Recognize areas for improvement – 36 Add new information to current knowledge – 41Add new information to current knowledge – 41

1010

Learning Outcomes Learning Outcomes in Tutor Training Coursesin Tutor Training Courses

Tutor Learning OutcomesTutor Learning OutcomesBy the end of the semester, you will have By the end of the semester, you will have Tutored students for a minimum of 25 hoursTutored students for a minimum of 25 hours

By the end of this course you will be able toBy the end of this course you will be able to Demonstrate your ability to use effective techniques in your tutoring/mentoring sessions, and Demonstrate your ability to use effective techniques in your tutoring/mentoring sessions, and Evaluate your challenges and successes in tutoring.Evaluate your challenges and successes in tutoring.

Homework Assignment:Homework Assignment:A Case Study where you will address the above learning Outcomes.A Case Study where you will address the above learning Outcomes. Describe one tutoring session you completed with a student this semester from the first “hello” Describe one tutoring session you completed with a student this semester from the first “hello”

to the last to the last “good-bye.”“good-bye.”

Include an analysis of techniques you used in this session, including techniques listed on the next Include an analysis of techniques you used in this session, including techniques listed on the next page: roles, responsibilities, processes, questioning, independent learning, direct study, positive page: roles, responsibilities, processes, questioning, independent learning, direct study, positive reinforcement, listening, student verbalization, learning styles and strategies, problem solving, reinforcement, listening, student verbalization, learning styles and strategies, problem solving, and diversity issues.and diversity issues.

Evaluate on your challenges and successes while using the techniques: Why did they work or not Evaluate on your challenges and successes while using the techniques: Why did they work or not work?work?

What techniques do you hope to further develop as you continue to tutor?What techniques do you hope to further develop as you continue to tutor?An analysis of your outcomes in this course.An analysis of your outcomes in this course. During your first tutor training session you wrote your definition of tutoring. You continued to During your first tutor training session you wrote your definition of tutoring. You continued to

update your definition at the end of each session. Now, write your current definition of tutoring update your definition at the end of each session. Now, write your current definition of tutoring by discussing how it has developed throughby discussing how it has developed through the course of this semester. What did you learn this semester the course of this semester. What did you learn this semester that you will take away with you for future personal use?that you will take away with you for future personal use?

1111

Learning Outcomes: Learning Outcomes: VTEA Tutors – 1VTEA Tutors – 1stst slide slide

VTEA Student Learning OutcomesVTEA Student Learning OutcomesLERN 10: Introduction to Tutoring – One-Unit courseLERN 10: Introduction to Tutoring – One-Unit course

At the first class session of LERN 10: Introduction to Tutoring, Spring 04, At the first class session of LERN 10: Introduction to Tutoring, Spring 04, I asked my students, all of whom had been hired as tutors in the I asked my students, all of whom had been hired as tutors in the Learning Assistance Center, the following question: Learning Assistance Center, the following question:

“ “What are your goals for tutoring this semester?”What are your goals for tutoring this semester?”

At the end of the semester, after tutoring for 15 weeks, I asked the At the end of the semester, after tutoring for 15 weeks, I asked the following questions: following questions:

“ “How has your tutoring developed from your initial tutoring How has your tutoring developed from your initial tutoring sessions?”sessions?”

“ “What did you learn this semester that you will apply to your future What did you learn this semester that you will apply to your future education and career?”education and career?”

Responses are on the next slide.Responses are on the next slide.

1212

Learning Outcomes: Learning Outcomes: VTEA Tutors – 2nd slideVTEA Tutors – 2nd slide

Microbiology and Physiology Tutor:Microbiology and Physiology Tutor:Pre: Pre: My goal is to help other students…myself…improve my skills…challenge myself…My goal is to help other students…myself…improve my skills…challenge myself…Post: Post: My goal became learning how to talk less, yet explain more… grouping students My goal became learning how to talk less, yet explain more… grouping students

for the best discussions…using different learning styles for different students.for the best discussions…using different learning styles for different students. Nursing Chemistry (CHEM 32)Tutor:Nursing Chemistry (CHEM 32)Tutor:Pre: Pre: My goal is to help others and understand the material better…work on my My goal is to help others and understand the material better…work on my

communication skills…meet people….build my self-esteem and self confidencecommunication skills…meet people….build my self-esteem and self confidencePost: Post: I am now better at managing my time in the sessions…being a leader…listen I am now better at managing my time in the sessions…being a leader…listen

actively…sense of accomplishment.actively…sense of accomplishment.

Anatomy (ANAT 25) Tutor:Anatomy (ANAT 25) Tutor:Pre: Pre: I want to help lost of people…get a sense of self-worth…I want to help lost of people…get a sense of self-worth…Post: Post: Tutoring is a heart-warming experience…I’ve made a difference…meet diverse set Tutoring is a heart-warming experience…I’ve made a difference…meet diverse set

of students…increased my ability to adapt myself.of students…increased my ability to adapt myself.

Accounting ACCT 1) Tutor:Accounting ACCT 1) Tutor:Pre: Pre: MyMy goal is to achieve self-confidence…be more competent.goal is to achieve self-confidence…be more competent.Post: Post: I learned that my students were my teachers…I learned through their questions…I learned that my students were my teachers…I learned through their questions…

amazed at how appreciative students were.amazed at how appreciative students were.

1313

Algebra StudyAlgebra Study

Algebra Students:Algebra Students:Tutoring Works!Tutoring Works!

You WILL PASS You WILL PASS Math 840 with Math 840 with 1-2 hours of 1-2 hours of tutoring each tutoring each week. week.

That’s only That’s only 15-30 hours of 15-30 hours of tutoring during tutoring during the semester.the semester.

Effectiveness of Math 840 tutoring

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

0 10 20 30 40 50 60Number of hours tutored per semester

Per

cent

of s

tude

nts

pass

ing

Pass Rate

1414

Faculty-Staff Morale Survey – 1Faculty-Staff Morale Survey – 1stst SlideSlide

http://research.ccsf.edu/Surveys.asphttp://research.ccsf.edu/Surveys.asp

Learning Assistance Center Survey Learning Assistance Center Survey

The purpose of this survey is to assess morale. Please respond to the following questions candidly. The purpose of this survey is to assess morale. Please respond to the following questions candidly. Responses are anonymous and only group data will be reported.Responses are anonymous and only group data will be reported.(For the purposes of this questionnaire, supervisor means immediate and most frequent supervisor.) (For the purposes of this questionnaire, supervisor means immediate and most frequent supervisor.) CCSF Surveys can be found at CCSF Surveys can be found at http://research.ccsf.edu/Surveys.asphttp://research.ccsf.edu/Surveys.asp

COMMUNICATIONCOMMUNICATION AlwayAlwayss

UsuallUsuallyy

SeldoSeldomm

NeverNeverNo No

AnswAnswerer

1.1. I have a cooperative working relationship with I have a cooperative working relationship with my co-workers.my co-workers.

2.2. I can comfortably express my concerns to my I can comfortably express my concerns to my supervisor.supervisor.

3.3.My job description is clear and I am expected My job description is clear and I am expected to perform within the scope of my job to perform within the scope of my job description.description.

http://research.ccsf.edu/Surveys.asp

http://research.ccsf.edu/Surveys.asp

1515

Faculty-Staff Morale Survey – 2Faculty-Staff Morale Survey – 2ndnd SlideSlide

RECOGNITION and LEADERSHIPRECOGNITION and LEADERSHIP AlwayAlwayss

UsuallUsuallyy

SeldoSeldomm

NeverNeverNo No

AnsAnswerwer

44..My supervisor listens to and follows through on My supervisor listens to and follows through on

concerns raised by the LAC staff.concerns raised by the LAC staff.

55..My supervisor communicates job responsibilities My supervisor communicates job responsibilities

clearly.clearly.

66..I feel that my work is valued.I feel that my work is valued.

77..I feel that my opinions are valued.I feel that my opinions are valued.

88..I am invited to participate in making decisions I am invited to participate in making decisions

that affect the operations of the LAC.that affect the operations of the LAC.

STAFFINGSTAFFING AlwayAlwayss

UsuallUsuallyy

SeldoSeldomm

NeverNever No No AnswerAnswer

9.9. The workload is distributed fairly between co-The workload is distributed fairly between co-workers.workers.

10.10. Staffing/Student assistance is adequate.Staffing/Student assistance is adequate.

1616

Faculty-Staff Morale Survey – 3Faculty-Staff Morale Survey – 3rdrd SlideSlide

FACILITIES, SUPPLIES, EQUIPMENTFACILITIES, SUPPLIES, EQUIPMENT AlwayAlwayss

UsuallUsuallyy

SeldoSeldomm

NeverNeverNo No

AnswAnswerer

11.11. The LAC complies with health and safety The LAC complies with health and safety regulations.regulations.

12.12. The LAC is comfortable and adequately The LAC is comfortable and adequately furnished.furnished.

13.13. My co-workers are professional in their use of My co-workers are professional in their use of shared space and equipment.shared space and equipment.

14.14. The computer equipment and software I have The computer equipment and software I have access to are sufficient for my duties.access to are sufficient for my duties.

15.15. The amount and kind of other equipment and The amount and kind of other equipment and supplies available for my work are adequate.supplies available for my work are adequate.

1717

Faculty-Staff Morale Survey – 4Faculty-Staff Morale Survey – 4thth SlideSlide

TRAINING & PROFESSIONAL GROWTHTRAINING & PROFESSIONAL GROWTH AlwayAlwayss

UsuallUsuallyy

SeldoSeldomm

NeverNeverNo No

AnswAnswerer

16.16. I receive necessary orientation and support to I receive necessary orientation and support to successfully carry out my duties.successfully carry out my duties.

17.17. I am informed of and understand the role of I am informed of and understand the role of the LAC in relation to the college at large.the LAC in relation to the college at large.

18.18.

I receive necessary training and support in the I receive necessary training and support in the use of new equipment and software (e.g., use of new equipment and software (e.g., Banner, computers and medical equipment, Banner, computers and medical equipment, other technology). other technology).

SUMMARYSUMMARY ExcellExcellentent GoodGood AveraAvera

gege PoorPoorNo No

AnswAnswerer

19.19. Overall, my morale at work is:Overall, my morale at work is:

20.20. Overall, I feel that the commitment and ability Overall, I feel that the commitment and ability of the staff to meet students' needs is:of the staff to meet students' needs is:

1818

Learning Assistance DepartmentLearning Assistance DepartmentFTES – WSCH ReportFTES – WSCH Report

TERMTERM YEARYEAR DEPTDEPT FTESFTES WSCHWSCH POS. ATT.POS. ATT.

FallFall 19981998 LERNLERN 183183 55075507 84,67184,671

SpringSpring 19991999 LERNLERN 198198 59485948 90,11490,114



FallFall 20002000 LERNLERN 173173 51895189(Peak of dot.com era)(Peak of dot.com era)

77,53277,532






Listening to our Students, Tutors, and Faculty: Applying assessment results to Learning Assistance...

Documents

Transcript of Listening to our Students, Tutors, and Faculty: Applying assessment results to Learning Assistance...