General EducationGeneral Education

Assessment ReportAssessment Report

Outcomes B-2, B-3, B-8, C-1, C-4, Outcomes B-2, B-3, B-8, C-1, C-4, C-5C-5

Methodology:Methodology:The assessment for each of these outcomes The assessment for each of these outcomes used the Measure of Academic Proficiency and used the Measure of Academic Proficiency and Progress (MAPP) test from ETS. Progress (MAPP) test from ETS.

Students in senior capstone courses from Students in senior capstone courses from various areas were asked to take the test in the various areas were asked to take the test in the spring. 49 students were tested from spring. 49 students were tested from Business, Science, Education, English, and Business, Science, Education, English, and PsychologyPsychology

ProblemProblem

Observations of students taking the tests Observations of students taking the tests and the scores reported indicate that test and the scores reported indicate that test data is highly suspect.data is highly suspect.

Outcome B-2Outcome B-2 Students will be able to articulate the parameters of the Students will be able to articulate the parameters of the

Wesleyan-Holiness tradition and see its connections with Wesleyan-Holiness tradition and see its connections with intellectual, emotional, spiritual, and physical life intellectual, emotional, spiritual, and physical life ..

The self-developed portion of the MAPP test was used to assess The self-developed portion of the MAPP test was used to assess this outcome, using questions developed by the Division of Religion. this outcome, using questions developed by the Division of Religion. In addition, students gave a level of satisfaction with the statement In addition, students gave a level of satisfaction with the statement “Trevecca Nazarene University provides an understanding of what it “Trevecca Nazarene University provides an understanding of what it means to live a holy life and relates this explanation to many means to live a holy life and relates this explanation to many aspects of my life.”aspects of my life.”

62% of the responses to the questions were correct, which did not 62% of the responses to the questions were correct, which did not meet the criterion of 70%. In addition, the average score on the meet the criterion of 70%. In addition, the average score on the additional question was 3.75, which did not meet the criterion of 5.5.additional question was 3.75, which did not meet the criterion of 5.5.

Outcome B-3Outcome B-3 Students will be able to articulate the doctrinal and moral Students will be able to articulate the doctrinal and moral

convictions of the Church of the Nazarene. convictions of the Church of the Nazarene.

The self-developed portion of the MAPP test was used to The self-developed portion of the MAPP test was used to assess this outcome, using questions developed by the assess this outcome, using questions developed by the Division of Religion. In addition, students gave a level of Division of Religion. In addition, students gave a level of satisfaction with the statement “Trevecca Nazarene satisfaction with the statement “Trevecca Nazarene University clearly describes those Christian doctrines University clearly describes those Christian doctrines and moral convictions that are important to the school’s and moral convictions that are important to the school’s Nazarene heritage.”Nazarene heritage.”

65.5% of the responses to the questions were correct, 65.5% of the responses to the questions were correct, which did not meet the criterion of 70%. In addition, the which did not meet the criterion of 70%. In addition, the average score on the additional question was 3.47, average score on the additional question was 3.47, which did not meet the criterion of 5.5.which did not meet the criterion of 5.5.

Outcome B-8Outcome B-8

Students will demonstrate the ability to Students will demonstrate the ability to understand and perform basic mathematical and understand and perform basic mathematical and

statistical tasks to analyze and solve problemsstatistical tasks to analyze and solve problems The context portion of the MAPP Test entitled Math was The context portion of the MAPP Test entitled Math was

used to assess this outcome. used to assess this outcome. The mean student score was in the 24The mean student score was in the 24thth percentile, which percentile, which

did not meet the criterion of the 75did not meet the criterion of the 75thth percentile. percentile.

Outcome C-1Outcome C-1

Students will demonstrate an understanding and Students will demonstrate an understanding and practice of various modes of intellectual thinking practice of various modes of intellectual thinking processes. processes.

The context portion of the MAPP Test entitled The context portion of the MAPP Test entitled Critical Thinking was used to assess this Critical Thinking was used to assess this outcome. outcome.

The mean student score was in the 5The mean student score was in the 5 thth percentile, which didpercentile, which did not meet the criterion of the 75 not meet the criterion of the 75thth percentile. percentile.

Outcome C-1Outcome C-1

Students will demonstrate an understanding and practice Students will demonstrate an understanding and practice of various modes of intellectual thinking processes. of various modes of intellectual thinking processes.

Laboratory exercises from 30 life science students were Laboratory exercises from 30 life science students were randomly selected and evaluated according to a rubric randomly selected and evaluated according to a rubric developed by the Department of Science and developed by the Department of Science and Mathematics.Mathematics.

The mean student score was 8.31, which met the The mean student score was 8.31, which met the criterion 7 out of 14 possible points. In addition, the line criterion 7 out of 14 possible points. In addition, the line items on the rubric had averages ranging from 0.7 to items on the rubric had averages ranging from 0.7 to 1.66, which met the criterion of 0.7.1.66, which met the criterion of 0.7.

Outcome C-4Outcome C-4

Students will understand the relationship Students will understand the relationship between personal well-being and the capacity to between personal well-being and the capacity to engage others. engage others.

Students gave a level of satisfaction with the Students gave a level of satisfaction with the statement “Trevecca Nazarene University statement “Trevecca Nazarene University enhances my sense of personal well being and enhances my sense of personal well being and my ability to engage others as well.”my ability to engage others as well.”

The average level of satisfaction 3.47, which did The average level of satisfaction 3.47, which did not meet the criterion of 5.5.not meet the criterion of 5.5.

Outcome C-5Outcome C-5 Students will demonstrate an appreciation of the Students will demonstrate an appreciation of the

stewardship of resources, as it applies to personal life stewardship of resources, as it applies to personal life and in society as a whole, from a Christian perspective. and in society as a whole, from a Christian perspective.

The self-developed portion of the MAPP test was used to The self-developed portion of the MAPP test was used to assess this outcome, using questions developed by assess this outcome, using questions developed by various divisions within the University. In addition, various divisions within the University. In addition, students gave a level of satisfaction with the statement students gave a level of satisfaction with the statement “My college education at TNU prepares me to be a “My college education at TNU prepares me to be a faithful steward of my personal finance.”faithful steward of my personal finance.”

81.5% of the responses to the questions were correct, 81.5% of the responses to the questions were correct, which met the criterion of 70%. In addition, the average which met the criterion of 70%. In addition, the average score on the additional question was 3.67, which did not score on the additional question was 3.67, which did not meet the criterion of 5.5.meet the criterion of 5.5.

Protocol for AdministeringProtocol for AdministeringAssessment InstrumentsAssessment Instruments

General Education CommitteeGeneral Education Committee2008-92008-9

Efforts to use “student convenience” as the sole criterion for gathering Efforts to use “student convenience” as the sole criterion for gathering data to assess General Education Outcomes has led at times to data to assess General Education Outcomes has led at times to flawed or useless data. In an attempt to rectify this situation, the flawed or useless data. In an attempt to rectify this situation, the following protocol for administering assessment instruments, following protocol for administering assessment instruments, including paper and computerized standardized tests, will be tested including paper and computerized standardized tests, will be tested during the Fall 2008 semester.during the Fall 2008 semester.

The MAPP will be used to assess content and skill outcomes where The MAPP will be used to assess content and skill outcomes where appropriate. MAPP will be administered in capstone courses for each appropriate. MAPP will be administered in capstone courses for each major with the approval of the course professor.major with the approval of the course professor.

A primary testing session will be scheduled in consultation with A primary testing session will be scheduled in consultation with the capstone course professor and the TNU Testing Center.the capstone course professor and the TNU Testing Center.

A second make-up testing session will be scheduled for students A second make-up testing session will be scheduled for students who have course conflicts or miss the primary testing session.who have course conflicts or miss the primary testing session.

The primary testing session should occur before the tenth week of The primary testing session should occur before the tenth week of the semester.the semester.

Students must stay for a one and one-half hour testing session. Students must stay for a one and one-half hour testing session. Additional time is available as allowed by the computer testing Additional time is available as allowed by the computer testing service.service.

The course professor should be present for the beginning of the The course professor should be present for the beginning of the testing session, in order to emphasize the importance of the test.testing session, in order to emphasize the importance of the test.

Testing sessions will be orally introduced by the professor or a Testing sessions will be orally introduced by the professor or a member of the General Education Committee stressing the member of the General Education Committee stressing the importance of test results in deciding future changes and importance of test results in deciding future changes and improvements to TNU’s instructional programs.improvements to TNU’s instructional programs.

A member of the General Education Committee will be present for A member of the General Education Committee will be present for the whole testing period to observe student behavior during the the whole testing period to observe student behavior during the period and record the length of time students were engaged period and record the length of time students were engaged answering test items. Any unexpected behavior (i.e., failure to answering test items. Any unexpected behavior (i.e., failure to give best effort) should be noted).give best effort) should be noted).

Department/Major Course Semester

Communication Studies COM 4550: Research Methods in Communication Studies

Fall

English ENG 4600: Senior Recitation for English Majors

Spring

Music/Music Business MUS 4010: Orchestration ? Fall

Human Performance HPE 4300: Fitness Assessment/ Exercise Prescription

Spring

Sports Management HPE 4500: Senior Seminar Fall

Science/Mathematics ### 4335: Seminar in ### Spring

History HIS 4700: Senior Seminar Fall

Psychology/ Behavioral Science

### 4350: Senior Seminar in ### Spring

Social Science SOC 4600: Senior Research Seminar in Social Science

Spring

Social Work SWK 4450: Senior Seminar in Social Work Spring

Business BUS 4110: Business Policies Spring

IT ITI 4970: Digital Portfolio Development Spring

Education PSY 4020: Educational Tests and Measurements

Fall/Spring

Religion REL 4100: Life of the Christian Minister Spring

Capstone Courses ?