Report from a project funded by the Teagle Foundation to Beloit, Knox, Monmouth, Ripon Marion Fass,...

51
Report from a project funded by the Teagle Foundation to Beloit, Knox, Monmouth, Ripon Marion Fass, Kevin Hastings, Frank Gersich, Robin Woods

Transcript of Report from a project funded by the Teagle Foundation to Beloit, Knox, Monmouth, Ripon Marion Fass,...

Report from a project funded by the Teagle Foundation to

Beloit, Knox, Monmouth, Ripon

Marion Fass, Kevin Hastings,Frank Gersich, Robin Woods

“[R]ather than divide the undergraduate experience into separate camps, general versus specialized education, the curriculum of a college of quality will bring the two together.”

Ernest Boyer We proposed a collaborative project to examine this complementary

relationship between general education and the major, and, in particular, to establish methods of assessment that allow us to learn about, improve, and strengthen the achievement of liberal learning goals by all of our students, irrespective of the major they choose.

How do departments contribute to students’ achievement of all college goals?  Do departments see their contributions in the same way?

Faculty from Beloit, Knox, Monmouth and Ripon are exploring how departments define and teach critical

thinking, quantitative reasoning and civic engagement, and

how they measure the successes of students in reaching their educational goals.  

As expected, quantitative reasoning in Philosophy differs from that in Mathematics, but what about critical thinking?  

We will discuss some of our experiences and findings, and identify issues that are important in our ongoing efforts at assessment.

Align learning goals with mission, general education goals and with major◦ Our institutions varied in amount of structure in

general education program Look at how general education goals are

enhanced by the major and by advising Develop systems for feedback Share among the participating colleges, at

institutional and departmental levels

None of our colleges have Center for Teaching and Learning

What do we know about what we do on each campus?◦ NSSE◦ Collegiate Learning Assessment

What do we want to share between campuses?

Each department developed a plan, but not all the same plan

What are the basic criteria for plans? Strategies

◦ Focus groups◦ Review of student work and transcripts◦ Links to NSSE, CLA◦ Embedded assessments◦ Logs of advising

Civic engagement Quantitative reasoning Critical thinking

How do we measure these? We let the departments decide, based on

their needs and their disciplinary orientations.

Institution Year One Year TwoBeloit Philosophy/

ReligionAnthropology

BiologyPsychology

Knox MathematicsEnglish

Education Economics

Ripon PhysicsSociology/Anthropology

FrenchEconomics

Monmouth ArtBiology

Communications and Theater ArtsAccounting

Explore the role of major courses and advising in assuring that students◦ Achieve depth in a disciplinary or

interdisciplinary area◦ Develop skills of liberally educated individual◦ Connect with co-curricular and experiential

Identify how to use this information to improve student academic experiences

1. Review course structure and content.2. Examine the sequencing of courses; 3. Identify patterns of elective course selection

by majors4. Survey about co-curricular activities to identify

if/how those activities are consistent with discipline and general education goals;

5. Review and devise methods of assessment used in major;

6. Identify actions to strengthen the major and the students’ total educational experiences

At the heart of the educational process

Critical thinking asks students to engage actively in their own learning

 As many definitions as departments, but all see it as a central part of what we do:       ◦  “This is the area where we found the most

assumptions and took the most for granted, given that we believe this concept to be at the very heart of every single thing toward which the English Department strives.” (Knox)

◦  Some see it as rooted in the discipline (Anthropology, Beloit);

◦ Others as more open, usually as process (Sociology, Ripon)

All departments chose to examine critical thinking

Eight different departments=eight different definitions

Despite differences, all departments see critical thinking as essential to what they do, and as a constitutive element of their disciplines and of a liberal education

Most definitions include two essential components:◦ Perception: seeing the subject clearly◦ Analysis: questioning the subject

Beloit: goals statement includes logical thinking and problem-solving

Knox: goals statement includes the critical exchange of ideas and demands for rigorous thinking

Monmouth: one of five educational elements identified in all-college gen ed goals

Ripon: all-campus discipline-based model: all departments required to have plan and

assessment procedures in place

Beloit Religion: ◦ students’ ability to think critically about religious

thought and practice Ripon Anthropology: extrapolates from

mission statement:◦ Comparative thinking and analysis; contextual

understanding of human behavior; ◦ awareness of the effects of study on object of study

Ripon Physics: from divisional mission: ◦ hypothesis formation and testing◦ original research

Direct measures of student learning: embedded assignments, writing/ portfolio analysis

Indirect measures: student surveys (Beloit Religion:

Students responsible for gauging their own progress),

Course evaluations

Monmouth Art: measures over time Beloit Religion: students responsible for

measures of progress Ripon Physics: specific gains in knowledge

What does the CLA tell us?

◦ “We are committed to the idea that thinking critically involves being able to recapitulate a line of reasoning and engage in dialogue, raising objections and concerns, to see if that reasoning approaches truth.” (Philosophy Department, Beloit)

◦ “Drawing on the work of other scholars….the sociology department defines critical thinking as thinking that requires students to evaluate and interpret evidence, identify and evaluate relevant arguments, develop and defend a position on an issue, and/or consider all sides of a question or issue without bias.” (Sociology Department, Ripon)

◦ ….We are not always conscious of thinking critically, that is, engaging with texts to assess both for their value and their meaning. To assess a text for value and meaning requires marshalling evidence from the text itself, employing logical reasoning, being attentive to emotional and psychological charges of the text, and considering relevant connections between the text and the larger world in which it is produced.” (English Department, Knox)

…We believe that by its very nature, anthropology is inherently about critical thinking. Cultural anthropology works to make the strange familiar and the familiar strange. To do this, students must question their basic assumptions and in questioning these assumptions they engage in critical thought.” (Anthropology Department, Beloit)

Quantitative literacy◦ Graphs, charts◦ Basic life skills math

Logical problem solving◦ Systematic analysis

Mathematical skills◦ Statistics◦ Mathematics

Integration of literacy, problem solving, using appropriate tools correctly

NSSE and other surveys ask students to self-report,

This assumes that this is one of the most measurable educational goals.

This project demonstrates, however, that a wide campus discussion is necessary to reinforce the need for this particular liberal education outcome, and to decide what it means. We don’t really agree.

Interpret mathematical models such as formulas, graphs, tables, and schematics, and draw inferences from them.

Represent mathematical information symbolically, visually, numerically, and verbally.

Use arithmetical, algebraic, geometric and statistical methods to solve problems.

Estimate and check answers to mathematical problems in order to determine reasonableness, identify alternatives, and select optimal results.

Recognize that mathematical and statistical methods have limits.

Out of our discipline, ◦ but value Logical Problem Solving-◦ But Life Skills are critical to success

Would be nice, not required ◦ (how to measure baseline, success?)

Important to our discipline, require courses◦ Taught by other departments, like Mathematics◦ Taught by “our” department, Social Statistics

Central to disciplinary mastery◦ Physics, Mathematics

As long as you abstract from the specific to the general by representing a system or process symbolically (which is abstracting), setting down rules for it and manipulating that symbol system within those rules, it is quantitative. (Chemistry reaction equations? Logic? Language syntax?) ◦ (Kevin Hastings, 2008)

Having students approach problems and projects and think of them in quantitative ways (CLA)

Rational/ symbolic analysis Review writing to diagnose whether

students are applying quantitative techniques. ◦ If bold statements are made, are they willing to

support with data?(Carleton approach) Develop disciplinary measures when

appropriate

Civic Engagement

• Broadly defined: preparing students to be involved in their community– Formal curriculum– Co-curriculum– Volunteer activities– Student/Faculty research

• Participating departments “wrestled” with definition for study

College Goals Include

• Beloit One of seven curricular goals is: “Active, responsible citizenship.”

• Knox One of four curricular goals is: “applying classroom learning through hands-on experience.”

• Monmouth General Education Capstone course: Citizenship (informed, conscientious action)

• Ripon Communicating Plus Program supports engagement in issues confronting citizens of the 21st century.

Civic Engagement Participation and Assessment

• Level of CE in formal curriculum may be dependent upon resources

• Departmental commitment to CE may be dependent upon campus priorities

• Assessment of CE outside of formal curriculum often is student reported participation levels

• Assessment of CE within formal curriculum may best be through “guided” participant reflections

CE in First-round Reports

• One department in first round included CE as part of departmental mission – focused on community service

• Six departments discussed role of preparing students to act (generally through ethics/values discussions)

• Two departments indicated a need to incorporate into future assessments

• One department collected information about student involvement in activities outside of departmental courses

Humanities Civic Engagement

Knox English

“how to respect the opinions, and emotions, the thoughts and articulations of others, thus preparing students for broader engagement at the civic and moral level.” Engage with artists and scholars beyond the classroom, participate in community of scholars in journals, readings, etc.

Beloit Philosophy

Preparation to act through applied ethics courses

Beloit Religious Studies

Address directly questions of how communal values are shaped, communicated, and contested. Helping students to cultivate a sense of responsibility as developing global citizens, and a sense of wonder about religious experiences and frames of reference. Evaluate by course evaluations.

Monmouth Art

Civic engagement student survey given as part of review process, including voting and art-related events on campus

Social Sciences

Civic Engagement

Ripon Sociology

Not systematically assessed – will do in Fall 2008

All students reported 2 to 4 activities

Ripon Anthropology

Used embedded assessments ethical perspectives on anthropology in community – Need to be more explicit in curriculum

Beloit Anthropology

Couldn’t agree on definition – Exposed to tools and ethical considerations in classes, faculty model engagement, students study abroad, Nicaragua class, “pragmatic solidarity”

Sciences Civic Engagement

Ripon Physics

Part of departmental mission, including Learning about and sharing information about the applications of physics to issues in society (e.g., energy conservation) and Community service in the form of sharing physics activities with others, especially school children and their teachers.

Knox Mathematics

Outlined civic engagement, through requirement and will verify with NSSE

Monmouth Biology

Through investigative case-based learning. Will assess when implemented.

Conclusions and recommendations

We all agree that these are important goals, but we don’t agree on how they are defined

There are legitimate differences between disciplines

Someone who thinks critically as a biologist may differ from someone who thinks critically as a philosopher

◦ By giving students “majors” on their diplomas we acknowledge this

These findings can catalyze important all college discussions about shared values, essential skills and disciplinary interpretation

Departments are at different levels of readiness to take on review◦ Personalities, changes in discipline◦ Departments need periodic retreats to revisit

goals and courses articulation◦ Goals may have been set before working faculty

arrived, departments split in programs Departments that depend on the “kindness

of others” to meet skill needs of majors need to sit down and talk about expectations

Smallness doesn’t preclude need to discuss and review

“Friendly” departments may not always discuss educational issues

Because of desire for flexibility in departments, students don’t always take courses in sequence-

This increases need for communication about goals and how they are reinforced in curriculum

Our college graduate with

liberal arts skills framed

by disciplinary orientations

Our college graduate with

liberal arts skills framed

by disciplinary orientations

Student Educational Experience

Resources◦ Assessment committees◦ Centers for teaching and learning◦ Administrative

Recognition Links of course, curriculum and mission

Thanks to the Teagle Foundation for supporting this work and to ACM FaCE, Lake Forest College and Rachel Ragland for inviting us to speak at this conference

Thanks to Kevin Hastings at Knox who has worked with us on this project, but couldn’t be here today.