1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University...

39
1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire) Lori Shaw (University of Dayton)
  • date post

    22-Dec-2015
  • Category

    Documents

  • view

    215
  • download

    0

Transcript of 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University...

Page 1: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

1

How LRW Faculty can Contribute to Their Law School’s Assessment Plan

David Thomson (University of Denver)

Sophie Sparrow (University of New Hampshire)

Lori Shaw (University of Dayton)

Page 2: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

2

Recognize that LRW Profs can become leaders in the conversation

Understand the language and process of assessment

Recognize that LRW Profs are already experts at assessment

Session Outcomes

Page 3: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

3

QuestionsLanguage and Process

Introduction and Background

Session Plan

Taking it School Wide

Page 4: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

4

IntroductionOur Current Situation

Where we want to get to

Our Fictional Law Student

Our Fictional Law Professor

Page 5: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

5

ContextABA Standards

Introduction to Assessment

Experience at my own School

Page 6: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

6

Small group discussion

How many of your law school faculties have articulated learning outcomes?

Have you aligned your Rubrics with your Outcomes?

Has your LRW Program Articulated Learning Outcomes?

Participant Engagement

Page 7: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

7

Language and Process

Page 8: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

8

Assessment Terms & Process

No one set of definitions

Assessment concepts are shared

Don’t let the language interfere

Use definitions adopted by others

Many ways to assess effectively

Assessment is powerful & FUN!

Page 9: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

9

“That which we measure we tend to improve.”

David Leach, MD

Page 10: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

10

Assessment Assessment cycle Learning goals, objectives &

outcomes Formative and summative - Rubrics Alignment Assessment plan

Assessment Terms & Process

Page 11: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

11

Assessment: gathering information about student learning to improve teaching and learning

We do this already - all the time, formally and informally

Page 12: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

12

1. Articulate student

learning goals & objectives

2. Gather information about how

well students are learning (outcomes)

3. Give feedback

(formative rubrics), interpret

information (alignment).

4. Use information to

improve teaching and

learning

Assessment Cycle

Page 13: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

13

1. Identify Learning Goals

• Broad, general, long-range statements of what the program, course, or activity intends to accomplish

Can be at the class, course, program level

Page 14: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

14

Learning Goals - Examples

LAR&W students will communicate legal analysis effectively JD students graduate “client-ready”

for the 21st Century

Each learning goal will often have multiple learning objectives

Page 15: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

15

Identify Learning Objectives

•Specific, measurable descriptions of knowledge (cognitive), skills (behavioral), and values (affective)

students should show by end of learning unit (class, course, program). 

Page 16: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

16

Learning Objectives - Examples• LAR&W: Given new set of facts, student will effectively research, analyze & write

• Pre-trial advocacy: Given discovery problem, student will listen and consider colleagues’ experience, knowledge & insights

Page 17: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

17

2. Get data: Learning Outcomes• Like objectives: specific knowledge, skills, values students have achieved

Based on objective evidence (performance, product).

ABA 302: identify, publish outcomesABA 305(a): use evidence to show competency

Page 18: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

18

Learning Outcomes - Examples•LAR&W: Given a new problem,

85% students accurately identified binding authority and

rules, identified and applied relevant

facts, cited authorities, and presented analysis in coherent

prose.

Evidence (direct): student work, rubric dataEvidence (indirect): student surveys

Page 19: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

19

3. Give feedback: Formative & Summative Assessment

•Formative: meaningful feedback designed to help students improve

•Summative: feedback that evaluates performance, e.g. score or grade

Feedback can be both (e.g. comments, rubrics)

ABA 304: provide variety of both across the curriculum

Page 20: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

20

Feedback using RubricsScoring tools that name specific expectations for

assignment parts & describe levels of performance

Valuable for students and teachers

Example:

Team Pre-sentation

Exemplary Competent Developing

Skills and teamwork

� All teammates participate in presentation, with each getting about the same amount of time

� Teammates show each other respect

� All teammates participate, with some imbalance

� Teammates mostly show each other respect

� Presentation unbalanced; a few people dominate

� Teammates show little respect or courtesy

Page 21: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

21

“People pay attention to what you inspect, not

what you expect.”

Page 22: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

22

Check Alignment

How well do student outcomes reflect your goals & objectives?

Gaps between?

Experience at UNH

Remediate – step 4: change teaching

Page 23: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

23

Assessment Plans must be:

Ongoing

Sustainable

Use multiple measures

Flexible

Public

Page 24: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

24

Participant Engagement

On the white index card on your seat...

Name 3 (or more) Learning Outcomes for LRW that you have for your students

Discuss with your neighbors

Page 25: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

25

Your Assessment Process

How do you assess your objectives - that is, gather student outcomes?

How do you check for alignment?

Where are there gaps?

Page 26: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

26

Taking it School-wide

Page 27: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

27

What does institutional assessment have to do with me?

“We assess that which we value.”

- Lloyd Bond, Carnegie Institute

Page 28: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

28

Taking a leadership role in this area will only enhance your professional reputation among

your colleagues.

Your school and students need that expertise.

You already possess expertise in teaching and assessment.

A stronger emphasis on learning outcomes benefits both students and legal writing

professionals.

Page 29: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

29

6 Key Points to Remember...

Page 30: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

30

Institutional Assessment1. Compels faculty to work together to expressly identify the broad outcomes they seek – “Truth in Advertising”

2. Provides empirical evidence of success (and failure) for faculty, administrators, and “customers” (students and prospective students) – “A U.S. News Alternative”

3. Requires a thoughtful, carefully structured plan – “Focus on Quality of Assessment, NOT Quantity”

Page 31: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

31

Institutional Assessment4. Focuses on the collective, not the individual performance of students – “Representative Samples”

5. Focuses on the collective, not the individual performance of faculty – “Focuses on Students’ Overall Experience”

6. Requires that we “close the loop” – “Change for the Better ”

Page 32: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

32

Page 33: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

33

Page 34: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

34

Dayton Law’s Learning Outcomes1) Graduates will demonstrate knowledge

and understanding of the law.

2) Graduates will exhibit issue-spotting skills.

3) Graduates will demonstrate analytical and problem-solving skills.

4) Graduates will communicate effectively and efficiently to individuals and groups.

5) Graduates will perform effective and efficient legal and non-legal research.

Page 35: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

35

Dayton Law’s Learning Outcomes6) Graduates will demonstrate

competency in legal practice skills.

7) Graduates will recognize and resolve ethical dilemmas.

8) Graduates will exhibit and continue to develop professional competency.

9) Graduates will adopt the Marianist charism of faith, service, community, and inclusivity in their professional and personal life.

Page 36: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

36

Page 37: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

37

What do you want your graduates to value?

What do you want your graduates to be able to do?

What do you want your graduates to know?

Participant Engagement

Page 38: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

38

Panel Discussion

Barriers to Assessment

Page 39: 1 How LRW Faculty can Contribute to Their Law School’s Assessment Plan David Thomson (University of Denver) Sophie Sparrow (University of New Hampshire)

39

Questions