Meg Frazier and Megan JaskowiakCullom-Davis Library

Bradley University

Learning Concepts

Assessment: What Do They Remember?

Who We Are

Meg Frazier: MLS in 1989 from UT-Austin At Bradley since 1998Information Literacy LibrarianLiaison Areas: Engineering, Computer Science, Women’s Studies and Theatre

Megan Jaskowiak: MLIS in 2013 from Kent St, PhD in 2003 from North Dakota St At Bradley since 2013Science/Health Science LibrarianLiaison Areas: Biology, Chemistry, Health Sciences, Mathematics, Nursing, Physical Therapy, Physics

Who We Are

• Bradley University: Private, undergraduate institution with graduate programs aimed at returning professionals -- 5,000 undergrads/ 1,000 graduates

3 or 5 Things Learned Assessment

• Concepts• Recall• What gets mentioned or What does not

Classroom Assessment

• One-Minute paper• Clear Muddy

Learning Concepts Sheet • Will Thalheimer• Newness of the Concept• Value of the Concept• Likelihood of Using the Concept

Some analysis of open ended questions

• Formulate categories• Condense the answers• Double check your categories

Our Results

• Revising Searches–‘narrow’ or ‘revise’–get better results–select a specific date range

• Generalized Statements–learned about the library–learned about finding articles–learned about finding books

Our ResultsThemes Total % Librarian 1 Librarian 2

How to revise searches 17.1 17.3 16.9

Generalized statements 16.9 19.9 15

I-share 14.5 2.6 21.6

Where databases’ links are on library's website 11 16.8 7.5

Other 8.6 4.2 11.3

Finding specific items (newspapers/books/articles) 8.2 6.8 9.1

Using Wikipedia's Talk Page 7.3 13.6 3.4

ILLiad 3.3 1.6 4.4

Finding accurate or credible information 2.9 5.2 1.6

Mentioned specific databases 2.7 4.2 1.9

Learned nothing new 2.2 4.7 0.6

Google Scholar 2 2.8 2

How use databases citation feature 1.4 0.5 1.9

How to find specific encyclopedias 1 0.9 1

The importance of reading the abstract 0.6 0 0.9

How to recognize a scholarly article 0.4 1 0

• Answers easier to code• Statistical analysis more

robust• Replication is easier• Takes less time

• Suggest ideas• Cannot notice

misinterpretations of questions

• May be too simplistic• Participants may find

them irritating

Pros and cons of closed questions

Standard Descriptive Statistics  Mean Median Skewness Kurtosis

How books are arranged in the library?

4.063 4.000 -0.501 -0.669

How to search for books in the library catalog?

4.135 4.000 -0.558 -0.558

What is the topic section of the catalog record?

3.683 4.000 -0.296 -0.695

How to get books and videos from other libraries?

4.026 4.000 -0.343 -0.445

Where to search for articles on the library website?

3.817 4.000 -0.341 -0.736

What kind of search tool is an article database?

4.325 5.000 -0.720 -0.397

How narrow or focus your search in an article database?

3.976 4.000 -0.442 -0.765

How to look for different kinds of articles?

4.214 5.000 -0.634 -0.400

What are the differences between these search tools: Google Scholar, the library catalog and article databases?

3.778 4.000 -0.235 -0.957

What is normal?

Pearson Correlation of values  A B C D E F G H IA 1 0.6(0) 0.6(0) 0.4(0) 0.5(0) 0.5(0) 0.5(0) 0.5(0) 0.4(0)B 0.6(0) 1 0.6(0) .5(0) 0.6(0) 0.5(0) 0.5(0) 0.5(0) 0.4(0)C 0.6(0) 0.6(0) 1 0.5(0) 0.6(0) 0.5(0) 0.5(0) 0.5(0) 0.4(0)D 0.4(0) 0.5(0) 0.5(0) 1 0.5(0) 0.4(0) 0.5(0) 0.4(0) 0.5(0)E 0.5(0) 0.6(0) 0.6(0) .5(0) 1 0.8(0) 0.7(0) 0.7(0) 0.5(0)F 0.4(0) 0.5(0) 0.5(0) 0.4(0) 0.8(0) 1 0.7(0) 0.7(0) 0.6(0)G 0.5(0) 0.5(0) 0.5(0) 0.5(0) 0.7(0) 0.7(0) 1 0.8(0) 0.6(0)H 0.5(0) 0.5(0) 0.5(0) 0.4(0) 0.7(0) 0.7(0) 0.8(0) 1 0.7(0)I 0.4(0) 0.3(0) 0.4(0) 0.5(0) 0.5(0) 0.6(0) 0.6(0) 0.6(0) 1

A= How books are arranged in the library?B= How to search for books in the library catalog?C= What is the topic section of the catalog record?D= How to get books and videos from other libraries?E= Where to search for articles on the library website?F= What kind of search tool is an article database?G= How narrow or focus your search in an article database?H=How to look for different kinds of article, I= What are the differences between these search tools: Google Scholar, the library catalog and article databases?

<0.2 Very weak relationship0.2-0.4 Weak relationship0.4-0.6 Moderate relationship0.6-0.8 Strong relationship>0.8 Very strong

relationship

  A B C D E F G H I

A 1 0.5(0) 0.4

(0.001)

0.4(0) 0.4(0) 0.4(0) 0.3(0) 0.4(0) 0.4

(0.002)

B 0.6(0) 1 0.5(0) 0.5(0) 0.5(0) 0.5(0) 0.4(0) 0.5(0) 0.5(0)

C 0.4

(0.001)

0.5(0) 1 0.3

(0.007)

0.24

(0.055)

0.4

(0.004)

0.24

(0.055)

0.3

(0.039)

0.50(0)

D 0.4(0) 0.5(0) 0.3

(0.007)

1 0.6(0) 0.5(0) 0.4(0) 0.4(0) 0.5(0)

E 0.4(0) 0.5(0) 0.2

(0.056)

0.6(0) 1 0.6(0) 0.5(0) 0.5(0) 0.4

(0.001)

F 0.5(0) 0.5(0) 0.4(0) 0.5(0) 0.6(0) 1 0.7(0) 0.6(0) 0.5(0)

G 0.3

(0.018)

0.4(0) 0.24

(0.055)

0.4(0) 0.5(0) 0.6(0) 1 0.7(0) 0.6(0)

H 0.4(0) 0.5(0) 0.3(0) 0.4(0) 0.5(0) 0.6(0) 0.7(0) 1 0.5(0)

I 0.4

(0.002)

0.5(0) 0.4

(0.002)

0.5(0) 0.4

(0.001)

0.5(0) 0.6(0) 0.5(0) 1

Pearson Correlation of newness

Pearson CorrelationQuestion Correlation between newness and importance

How books are arranged in the library? -0.097(0.442)

How to search for books in the library catalog? -0.087(0.491)

What is the topic section of the catalog record? -0.156(0.215)

How to get books and videos from other libraries? -0.044(0.727)

Where to search for articles on the library website? -0.282(0.001)

What kind of search tool is an article database? 0.205(0.107)

How narrow or focus your search in an article database?

-0.221(0.077)

How to look for different kinds of articles? -0.358(0.001)

What are the differences between these search tools: Google Scholar, the library catalog and article databases?

-0.252(0.043)

Interpreting Results from Both Analyses

• Students remembered and seemed to value finding articles/using article databases over finding books/use the library catalog.

GOING FORWARD