Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

70
Enhancing the One-Shot Session: Using Pre-Class Online Tutorials to Build a Basic Information Literacy Foundation MAC Annual Meeting, October 14 th , 2010 Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

description

Enhancing the One-Shot Session: Using Pre-Class Online Tutorials to Build a Basic Information Literacy Foundation MAC Annual Meeting, October 14 th , 2010. Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP. Coming Up Next. Project overview - PowerPoint PPT Presentation

Transcript of Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Page 1: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Enhancing the One-Shot Session: Using Pre-Class Online Tutorials to Build a Basic Information Literacy Foundation

MAC Annual Meeting, October 14th, 2010

Emily Mazure, MSI, AHIPMargaret Henderson, MLIS

Shannon D. Jones, MLS, AHIP

Page 2: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Coming Up Next• Project overview• VCU & The Tompkins-McCaw Library for the

Health Sciences• Why• How• Results• Lessons

Page 3: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Pre-Class

Class

Page 4: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Post-Class

Page 5: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Experimental

Class

Page 6: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Control

Class

IRB

Page 7: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Virginia Commonwealth University

Page 8: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Tompkins-McCaw Library for the Health Sciences

Page 9: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Learning styles

Page 10: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Standardize

Page 11: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 12: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Why Tutorials

Page 13: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 14: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

The Tutorials

Boolean Operators

Controlled Terms & Database Thesauri

Page 15: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Design Objectives• Basics• Concepts• Application• Generalizable

Page 16: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Process

Storyboard• PowerPoint

Audio• Audacity

Screencapture• PowerPoint

slides• Camtasia

Edit• Camtasia

Produce videos• Quiz links

Page 17: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 18: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Boolean Operators

ANDOR

NOT

Page 19: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Storyboard• PowerPoint

Audio• Audacity

Screencapture• PowerPoint

slides• Camtasia

Edit• Camtasia

Produce videos• Quiz links

Process

Page 20: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Storyboard• PowerPoint

Audio• Audacity

Screencapture• PowerPoint

slides• Camtasia

Edit• Camtasia

Produce videos• Quiz links

Process

✔✔

Page 21: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Storyboard• PowerPoint

Audio• Audacity

Screencapture• PowerPoint

slides• Camtasia

Edit• Camtasia

Produce videos• Quiz links

Process

✔✔

Page 22: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 23: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Storyboard• PowerPoint

Audio• Audacity

Screencapture• PowerPoint

slides• Camtasia

Edit• Camtasia

Produce videos• Quiz links

Process

✔✔

✔✔

Page 24: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 25: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Storyboard• PowerPoint

Audio• Audacity

Screencapture• PowerPoint

slides• Camtasia

Edit• Camtasia

Produce videos• Quiz links

Process

✔✔

✔✔ ✔

Page 26: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Boolean Operator Tutorial

Controlled Terms & Thesauri Tutorial

Pre-Class Pre-Class

Post-Class Post-Class

Quizzes

Page 27: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

7 Questions

QuizzesBoolean Operator

Tutorial

Pre-Class

Post-Class

Page 28: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

5 Questions

Db screenshots

QuizzesControlled Terms

& Thesauri Tutorial

Pre-Class

Post-Class

Page 29: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Please select the date and time of the library class session.

QuizzesBoolean Operator

TutorialControlled Terms

& Thesauri Tutorial

Pre-Class Pre-Class

Post-Class Post-Class

Page 30: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Did you watch the tutorial on _____ before attending class?

QuizzesBoolean Operator

TutorialControlled Terms

& Thesauri Tutorial

Post-Class Post-Class

Page 31: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Evaluation• 9 questions

– 3 open-ended– Rate

• Content• Aesthetics• Confidence

Page 32: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 33: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Results• 2 Workshops • 1 curriculum-based class

Page 34: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Color Code• Purple = correct answers

• Orange = incorrect answers

Page 35: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Pre-Class Post- ClassVS.

Page 36: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Correct74%

In-correct26%

Correct75%

In-correct25%

Pre-Class Post-Class

CorrectIncorrect

BOOLEAN OPERATORS

Page 37: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Correct59%

In-cor-rect41%

Correct59%

In-cor-rect41%

Pre-Class Post-Class

CorrectIncorrect

CONTROLLED TERMS & THESAURI

Page 38: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Pre-Class Post- ClassVS.

TIE

Page 39: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Tutorial No TutorialVS.

Page 40: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

BOOLEAN OPERATORSWatched Tutorial Did Not Watch Tutorial

Correct44%

In-cor-rect56%

Correct74%

In-correct26%

CorrectIncorrect

Page 41: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Correct13%

In-cor-rect87%

Correct59%

In-cor-rect41%

Watched Tutorial Did Not Watch Tutorial

CorrectIncorrect

CONTROLLED TERMS & THESAURI

Page 42: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Tutorial No TutorialVS.

WINNER

Page 43: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 44: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Time on quiz

Pre Post0

50

100

150

200

250

Pre Post0

50

100

150

200

250Boolean Operators Controlled Terms

Seco

nds

Seco

nds

Page 45: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 46: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 47: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

What do you think?

What percentage of students do you think watched the tutorials and

completed the quizzes?

Page 48: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

What do you think?

Do you think the percentage changes depending on if librarians or faculty

instructors contacted students? How so?

Page 49: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Response Rates• Librarians contacted students

– 67 – 100 % completed tutorials & Pre-Class Quizzes

• Faculty Instructors contacted students– < 50%

Page 50: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 51: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 52: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Please rate your confidence in

completing the following tasks, after watching

the tutorial, but before coming

to class.

02468

1012

Using Controlled terms to search in a database

Very confident

Fairly confident

Not very confident

Not at all confident

Don’t know

N/A02468

101214

Identifying Controlled terms in a database

02468

1012

Using Boolean operators to search in a database

Page 53: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Please rate your confidence in

completing the following tasks,

after attending class with a

librarian.

0

4

8

12

Using Controlled terms to search in a database

Very con-fident

Fairly confident

Not very confident

Not at all confident

Don’t know

N/A0

5

10

15

20

Identifying Controlled terms in a database

0

5

10

15

20Using Boolean operators to search in a database

Page 54: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

How would you prefer to learn about basic concepts (like Boolean operators and controlled terms)?

By watching tutorials prior to class.

Through librarian lectures during class.

Through your own trial-and-error.

Other 0

2

4

6

8

10

12

14

16

18

20

Page 55: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

I thought using the tutorial before class was helpful because it meant some of the lecture could be cut out and we

could do some searches hands-on and have questions answered. Nice pairing.

…I learned it in the tutorial, but firmed up the

knowledge in class.

This class was wonderful and very practical.

Page 56: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP
Page 57: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Final Thoughts• Class Recruitment difficult

• Student participation varies

Page 58: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Final Thoughts• IRB Constraints

• Time

Page 59: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Final Thoughts• Post-class = Pre-class

• No Tutorials = Poor understanding

• Save class time and focus instruction – Students appreciated this!

Page 60: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Future• More classes• More controls• Additional tutorials?

Page 61: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Links• Controlled Terms & Thesauri Tutorial:

http://bit.ly/vcucttutorial

• Boolean Operators Tutorial:http://bit.ly/vcubotutorial

• Additional Info: http://bit.ly/mac2010handout

Page 62: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Images Used• http://www.flickr.com/photos/rberteig/177100826/• http://www.flickr.com/photos/dherholz/2290958516/sizes/l/• http://www.flickr.com/photos/14610199@N07/3143043598• http://flickr.com/photos/ranieriribeiro/1360021695/• http://www.flickr.com/photos/27987437@N06/3945958797/• http://www.flickr.com/photos/paulbridgewater/3761128885/• http://www.flickr.com/photos/rufino_uribe/178577542/• http://www.flickr.com/photos/80039525@N00/2763362494/• http://www.flickr.com/photos/seatbelt67/502255276/• http://www.flickr.com/photos/mitchsurprenant/3133901461/• http://www.flickr.com/photos/49462908@N00/4356185807/• http://www.flickr.com/photos/37183619@N00/1574355646/• http://www.flickr.com/photos/29601732@N06/3020016417/• http://www.flickr.com/photos/jason-samfield/4103120905/• http://www.flickr.com/photos/43322231@N07/4003590489/• http://www.flickr.com/photos/16151021@N00/4784609368/

Page 63: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Questions?Suggestions?

Emily MazureVirginia Commonwealth [email protected]

Page 64: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Correct71%

In-correct29%

BO Pre Total (Workshops)

Correct74%

In-correct26%

BO Post Total (Workshops)

Correct87%

In-correct13%

Pre BO Total (Biostat)

Correct84%

In-correct16%

Post BO Total (Biostat)

Page 65: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Correct60%

In-correct40%

CT Pre Total (Workshops)

Correct59%

In-correct41%

CT Post Total (Workshops)

Correct57%

In-correct43%

PRE CT Total (Biostat)

Correct58%

In-correct42%

Post CT Total (Biostat)

Page 66: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Approximately how many minutes did it take you to watch the tutorials and complete the quizzes before class?

0-5 minutes 6-10 minutes 11-15 minutes 16-20 minutes 21+ minutes0

1

2

3

4

5

6

7

8

9

10

* Spring Workshops Only

Page 67: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Please rate the following:

0

2

4

6

8

10

12

Tutorial content

Poor Fair Adequate Very Good

Excellent N/A02468

101214

Tutorial aesthetics

Page 68: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Please rate the following:

02468

101214

In-class content

Poor Fair Adequate Very Good

Excellent N/A02468

101214

In-class delivery

Page 69: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Classes

• Spring 2010– General Workshops on PubMed

• Highly publicized• Food• < 1 hour

• Fall 2010– Curriculum-based Classes

• 3 total• 1 – 2.5 hours

– Targeted Workshop• 1 hour

Page 70: Emily Mazure, MSI, AHIP Margaret Henderson, MLIS Shannon D. Jones, MLS, AHIP

Which tutorial(s) did you watch? (select all that apply)

Boolean operators for database searching

Database controlled terms and thesauri

None0

5

10

15

20

25

30