Visible Human Browsers: Formative Evaluation Based on Student Feedback

23
Visible Human Conference, 2002 Visible Human Browsers: Formative Evaluation Based on Student Feedback Neil Skov, EdD Wen Yu Lee, MS Deborah S. Walker, DNSc, CNM, FACNM Carl Berger, EdD

description

Visible Human Browsers: Formative Evaluation Based on Student Feedback. Neil Skov, EdD Wen Yu Lee, MS Deborah S. Walker, DNSc, CNM, FACNM Carl Berger, EdD. Introduction. Context: Next Generation Internet – Visible Human Project (NGI–VHP) User Interface and Evaluation Team Purpose: - PowerPoint PPT Presentation

Transcript of Visible Human Browsers: Formative Evaluation Based on Student Feedback

Page 1: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Visible Human Browsers:Formative Evaluation

Basedon Student Feedback

Neil Skov, EdD

Wen Yu Lee, MS

Deborah S. Walker, DNSc, CNM, FACNM

Carl Berger, EdD

Page 2: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Introduction

Context: Next Generation Internet –

Visible Human Project (NGI–VHP) User Interface and Evaluation Team

Purpose: Student use of Visible Human data sets Formative evaluation of user interfaces

Page 3: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Introduction Cont.

Research Questions: What is the most effective way for

student users to interact with VH browser interfaces?

What are students’ perceptions of the usefulness of the VH software for learning anatomy?

Page 4: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Background

Formative Evaluation Early feedback Support design decisions

Types of Review Expert or Formal Potential users

Usability Acceptance

Page 5: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Methods

Hybrid Methodology Qualitative Semi-structured interview Interview about instances Focus group

Video Taping

Page 6: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Methods Cont.

Participants Second-year medical students One year gross anatomy Three groups of four

Group 1 Group 2 Group 3 0 Female 4 Male

2 Female 2 Male

1 Female 3 Male

Page 7: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Methods Cont.

Procedure Demonstration Student trials Discussion

Repeat for Each Tool

Summary Discussion

Page 8: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Methods Cont.

Software Edgewarp 3D (EW)

PSC Volume Browser (PVB)

Other Anatomy content database Edgewarp fly-through simulation

Page 9: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Edgewarp 3D

Page 10: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

PSC Volume Browser

Page 11: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Data Analysis

Qualitative Video Analysis Joint viewing Repetition Notes (tables)

Search for Patterns Thematic Organization

Page 12: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Data Analysis Cont.

Event Summary Table

EventSeq.

#

GroupRec.

#

VHTool Observation/

Comment

Theme

Code

Page 13: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Data Analysis Cont.

Interactions with VH software Controls Interpretation of display Strategies for use

Learning Anatomy Student requirements for anatomy

content Use of the software for learning

anatomy

Page 14: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Data Analysis Cont.

Suggestions for Control devices New functions Anatomy topics

Page 15: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Selected Results

Interactions with VH Software: Controls Like dragging yellow box (EW) Preference for button bars Image pixelation problem

Page 16: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Selected Results Cont.

Interactions with VH Software: Display Interpretation Problems Location of cut plane Aspect Motion

Translation Rotation

Page 17: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Results Cont.

Learning Anatomy Labels, labels, labels, … Head-and-neck and pelvis Usefulness

Secondary resource Steep learning curve

Value increase with time

Page 18: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Principal Conclusions

Answers to Research Questions: Best Interface Features? Familiar button bars, but … Ability to jump/return to preset views Dragging cut plane in context window

Page 19: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Conclusions Cont.

Answers to Research Questions: Usefulness for Learning Anatomy? Importance of models Secondary learning tool ??? Avoid excessive cognitive load

Page 20: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Conclusions Cont.

Recommendations Image refresh & synchronization

NGI !!! Compression !!!

Orientation support Models “Compass”

Selectable user modes

Page 21: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Conclusions Cont.

Remaining Issues Student study preferences Possible order effect

Future Work

Page 22: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Credits

National Library of MedicineBrian Athey, P.I. (Contract: N01 - LM - 0 - 3511)

Edgewarp 3DFred Bookstein & William Green

PSC Volume BrowserArt Wetzel & Stuart Pomerantz

Arrangements and DemosAlex Ade, Walter Meixner, Geri Pelok,

& Alex Terzian

Page 23: Visible Human Browsers: Formative Evaluation Based on Student Feedback

Visible Human Conference, 2002

Visible Human Browsers: Formative Evaluation Based on Student Feedback

Neil Skov, EdD ([email protected])

Wen Yu Lee, MS

Deborah S. Walker, DNSc,CNM, FACNM

Carl Berger, EdD