Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar -...

36
Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang
  • date post

    22-Dec-2015
  • Category

    Documents

  • view

    213
  • download

    0

Transcript of Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar -...

Page 1: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Evaluation of Project Engage - Staff Side

Team RENEU

- Anran Ye

- Aalap Doshi

- Gaurav Pimprikar

- Yung-Ju Chang

Page 2: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Home • Overview of Project Engage• Methodology• Problems and Recommendations• Summary

Home

Page 3: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

OVERVIEW OF PROJECT ENGAGE

Page 4: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

• “University of Michigan Engage is intended to provide ‘one-stop shopping’ for people who want to help medicine move forward by participating in clinical research at the University of Michigan.”

Overview

Overview

Page 5: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

• Engage has several features - study database, public search tool, community information as well as a secure Registry.

– The Study Database feature allows study teams at University of Michigan to post their clinical research trials for the public to view.

– The Registry is a feature that • allows interested volunteers to enroll in a registry, • automatically matches volunteers to potential studies so that

researchers can contact them as potential candidates

Functionality

Overview

Page 6: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

User Demographics

Busy Researchers who want to do their things quickly

1

Study Co-ordinators who want an easy and intuitive system

2

Engage Staff who wants to make Engage an easy and pleasurable experience for the users

3

Overview

Page 7: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

• It is a very good concept and has the potential to reduce the difficulties in recruiting volunteers for clinical research.

• "Once you get the hang of it, the website is easy to use."

• The website is IRB approved and so one can post clinical studies on it without any concerns.

• The Engage team is very cooperative and committed to the improvement of Engage.

Successful Features

Overview

Page 8: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

METHODOLOGY

Page 9: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Methodology

Team RENUE has completed a thorough exploration of the website structure using:

•Generalized Transition Network •Interviews and focus group•Comparative Analysis •Personas and Scenarios •Heuristic Evaluation using Jakob Nielson's Heuristics•User survey•Usability tests•Vocabulary Analysis

Methodology

Page 10: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

PROBLEM AREAS AND RECOMMENDATIONS

Page 11: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Problem Area 1: Login

Absence of prominent login points for staff in the entire site.

• There is a lack of clues leading users to the login page.

• There is no separate section dedicated to login and the link is buried deep in text.

• Users took an average of 4.2425 minutes just to login.

Problems &Recommendations

Page 12: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summaryfold

Engage Main Page

Problem Area 1: Login

Problems &Recommendations

Page 13: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Still trying to login…

Problem Area 1: Login

Problems &Recommendations

Page 14: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Recommendations:

• The staff login link should be present on the home page.

• A prominent section dedicated to login on the home page will go a long way in making the website more accessible and user-friendly.

Problem Area 1: Login

Problems &Recommendations

Page 15: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

The navigation through the system is hampered by the following problems:

•Two sections critical to staff, namely “Post/Edit Study” and “Online Registry” are disconnected from each other.• Users have to go back to main page to get to another section.

Problems &Recommendations

Problem Area 2: Navigation

Page 16: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Problem Area 2: Navigation

Problems &Recommendations

Page 17: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Recommendation:

• A single login section on the home page leads to different options such as bulletin board, Registry, etc.

• The use of a consistent navigation bar will make it possible for the users to move about freely on the website.

Problem Area 2: Navigation

Problems &Recommendations

Page 18: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

A. Lack Of User Control When Managing Volunteers

• Users have very limited approach to categorize volunteers.

• The buttons to categorize & corresponding category link have the same name and hence

are easy to be confused with each other.

• Lack of flexibility when categorizing volunteers. e.g: records can be moved from ‘Plan to

Contact’ to ‘Contacted’ directly, but not the other way around.

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 19: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

The button to categorize and corresponding category link have the same name and hence are easy to be confused with each other.

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 20: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Only one way tagging is possible

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 21: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Recommendations:

• Users should be able to tag records from the full record page and move records from one category to another without extra steps.

• A feedback mechanism needs to be implemented which states the actions that have taken place.

• Long-term Recommendation: A main table for all volunteers with their status indicated

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 22: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

A Mock-up of the Suggested Volunteer Tagging System

# Name Careweb access

Plan to contact

Contacted ineligible

1 Ben Linus Y X

2 Desmond Hume Y X X

3 Shannon Rutherford

Y X

4 Sun-Hwa Kwon Y X X

5 Sayid Jarrah N X

6 Hurley Reyes N X

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 23: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

B. Selection of Principal Investigator not clear

• The principle investigators’ name cannot be typed into the box directly.

• The tool of searching ‘Principal investigator’ only supports unique name and last name search.

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 24: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

The principle investigators’ name cannot be typed into the box directly.

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 25: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

The tool of searching ‘Principal investigator’ only supports unique name and last name search.

If the user did not know the unique name, the only alternative is to search the last name, which usually leads to quite a long list of names to choose from.

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 26: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Recommendations:

• Allow the user to type into the textbox.

• Design a drop down list of names, which emerges when users enter characters into the textbox.

• More searching fields should be added into the ‘Principal investigator’ search such as first name as well as last name.

Problem Area 3: User Control & Freedom

Problems &Recommendations

Page 27: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

A: Metaphor -- My Bulletin Board

• In the physical world: usually mentioned as a board for posting bulletins, messages and announcements.

• In Engage: a system to post and edit studies.

Problem Area 4: Vocabulary

Problems &Recommendations

Page 28: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Recommendation:

• Short-term: Replace the current metaphor with more intuitive term such as ‘My postings’ or ‘My studies’.

• Long-term: Design the ‘Bulletin Board’ to be similar to its real world counter part.

For example: - In-site communication system- Short messages, announcement, etc.

Problem Area 4: Vocabulary

Problems &Recommendations

Page 29: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

B: Managing Volunteer The ‘Look at Volunteers' link leads to the

‘Requested Contact' list which often contains no records.

Problem Area 4: Vocabulary

Problems &Recommendations

Page 30: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Problem Area 4: Vocabulary

Problems &Recommendations

Page 31: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Recommendations:

• Short-term: Replace ‘Requested Contact' with ‘Potential Subjects’.

• Long-term: A main table for all volunteers with their status indicated (as discussed previously).

Problem Area 4: Vocabulary

Problems &Recommendations

Page 32: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

C: ‘Find studies’ Link

• The link to ‘My Bulletin Board’ is placed on the ‘find studies’ page. Hence the ‘find studies’ link misleads most users.

• “So I have to go though ‘Find Studies ’ to post studies?”-- user testing, U02

Problem Area 4: Vocabulary

Problems &Recommendations

Page 33: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Recommendations:

Place a separate link on the Engage home page titled ‘Bulletin Board’ or ‘Post/Edit studies’.

OR

Rename ‘Find studies’ to ‘Find/Post studies’.

Problem Area 4: Vocabulary

Problems &Recommendations

Page 34: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

SUMMARY

Page 35: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

The Engage project is a significant step in helping MedicalResearchers find suitable Volunteers. We believe that theabove recommendations will improve their efficiency andcreate a better environment for the allocation of volunteers.

Summary

Summary

Page 36: Evaluation of Project Engage - Staff Side Team RENEU - Anran Ye - Aalap Doshi - Gaurav Pimprikar - Yung-Ju Chang.

Home

Overview

Methodology

Problems & Recommendations

Summary

Thank You…

Keep ‘Engage’ing…