Usability Test Report

Usability Test ReportUsability Test Report

““Elementary School Math Club” Elementary School Math Club”

in UTOPIAin UTOPIA

By I-Fan Chou

OverviewOverview

IntroductionIntroduction ObjectivesObjectives Test ProcedureTest Procedure Task DesignTask Design Participant ProfileParticipant Profile Results & SummaryResults & Summary Problems & RecommendationsProblems & Recommendations ConclusionConclusion

IntroductionIntroduction

Elementary School Math ClubElementary School Math Club (ESMC) is a sub (ESMC) is a sub Website under UTOPIA protocol. Website under UTOPIA protocol.

ESMC provides five activities forESMC provides five activities for PreK-3 PreK-3 and and

4-84-8 elementary school teachers or parents to elementary school teachers or parents to use as lesson plans.use as lesson plans.

ESMC is designed for ESMC is designed for math educatorsmath educators and and parentsparents with elementary school kids in order to with elementary school kids in order to stimulate children’s mathematical curiosity. stimulate children’s mathematical curiosity.

ObjectivesObjectives

Assessed the performance of target Assessed the performance of target users using the current ESMC Websiteusers using the current ESMC Website

Detected any problems focusing on: Detected any problems focusing on: Navigation SystemNavigation System Interface DesignInterface Design Labeling/languageLabeling/language

OverviewOverview


Test ProcedureTest Procedure

IRB consent form & Self-report IRB consent form & Self-report background questionnairebackground questionnaire

Performance evaluation: Performance evaluation: 10 tasks10 tasks (“Think aloud”, timed, and video/audio recorded)(“Think aloud”, timed, and video/audio recorded)

Interview Interview (Audio recorded)(Audio recorded)

OverviewOverview


Task DesignTask Design

Task 1Task 1: Locate ESMC with navigation : Locate ESMC with navigation systemsystem Task 2Task 2: Locate ESMC with search : Locate ESMC with search functionfunction Task 3Task 3: Find the “About” information of : Find the “About” information of ESMCESMC Task 4Task 4: Go to “Math Mobile” section: Go to “Math Mobile” section

Task Design (cont’d)Task Design (cont’d)

Task 5Task 5: Find “Lesson Duration”: Find “Lesson Duration” Task 6Task 6: Find curriculum plan for lesson: Find curriculum plan for lesson Task 7Task 7: Download lesson kit to the : Download lesson kit to the desktopdesktop Task 8Task 8: Find “Distributive Law”: Find “Distributive Law” Task 9Task 9: Find “Materials” info: Find “Materials” info Task 10Task 10 : Send questions to ESMC : Send questions to ESMC

Participant ProfileParticipant Profile

1010 participants: participants: 88 math teachers for PreK-3 or 4-8 math teachers for PreK-3 or 4-8 22 parents with elementary school kids parents with elementary school kids 99 females; females; 11 male male

Test Participants (n=10)

Male 1

Female 9

Age 26 ~ 35 6

Participant Profile (cont’d)Participant Profile (cont’d)

All participants have basic Web capabilitiesAll participants have basic Web capabilities 55 out of 10 have visited UTOPIA protocol out of 10 have visited UTOPIA protocol 77 participants have used online tutorial tools participants have used online tutorial tools

Test Participants (n=10)

Average time of surfing online daily

½~1 hour

Visited UTOPIA 5

Used online tutorial tools

7

OverviewOverview


Results & SummaryResults & Summary

60%60% of the tasks had errors happened of the tasks had errors happened 40%40% of the participants completed tasks of the participants completed tasks

without making errorswithout making errors Task 3Task 3 (70%) and (70%) and Task 10Task 10 (80%) had lower (80%) had lower

success rate than any other tasks success rate than any other tasks T3: Find the “About” information of ESMCT3: Find the “About” information of ESMC T10: T10: Send questions to ESMCSend questions to ESMC

Confusion of universal navigation bar Confusion of universal navigation bar between between ESMCESMC and UTOPIA and UTOPIA

Results & Summary (cont’d)Results & Summary (cont’d)

Task 2Task 2 (117.5 sec.) has the longest time (117.5 sec.) has the longest time span in average for the participants to span in average for the participants to completecomplete

T2: Locate ESMC with search functionT2: Locate ESMC with search function

Problems in search functionProblems in search function

DemoDemo

OverviewOverview


Problems & Problems & RecommendationsRecommendations

Navigation SystemNavigation System Hard to locate ESMCHard to locate ESMC

Role settings vs. Local navigation barRole settings vs. Local navigation bar URL is not easy for memorizingURL is not easy for memorizing Bread crumb links do not help muchBread crumb links do not help much

Search results are sorted by categories Search results are sorted by categories add “Sort by relevance” function will helpadd “Sort by relevance” function will help

Confusion of universal navigation bar Confusion of universal navigation bar Move “About” and “Help/FAQ” of UTOPIA upMove “About” and “Help/FAQ” of UTOPIA up

Problems & Problems & Recommendations (cont’d)Recommendations (cont’d)

Interface DesignInterface Design Entrance pageEntrance page

““That’s the huge problem, it’s misleading!” That’s the huge problem, it’s misleading!” ““Tell me what is this, don’t make me click on everything Tell me what is this, don’t make me click on everything

to find out what it is” to find out what it is” Tool tips will help!Tool tips will help!

ConsistencyConsistency FontsFonts

“ “It’s really It’s really smallsmall, and no body wants to read that!” , and no body wants to read that!”

ColorColor Orange linksOrange links?? Blue headersBlue headers??

Problems & Problems & Recommendations (cont’d)Recommendations (cont’d)

Labeling/languageLabeling/language Not Teacher friendly languageNot Teacher friendly language

Not TEKS language Not TEKS language ex. Platonic Solids ex. Platonic Solids Geometric SolidGeometric Solid ““I’ve never seen platonic solid until I saw here.”I’ve never seen platonic solid until I saw here.”

Too complicatedToo complicated Not straightforwardNot straightforward Too much redundant information Too much redundant information

Vague labeling termsVague labeling terms The Math The Math Math(ematical) Concepts/ Math FormulaMath(ematical) Concepts/ Math Formula Number Paths, Guess the number-magic trick, The Human Number Paths, Guess the number-magic trick, The Human

Counting Machine, A Math MuralCounting Machine, A Math Mural

ConclusionConclusion

Modify the search function to serve Modify the search function to serve users’ searching behaviorusers’ searching behavior

Improve the navigation to locate ESMC Improve the navigation to locate ESMC from UTOPIAfrom UTOPIA

Decrease the confusion of universal Decrease the confusion of universal navigation barnavigation bar

Match the Interface design with target Match the Interface design with target user’s expectationuser’s expectation

Conclusion (cont’d)Conclusion (cont’d)

Improve consistency between entrance Improve consistency between entrance page and inside pagespage and inside pages

Change vague termsChange vague terms Add tool tips when users move the Add tool tips when users move the

mouse over the graphicsmouse over the graphics Revise the language to match TEKS Revise the language to match TEKS

languagelanguage Enlarge the fonts; deduct the content Enlarge the fonts; deduct the content

Any Questions?Any Questions?

Usability Test Report

Documents

Transcript of Usability Test Report