Usability Test Alban Demiraj. Measuring real-life-scenario performance Participants go through the...
18
Usability Test Alban Demiraj
-
Upload
rudolph-potter -
Category
Documents
-
view
212 -
download
0
Transcript of Usability Test Alban Demiraj. Measuring real-life-scenario performance Participants go through the...
Usability Test
Alban Demiraj
• Measuring real-life-scenario performance
• Participants go through the predefined scenario
• The Software and the testers log the performance
What is the Usability Test
1. The Tasks 2. The Technology 3. The Participants
Preparing the Test
• To run a Usability Test we need some real life scenario (tasks) the participants have to complete.
• Our result will very according to the capability of this tasks to cover major function.
• We have to consider participants psychologically in order to get their best
• Design tasks accordingly
• Order tasks accordingly
The Tasks - Requirements
The TasksFind the article "India's surprising economic miracle". (The Economist US, 2 Oct 2010)
See how easy is for the students, to use AUP’s subscription to external resources.
Find the books from William Shakespeare. And open the 3d on the list.
Analyzing the efficiency of the Libraries Search Engine.
Find when you can access the library building.
Analyzing the load of links in the Library’s main page.
Find how to use the Academic Film Collections.
Analyzing the naming of links in the Library’s pages.
Find a book on "Cognitive Science" and "Computer", published between 1950 and 2000.
Analyzing how easy is to find and use the Advanced Search Engine.
• Keep track of the time participants spend on each page
• Keep track of the path the participants travel to the solution
• Be able for the participants trough the software to identify their finish
• Be able to reshow the task to the participants at their will, anytime
The Technology - Requirements
The Technology
1. How many ?
2. Who ?
The Participants
The Results 1/4
Task 1 Task 2 Task 3 Task 4 Task 5User 01 NO NO YES NO NOUser 02 YES NO YES YES NOUser 03 NO YES YES YES NOUser 04 NO YES YES YES NOUser 05 YES NO YES YES YESSolve Rate
40% 40% 100% 80% 20%
The Results 2/4
Task1 Task2 Task3 Task4 Task50
2
4
6
8
10
12
14
16
18
20
User01
User02
User03
User04
User05
Ideal
Avarage
Task vs Number of traveled pages (Path)
Task 1 Task 2 Task 3 Task 4 Task 5User 01 NO NO YES NO NOUser 02 YES NO YES YES NOUser 03 NO YES YES YES NOUser 04 NO YES YES YES NOUser 05 YES NO YES YES YESSolve Rate
40% 40% 100% 80% 20%
Task1 Task2 Task3 Task4 Task50
2
4
6
8
10
12
14
16
18
20
User01
User02
User03
User04
User05
Ideal
Avarage
Task vs Number of traveled pages (Path)
The Results 3/4
Task1 Task2 Task3 Task4 Task50
50
100
150
200
250
300
350
User01User02User03User04User05AvarageFastest
Task 1 Task 2 Task 3 Task 4 Task 5User 01 NO NO YES NO NOUser 02 YES NO YES YES NOUser 03 NO YES YES YES NOUser 04 NO YES YES YES NOUser 05 YES NO YES YES YESSolve Rate
40% 40% 100% 80% 20%
Task1 Task2 Task3 Task4 Task50
50
100
150
200
250
300
350
User01User02User03User04User05AvarageFastest
The Results 4/4
Time spent on Basic Pages (seconds)
Homepage InitialHomepage ReselectedBasic SearchAdvanced Search
Discussing
Task Goal Conclusion
Find the article "India's surprising economic miracle". (The Economist US, 2 Oct 2010)
See how easy is for students, to use AUP’s subscription to external resources.
One possible explanation for this difficulty is that students find it very difficult to adapt to different external resources’ interface, thus loosing time there
Find the books from William Shakespeare. And open the 3d on the list.
Analyzing the efficiency of the library search engine.
Students consistently use the keyword search, even on occasion when other types of searches would be much more efficient. On explanation for this behavior is that students are used to Web search-engines queries (such as Google Searches), and they don’t see the utility of index-specific searches.
Discussing
Task Goal Conclusion
Find when you can access the library building.
Analyzing the load of links in the libraries main page.
The AUP Library homepage is overloaded for students’ eyes. They offer direct link to tons of information, shadowing basic info like the library hours.
All + Find how to use the Academic Film Collections.
Analyzing the naming of the links in the library’s homepage.
The AUP Library homepage is well named; still students seem to somehow tend to look for the natural Google instinct they own.
Find a book on "Cognitive Science" and "Computer", published between 1950 and 2000.
Analyzing how easy it is to use the Advanced Search Engine.
The majority of students don’t know what the Advanced Search is. There is no link from the home page to the Advanced Search, one must run a search in order to be able to use the advanced search.
