Morae: Digital Solution for Morae: Digital Solution for Usability StudiesUsability StudiesInformation Experience LaboratoryInformation Experience Laboratory

Borchuluun Yadamsuren & Paul TurnerBorchuluun Yadamsuren & Paul Turner

School of Information Science & Learning School of Information Science & Learning TechnologiesTechnologies

University of Missouri-ColumbiaUniversity of Missouri-Columbia

LIDA conferenceLIDA conference

Dubrovnik, 2007Dubrovnik, 2007

OverviewOverview

What is usability?What is usability?• IE Lab SetupIE Lab Setup MORAE componentsMORAE components Demonstration of usability session with Demonstration of usability session with

MoraeMorae

What is a usability?What is a usability?

• LearnabilityLearnability• Efficiency of UseEfficiency of Use• MemorabilityMemorability• Minimum errors in UseMinimum errors in Use• Subjective Satisfaction Subjective Satisfaction (Jacob Nielsen, (Jacob Nielsen,

1993)1993)

Usability testingUsability testing

Measures usability by giving a close-up Measures usability by giving a close-up look at an individual user’s experience look at an individual user’s experience while navigating a site or software while navigating a site or software application, right down to the user’s application, right down to the user’s verbal and facial expressions.verbal and facial expressions.

Usability Testing with MoraeUsability Testing with Morae

•Think aloud

•Task analysis

•Interview

•Focus group

•Expert review

IE Lab SetupIE Lab Setup

•Established in 2003 Established in 2003 •Includes the Information Experience Includes the Information Experience Room (data collection) and the Control Room (data collection) and the Control Room (research & analysis)Room (research & analysis)

•Experience Room is set up with five Experience Room is set up with five collection stationscollection stations

•Remote data collection via laptopRemote data collection via laptop

Information Experience LabInformation Experience Lab• ResearchResearch• ConsultingConsulting• TeachingTeaching

Experience RoomExperience Room

Control RoomControl Room

MoraeMorae

Old technology v. New technologyOld technology v. New technology

All software solution

Truly portable

Easy to use

Rich Recording TechnologyRich Recording Technology

Portable LabPortable Lab

Morae ProcessMorae Process

Three componentsThree components• RecorderRecorder• ObserverObserver• ManagerManager

Recording the User TestRecording the User Test

Morae featuresMorae features

• Instantly calculate and graph standard Instantly calculate and graph standard usability measurementsusability measurements• Focus on understanding results Focus on understanding results •Visualize important results in meaningful Visualize important results in meaningful waysways

•Present results persuasively and Present results persuasively and professionally professionally

Testing ProcessTesting Process

Morae RecorderMorae Recorder• Defining study name, configuration, and capture options

• Defining markers and tasks

• Defining surveys (SUS and user satisfaction surveys)

Capture optionsCapture options• CameraCamera• MicrophoneMicrophone• KeystrokesKeystrokes• Screen textsScreen texts

Mouse clicks Mouse clicks (cursor, right, left (cursor, right, left and middle buttons)and middle buttons)

MarkersMarkers

• Color

• Type

• Description

Use of MarkersUse of Markers• User actionsUser actions• User comments and questionsUser comments and questions• Observations about how the user Observations about how the user

performs a taskperforms a task• Interesting comments or actions to Interesting comments or actions to

include in highlight videosinclude in highlight videos

Logging the user testLogging the user test

Morae Observer featuresMorae Observer features

•Connect to Connect to RecorderRecorder via Network. via Network. •Remotely start and stop Remotely start and stop RecorderRecorder from from an Observer station.an Observer station.

•View View RecorderRecorder's screen video, picture-in-'s screen video, picture-in-picture (PIP) and audio of the user.picture (PIP) and audio of the user.

Morae Observer featuresMorae Observer features

• Log the test session markers and text Log the test session markers and text notesnotes

• Record a digital video file (WMV) of the Record a digital video file (WMV) of the session in session in ObserverObserver for immediate for immediate playback and sharing of the test session.playback and sharing of the test session.

• Connect multiple Observers Connect multiple Observers simultaneously to simultaneously to RecorderRecorder..

Multiple ResearchersMultiple Researchers

Morae ManagerMorae Manager

• Synchronized review of test recordingsSynchronized review of test recordings• Video and audio indexed with interaction eventsVideo and audio indexed with interaction events• Quickly calculate time-based and frequency metricsQuickly calculate time-based and frequency metrics• Easily create and share highlight videosEasily create and share highlight videos

ANALYZER PRESENTER

Morae Analysis FeaturesMorae Analysis Features

•Review screen video automatically Review screen video automatically synchronized with user video and audio.synchronized with user video and audio.

•View log marks and text notes entered View log marks and text notes entered through through Remote ViewerRemote Viewer(s) synchronized with (s) synchronized with the video recording.the video recording.

•Automatically break recordings into tasks Automatically break recordings into tasks based on markers.based on markers.

•Calculate usability metrics, including time on Calculate usability metrics, including time on task, click path, and user success rate.task, click path, and user success rate.

SearchSearch• Mouse clicksMouse clicks• Web page changesWeb page changes• KeystrokesKeystrokes• Screen textScreen text• TasksTasks• Window dialog eventsWindow dialog events

Export search results to a comma-delimited file Export search results to a comma-delimited file that can be used in other applications (Excel, that can be used in other applications (Excel, SPSS etc)SPSS etc)

Task analysisTask analysis

Task AnalysisTask Analysis

Data AnalysisData Analysis

Morae Presentation featuresMorae Presentation features

•Edit and create highlight videos and title clipsEdit and create highlight videos and title clips•Create multiple highlight videos within a single Create multiple highlight videos within a single project.project.

•Easily add transitions.Easily add transitions.•Add audio voice-overs.Add audio voice-overs.

Presentation of resultsPresentation of results• Import videos not recorded with Import videos not recorded with MoraeMorae and and

include them in the highlight video.include them in the highlight video.• Position, resize and adjust the PIP image for Position, resize and adjust the PIP image for

each clip.each clip.• Produce individual clips for Power Point Produce individual clips for Power Point

PresentationsPresentations

DemonstrationDemonstration• Object of the study: MU Libraries websiteObject of the study: MU Libraries website• Method: Think Aloud and Task AnalysisMethod: Think Aloud and Task Analysis• User will perform tasksUser will perform tasks• Observation of the sessionObservation of the session• Basic AnalysisBasic Analysis• Data presentationData presentation

ResourcesResources• Information about MoraeInformation about Morae• Case study of MU Usability StudyCase study of MU Usability Study• Other case studies of Morae useOther case studies of Morae use

www.techsmith.comwww.techsmith.com

Contact UsContact Us

•Dr.Sanda Erdelez: Dr.Sanda Erdelez: erdelezs@missouri.eduerdelezs@missouri.edu •Borchuluun Yadamsuren: Borchuluun Yadamsuren: by888@mizzou.eduby888@mizzou.edu•Paul Turner: Paul Turner: turnerp@missouri.eduturnerp@missouri.edu

Information Experience Laboratory:Information Experience Laboratory:

http://ielab.missouri.eduhttp://ielab.missouri.edu

School of Information Science & Learning School of Information Science & Learning Technologies: Technologies:

http://www.sislt.missouri.eduhttp://www.sislt.missouri.edu