Geoportal Usability Evaluation Geoportal Usability Evaluation

37
Geoportal Usability Evaluation Xin HE, Hans Persson, Anders Östman FPX, IHT, HIG Sweden Geoportal Usability Evaluation Xin HE, Hans Persson, Anders Östman FPX, IHT, HIG Sweden

Transcript of Geoportal Usability Evaluation Geoportal Usability Evaluation

Page 1: Geoportal Usability Evaluation Geoportal Usability Evaluation

Geoportal Usability Evaluation

Xin HE, Hans Persson, Anders Östman

FPX, IHT, HIG

Sweden

Geoportal Usability Evaluation

Xin HE, Hans Persson, Anders Östman

FPX, IHT, HIG

Sweden

Page 2: Geoportal Usability Evaluation Geoportal Usability Evaluation

GEOTEST

2

Page 3: Geoportal Usability Evaluation Geoportal Usability Evaluation

GeoTest

• A project jointly initiated by

– National Land Survey of Sweden

– University of Gävle

– Future Position X

• A GIS cluster organization in Gävle, Sweden

3

Page 4: Geoportal Usability Evaluation Geoportal Usability Evaluation

[GeoTest] Aims

• Measuring Swedish SDI

• Contributing the implementation of INSPIRE in Sweden

4

Page 5: Geoportal Usability Evaluation Geoportal Usability Evaluation

[GeoTest] Scopes

• Performance

• Usability

• Feasibility

• (Cost & Benefit)

• (Data quality)

5

Page 6: Geoportal Usability Evaluation Geoportal Usability Evaluation

GEOTEST USABILITY EVALUATION

6

Page 7: Geoportal Usability Evaluation Geoportal Usability Evaluation

GeoTest Usability Evaluation

• ISO standards

• Institute for Humane Technology, Sweden

• FPX GeoUsability Lab

• Established network of test panels

7

Page 8: Geoportal Usability Evaluation Geoportal Usability Evaluation

[GeoTest] Applying ISO Standards

• Evaluate usability of GI services by applying standard

frameworks

– ISO 9241-11: Guidance on Usability

– ISO 9241-210: Human-centered design for interactive

system

– ISO 20282-3: Test method for measuring usability

8

Page 9: Geoportal Usability Evaluation Geoportal Usability Evaluation

GEOPORTAL

9

Page 10: Geoportal Usability Evaluation Geoportal Usability Evaluation

Geoportal

• An access point to different sources of GI on the web

• Many Member States provide access to their

infrastructures through geoportals

10

Page 11: Geoportal Usability Evaluation Geoportal Usability Evaluation

Geoportal Examples

11

Page 12: Geoportal Usability Evaluation Geoportal Usability Evaluation

USABILITY

12

Page 13: Geoportal Usability Evaluation Geoportal Usability Evaluation

Usability

• “Extent to which a product can be used by specified

users to achieve specified goals with effectiveness,

efficiency and satisfaction in a specified context of

use.”

• (ISO 9241-11:1998, definition 3.1)

13

Page 14: Geoportal Usability Evaluation Geoportal Usability Evaluation

[Usability] Effectiveness

• “the accuracy and completeness with which users

achieve specified goals”

• (ISO 9241-11:1998, definition 3.2)

14

Page 15: Geoportal Usability Evaluation Geoportal Usability Evaluation

[Usability] Efficiency

• “the resources expended in relation to the accuracy

and completeness with which users achieve goals”

• (ISO 9241-11:1998, definition 3.3)

15

Page 16: Geoportal Usability Evaluation Geoportal Usability Evaluation

[Usability] Satisfaction

• “freedom from discomfort, and positive attitudes

towards the use of the product”

• (ISO 9241-11:1998, definition 3.4)

16

Page 17: Geoportal Usability Evaluation Geoportal Usability Evaluation

USABILITY EVALUATION

17

Page 18: Geoportal Usability Evaluation Geoportal Usability Evaluation

Usability Framework (ISO 9241-11)

18

Page 19: Geoportal Usability Evaluation Geoportal Usability Evaluation

Evaluating Usability

• Understanding the goal for which the tool is designed

• Context of use in test

– Test panel

– Test tasks

• Usability measures

19

Page 20: Geoportal Usability Evaluation Geoportal Usability Evaluation

Usability Measures

• Effectiveness

– Level of completion

– Errors

• Efficiency

– Time

– (Cognitive workload)

• Satisfaction

– Psychometric questionnaire, e.g. SUMI and SUS

20

Page 21: Geoportal Usability Evaluation Geoportal Usability Evaluation

USABILITY EVALUATION OF A SWEDISH

GEOPORTAL

21

Page 22: Geoportal Usability Evaluation Geoportal Usability Evaluation

Geodata.se

22

Page 23: Geoportal Usability Evaluation Geoportal Usability Evaluation

Test Panel

23

Page 24: Geoportal Usability Evaluation Geoportal Usability Evaluation

Test Tasks

24

Page 25: Geoportal Usability Evaluation Geoportal Usability Evaluation

Usability Measures

25

Page 26: Geoportal Usability Evaluation Geoportal Usability Evaluation

SUMI

• Software usability measurement inventory (Kirakowski

and Corbett, 1993)

26

Page 27: Geoportal Usability Evaluation Geoportal Usability Evaluation

GeoUsability Lab

• 13.3 inches laptops

• Windows-based

• IE 8 installed

27

Page 28: Geoportal Usability Evaluation Geoportal Usability Evaluation

GeoUsability Lab

• Recording

– Task completion

– Time spent

– Keyboard strokes

– Mouse movements and

clicks

– Facial and oral expressions

28

Page 29: Geoportal Usability Evaluation Geoportal Usability Evaluation

[Results] Effectiveness and Efficiency

29

Page 30: Geoportal Usability Evaluation Geoportal Usability Evaluation

[Results] User Satisfaction

30

Page 31: Geoportal Usability Evaluation Geoportal Usability Evaluation

[Results] Design weakness

31

Page 32: Geoportal Usability Evaluation Geoportal Usability Evaluation

[Results] Differences in age groups

32

Page 33: Geoportal Usability Evaluation Geoportal Usability Evaluation

CONCLUSIONS

33

Page 34: Geoportal Usability Evaluation Geoportal Usability Evaluation

Conclusions from the pilot study

• Usability consideration should be a part of design

• Usability test detects design weakness

• Furthermore, it helps in understanding

– The activity

– Users

• It works for GI applications such as geoportals

34

Page 35: Geoportal Usability Evaluation Geoportal Usability Evaluation

Future works

• More tests

• Smarter method

– Test panel (Public, expert users, user experts?)

– Psychometric measurement

– Statistical inference

• Context of using geodata

35

Page 36: Geoportal Usability Evaluation Geoportal Usability Evaluation

Conclusions

• Feedbacks

• Design weakness detection

• Benchmarking

• Best practice and specification

36

Page 37: Geoportal Usability Evaluation Geoportal Usability Evaluation

Any questions?Any questions?