G1: Usability Test Findings

Jun.2007Teste de usabilidade da Nova Home da Globo.com - RESULTADOS (Marcia Maia) 1

Usability TestFINDINGS

2

Objectives and methodologyPlanning the sampleElements to evaluate- Comparison between Folha’s website and G1’s current website - Evaluation of the new G1

- Initial perception- Home page- Tag Clouds- Box ‘estado’- Box ‘as mais’- Article page- Article page with embedded gallery- Search- The Web portal’s navigation bar

Items’ order of importancePrioritizing the problemsRecommendations

Agenda

3

Objective To observe user’s perceptions towards Folha’swebsite or G1’s current website and the new G1, as well as to evaluate some functionalities

Date

Methodology

9th to 12th July 2007

Place Try’s Usability Lab (SP)

Folha’s website and G1’s current website: Free navigation and guided navigation.

New G1: Usability test monitored by a moderator in which the user follows a pre-determined task list.

ABOUT THE TEST

4

Planning the Sample – IBOPE Ratings IBOPE Category: News & Information > Sub-category: Cu rrent News & Global News > Channel: Globo Noticias

By Gender

56.55%

43.45%

59.91%

40.09%

58.01%

41.99%

56.41%

43.59%

61.98%

38.02%

59.80%

40.20%

0%

10%

20%

30%

40%

50%

60%

70%

Globo Notícias TerraActualidad

UOL Notícias &Informação

Folha Online iGNews/Último

Segundo

Estadão

This segment’s audience is predominantly male with Globo Notícias having the second highest shareof women users in the market.

Men Women

5

By Age Group

4.60%13.52%

19.89%

24.99%

24.85%

10.90%

1.25%

2.22%12.61%

19.56%

24.59%

25.17%

14.06%

1.79%

5.10%

16.67%

16.71%

22.57%

24.82%

12.64%

1.48%

3.66%13.98%

17.96%

22.05%

25.76%

14.98%

1.61%

3.55%14.78%

14.34%

22.57%

29.74%

13.60%

1.43%

3.03%14.40%

15.16%

22.46%

25.14%

18.34%

1.46%

0%

20%

40%

60%

80%

100%

GloboNotícias

TerraActualidad

UOL Notícias& Informação

Folha Online iGNews/Último

Segundo

Estadão

65+

50 - 64

35 - 49

25 - 34

18 - 24

12 - 17

2 - 11

Globo Notícias has an audience slightly younger than its copetitors: leads the 12-17 ag group and has the second highest percentage of users between 18 and 24 years old and 25 and 34 years old

Planning the Sample – IBOPE RatingsIBOPE Category: News & Information > Sub-category: Cu rrent News & Global News > Channel: Globo Noticias

6

Profile

6 men 4 women

Total sample: 10 people

Female1 woman between 20 – 25 y.o.1 woman between 26 – 30 y.o.1 woman between 31 – 35 y.o.1 woman between 36 – 45 y.o.

Male2 men between 20 – 24 y.o.1 man between 25 – 30 y.o.2 men between 31 – 35 y.o.1 man between 36 – 45 y.o.

Sample

7

Interviewees’ Internet use profile

Most of the interviewees access the Internet daily, more than once a day(6 out of 10 interviewees)

Most of the interviewees access are used to access the Internet from home (9 out of 10 interviewees)

5 of the interviewees use IE, 3 use FireFox and 2 did not know what their browser was

None of the interviewees leaves the favourites window open on the browser while navigating

Most of the interviewee use the tools bar on the browser (google, yahoo...) (7 out of 10 interviewees)

8

Interviewees’ Internet use profile

Interviewees’ main interests on the Internet:OrkutGoogleMsnShoppingBankingNews websites, gossip websites, downloads websites

Main news websites accessed by the interviewees:

FOLHA1 2 3 4 5 6 7 8 9 10

ESTADÃO

TERRAGLOBO.COMOUTROS

Obs: Some of them already knew G1 but but were not used to access it


COMPARISONFOLHA x G1

10

FOLHA DE SÃO PAULO

x

G1

11

1GOLUAP OÃS ED AHLOF

xTo access Folha’s website:

8 users typed the URL

1 accessed it through parent Web portal UOL

1 looked it up on Google

To access G1’s website:

4 users typed the URL

3 accessed it through parentWeb portal Globo.com

3 looked it up on Google

Obs: significant number of arrivals at G1 viaGoogle reinforces the importance of SEOpractices

12

It doesn’t have that much content displayed on the home page as Folha’s website

Pontos positivos (segundo os entrevistados)

FOLHA G1The colours, the look

Main positive aspect (according to the interviewees)

“It’s not visually tiring”

“The look is pretty clear, clean”

“Good utilisation of colours”

“It doesn’t have Folha’s ‘huddle’”

13

G1

It doesn’t have as much as FolhaIt doesn’t have Folha’s ‘huddle’ Categorisation of news / News designMore sparseSee more below the photo (article page)More organised than Folha’s websiteNo advertisingMenu divisionA lot of photosWeather forecastLatest news / Times on the latest newsLive video streaming / Radio CBN / VideosQuite complete. Informs well.Organisation. Large lettersMore complete articles More modern feel to it. Easier

FOLHA

Colours (aspect pointed out by the majority)It’s not visually tiringThe look is pretty clean, clearIt looks more like foreign news outlets, more

discreteNews are focused in São PauloLatest news / News tickerRelevant newsWell organisedSummary of everything. Quite completeUpdating (frequency)DiversityCorrespondence between the newspaper and the

news websiteThere are videos, but there is no attempt to induce

you to watch videosNews from other agenciesCredibility

FOLHA G1

Other positive aspects (according to the interviewees)

14

“Too much news”

“Too many things together”

“A huddle”

Main negative aspect (according to the interviewees)

Colour. Red in excess.FOLHA G1Excessive ammount of information on the home page.

15

Excess of red colour

Focused on Rio de Janeiro

Position of the search box

Perception that the a large portion of the content is for susbcribers only

Overload of information on the homepage“Too many options”

Small font size

Excess of advertising

Lack of photographs related to the highlights

Other negative aspects (according to the interviewees)

FOLHA G1

16

“Red is overwhelming”

“There is too much red on the website”

”The excess of the red colour irritates me”

“I associate the red colour to tabloids and sensationalism”

“Everything on this page looks important and urgent. There is no hierarchy”

COMMENTS ABOUT THE USAGE OF RED COLOUR ON THE CURRENT WEBSITE


NEW G1

18

First impressions

Visually lighter than the curent website, less ‘blocky’

Organised and clean

Excessive amount of information

19

G1 ATUAL G1 NOVO

Comments about the colour and the amount of content

“It’s much better, but there is still too much red.”

“Wow! There is too much information here!”

“The colour is much better now!

“It’s clean, I like it”

“Overwhelming! What am I supposed to do here?”

20

What first catches your attention on this page?Advertising ( 6 users)

Main headline

2º

1º

1º

2º (4 users)

21

HOME

During the sessions, most of the users said that G1 has a strong presence of videos. This element was explored by 6 users.

Videos on the home page

The ‘play’ button was understood by all the participants.

“It’s like YouTube. ”

“This arrow means that it’s a video”

In some cases, such as dark backgrounds,the ‘play’ button looks like an element of the image.

“It looks like he is holding a small board”

22

TAG CLOUD

The vertical tag cloud was understood as a part of the main menu.

Most of the users associate the tag cloud to popular search terms, but the relationship between size and relevance is unclear.

Some of the aspects mentioned by users as possible reasons for the size variation:

Editorial relevance of the topics;

Amount of information about the topic available on the website;

Aesthetics.

Tag cloud

23

Tag cloud – Globo.com Home Page UT (May 2007)

Most of the participants of the Home Page UT understood the behaviour of the tag cloud.

Possible reasons for the different results in the G1 UT: - Placement (underneath the main menu instead of on the bottom of the page);- Shape (vertical instead of horizontal);- Colour (the use of the red colour makes the tag cloud look like an extension of the menu);

TAG CLOUD

24

“Most read”, “most emailed”and “most commented

Most of the users did not explore this box on the news section pages. Only 2 users mentioned this box spontaneously.

When asked to look at this box, most users did not realise that they could click on the tabs. Only 3 participants used the tabs to navigate through the content of this box.

SECTION PAGES

25

Video signageThe ‘play button’ was easiliy understood by the partcipants.

Links to related stories (”saiba mais”)Most of the users like the new position of this element - integrated to the stoty text instead of an the bottom of the page.

Ability to change the font size

STORY PAGE

Easily noticed by most of the users.

26

Poll - Only 2 participants used this feature. It was not mentioned by the other users.

“Main page” Box

Breadcrumbs – It was used by 3 participants to navitage through topics and sections pages.

Comments - Most of the participants noticed this feature.

STORY PAGE

- During the sessions, participants usedthis box to ‘monitor’ the headlines on the homepage. However, most of them went back to the homepage to read more about a specific stoty.

27

Most of the users preferred the new navigation bar.

Reasons for the preference:- Prominent search box;- Visually clean;- Roll-over effects

Negative comments: - The link to “All sites’ was considered small and difficult to find by 2 users.

GLOBAL NAVIGATION BAR

x During the UT sessions, the participants made spontaneous comments about the new navigationbar. In the end of the sessions, all of the participants were encouraged to compare the the old and the new bars

28

SEARCH

It was used by all the participants at least twice during the UT sessions. They used the search to look for specific topics (some of them featured on the website).

The new position of the search box was praised by most of the users.

“I don’t have time to read all the stories to find what I want. I just search for the topics I am interested in”.

“The search has to be in your face because people don’t bother reading all the pages.”


Importance Hierarchy

30

How important are the following items on a news website?

VERY IMPORTANT

Latest news 1 2 3 4 5 6 7 8 9 10

IMPORTANT

LESS IMPORTANT

NOT IMPORTANT

Search 1 2 3 4 5 6 7 8 9 10

LESS IMPORTANT

Local news 1 2 3 4 5 6 7 8 9 10

LESS IMPORTANT

Very important + important = 10Less important + not important = 0

VERY IMPORTANT

IMPORTANT

NOT IMPORTANT

VERY IMPORTANT

IMPORTANT

NOT IMPORTANT



31

VERY IMPORTANT

Blogs & Columns 1 2 3 4 5 6 7 8 9 10

IMPORTANT

LESS IMPORTANT

NOT IMPORTANT

Live video streamings1 2 3 4 5 6 7 8 9 10

Financial indexes 1 2 3 4 5 6 7 8 9 10

How important are the following items on a news website?


VERY IMPORTANT

IMPORTANT

LESS IMPORTANT

NOT IMPORTANT

VERY IMPORTANT

IMPORTANT

LESS IMPORTANT

NOT IMPORTANT




SUMMARY OF RECOMMENDATIONS

33

Summary of recommendationsReview the amount of information displayed on the home page

Refine the graphical application of the ‘play button’ on images

Review the positioin and shape of the tag cloud

Redesign the ‘most read’, ‘most emailed’ and ‘most commented’ box (information design and interaction).

34

Next Steps

Prioritisation of issues - Product management

Solutions Workshop - Product team

Release planning

Design and Development

G1: Usability Test Findings

Design

Transcript of G1: Usability Test Findings