Group 2009 Bateman Muller Freyne

27
Personalized Retrieval in Social Bookmarking Scott Bateman, University of Saskatchewan Michael Muller, Center for Social Software, IBM Research Jill Freyne, CLARITY, University College Dublin

description

Slides from a talk at GROUP 2009 conference by Scott Bateman, Michael Muller, & Jill Freyne

Transcript of Group 2009 Bateman Muller Freyne

Page 1: Group 2009 Bateman Muller Freyne

Personalized Retrieval in

Social Bookmarking

Scott Bateman, University of Saskatchewan

Michael Muller, Center for Social Software, IBM Research

Jill Freyne, CLARITY, University College Dublin

Page 2: Group 2009 Bateman Muller Freyne
Page 3: Group 2009 Bateman Muller Freyne
Page 4: Group 2009 Bateman Muller Freyne
Page 5: Group 2009 Bateman Muller Freyne

pivot browsing to refine the list

Page 6: Group 2009 Bateman Muller Freyne

typed tag filter

Page 7: Group 2009 Bateman Muller Freyne

finding bookmarks

• filters: pivot browsing or typed tag filter

• 59% of filters lead to refinding a bookmark

– refinding: selecting a bookmark that has been – refinding: selecting a bookmark that has been

previously visited

– more refinding than discovery

Page 8: Group 2009 Bateman Muller Freyne

bookmark refinding scenario

I need to find that

news article I saw in

Dogear about

collaboration and collaboration and

social networking in

the workplace.

John

Page 9: Group 2009 Bateman Muller Freyne

John’s target bookmark

-ranked 67,564 of 575,891

Page 10: Group 2009 Bateman Muller Freyne

John’s target bookmark

-ranked 67,564 of 575,891

Page 11: Group 2009 Bateman Muller Freyne

John’s target bookmark

-ranked 67,564 of 575,891

John sees and clicks on collaboration

Page 12: Group 2009 Bateman Muller Freyne

John’s target bookmark:

-ranked 1,254 of 6,931

Page 13: Group 2009 Bateman Muller Freyne

John’s target bookmark:

-ranked 1,254 of 6,931

Page 14: Group 2009 Bateman Muller Freyne

John’s target bookmark:

-ranked 1,254 of 6,931

Page 15: Group 2009 Bateman Muller Freyne

John’s target bookmark:

-ranked 1,254 of 6,931

John sees and clicks on Ryan Jones

Page 16: Group 2009 Bateman Muller Freyne

John’s target bookmark:

-ranked 5th of 121

-presented, 1 of 2 filters

Page 17: Group 2009 Bateman Muller Freyne

new ordering options needed

• list orderings don’t necessarily reflect what is

relevant to a user’s purpose

• move relevant bookmarks to the top of the list• move relevant bookmarks to the top of the list

– reduce user effort

Page 18: Group 2009 Bateman Muller Freyne

evaluation of new metrics

• using system logs, identified all query sessions

in a 6 month period where users filtered lists

and selected a bookmark (a target)

– used all session whether refinding or not– used all session whether refinding or not

• recreated query sessions comparing original

date-based ordering versus new ordering

– positions in result lists for target (rank)

– number of results lists where target was visible

Page 19: Group 2009 Bateman Muller Freyne

wisdom of the crowd

• our initial attempts:

– access histories of all users

– access histories of automatically created

groups – based on cosine sim. of accesses, groups – based on cosine sim. of accesses,

tags, or bookmarks

Page 20: Group 2009 Bateman Muller Freyne

personalized ordering metric

∑=

ij

iselected

selectedbkmkuserrelevance ),( j

∑=

j

ij

iselected

bkmkuserrelevance ),( j

Page 21: Group 2009 Bateman Muller Freyne

Personalized

John’s target bookmark

-was ranked 4, was 1,254

-presented after 1 filter

Personalized

Page 22: Group 2009 Bateman Muller Freyne

results: rank in list

rank

Page 23: Group 2009 Bateman Muller Freyne

results: times presented

Page 24: Group 2009 Bateman Muller Freyne

we also found…

• improved result orderings on all filter types

(by tag, user, or user and tag)

• worked well on profiles of other users -> • worked well on profiles of other users ->

suggests refinding?

Page 25: Group 2009 Bateman Muller Freyne

summary

• Personalized orderings based on access

histories provide a simple metric for re-

ordering bookmarks

– improved position in list– improved position in list

– presented after fewer refinement steps

Page 26: Group 2009 Bateman Muller Freyne

future work

• is there a way to incorporate group interaction

histories?

Page 27: Group 2009 Bateman Muller Freyne

thank you

[email protected]