Recommender Systems and the Human Factor
-
Upload
mark-graus -
Category
Data & Analytics
-
view
428 -
download
3
Transcript of Recommender Systems and the Human Factor
![Page 1: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/1.jpg)
Recommender Systems and the Human FactorMark GrausNetherlands Machine Learning Meetup
2016/03/16
![Page 2: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/2.jpg)
I’m 50% Machine Learner 50% Psychologist
![Page 3: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/3.jpg)
I’ve been working with ‘recommender systems’ since 2009
Movie Recommender Systems
Website
Personalization
App
Personalization
200
920
1120
16
![Page 4: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/4.jpg)
Content What Are Recommender Systems
Why Machine Learning is not Enough
![Page 5: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/5.jpg)
What are Recommender Systems?
![Page 6: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/6.jpg)
![Page 7: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/7.jpg)
The Machine Learning Behind Recommender Systems
We use historical item-user data to predictunobserved item-user data
Typically big datasets i.e. billions of observations
millions of users
tons of items
Numerous Specifically Designed Algorithms
![Page 8: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/8.jpg)
How I see Recommender Algorithms
Implicit Feedback Explicit Feedback
Collaborative
Content-Based
![Page 9: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/9.jpg)
Distinction 1:Implicit versus Explicit Feedback
Implicit
My actual behavior watching
skipping/stopping
Explicit
The feedback I give star rating
![Page 10: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/10.jpg)
Distinction 1:Considerations
“Oh no! My TiVo thinks I’m gay”
Jeffrey Zaslow, The Wall Street Journal, December 2002
What I Like versus What I Say I Like
Solution: Use a bit of both implicit and explicit
![Page 11: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/11.jpg)
Distinction 2:Content-Based versus Collaborative Filtering
Supervised learning Features are extracted from ‘metadata’
Target variable is rating (explicit) or whether the movie will be watched (implicit)
Genre Director MainActor
Year Rating
The Usual Suspects
Crime Bryan Singer
Kevin Spacey
1995
Titanic Drama JamesCameron
LeonardoDiCaprio
1997
Die Hard Action John McTiernan
Bruce Willis
1988?
![Page 12: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/12.jpg)
Distinction 2:Content-Based versus Collaborative FilteringKNN, Slope One
?
?
![Page 13: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/13.jpg)
Matrix Factorizationbut also FunkSVD, SVD+
Usu
al S
usp
ect
s
Tit
an
ic
Die
Ha
rd
Th
e G
od
fath
er
Jack
Dylan
Olivia
Mark
?
?
?
? ? ?
?
Dimensionality Reduction
![Page 14: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/14.jpg)
Matrix Factorizationbut also FunkSVD, SVD+
Jack
Mark
Olivia Dylan
![Page 15: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/15.jpg)
Content-Based versus Collaborative
Considerations
Metadata availability
Need for explaining
![Page 16: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/16.jpg)
My Approach
Start with Open Source Software Lenskit (Java)
MyMediaLite (C#)
Mahout (Python)
Learn about Recommender Systems and User Base
Scale Up Cassandra
Akka
![Page 17: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/17.jpg)
State-of-the-Art
We can do predictions really well
Challenges Cold Start Problem
Context-Aware Recommendations
Social Recommendations
“Merged accounts”
![Page 18: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/18.jpg)
Why Machine Learning is Not Enough
![Page 19: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/19.jpg)
Recommender System Data is Observable Behavior
Recommendations
Behavior
Recommender System
User Experience
![Page 20: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/20.jpg)
Examples of Things Data Cannot Tell Us
Do I feel my privacy invaded? Am I happy to have American Pie 2 recommended?
Why do people react to recommendations the way they do? Presentation?
Bad Recommendations?
Choice Overload?
![Page 21: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/21.jpg)
We need to do A/B testing and UX measurement
System A System B
![Page 22: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/22.jpg)
What did we learn from surveys?
Satisfaction = Recommendation Set Attractiveness - Choice Difficulty
More views != Satisfaction
Diversity influences Satisfaction
Long Lists = Difficult to Choose
Short Lists = Easier to Choose, but not enough choice
Right Balance = Short Lists of Diverse Items
![Page 23: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/23.jpg)
Take Home Message
The Machine Learning is just the beginning of Recommender Systems
![Page 24: Recommender Systems and the Human Factor](https://reader031.fdocuments.us/reader031/viewer/2022022202/587c46491a28ab5a1d8b7ac1/html5/thumbnails/24.jpg)
Thank you for listening!
Some Pointers
Recommender Algorithms Yehuda Koren, Google
Introduction to Recommender Systems, Coursera/GroupLens
Infrastructure Netflix Tech Blog
A/B Testing Ron Kohavi, Microsoft Research
User Experience Evaluation in Recommender Systems Bart Knijnenburg, Clemson University