Kartik Hosanagar at Supernova 2008

18
Kartik Hosanagar The Present and Future of Personalized Recommendations

Transcript of Kartik Hosanagar at Supernova 2008

Page 1: Kartik Hosanagar at Supernova 2008

Kartik Hosanagar

The Present and Future of

Personalized Recommendations

Page 2: Kartik Hosanagar at Supernova 2008

Personalized Retail

Page 3: Kartik Hosanagar at Supernova 2008

Personalized Radio

Page 4: Kartik Hosanagar at Supernova 2008

Personalized News

Page 5: Kartik Hosanagar at Supernova 2008

3rd Party Providers

Img Src: Business 2.0

Page 6: Kartik Hosanagar at Supernova 2008

Why are Recommenders Important?

Value to Consumers:

• Learn about new products • Sort through myriad choices

Value to Firms:

• Convert browser to buyers • Cross-sell • Increase loyalty

Used by major Internet firms (Amazon, NetFlix, Yahoo!)

Recommenders can be beneficial to both consumers and firms.

Page 7: Kartik Hosanagar at Supernova 2008

Recommender Design

Content Based Collaborative Social Network

Correlation Engine

vs.

High Correlation

Recommendations

Page 8: Kartik Hosanagar at Supernova 2008

The Amazon Approach

A bundle is created based on the look-alikes

Customer views an item

Amazon immediately identifies his profile and recent history, the product attributes and the behavior of similar customers

Additional items are proposed, based on other customers’ buying behavior

Amazon uses all available information about customers in order to present the most relevant offer possible.

Page 9: Kartik Hosanagar at Supernova 2008

The Netflix Approach

Customer asked to rate movies Movie ratings are used by Netflix to build the customer “persona”

Based on the “persona”, a group of movies the Customer will probably like is created

A movie is then recommended

Utilizing customer information, Netflix is able to improve profits through its recommendation engine.

Based on the ratings provided by customer with a similar “persona”

Page 10: Kartik Hosanagar at Supernova 2008

Cinematch Engine

User Ratings 100 Million 18,000

Movies

Dataset Correlation Engine

vs.

High Correlation

Recommendations

 Encourage users to rate movies

 Determine correlations in user ratings to identify similar users

 Recommend movies based on evaluations of similar people

Cinematch uses statistical techniques to identify similar users and recommend movies based on ratings of similar users.

NetFlix Data Available (NetFlix Challenge)

Page 11: Kartik Hosanagar at Supernova 2008

Recommender Impact: Substitution or Incremental Sales?

Page 12: Kartik Hosanagar at Supernova 2008

Impact on Volume (Fleder & Hosanagar 2007)

Results available in popular press(Billboard, Yahoo)

December(2006)

January February March April May June July

iLikeUsers 15 14 12 41 27 23 21 18

Control 10 9 7 8 8 10 7

iLikeUsers

control

0

5

10

15

20

25

30

35

40

45

Numberof

Songs

MonthlySongsAdded(Median)byUserType

N/A

Page 13: Kartik Hosanagar at Supernova 2008

Recommenders => Long Tail? (Fleder & Hosanagar 2008)

•  Do recommenders (collaborative filters) foster discovery of obscure/niche items?

Page 14: Kartik Hosanagar at Supernova 2008

Results 1.  Collaborative filters can help enhance sales diversity

(e.g., by increasing awareness) but …

a design feature, namely the use of sales data to recommend products, can often come in the way and drive up sales concentration

14

Page 15: Kartik Hosanagar at Supernova 2008

Consumer level effects •  Individual diversity can increase but aggregate

diversity decreases

•  Basic design choices affect the outcome

How do you foster discovery?

Results available on web (SSRN)

Page 16: Kartik Hosanagar at Supernova 2008

Why do Recommenders Work? (Fleder & Hosanagar 2007) •  Lots of biases in

–  What people watch –  What people rate

•  Most systems assume ratings missing at random … yet they work. Why?

•  Test the impact of missing ratings

Page 17: Kartik Hosanagar at Supernova 2008

Results

Random NR (a) NR (b) NR (c) NR (d)

Chance missing Equal Increasing Decreasing U-Shape Inverse-U

Prediction error (E) 0.770 0.785 0.791 0.945 0.686

Page 18: Kartik Hosanagar at Supernova 2008

Future of Personalized Recommendations? •  Discovery •  Fluid inter-site personalization

–  Privacy –  Ownership

Contact: [email protected]