THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3...

41
21 st Century Marketing Conference THE POWER OF VISUAL DATA Shasha Lu

Transcript of THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3...

Page 1: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

21st Century Marketing Conference

THE POWER OFVISUAL DATA

Shasha Lu

Page 2: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

The “Big Data” Trend

2

Source: IDC,2014

Page 3: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

What makes big data big?

3

3

Source: https://www.go-globe.com/blog/things-that-happen-every-60-seconds/ 2017

In 1 minute……

Youtube 700,000 hours of videos watched and 500 hours of videos uploaded

Facebook 243,000 photos uploaded and 70,000 hours of video content watched

Instagram 65,000 photos uploaded

Netflix 87,000 hours of videos watched

Tinder 1,000,000 swipes and 18,000 matches

Whatsapp 1,000,000 photos shared

… …

Page 4: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Which part is unstructured data? Why is it useful?

Strength of The ‘New’ Data

Which part is structured data? Why is it useful? What problems it may have?

Page 5: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Customer comments

Tweets

Forum discussions

Photo posts

Video posts

(Visual) content marketing

In-store shopping behavior

… …

5

Gain customer insights

Understand customer preference

Improve customer experience

Discover unmet needs

Generate new product/business ideas

Measure and optimize marketing effectiveness

Page 6: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Use face analytics to improve business practice

6

Page 7: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

What can you tell from a face?

Page 8: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Demographics (age, gender, ethnicity, height, weight,…)?

Background (education, occupation, )?

Emotional states (joy, disgust, angry, …)?

Habits (smoking, drinking, stay up late, …)?

Traits (trustworthy, attractive, mature, …)?

Personality (extroversion, conservative, …)?

Behavioral tendency (risk seeking, leadership, competent… )?

Information from a Face

8

What can we do with these information?

Page 9: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Health and Lifespan

Lifespan Estimate: 84.6Lifespan Estimate:71.2

Can face reveal how long one will live?

Page 10: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

How does it work?

Page 11: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

A New Solution for Life Insurance

Source: https://demo.lapetussolutions.com/light/home

Page 12: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Online Dating

Page 13: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Finding Better Matches with Face

• Tom

• Male

• 32 years old

• 178cm

• Graduated from Cambridge

• …

• Mark

• Male

• 32 years old

• 178cm

• Graduated from Cambridge

• …

?

Page 14: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video
Page 15: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Challenges in Online Dating Screening Process

15

VS.

400 Survey Questions Facial Appearance-based

Page 16: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

16

Face Preference-based Screening

Page 17: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Face Perception Framework

17

Local

Facial Feature

Global

Facial Feature

17

Ref: Yinghui Zhou, Shasha Lu, and Min Ding. “A Face Anonymity-Perceptibility Paradigm and An Application in Online Dating Industry”

Page 18: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

The Matching Result

18

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

recommend top one recommend top four

without facialpreference

with facialpreference

Percentage

of correct

predictions

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

recommend top one recommend top four

without facialpreference

with facialpreference

Ref: Yinghui Zhou, Shasha Lu, and Min Ding. “A Face Anonymity-Perceptibility Paradigm and An Application in Online Dating Industry”

Page 19: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

19

A New Solution for Online Dating

Page 20: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Do faces affect how a viewer reacts to an ad in the metrics that advertisers care

about?

20

Content Marketing

Page 21: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

21

Page 22: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

22

Page 23: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

23

Page 24: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

24

Page 25: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

25

Page 26: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Is the effect large enough (and/or affect the right viewers) to warrant careful selection

of faces when constructing print ad?

26

Page 27: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

27

0.00%

5.00%

10.00%

15.00%

20.00%

25.00%

Maxim

um

Ab

so

lute

Im

pro

vem

en

t

Product Categories

Maximum Absolute Percentage Improvement for High Rating Participants

Aad

Abrand

PI

Reference: Xiao, L. and M. Ding. (2014). Just the Faces: Exploring the Effects of Facial Features in Print Advertising. Marketing Science. 33(3):338-352.

Page 28: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Content Targeting

28Reference: Xiao, L. and M. Ding. (2014). Just the Faces: Exploring the Effects of Facial Features in Print Advertising. Marketing Science. 33(3):338-352.

Page 29: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Face Analytics in Content Marketing

29What can You do with face analytics?

Page 30: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

30

Customer Insights from Video Analytics

Page 31: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

31

Fashion Retailing

Page 32: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

32

Page 33: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

33

Reference: Lu, S., Xiao, L., & Ding, M. (2016). A video-based automated recommender (VAR) system for garments. Marketing Science, 35(3), 484-510.

Video-based Automated Recommender

Page 34: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Understanding Customer Preference from Video

34

Page 35: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Customer Feedback

35

“There are too many clothes displayed in a store. I don’t have the time or effort to carefully check every piece of clothing.

The system saves me a lot of time and

effort by finding what I like in several

rounds.”

“The system is like magic! It made recommendations on some clothes that I

would never pick myself, but when I

follow the recommendations and try

them on, they look amazingly good on

me.”

“I don’t trust a salesperson’s recommendations since their

recommendations are often very

subjective, and they make

recommendations based on what they

would like to sell, rather than how I look.”

▪ Field Test Result: intention to try on (95%),purchase (50%)

▪ Shopping Experience: similar(44%),very similar(20%)

▪ Easy-to-use: easy/very easy(56%), difficult(16%)

▪ Willing to use in retailing store: 89%

Page 36: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Visual Analytics in Fashion Industry

36

Page 37: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

Where does visual data come from?

37

Page 38: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

When to use?

38

Product Design

Content Marketing

Customer Analysis

Page 39: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

The Future Battlefield for Marketers

39

Opportunity for actionable insights

Page 41: THEPOWEROF VISUALDATA... · The “Big Data” Trend 2 Source: IDC,2014. What makes big data big? 3 3 ... What can You do with face analytics? 29. 30 Customer Insights from Video

The Eigenface Decomposition

41Reference: Xiao, L. and M. Ding. (2014). Just the Faces: Exploring the Effects of Facial Features in Print Advertising. Marketing Science. 33(3):338-352.