Who are the Devils Wearing Prada in New York City? are the Devils Wearing Prada in New York City?...

4
Who are the Devils Wearing Prada in New York City? KuanTing Chen National Taiwan University, Taipei, Taiwan [email protected] Kezhen Chen * University of Rochester, Rochester, New York, USA [email protected] Peizhong Cong University of Rochester, Rochester, New York, USA [email protected] Winston H. Hsu National Taiwan University, Taipei, Taiwan [email protected] Jiebo Luo University of Rochester, Rochester, New York, USA [email protected] ABSTRACT Fashion is a perpetual topic in human social life, and the mass has the penchant to emulate what large city residents and celebrities wear. Undeniably, New York City is such a bellwether large city with all kinds of fashion leadership. Consequently, to study what the fashion trends are during this year, it is very helpful to learn the fashion trends of New York City. Discovering fashion trends in New York City could boost many applications such as clothing rec- ommendation and advertising. Does the fashion trend in the New York Fashion Show actually influence the clothing styles on the public? To answer this question, we design a novel system that consists of three major components: (1) constructing a large dataset from the New York Fash- ion Shows and New York street chic in order to understand the likely clothing fashion trends in New York, (2) utilizing a learning-based approach to discover fashion attributes as the representative characteristics of fashion trends, and (3) comparing the analysis results from the New York Fashion Shows and street-chic images to verify whether the fashion shows have actual influence on the people in New York City. Through the preliminary experiments over a large clothing dataset, we demonstrate the effectiveness of our proposed system, and obtain useful insights on fashion trends and fashion influence. Categories and Subject Descriptors H.4.0 [Information Systems Applications]: General; I.4.8 [Scene Analysis]: Color, Shape, Object recognition; I.5.4 [Applications]: Computer vision Keywords Fashion trend; clothing attributes; clothing style * KuanTing Chen and Kezhen Chen contributed equally to this work. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full cita- tion on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or re- publish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]. MM’15, October 26–30, 2015, Brisbane, Australia. c 2015 ACM. ISBN 978-1-4503-3459-4/15/10 ...$15.00. DOI: http://dx.doi.org/10.1145/2733373.2809930. 2014 New York Fashion Show 2014 Street-chic Fashion Trend Black No sleeve Pants (a) 2015 New York Fashion Show 2015 Street-chic (b) Fashion Trend White Medium sleeve Skirt Figure 1: Examples for the influence of New York Fashion Show on the public. 1. INTRODUCTION ”The devil wears Prada” is a very popular fashion re- lated movie which describes the story between a recent col- lege graduated girl and the diabolic fashion magazine edi- tor Miranda Priestly. Although Miranda’s grim manner of management is impressive, we also admire her unique fore- sight and aesthetics of fashion. In modern times, a grow- ing number of people pay more attention to fashion and the mass has the penchant to emulate what large city res- idents and celebrities wear. Moreover, investigating fash- ion trends has become a great interest for the industry and academia [8][14][15][13] because of its promising opportunity for boosting many emerging applications such as clothing recommendation, advertising by clothing brand association, etc. Consequently, learning the fashion trends every year is very important for the industry as well as sociology and psychology. Indisputably, New York City is one of the most famous fashion metropolises and the New York Fashion Week is one of the four most significant fashion weeks around the world [6][2][4]. The New York Fashion Show consists of almost 300 catwalk shows which are attended by more than 100,000 people [6]. The New York City Economic Development Cor- poration reported that the local economy is boosted by 850 million dollars by the New York Fashion Week [5]. A traditional way to discover fashion trend in the New York Fashion Week would be relying on the domain knowl- edge of the clothing designers and experts. However, it is very time consuming and the fashion trends vary with the arXiv:1508.04785v1 [cs.CV] 19 Aug 2015

Transcript of Who are the Devils Wearing Prada in New York City? are the Devils Wearing Prada in New York City?...

Who are the Devils Wearing Prada in New York City?

KuanTing ChenNational Taiwan University,

Taipei, [email protected]

Kezhen Chen∗

University of Rochester,Rochester, New York, [email protected]

Peizhong CongUniversity of Rochester,

Rochester, New York, [email protected]

Winston H. HsuNational Taiwan University,

Taipei, [email protected]

Jiebo LuoUniversity of Rochester,

Rochester, New York, [email protected]

ABSTRACTFashion is a perpetual topic in human social life, and themass has the penchant to emulate what large city residentsand celebrities wear. Undeniably, New York City is sucha bellwether large city with all kinds of fashion leadership.Consequently, to study what the fashion trends are duringthis year, it is very helpful to learn the fashion trends ofNew York City. Discovering fashion trends in New YorkCity could boost many applications such as clothing rec-ommendation and advertising. Does the fashion trend inthe New York Fashion Show actually influence the clothingstyles on the public? To answer this question, we designa novel system that consists of three major components:(1) constructing a large dataset from the New York Fash-ion Shows and New York street chic in order to understandthe likely clothing fashion trends in New York, (2) utilizinga learning-based approach to discover fashion attributes asthe representative characteristics of fashion trends, and (3)comparing the analysis results from the New York FashionShows and street-chic images to verify whether the fashionshows have actual influence on the people in New York City.Through the preliminary experiments over a large clothingdataset, we demonstrate the effectiveness of our proposedsystem, and obtain useful insights on fashion trends andfashion influence.

Categories and Subject DescriptorsH.4.0 [Information Systems Applications]: General; I.4.8[Scene Analysis]: Color, Shape, Object recognition; I.5.4[Applications]: Computer vision

KeywordsFashion trend; clothing attributes; clothing style

∗KuanTing Chen and Kezhen Chen contributed equally tothis work.

Permission to make digital or hard copies of all or part of this work for personal orclassroom use is granted without fee provided that copies are not made or distributedfor profit or commercial advantage and that copies bear this notice and the full cita-tion on the first page. Copyrights for components of this work owned by others thanACM must be honored. Abstracting with credit is permitted. To copy otherwise, or re-publish, to post on servers or to redistribute to lists, requires prior specific permissionand/or a fee. Request permissions from [email protected]’15, October 26–30, 2015, Brisbane, Australia.c© 2015 ACM. ISBN 978-1-4503-3459-4/15/10 ...$15.00.

DOI: http://dx.doi.org/10.1145/2733373.2809930.

2014 New York Fashion Show 2014 Street-chic

Fashion Trend

Black No sleeve

Pants

(a)

2015 New York Fashion Show 2015 Street-chic (b)

Fashion Trend

White Medium sleeve

Skirt

Figure 1: Examples for the influence of New YorkFashion Show on the public.

1. INTRODUCTION”The devil wears Prada” is a very popular fashion re-

lated movie which describes the story between a recent col-lege graduated girl and the diabolic fashion magazine edi-tor Miranda Priestly. Although Miranda’s grim manner ofmanagement is impressive, we also admire her unique fore-sight and aesthetics of fashion. In modern times, a grow-ing number of people pay more attention to fashion andthe mass has the penchant to emulate what large city res-idents and celebrities wear. Moreover, investigating fash-ion trends has become a great interest for the industry andacademia [8][14][15][13] because of its promising opportunityfor boosting many emerging applications such as clothingrecommendation, advertising by clothing brand association,etc. Consequently, learning the fashion trends every yearis very important for the industry as well as sociology andpsychology.

Indisputably, New York City is one of the most famousfashion metropolises and the New York Fashion Week is oneof the four most significant fashion weeks around the world[6][2][4]. The New York Fashion Show consists of almost300 catwalk shows which are attended by more than 100,000people [6]. The New York City Economic Development Cor-poration reported that the local economy is boosted by 850million dollars by the New York Fashion Week [5].

A traditional way to discover fashion trend in the NewYork Fashion Week would be relying on the domain knowl-edge of the clothing designers and experts. However, it isvery time consuming and the fashion trends vary with the

arX

iv:1

508.

0478

5v1

[cs

.CV

] 1

9 A

ug 2

015

Year   #designer   #images   Year   #designer   #images  

2014   27   4000   2015   20   3914  

(a) New York Fashion Shows

(b) Street-Chic

Year     #images   Year   #images  

2014   471   2015   575  

Figure 2: Examples from two data resources forclothing style analysis, (a) New York Fashion Showand (b) Street-chic.

season. Hidayati et al. [12] proposed to exploit fashion ele-ments by clustering visual patches in the video frames of thefashion show. In contrast to this work, we focus on learningthe clothing fashion trends by fashion attribute discovery.Moreover, to our best knowledge, this is the first work toaddress the question ”Does the fashion trend in the NewYork Fashion Show actually influence the clothing styles ofthe public?” (cf. Figure 1).

In this paper, we first construct a large clothing datasetfrom two resources: (1) a large number of images from fash-ion shows during the annual New York Fashion Week. (2)Street-chic images after New York Fashion Shows in order togauge whether the fashion trends have influence on people’sdaily life. Next, we analyze 2014 and 2015 fashion show im-ages and extract the fashion attributes. More specifically,for every image, we automatically extract 60 clothing at-tributes such as collar, necktie, pants, etc. Using semanticclothing attributes to represent fashion trends can tell peo-ple the most popular style, which is not only a good wayto learn fashion trends for research, but also is a specificfashion reference for people to choose. Finally, we utilizethese attributes as our predicted clothing fashion style andcompare these attributes with attributes from street-chic. Inour experimental results, we demonstrate the effectiveness ofthe clothing attributes and the correlation of clothing stylebetween fashion shows and street-chic.

2. DATASET CONSTRUCTIONIn this work, we mainly exploit the fashion trend in 2015

and the influence of fashion trends on people’s daily life. Inour dataset, in order to study the fashion influence on peo-ple’s daily life, we collect two datasets. (1) Street-chicdataset. This dataset contains 471 street-chic images inNew York from April 2014 to July 2014 and 575 street-chicimages in New York from April 2015 to July 2015 [1][3]. Itis worth noting that the number of images from street chicis not very large in each year, but these images are highquality and representative (cf. Figure 2) (2) New YorkFashion Show. As these street-chic images are all fromsummer/spring season, we collected 3914 images from 2014summer/spring New York Fashion Show and 4000 imagesfrom 2015 summer/spring New York Fashion Show, respec-tively [7]. The 7914 images from 2014 and 2015 New YorkFashion Shows are used to extract features and fashion at-tributes to analyze fashion trends. We summarize and illus-trate examples of our datasets in Figure 2.

Body Region Torso

Upper right arm Lower right arm

Upper left leg Lower left leg

Upper right leg Lower right leg

Features Types Aggregation Methods SIFT

Texture Color

Skin Probability

Upper left arm Lower left arm

Average pooling Max pooling

Figure 3: An illustration of the visual features weextracted from photos.

3. FASHION STYLE DISCOVERYTo provide a significant and specific clothing fashion ref-

erence, an effective framework for exploring clothing stylerepresentation is required. Using an appropriate clothingrepresentation, we could offer a semantic and intuitive wayfor people to determine what fashion style they would like tochoose. Inspired by the paper [10], a learning-based cloth-ing attributes approach was carried out to describe cloth-ing style. In the research [10], Chen et al. only detected42 upper body clothing attributes. However, we observethe clothing information in the lower body is an essentialclue for fashion trends understanding (e.g. wearing pants orskirt). Different from this research [10], we proposed to ex-ploit a 60-attribute semantic representation to describe bothupper and lower body clothing attributes. In the following,we briefly describe the adopted approaches for learning theclothing attribute. Table 1 shows the details of clothing at-tributes.

3.1 Feature ExtractionBefore learning the 60 clothing attributes, we need to ex-

tract clothing features beforehand to train classifiers for ev-ery attribute. Thanks for Marcin Eichner’s team [11], we ap-ply their pose estimation software to detecting the model’spose and retrieve the body region of the model. More clearly,the pose estimation process is to segment body into nineparts: torso, upper left arm, upper right arm, lower leftarm, lower right arm, upper left leg, upper right leg, lowerleft leg and lower right leg. Next, we extract four differentkinds of features (e.g. color, texture, SIFT, and skin) andutilize two different aggregation methods to generate a vi-sual feature vector for all the parts of the body. An exampleis illustrated in Figure 3.

3.2 Fashion Attribute LearningIn order to determine whether an fashion element is present

in an image, we adopt a Support Vector Machine (SVM) [9]with a Chi-square kernel to learning fashion attributes (cf.Table 1). The most intuitive way for training each fash-ion attribute is concatenating 72 features (cf. Section 3.1)into a long vector that becomes the full body visual featurevector. However, the influence of different types of featureon each attributes may vary. For example, texture featuresmight have a great effect on pattern based attributes. Conse-quently, we compute the classification performance of eachfeature to represent the importance of features as weightstowards individual attributes. As a result, a weighting pa-rameter can be applied to vectors from different features toemphasize the importance of different features.

3.3 Attribute Relation InferenceIn section 3.2 the fashion elements are considered as iso-

lated attributes. However, it is highly possible that someattributes appear in pairs (or groups). For example, we ob-

Table 1: A summary of Fashion attributes.

Style

Gender Bags Accessories Skin  Exposure

Neck9e Collar Neckring Belt

Placket Pant Skirt

Upper-­‐body  

Pa?ern   Color  

floral,  graphics,  plaid,  solid,  spot,  stripe   black,  blue,  brown,  cyan,  gray,  green,  purple,  red,  white,  yellow,  mul9color

Lower-­‐body  

Pa?ern   Color    

floral,  graphics,  plaid,  solid,  spot,  stripe   black,  blue,  brown,  cyan,  gray,  green,  purple,  red,  white,  yellow,  mul9color

serve that a plaid shirt might have more than two colors.Note that inter-attribute dependencies are not always sym-metric. For example, while a plaid shirt strongly suggeststhe presence of more than two colors, more than two colorsdo not necessarily suggest a shirt being plaid. We adopta Conditional Random Fields (CRF) approach to inferencethe relation betweens attributes. More specifically, each at-tribute acts as a node in the CRF framework and the edgeconnecting every two nodes indicates the joint probability ofthese two attributes. We build a fully connected CRF withall the attributes pairwise connected.

4. EXPERIMENTAL RESULTSWe conduct experiments on a large clothing dataset col-

lected from the New York Fashion Shows and Street-chicphotos.

We conduct several experiments to gain understanding ofthe performance of the attributes. The overall accuracy ofattributes is 62.6%. The examples in Figure 1 indicate thatthe extracted attributes was effective for clothing style rep-resentation. An interesting observation is that some cate-gories suffer from worse results (e.g. 42% accuracy of belt,56% accuracy of accessories) since the objects are relativelysmall compared to the entire body. In the future, we couldsegment the body into more parts to improve the accuracy ofthe attributes detection. For example, we could segment themiddle body for belt and the neck part for the accessories.

Table 2 shows the attributes percentage detected on the2014 New York Fashion Shows and 2015 New York Fash-ion Shows. We divide these attributes into three categories,color, pattern and clothing style. We observe that thereare always some classic colors, patterns or styles that have alarge amount of clothing images in the fashion shows of everyyear. For example, in upper body color, both 2014 and 2015fashion images have a large amount of white, gray and blackcolors. In upper body and lower body patterns, solid patternis the classic pattern and solid pattern clothes always dom-inate every year’s fashion shows. In the style attribute cat-egory, there are many images with skirt in spring/summerfashion shows. These examples indicate that the results gen-erated by attribute description methods are very reasonableand these results can be a very significant reflection for thefashion shows styles.

Besides these classic cloth styles, we are also interestedin the changes in the fashion trend. These changes in at-tributes could indicate special fashion trends for the specificyear. Note that we remove the classic style attributes, black,white and gray in the color category, solid pattern in the pat-tern category and skirts in the style category to present thechanges more clearly. Figure 4 shows the change of fashiontrend between the 2015 fashion shows and the 2014 fashionshows. From this figure, we could tell the unique fashiontrends for 2015. In the color category, attributes with largerchanges in the upper body are blue, multicolor, cyan and

Table 2: The summary of attributes percentage ap-peared in spring/summer fashion shows.

A"ribute   2014   2015   A"ribute   2014   2015   A"ribute   2014   2015   A"ribute   2014   2015  

Bags  accessories  

21.9%   22.7%   Neck3e   0.7%   1.1%  Medium  

(Knee  Length)  48.8%   43.4%  

T-­‐shirt  (category)  

6.1%   7.7%  

Skirt   74.0%   71.0%   Placket   29.6%   34.1%  Long    

(Knee  Length)  45.3%   52.7%  

Outwear  (category)  

44.6%   49.1%  

Pants   26.0%   29%   Skin  Exposure   30%   27.4%  V-­‐shape  (Neckline)  

15.4%   18.9%  Suit  

(category)  2.0%   2.2%  

Belt   21.4%   20.4%   No  Sleeve   35.2%   29.6%  Round  

(Neckline)  60.0%   59.1%  

Tank  Top  (category)  

28.1%   34.0%  

Collar   39.5%   43.6%   Short  Sleeve   18.5%   20.8%  Other  

(Neckline)  19.6%   18.1%  

Dress  (category)  

43.7%   37.4%  

Male   2.1%   2.3%   Long  Sleeve   56.6%   61.0%  Shirt    

(category)  2.6%   3.2%  

Neckring   5.4%   6.2%  Short    

(Knee  Length)  27.6%   22.1%  

Sweater  (category)  

3.8%   3.5%  

Style

A"ribute    (Upper-­‐body)  

2014   2015  A"ribute    

(Upper-­‐body)  2014   2015  

A"ribute  (Lower-­‐body)  

2014   2015  A"ribute  

(Lower-­‐body)  2014   2015  

Black   20.9%   19.2%   Purple   3.2%   3.1%   Black   27.7%   28.5%   Purple   0.8%   1.1%  

Blue   8.9%   11.7%   Red   4.1%   5.4%   Blue   5.7%   6.8%   Red   9.0%   8.9%  

Brown   4.0%   4.4%   White   32.6%   32.1%   Brown   6.5%   5.5%   White   29.9%   29.3%  

Cyan   10.4%   11.8%   Yellow   14.6%   11.7%   Cyan   0.3%   0.5%   Yellow   6.3%   4.3%  

Gray   18.9%   18.4%   Mul3color   14.2%   16.3%   Gray   15.7%   15.7%   Mul3color   36.4%   35.5%  

Green   7.1%   6.9%   Green   2.1%   1.6%  

Color

A"ribute    (Upper-­‐body)  

2014   2015  A"ribute    

(Upper-­‐body)  2014   2015  

A"ribute  (Lower-­‐body)  

2014   2015  A"ribute  

(Lower-­‐body)  2014   2015  

Floral   12.7%   10.0%   Solid   46.4%   50.4%   Floral   8.9%   8.7%   Solid   59.1%   62.4%  

Graphics   14.7%   13.7%   SpoYed   3.1%   3.2%   Graphics   20.0%   19.5%   SpoYed   1.7%   1.2%  

Plaid   0.5%   0.3%   Striped   2.6%   3.3%   Plaid   0.6%   0.5%   Striped   1.5%   2.1%  

Pattern

red; attributes with larger changes in the lower body areblue and purple. In the pattern category, attribute withlarger changes in the upper body is striped; attribute withlarger changes in the lower body is striped. In the style cate-gory, long knee length, tank top, placket, outwear and collarare most significant attributes in 2015. These attributeswith larger changes could be regarded as the unique fashionattributes trends shown in 2015.

In order to analyze the influence from the New York Fash-ion Shows on people’s daily life, we analyze the clothing at-tributes from the street chic images. As we mainly focuson the spring and summer fashion show influence, we col-lected 471 street chic images in 2014 and 575 street chicimages in 2015 that were taken in New York from Aprilto July and utilize these images as our street-chic data forfashion influence analysis. The changes of these attributesbetween 2014 and 2015 are shown in Figure 4. As shown inFigure 4, some changing trends of attributes are the samein fashion shows and in street chic. For example, there isa significant rise in both placket and tank top of the stylecategory. In the pattern category, striped pattern in theupper body increased substantially. In the color category,blue in the lower body, blue, cyan, red and multicolor in theupper body showed an upward trend in both fashion showand street chic images. Consequently, we could tell thatmany people have the penchant to emulate clothing stylesshown in the fashion shows. Some examples are shown inFigure 5. Interestingly, there are some different changes offashion elements between the fashion shows and street chicimages. For instance, we observe that the difference betweenthe fashion shows and street chic lies in the long knee sleeveand outwear. We discovered that summer 2014 is the cold-est in a decade, and people tended to wear outwear to keepwarm. Another interesting observation is that people tendto wear bright-colored clothes in both the upper body andthe lower body instead of wearing in only the upper body asshown in the fashion shows. A reasonable explanation is thatlight-colored clothes can absorb less sun light and keep peo-ple cooler; therefore, people are tempted to wear light colorclothes in order to keep them cooler in the hotter weather in2015. In summary, it seems clear that fashion trends fromfashion shows indeed provide people a clothing reference andhave significant influence on people’s daily life. However, so-

-­‐5.0%  

-­‐4.0%  

-­‐3.0%  

-­‐2.0%  

-­‐1.0%  

0.0%  

1.0%  

2.0%  

3.0%  

Uppe

r_flo

ral  

Uppe

r_graphics  

Uppe

r_plaid

 

Uppe

r_spo:

ed  

Uppe

r_str

iped

 

Lowe

r_flo

ral  

Lowe

r_graphics  

Lowe

r_plaid

 

Lowe

r_spot  

Lowe

r_str

ipe  

Street  Pa(ern  Change  

A.butes  

The  p

ercentage  o

f  a.bu

te  

-­‐4.0%  

-­‐3.0%  

-­‐2.0%  

-­‐1.0%  

0.0%  

1.0%  

2.0%  

3.0%  

4.0%  

Lowe

r_blue

 

Lowe

r_brow

n  

Lowe

r_cyan  

Lowe

r_green  

Lowe

r_mulCcolor  

Lowe

r_pu

rple  

Lowe

r_red  

Lowe

r_yellow  

Uppe

r_blue

 

Uppe

r_brow

n  

Uppe

r_cyan  

Uppe

r_green  

Uppe

r_mulCcolor  

Uppe

r_pu

rple  

Uppe

r_red  

Uppe

r_yellow  

Color  Change  

-­‐8.0%  

-­‐6.0%  

-­‐4.0%  

-­‐2.0%  

0.0%  

2.0%  

4.0%  

6.0%  

8.0%  

10.0%  

bags  Accesssories

 

Belt  

Collar  

Neckrin

g  

NeckCe

 

Placket  

Skin  Ex

posure  

No  (slee

ve)  

Short  (sle

eve)  

Long  (slee

ve)  

V-­‐shape    (neckline

)  

Roun

d-­‐Shape  (

neckline)  

Othe

r    (neckline

)  

Short  (kneelen

gth)  

Med

ium  (kne

elength)  

Long  (kne

elength)  

Shirt  (C

ategory)  

Sweater  (Category)  

T-­‐shirt  (Category)  

Outw

ear  (Category)  

Suit  (Category)  

Tank  To

p    (C

ategory)  

Dress  (Category)  

Style  Change  Th

e  percentage  o

f  a(ribute  

A.butes  

A.butes  

-­‐5.0%  

-­‐4.0%  

-­‐3.0%  

-­‐2.0%  

-­‐1.0%  

0.0%  

1.0%  

2.0%  

3.0%  

Uppe

r_flo

ral  

Uppe

r_graphics  

Uppe

r_plaid

 

Uppe

r_spo:

ed  

Uppe

r_str

iped

 

Lowe

r_flo

ral  

Lowe

r_graphics  

Lowe

r_plaid

 

Lowe

r_spot  

Lowe

r_str

ipe  

Pa(ern  Change  

A.butes  

The  p

ercentage  o

f  a.bu

te  

The  p

ercentage  o

f  a(ribute  

-­‐8.0%  

-­‐6.0%  

-­‐4.0%  

-­‐2.0%  

0.0%  

2.0%  

4.0%  

6.0%  

8.0%  

10.0%  

bags  Accesssories

 

Belt  

Collar  

Neckrin

g  

NeckCe

 

Placket  

Skin  Ex

posure  

No  (slee

ve)  

Short  (sle

eve)  

Long  (slee

ve)  

V-­‐shape    (neckline

)  

Roun

d-­‐Shape  (

neckline)  

Othe

r    (neckline

)  

Short  (kneelen

gth)  

Med

ium  (kne

elength)  

Long  (kne

elength)  

Shirt  (C

ategory)  

Sweater  (Category)  

T-­‐shirt  (Category)  

Outw

ear  (Category)  

Suit  (Category)  

Tank  To

p    (C

ategory)  

Dress  (Category)  

Street  Style  Change  

The  p

ercentage  o

f  a(ribute  

A.butes  

-­‐4.0%  

-­‐3.0%  

-­‐2.0%  

-­‐1.0%  

0.0%  

1.0%  

2.0%  

3.0%  

4.0%  

Lowe

r_blue

 

Lowe

r_brow

n  

Lowe

r_cyan  

Lowe

r_green  

Lowe

r_mulCcolor  

Lowe

r_pu

rple  

Lowe

r_red  

Lowe

r_yellow  

Uppe

r_blue

 

Uppe

r_brow

n  

Uppe

r_cyan  

Uppe

r_green  

Uppe

r_mulCcolor  

Uppe

r_pu

rple  

Uppe

r_red  

Uppe

r_yellow  

Street  Color  Change  

The  p

ercentage  o

f  a(ribute  

A.butes  

Figure 4: Quantitative fashion style changes in 2015shown in the New York Fashion Shows (left column)and street-chic (right column). The correlation co-efficients between the two columns are (style: -0.32,pattern: 0.64, color: 0.28). Note that the positivelycorrelated attributes are marked red and the nega-tively correlated attributes are marked green. Interms of style, there are positively correlated at-tributes even though the overall correlation is neg-ative, revealing both correlation and distance be-tween stage and reality.

cial condition and natural conditions, such as weather, couldbe important factors for people to determine what they arelikely to wear. Furthermore, analysis of street chic imagesalso has benefit to inspire fashion designers to come up withmore main-stream designs.

5. CONCLUSIONSIn this work, we construct a large dataset from the New

York Fashion Shows and street-chic in order to investigatethe possible clothing fashion trends in New York. In addi-tion, we investigate a learning based method to automati-cally detect fashion attributes as the representation of fash-ion trends. We further demonstrate that the proposed frame-work is effective in fashion trend discovery. Furthermore,we compare the analysis result from the New York FashionShows and street-chic images in order to investigate whetherand to what extent the fashion shows have influence on NewYork people. In the future, we plan to collect more im-ages to increase the data set for more comprehensive studies.Moreover, there is also keen interest in exploring the properfashion outfits to recommend users by aggregating user pref-erence in clothing style and one future direction would be toincorporate these elements into the existing model and thescope will be extending and applying our system to practicalapplications, for example clothing style and product recom-mendation. Besides, the concept of clustering will also beone of the options as it will be interesting to automaticallylearning unseen clothing elements [12].

6. ACKNOWLEDGMENTSThis work was generously supported in part by Google,

Yahoo, Adobe, TCL, and New York State CoE CEIS andIDS. KuanTing Chen is supported by a scholarship by the

Figure 5: The examples of the similarity of fashiontrends shown both in (a) New York Fashion Showand (b) Street-chic.

Taiwan Government NSC Study Abroad Program grants103-2917-I-002-159.

7. REFERENCES[1] Pinterest. http://pinterest.com.

[2] In vogue: How does catwalk influence the main street.http://www.bbc.com/news/magazine-14984468.

[3] Flickr. http://www.flickr.com.

[4] The 14 best trends of new york fashion week.http://www.marieclaire.com/fashion/g2359/new-york-fashion-week-spring-2015-trends/.

[5] The new york city economic development corporation.http://www.nycedc.com/.

[6] The new york times. http://www.nytimes.com/.

[7] Vogue. http://www.vogue.com/.

[8] L. D. Bourdev, S. Maji, and J. Malik. Describingpeople: A poselet-based approach to attributeclassification. In IEEE ICCV 2011, Barcelona, Spain,November 6-13, 2011, pages 1543–1550, 2011.

[9] C.-C. Chang and C.-J. Lin. Libsvm: A library forsupport vector machines. ACM Trans. Intell. Syst.Technol., 2(3):27:1–27:27, May 2011.

[10] H. Chen, A. Gallagher, and B. Girod. Describingclothing by semantic attributes. In ECCV 2012,volume 7574, pages 609–623, 2012.

[11] M. Eichner and V. Ferrari. Appearance sharing forcollective human pose estimation. In Computer Vision- ACCV 2012, pages 138–151, 2012.

[12] S. C. Hidayati, K.-L. Hua, W.-H. Cheng, and S.-W.Sun. What are the fashion trends in new york? InProceedings of the ACM International Conference onMultimedia, MM ’14, pages 197–200. ACM, 2014.

[13] S. Liu, J. Feng, C. Domokos, H. Xu, J. Huang, Z. Hu,and S. Yan. Fashion parsing with weak color-categorylabels. IEEE Transactions on Multimedia,16(1):253–265, 2014.

[14] S. Liu, Z. Song, G. Liu, C. Xu, H. Lu, and S. Yan.Street-to-shop: Cross-scenario clothing retrieval viaparts alignment and auxiliary set. In IEEE CVPR2012, pages 3330–3337, 2012.

[15] T. V. Nguyen, S. Liu, B. Ni, J. Tan, Y. Rui, andS. Yan. Sense beauty via face, dressing, and/or voice.In Proceedings of the 20th ACM MultimediaConference, MM ’12, pages 239–248, 2012.