The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay
24
CloudCon, Tuesday, October 2 nd , 11am
-
Upload
exponential-inc -
Category
Education
-
view
148 -
download
0
description
Developers are leading the charge to turn consumer behavior into profitable solutions. By accessing and analyzing the explosion of data from consumer activities, any developer can create the personalized, relevant products and services that customers demand and merchants urgently need. Brian will discuss how to acquire, store, and mine information, and how to design analytics-focused software and build data-driven software engines.
Transcript of The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay
!!
!
CloudCon, Tuesday, October 2nd, 11am
Every Second – in over thousands of Categories
www.wallpapertimes.com
$’s per year in incremental revenue
Value > Cost
Big
Detail
structured
incremental storage
processing
change
Volume
Variety Velocity DATA
semi-structured un-structured
Data Warehouse + Behavioral
Data Warehouse
Semi-Structured SQL++
Structured SQL
Low End Enterprise-class System
Contextual-Complex Analytics Deep, Seasonal, Consumable Data Sets
Production Data Warehousing Large Concurrent User-base
Enterprise-class System
Unstructured Java/C++/Pig/Hive
Structure the Unstructured Detect Patterns
Commodity Hardware System
8+PB 60+PB 40+PB
Hadoop
Analyze & Report
Discover & Explore
! Data Growing Faster
10
questions later
structure later
(<$0.04/GB, <$80/2TB)
single HDFS instances >50PB
Value > Cost
Data
Designing for the Unknown >85% of analytical workload is NEW & Unknown The metrics you know are cheap The metrics you don’t know are expensive – but high in potential ROI Exploration & Testing are core pillars of an analytics-driven
organization
• Impact
!"#$ %$& '()*+,"-+ .-)/01$2& 3-#$4! 5"*2"$, 5"*2&4! 6*77"$, 6*77&4! 82*+6$22"$, 82*+6$22&4! 9-77"+7 9-74! :",;"+7/,#"8<$2 :",;/,#"8<$2,4% )*+$=, )*+$=="+74% )2-#$8#"-+ )2-#$8#$24% ="+"+7 ="+$54% *+">*#"-+ *+">*#$54% #218<, #218<"+74% $57"+7 $57$,4% +$#, +$##"+7
!"#$ %$& '()*+,"-+ .-)/01$2& 3-#$4! 5"*2"$, 5"*2& 6*7)"2$/5"*2"$,4! 8*99"$, 8*99& )*#*9-+"*/8*99"$, 9--5/:-2/)*#*9-+"*/8*99&;/+-#/9--5/*<-+$4! =2*+8$22"$, =2*+8$22& #>$/=2*+8$22"$,4! ?-99"+9 ?-9 ?-99"+9/,#2-<<$24! :",>"+9/,#"=@$2 :",>/,#"=@$2, :",>"+9/,#"=@$2 ,)-2#,/6,A/@"5,/2--7,4% )*+$<, )*+$<<"+9 :$+=$/)*+$<,4% )2-#$=#"-+ )2-#$=#$2 7=*:$$/#-#*</)2-#$=#"-+/BCDB ,=2$$+/)2-#$=#$2/",/#-)/4!/E1$2&4% <"+"+9 <"+$5 )"+@/<"+"+9/=>*+9"+9/8*94% *+"7*#"-+ *+"7*#$5 *+"7*#"-+/=$<4% #21=@, #21=@"+9 =-29"/#21=@,4% $59"+9 $59$, 9*25$+/$59"+94% +$#, +$##"+9 )12,$/+$#,
www.wallpapertimes.com
$’s per year in incremental revenue
Value > Cost
Toys and Hobbies ATC > Artist trading card in ART ATC > Automatic Tool Change in Business and Industrial
German Compound Words • German compound words can be arbitrarily created and extremely long
Adidastrainingsanzug (Adidas track suit) Rindfleischetikettierungsüberwachungsaufgabenübertragungsgesetz
(beef labeling regulation & delegation of supervision law) • Syntactically, words can be combined and split in many ways. • Some words shouldn’t be de-compounded.
beiden (both) – bei(at) den(the) • Too many candidates for
Granitpflastersteine (granite paving stones) Granit(granite) pflastersteine(cobblestones) Granit(granite) pflaster(paving/band-aid) steine(stones)
• Binding characters Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de) Hochzeitschuhe (129 hits on ebay.de).
Synonyms derived from top queries in item query clusters texas instruments ba ii plus / ba ii plus brighton handbag brighton purse lenovo x200 thinkpad x200 king bedspread king coverlet rockabilly dress swing dress 1963 ford falcon 63 falcon jessica simpson hair extensions jessica simpson hairdo
Abbrevia7ons/acronym derived from query transi7ons
stanford ky stanford kentucky dc sub dc subwoofer snowboard helmet l snowboard helmet large motorcycle cam motorcycle camera diamond amp diamond amplifier
