Big_Data

20
7/17/2019 Big_Data http://slidepdf.com/reader/full/bigdata-568dd690c25b8 1/20 BIG DATA – WHAT’S THE BIG DEAL Debarchan Sarkar Microsoft Corporation  The call o!l" start soon# please be on $!te%  Thanks for &o!r ti$e an" patience%

description

big data ieee paper

Transcript of Big_Data

Page 1: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 1/20

BIG DATA – WHAT’S THE BIG DEAL

Debarchan SarkarMicrosoftCorporation

 The call o!l" start soon# please be on$!te%

 Thanks for &o!r ti$e an" patience%

Page 2: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 2/20

WH' AM I

Debarchan# fro$ Calc!tta ith an In"ian heart an" a (lobal $in"%

%)ET pro(ra$$er ho fell in lo*e ith 'pen So!rce# speci+call& Ap A!thor%

Co$$!nit& enth!siast%

Cricket an" $!sic lo*er%

'ne ho (ets reall& scare" an" bore" if to$orro is e,actl& like to"

-non is a "rop# the !nknon is an ocean%

Page 3: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 3/20

WHAT IS BIG DATA.

Data Co$ple,it&/ 0ariet& an"

0elocit&

 Terab&tes

Gi(ab&tes

Me(ab&tes

1etab&te

s BDLo( +les

Spatial 2G1S coo

Data $afee"s

eGo* feWeather

 Te,t3i$a

Click

strea$

Wikis3blo(s

Sensors345ID

3"e*ices

Social

senti$ent

A!"io3*i"eo

Web6%7

Web Lo(s

Di(ital Marketin(

Search Marketin(

4eco$$en"ations

A"*ertisin(

Mobile

Collaboration

eCo$$erce

E413C4M1a&ables

1a&roll

In*entor&

Contacts

Deal Trackin(

Sales1ipeline

Page 4: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 4/20

Ho "o I opti$i8e$& 9eet base" oneather an" tra:cpatterns.

S'CIAL 2 WEBA)AL;TICS

LI0E DATA5EEDS

AD0A)CA)AL;T

What’s the socialsenti$ent for $&bran" or pro"!cts

Ho pre"o!tco

A )EW SET '5 <=ESTI')

Page 5: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 5/20

C'MM') BIG DATA C=ST'ME4 SCE)A4I'SGAI) C'M1ETITI0E AD0A)TAGE B; M'0I)G 5I4ST A)D 5AI)D=ST4;

Web appopti$i8ation

S$art $eter$onitorin(

E>!ip$ent$onitorin(

A"*ertisin(anal&sis

Life sciencesresearch

5ra!""etection

Healthcareo!tco$esWeatherforecastin(

)at!ral

reso!rcee,ploration

Social netorkanal&sis

Ch!rnanal&sis

 Tra:c 9oopti$i8ation

ITinfrastr!ct!reopti$i8ation

Le(al"isco*er&

Page 6: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 6/20

 THE BIG DATA LI5EC;CLE

Insi(htMana(e Enrich

Page 7: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 7/20

4elational)on?4elational Strea$in(

MA)AGE A); DATA# A); SI@E# A);

777777777777777777777777

=ni+e" Monitorin(# Mana(e$ent 2

Sec!rit&

Data Mo*e$ent

Page 8: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 8/20

E,tre$el& lar(e *ol!$e of !nstr!eb lo(s

A" hoc anal&sis of lo(s to protot&patternsHa"oop "ata cl!ster fee"s lar(e 6B!siness !sers anal&8e c!be "ata

1BHa"oopCl!ster

6 TB S<LSer*er ASC!be

Micro Tools

E%(% ST4=CT=4ED 2 =)ST4=CT=4ED

Page 9: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 9/20

Insi(htMana(e Enrich

 THE BIG DATA LI5EC;CLE

Page 10: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 10/20

E)4ICH B; C'))ECTI)G T' THE WDATA

Disco*er

Co$bine

4e+ne

Page 11: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 11/20

1'WE4 '5 C'MBI)I)G THE W'4LD

1ersonalData

'r(ani8ationalData

Co$$!nit&Data

Worl"Data

0a

Page 12: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 12/20

E%(% 0AL=E '5 ETE4)AL DA

“When it comes to business intelligence, Microsoft SQL Servdemonstrates that the platform has continued to advance aith the innovations that are happening in big data!"

David Mariani,0ice 1resi"ent of En(ineerin(

Connects to $ore than billion si(nals

Across lea"in( social netorks# incl!"in(

Generates a F-lo!t’ score for in"i*i"!al peoppartners

Enables anal&sis# tar(etin( an" social (raphs

Page 13: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 13/20

Insi(htMana(e Enrich

 THE BIG DATA LI5EC;CLE

Page 14: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 14/20

I)SIGHTS ') A); DATA# ALL =SE4S# WHE4EA4E

4elational)on?4elational Strea$in(

777777777777777777777777777777

BI 1rofessionals B!siness AnaData Scientists

Page 15: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 15/20

I)SIGHTS 5'4 ALL =SE4S TH4'=GH 5A T''LS

A"*ance"Anal&tics fro$Microsoft an" r" parties

Self Ser*iceAnal&sis ith1oer1i*ot 21oer 0ie

Interacti*it& 2e,ploration Ha"oop "ataE,cel

1B  TB GB

BI 1rofessionals B!siness AnData Scientists

Page 16: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 16/20

• Application ritten in a*a for Bi( Data 1rocessin(

• =ses the Map?4e"!ceJ 1rocessin( 1ara"i($

• Characteristics/ Ho is it "iKerent fro$ tra"itional Ser*er.

% 'pti$i8e" for "istrib!te" stora(e an" co$p!tin( of "ata

6% Hi(hl&?scalable scale o!t $o"el

% Co$$o"it& HW?base"

% 'pen So!rce

⇒.0er& lo cost for ac>!isition an" stora(e

Ha"oop is for Bi( Data%

Ha"oopData Anal&tic

Datafow

Page 17: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 17/20

Distrib!te" Stora(eHD5S

<!er&Hi*e

Distrib!te" 1rocessin(

Map 4e"!ce

Scriptin(1i(

) o S  <L D at  a

 b  a s  e

   HB  a s  e

 M  

Meta"ataHCatalo(

D at  aI  nt  e (r  at i   on

    'DB  C  3   S  < ' '1  3  

4 E  S T  M  

B  ! s i  n e s  s I  nt  el  l  i   ( en c  e

   E , c  el   #1  o e

r 0 i   eO M  

MachineLearnin(Maho!t

Graph1e(as!s

Statsprocessin

(4Ha"oop

1 i   p el  i  n e 3  

 or k 9  o

    ' o8 i   e M  

L  o (+ l   e

 a ( (r  e ( at i   on

   5 l   !$ e M  

A  c t i  * e

Di  r  e c t  or  &

    S  e c  !r i  t  & M  

 S  & s t  e$  C  ent  er 

 The Ha"oop Ecos&ste$

Page 18: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 18/20

Welco$e to the @ooQHDInsight

ApacheRHa"oopRon Win"os

A8!re Blob Stora(eLibHD5S5T1S

Acti*eDirector&

Need to Know*

StreamInsight

 JDBC Connector

Good to Know*

HCatalo( Oo8ieA$bari

Hadoop/ #he $e%nitive? To$ White# '

Page 19: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 19/20

5ee" !s back

• S!pport Tea$’s blo(/ http/33blo(s%$s"n%co$3b3bi("atas!p• 5acebook 1a(e/ https/33%facebook%co$3MicrosoftBi(Da• 5acebook Gro!p/ https/33%facebook%co$3(ro!ps3bi("a•  Titter/ "ebarchans

4ea" $ore/• http/33en%ikipe"ia%or(3iki3Ha"oop• http/33en%ikipe"ia%or(3iki3Bi(U"ata

)e,t Session/• Apache Ha"oop – A "eep "i*e

Page 20: Big_Data

7/17/2019 Big_Data

http://slidepdf.com/reader/full/bigdata-568dd690c25b8 20/20

V 676 Microsoft Corporation% All ri(hts reser*e"% Microsoft# Win"os# Win"os 0ista an" other pro"!ct na$es are or $a& be re(istere" tra"e$arks an"3or tra"e$arks in the =%S% an"3or other co!ntries% The infor$ation herein is for infor$ational p!rposes onl& an" represents the c!rrent *ie of Microsoft Corporation as of the "ate of this presentation% Beca!se Microsoft $!st respon" to chan(in( $arket con"itionsco$$it$ent on the part of Microsoft# an" Microsoft cannot (!arantee the acc!rac& of an& infor$ation pro*i"e" after the "ate of this presentation%MIC4'S'5T MA-ES )' WA44A)TIES# E14ESS# IM1LIED '4 STAT=T'4;# AS T' THE I)5'4MATI') I) THIS 14ESE)TATI')%