1
BIG DATAAN ADVENTUROUS JOURNEY
THROUGH THE FIELD OF
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
ent
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
ent
2
Meekers Natan3 IMS A
2012 – 2013
Big Data
PROGRAMME
Concept de ma thèse
Étude de la littérature
Cas: FOD Justice
Cas: Adswizz
Démo
Conclusion
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
ent
3
Meekers Natan3 IMS A
2012 – 2013
Big Data
CONCEPT DE MA THÈSE
M’initier au Big Data
Contacts externes, événements, Médias sociaux, webinars
Expérimenter avec les machines virtuelles (HortonWorks)
Réunions sur BigData.be (+pratique)
Projet
FOD Justice
Configurer un environnement de Big Data (HDP)
SAS Visual Analytics
Adswizz (‘réserve’)
INNOVATIE
OPPORTUNITEIT
UITDAGING
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
ent
4
Meekers Natan3 IMS A
2012 – 2013
Big Data
THESIS
Data aspect Volume, variëteit en velocity
External data
Technological aspect Distributed (HDFS/MapReduce)
Analytical aspect Predictive
Prescriptive
HADOOP
Externe data
CLOUD
MOBILE
SOCIAL MEDIA
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
ent
5
Meekers Natan3 IMS A
2012 – 2013
Big Data
THESIS
Customer churn
Fraudulent transactions
Customer insight
Discover new patterns between data
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
en
t6
Meekers Natan3 IMS A
2012 – 2013
Big Data
THESIS
1. Research
2. Formulate opportunities
3. Develop use case(s)
4. Identify requirements
5. Set-up testing environment
6. Evaluate results
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
ent
7
Meekers Natan3 IMS A
2012 – 2013
Big Data
CASE: FOD JUSTITIE
1. Duidelijke afspraken
2. Scope afgebakend
3. Project goedgekeurd
4. Veelheid aan procedures
5. Moeilijke communicatie
6. SAS Visual AnalyticsCOMMUNICATI
E
XPROCEDURES
A man’s errors are his portals of discovery.
by James Joyce
“
“
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
en
t8
Meekers Natan3 IMS A
2012 – 2013
Big Data
CASE: ADSWIZZ
Internet radio webstreams
Injectie advertenties
Logfiles
75GB 750GB/maand
Amazon S3 & EMR
Pig scriptsPIG
SCRIPTS
Skill to do comes from doing.by
Ralph Waldo Emerson“
“WEBLOGS
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
en
t9
Meekers Natan3 IMS A
2012 – 2013
Big Data
DEMO Knowledge is of no value unless
you put it into practice.
by Anton Chekhov
“ “
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
ent
10
Meekers Natan3 IMS A
2012 – 2013
Big Data
BESLUIT
A LGE M E E N :
Big Data is een ‘hot’ topic
Uitbreiding op klassieke Business Intelligence
Wordt steeds belangrijker
Vereist nieuwe kennis (Analytics, Pig/Hive, Linux, … )
Goede voorbereiding en klein beginnen
PE RS OON L I JK:
Boeiende en leerrijk traject
Communicatie, Toepassing Big Data, PigQL, SAS Programming & VA
Ontwikkeling professionele attitude
Aan een interessante & uitdagende job geholpen
Info
rmatica
managem
en
t en -sy
stem
en - Pe
rform
ance
Managem
en
t11
Meekers Natan3 IMS A
2012 – 2013
Big Data
VRAGEN? No question is so difficult to answer as
that to which the answer is obvious.
by George Bernard Shaw
“ “