Automating Big Data (Dec-2016)
-
Upload
seth-familian -
Category
Education
-
view
54 -
download
0
Transcript of Automating Big Data (Dec-2016)
![Page 1: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/1.jpg)
Seth Familian Founder + Principal, Familian&1
AUTOMATING BIG DATA
![Page 2: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/2.jpg)
INTRODUCTION
SETH FAMILIAN FOUNDER + PRINCIPAL, FAMILIAN&1
2
Corporate Strategy User Experience Design
Creative ProcraftinationTeaching + Education
Growth Hacking
![Page 3: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/3.jpg)
AUTOMATING BIG DATA
THE ANALYTICS PROCESS
3
![Page 4: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/4.jpg)
“Long” Data
AUTOMATING BIG DATA
THE “OLD SCHOOL” APPROACH4
Raw “Header”
File2
1
Affiliates Lookup File
Update Loop
Summary Index
saved searches
scheduled searches
TRANSFORM
InstantlyGenerates
EXTRACT LOAD
ChannelDashboards
![Page 5: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/5.jpg)
AUTOMATING BIG DATA
SEGMENT-CLEARBIT ENRICHMENT5
RAW DATA EXTRACT
Core Website
Enrichment of email addresses
![Page 6: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/6.jpg)
AUTOMATING BIG DATA
“NEW SCHOOL” EXAMPLE 16
RAW DATA EXTRACT LOADTRANSFORM
Traffic Sources & Session Stats
RAW DATA
Behavioral Segments, Funnels, Retention & LTV
EXTRACT
Additional aggregation and data refinement
Core Website
Social Engagement Footprint
Unified socialfootprint metrics
Enrichment of email addresses
CRM data store for easy segmentation + analysis
Additional context on Twitter followers
More flexible segments, funnels + retention metrics
![Page 7: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/7.jpg)
AUTOMATING BIG DATA
“NEW SCHOOL” EXAMPLE 27
LOADCustom dashboards synced with 70+ APIs
Traffic Sources & Session Stats
Realtime (RT)
TRANSFORMRAW DATA EXTRACT
Core Website
Social Engagement Footprint
heavy-duty query tools already in place
App Databases
Custom aggregation scripts
Postgres or Redshift DB
Daily Pull
Internally-reported metrics summarized for triangulation
Daily CSV
Behavioral segmentation + in-app messaging
RT
Behavioral Segments, Funnels, Retention & LTV
RT
Unified socialfootprint metrics
Unified app downloads & ratings metrics
App Store Activity
email address enrichment
![Page 8: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/8.jpg)
AUTOMATING BIG DATA 8
MORE ADVANCED AUTOMATION
![Page 9: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/9.jpg)
DISCUSSION TIMEWORKING WITH BIG DATA 9
QUESTIONS · FEEDBACK · IDEAS · INSIGHTS
![Page 10: Automating Big Data (Dec-2016)](https://reader031.fdocuments.us/reader031/viewer/2022030214/5899aace1a28ab30688b762f/html5/thumbnails/10.jpg)
A BIT ABOUT ME 10MY GENERAL ASSEMBLY WORKSHOPS