Case study: Log Aggregation and Reporting For a Leading
1
Log Aggregation and Reporting For a Leading Customer Experience Company BUSINESS REQUIREMENT To Determine Marketing Effectiveness and Consumer Behavior Load huge Click Stream logs approx 10GB per hr Aggregation of huge machine data BUSINESS IMPACT Multi-level Aggregation optimized for large volume of data as compared to RDBMS or In-Memory OUR SOLUTION Use Hbase/ Hadoop to extract various statistical insights Store the data in Columnar database for faster read/ write throughout Multi-level Map Reduce based aggregation jobs to handle huge volume Speed Optimized Solution Analyzing multi-structured log data to derive insights Hbase Archived Log Files ETL Tool BATCH SCAN TIME SCAN TIME SCAN B4 B3 B2 B1 M/R Job M/R Job M/R Job Batch Table Batch Aggregation Table Session Aggregation Table Cross Session Aggregation Table Map Reduce Workflow Batch Insert Multi-level Map Reduced Based Aggregation Load Store Process Tables Hbase Case study About Us Happiest Minds, the Mindful IT Company, applies agile methodologies to enable digital transformation for enterprises and technology providers by delivering seamless customer experience, business efficiency and actionable insights. We leverage a spectrum of disruptive technologies such as: Big Data Analytics, AI & Cognitive Computing, Internet of Things, Cloud, Security, SDN-NFV, RPA, Blockchain, etc. Positioned as “Born Digital . Born Agile”, our capabilities spans across product engineering, digital business solutions, infrastructure management and security services. We deliver these services across industry sectors such as retail, consumer packaged goods, edutech, e-commerce, banking,insurance, hi-tech, engineering R&D, manufacturing, automotive and travel/transportation/hospitality. Headquartered in Bangalore, India; Happiest Minds has operations in USA, UK, The Netherlands, Australia and Middle East. © Happiest Minds Proprietary Business Contact: [email protected]
Transcript of Case study: Log Aggregation and Reporting For a Leading
Log Aggregation and Reporting For a LeadingCustomer Experience Company
BUSINESS REQUIREMENT
To Determine Marketing Effectiveness and Consumer Behavior
Load huge Click Stream logs approx 10GB per hr
Aggregation of huge machine data
BUSINESSIMPACT
Multi-level Aggregation optimized for large volume of data as compared to RDBMS or In-Memory
OUR SOLUTION
Use Hbase/ Hadoop to extract various statistical insights
Store the data in Columnar database for faster read/ write throughout
Multi-level Map Reduce based aggregation jobs to handle huge volume
Speed OptimizedSolution
Analyzing multi-structured log data to derive insights
Hbase
ArchivedLog Files
ETL Tool
BATCHSCAN
TIMESCAN
TIMESCAN
B4
B3
B2
B1
M/RJob
M/RJob
M/RJob
BatchTable
BatchAggregation
Table
SessionAggregation
Table
Cross SessionAggregation
Table
Map Reduce Workflow
BatchInsert
Multi-level Map ReducedBased Aggregation
Load
Store
Process
Tables
Hbase
Case study
About UsHappiest Minds, the Mindful IT Company, applies agile methodologies to enable digital transformation for enterprises and technology providers by delivering seamless customer experience, business efficiency and actionable insights. We leverage a spectrum of disruptive technologies such as: Big Data Analytics, AI & Cognitive Computing, Internet of Things, Cloud, Security, SDN-NFV, RPA, Blockchain, etc. Positioned as “Born Digital . Born Agile”, our capabilities spans across product engineering, digital business solutions, infrastructure management and security services. We deliver these services across industry sectors such as retail, consumer packaged goods, edutech, e-commerce, banking,insurance, hi-tech, engineering R&D, manufacturing, automotive and travel/transportation/hospitality.
Headquartered in Bangalore, India; Happiest Minds has operations in USA, UK, The Netherlands, Australia and Middle East.
© Happiest Minds Proprietary
Business Contact: [email protected]
