Building Your Big Data Analytics Strategy- Impetus Webinar

8/3/2019 Building Your Big Data Analytics Strategy- Impetus Webinar

1/26

Building Your Big DataAnalytics Strategy: Block by

Block

1Recorded version available at

http://www.impetus.com/webinar_registration?event=archived&eid=53

@impetuscalling


2/26

Outline

Building a Big Data Strategy

Big Data & 3Vs

3 Vs model

Big Data Analytics Lifecycle

Strategy Selection

Technology Selection

Hadoop Ecosystem

Alternative

Putting it Together

Case Studies and Applications

Q&As

2Impetus Proprietary

Recorded version available at



3/26

Building a Big Data Strategy

Gather Requirements

What needs to be done?

Objectives

Choose Candidate Strategy Options

Patterns & Best Practices

Choose Tools and Technology

Implementation

Operational Readiness


Requirements

CandidateStrategySelection

Tools &TechnologySelection

Implementation




4/26

Big Data & 3Vs Model

What is Big Data?

Define by size or volume

or by breakdown

3Vs model

Variety of Data

Volume of Data

Velocity of Data





5/26

Big Data Analytics Life Cycle


Creation

Ingestion

Analysis

Visualization




6/26

BIG Data Analytics Life Cycle: Concerns


Storage

Elasticity

Monitoring

Compression

Creation

Integrations

Tools &Technologies

Standardization

Ingestion Tools &Technologies

Testing

Pre BuiltSolutions

Analysis

Channels

In MemorySupport

Standardization

Visualization




7/26

BIG Data Analytics Life Cycle & 3Vs

Simple and potent tool to analyze strategy requirements

Answer simple questions of how much, what type and at what rate

Applicable to each phase

Using matrix to select suitable strategy

Dictates the potential choice of solutions, tools & technologies





8/26


How Much? What Type? What Rate?

Creation

Storage

Elasticity

Monitoring

Compression

Ingestion

Analysis

Visualization

BIG Data Analytics Life Cycle & 3Vs




9/26


Strategy Selection




10/26

Big Data Analytics Strategy


Creation Ingestion Analysis Visualization




11/26


Technology Selection




12/26

The Hadoop Ecosystem

Impetus Proprietary 12




13/26

Alternate/EmergingOptions

Making stuff Faster

Pervasive Datarush, Hstreaming

Cloud Map Reduce

HPCC, Datastax Brisk, Platform Computing

MARS, GPMR

Major MPPs-in-database MR-Oracle, Aster etc

Hadapt

NOSQL

Cassandra, MongoDB

, Hbase Riak

Redis





14/26

Alternate/EmergingOptions

Graph Type DBs

Neo4j

HyperGraphDB

InfiniteGraph

Pregel

Trinity

Faster SQL DBs

VoltDB, Clustrix

Hardware + Software Solutions Exadata , Parstream

Virtualized Options of Hardware + Software Solutions such as

Xeround





15/26


Putting itTogether




16/26

Indirect Analytics over Hadoop





17/26

Direct Analytics over Hadoop





18/26

Analytics over Hadoop with MPPDW





19/26


Case Studies




20/26

Social Media Analytics

Problem Statement Analytics on huge data sets populated from live streaming data

Simplifying services, cost reduction, proactive analysis on

customers feedback

Challenges

Live data streaming from social media websites

Clustering

Learn typical comments, demands, questions

Value: Helps identify response / behavior anomalies

Classification

Learn to identify known patterns automatically

Value: useful in filtering, pre-emptive addressing, gaining

customer confidence





21/26

Social Media Analytics (cont..)

Approach

Prepare matrix to capture How Much?, What Type?, What Rate

against each phase

Use big data solution strategy covering all concerns of big data

analytics lifecycle

Solution

Architected a flexible and scalable solution with near real time

streaming of social media data on daily/hourly scheduled jobs

Built a solution based on Hadoop, HBase, Hive and Mahout





22/26

Solution Overview


Creation Ingestion Analysis Visualization




23/26

Summing Up

Creating a matrix to build suitable strategy

Enables creation of a platform or a solution to manage 3Vs of data

Solutions, tools & technologies

Hadoop based Big Data Analytics is a scalable and cost effective

option Strategy selection





24/26

About Us

Strategic partners for software product engineering and R&D

Thought leaders in cutting-edge technologies

Mature processes and practices that are methodical, yet flexible

Diverse domain expertise

Our services in Big Data and Analytics

Expert consulting

Proof-of-concept & Implementation Support services




25/26

Questions

Please send in your questions

using the chat panel

25




26/26

Thank youFor more information,

write to us at [email protected]



@impetuscalling

Building Your Big Data Analytics Strategy- Impetus Webinar

Documents

Transcript of Building Your Big Data Analytics Strategy- Impetus Webinar