Big data and Microsoft

Post on 10-May-2015

211 views 5 download

Tags:

Transcript of Big data and Microsoft

http://k-mug.org/

https://www.facebook.com/TeamKmug

Huh, big data?PRAVEEN NAIR

Head of Technology & Architecture, Orion India Systems Kochihttp://www.ninethsense.com/

31 May 2014 – K-MUG UG Session

What is Big Data?

Volume

Velocity

Veriety

What is Big Data?

Volume

Velocity

Veriety

Veracity

Source: http://www.ibmbigdatahub.com/infographic/four-vs-big-data

What is Big Data?

Volume

Velocity

VarietyVeracity

Virality

Viscosity

Variability

VisualizationValueVerisimilitude

Viability

What is Big Data?

Stories

1. Macy's Inc. and real-time pricing

2. Fast food and video

3. PredPol Inc. and repurposing

4. McLaren’s Formula One racing team

5. American Express Co. and business intelligence

6. Express Scripts Holding Co. and product generation.

7. Infinity Property & Casualty Corp. and dark data.

Magic Quadrant for BI and Analytics Platforms

Source:http://www.gartner.com/technology/reprints.do?id=1-1QYUTPJ&ct=140220&st=sb

Processing data(Map Reduce)

Storing Data(HDFS)

HadoopCommon utilities

YARN (Job and cluster management)

Derivative Works

Distributions

Variants

Apache projects for Hadoop

HivePig SQOO

PHCatalo

g

HBase

FlumeMahout

Ambari

Oozie

Zookeeper

Avro

Cassandra

Spark Tez

Chukwa

Microsoft Power BI

Discover and CombinePower Query

VisualizePower ViewPower Map

Model and AnalyzePower Pivot

Microsoft Analytics Platform System (APS)

Pre-Build and performance-tuned appliance

Linear scale-out to petabytes of data (up to 6pb)

MPP design and in-memory columnstore for 100x speed improvement and 15 time data compression

Dedicated region for Hadoop

Joining relational and non-relational data with Polybase

HDInsight

Hadoop on Azure

Thank You!