Big Data - Intel Vision

9
Big Data Vision: Movement, Management & Merging of Data, Solutions & People

description

Pauline Nist , Intel General Manager presented at OOW 2012 Big Data

Transcript of Big Data - Intel Vision

Page 1: Big Data - Intel Vision

Big Data Vision: Movement, Management & Merging of Data, Solutions & People

Page 2: Big Data - Intel Vision

2

Big Data Phenomenon

Data  Growth  Statements  –  Mckinsey  Ins6tute  

Page 3: Big Data - Intel Vision

3

The Four Pillars and Associated Challenges of Big Data

Page 4: Big Data - Intel Vision

4

Volume - Storage Transformation  Data  explosion  …  

Source:    Intel    

Driving  storage  opportunity    

Big  Sensed  Data  

Big  Corp  Data  

Big  Web  Data  

Structured  Data  

Unstructured  Data  

Corporate  Data  

Time  

Volume  

690% Growth  in  storage  capacity  2010-­‐2015  

Intel®  Xeon®  processors  provide  storage  intelligence  

•  Deduplica6on  •  Thin  provisioning  •  Erasure  code  •  Map  reduce  •  Encryp6on  

Tradi6onal  Storage  

Distributed  Storage  

30% CAGR

16% CAGR

Page 5: Big Data - Intel Vision

5

Variety - Right Data Methods For Right Data Structure

Structured    Data  

Unstructured    Mul6-­‐format  Data  

Emerging  Technologies  

Rela6onal  Database  

EXALYTICS  

Analy6cal  Paradigms  

                       MapReduce                /Hive�

Op#mized  on  Xeon  

Page 6: Big Data - Intel Vision

6

Velocity - Fast Fabric and Networking

All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.

10GbE  preferred  solu6on  for  Hadoop*  clusters  

•  Completes  data  import  up  to  80%  faster  •  4x  increase  in  write  performance  

•  PorWolio  investment  for  future  fabric  technologies  

•  Ethernet  remains  fabric  of  choice  within  Enterprise  

•  Op6ons  for  preconfigured  solu6ons  

–  DB  /  analy6c  engineered  systems  

Page 7: Big Data - Intel Vision

7

•  Provides datacenter endurance and performance

•  Positioned for high write usage models

•  Built in data protection features

Velocity  -­‐  Intel®  SSD  710  Series  SATA  SSD  Ideal  for  Performance  Storage  Drive  Capacity  

Boos#ng  Data  Center  Performance  and  Endurance  

Page 8: Big Data - Intel Vision

8

Up  to  4  channels    DDR3  1600  MHz    memory  

Up  to  8  cores    Up  to  20  MB  cache  

Integrated    PCI  Express*  3.0  Up  to  40  lanes    per  socket  

Value - Compute Platform Optimizations

•  Preferred  soluUon  for  Hadoop*  and  scale-­‐out  analyUc/DW  engines  

•  Up  to  80%  performance  boost  compared  to  prior  generaUon  

•  Intel  Direct  Data  IO  reduces  latency  and  adds  bandwidth  

•  Latest  DDR3  memory  technology/capacity  for  reduced  memory  latency  

•  Preferred  soluUon  for  in-­‐memory  analyUc  engines  and  scale-­‐up  databases  

•  Columnar  DB  performance  improvements  through  use  of  Intel  AVX  instrucUons  

•  Up  to  2TB  memory  footprint  (4-­‐socket  pla]orm)  for  in-­‐memory  apps  

•  Highest  reliability  &  8-­‐socket+  scalability  

Up  to  10  cores    Up  to  30  MB  cache  

QPI  1  

QPI  2  

QPI  3  

QPI  4  

Xeon  E7-­‐4800  

CORE  1   CORE  2  

CORE  3   CORE  4  

CORE  5   CORE  6  

CORE  7   CORE  8  

CORE  9   CORE  10  

CACHE  4  QPI  1.0  Lanes  for  robust  scalability  

RAM  

Up  to  8  channels    DDR3  1066  MHz    memory  

Intel  ®  Xeon  ®  E7  Family  Intel®  Xeon®  E5  Family  

Page 9: Big Data - Intel Vision

9

1  

2  

3  

  Big  Data  is  here  and  growing  rapidly  

  Intel  &  Cisco  are  well  posiUoned  from  sodware  stack  and  pla]orm  basis      

  Intel  &  Cisco  are  commieed  to  invesUng  in  new  technology  to  address  more  demanding  big  data  requirements  of  the  future    

Summary