Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald...

28
Copyright © 2012, SAS Institute Inc. All rights reserved. make connections • share ideas • be inspired Data Guido Oswald Solution Architect @SAS Switzerland

Transcript of Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald...

Page 1: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

make connections • share ideas • be inspired

Data

Guido Oswald Solution Architect @SAS Switzerland

Page 2: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

BIG Data….. Wer?

Page 3: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

BIG Data….. Wer?

Page 4: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Wikipedia sagt:

Als Big Data werden besonders große Datenmengen bezeichnet, die mit Hilfe von Standard-Datenbanken und Daten-Management-Tools nicht oder nur unzureichend verarbeitet werden können.

Problematisch sind hierbei vor allem die Erfassung, die Speicherung, die Suche, Verteilung, Analyse und Visualisierung von großen Datenmengen.

Das Volumen dieser Datenmengen geht in die Terabytes, Petabytes, Exabytes und Zettabytes.

Page 5: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Ist BIG Data relevant für mich?

Zettabytes ?!

1021 Byte

1.000.000.000.000.000.000.000 Byte

Page 6: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Zettabytes

Page 7: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved. * According to IDC

Page 8: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Diversität der Daten wächst!

Page 9: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

E = mc2

Page 10: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Gartner “Hype Cycle”

Page 11: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Gartner IT Trends 2012

6. Next-Generation-Analytics

7. Big Data

8. In-Memory-Computing

9. Extrem stromsparende Server

10. Cloud Computing

1. Tablets

2. Mobile Applikationen und Interfaces

3. Kontextuelles und soziales Benutzererlebnis

4. Das Internet der Dinge

5. App-Stores und Marktplätze

Oktober 2011

Page 12: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

BIG Data kommt

Wie hat sich nach Ihrer Einschätzung die Datenmenge, die in Ihrem Unternehmen verarbeitet wird,

in den letzten zwölf Monaten verändert? Die Datenmenge ist ... (n=116 , Angaben in Prozent)

Quelle: CW-Marktstudie 2011: Big Data.

Page 13: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

VOLUMEN

VARIETÄT

GESCHWINDIGKEIT

RELEVANZ

TODAY THE FUTURE

DA

TA

SIZ

E

Wettbewerbsvorteil aus BIG Data

Page 14: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Analytics Lifecycle und BIG Data

IDENTIFY /

FORMULATE

PROBLEM

DATA

PREPARATION

DATA

EXPLORATION

TRANSFORM

& SELECT BUILD

MODEL

VALIDATE

MODEL

DEPLOY

MODEL

EVALUATE /

MONITOR

RESULTS

How can we

create

strategic

advantage?

Domain Expert

Makes Decisions

Evaluates Processes and ROI

BUSINESS

MANAGER

Model Validation

Model Deployment

Model Monitoring

Data Preparation

IT SYSTEMS /

MANAGEMENT

Data Exploration

Data Visualization

Report Creation

BUSINESS

ANALYST

Exploratory Analysis

Descriptive Segmentation

Predictive Modeling

DATA MINER /

STATISTICIAN

Page 15: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Die Lösung: Supercomputer?

Page 16: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Die Lösung: Supercomputer?

“Monte Rosa” im CSCS (Lugano)

AMD quad core Opteron 2,4 GHz Prozessoren

47.872 Kerne

297,0 TFLOPS

ABER:

Kosten?

Verteilen der Daten / Verarbeitung?

Page 17: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Lösungsansatz für BIG Analytics

Statt die Daten zur «Arbeit»

Page 18: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Lösungsansatz für BIG Analytics Traditionelle Architektur

Page 19: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Lösungsansatz für BIG Analytics

Statt die Daten zur «Arbeit»

Die «Arbeit» zu den Daten

Page 20: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Lösungsansatz für BIG Analytics

MARKETING

VERKAUF

FINANZEN

SUPPLY

CHAIN

RISK

HR

EDW

ADW

Page 21: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Die Lösung für BIG Analytics

Paralleles Datenbanksystem

EMC Greenplum

Teradata

Apache Hadoop

Erprobt durch Google, Facebook, Yahoo

Skaliert praktisch beliebig!

Commodity Hardware (Blade Server)

Page 22: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Commodity Hardware: Blade Server

Page 23: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

SAS Lösung für BIG Data

Page 24: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Fazit

Page 25: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

make connections • share ideas • be inspired

Copyright © 2012, SAS Institute Inc. All rights reserved.

Vielen Dank für Ihre

Aufmerksamkeit!

Page 26: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

make connections • share ideas • be inspired

BACKUP SLIDES

Page 27: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Welche Daten wohin?

DECISIONS / ACTIONS / DATA

RAW RELEVANT DATA

LOW COST STORAGE

ENTERPRISE

DATAWAREHOUSE

Page 28: Big Data - Trend oder Hype? - SAS · Title: Big Data - Trend oder Hype? Author: Guido Oswald Subject: Big Data Keywords: Information Management, High Performance Analytics, SAS Created

Copyright © 2012, SAS Institute Inc. All rights reserved.

Business intelligence weiter denken

FORECASTING

DATA MINING

TEXT ANALYTICS

OPTIMIZATION

STATISTICS

INFORMATION

MANAGEMENT

Copyright © 2012, SAS Institute Inc. All rights reserved.