TechTalk

2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme

1

BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN

TechTalk Hochperformante und kostengünstige Data Warehouse Systeme

Meinrad Weiss09.05.2012

09.05.2012


2

AGENDA1. Introduction Microsoft Appliances

2. Overview Microsoft Data Warehousing Solutions

3. FastTrack

4. “Case Study”

5. Concrete Offerings

09.05.2012


3

Accelerate time to value, And optimized Systems

Custom-built solution Integrated, optimized appliance

1

4

2

3

6

5

Weeks

Design

Build

Deploy

Use

Acquire appliance

Extract data from existing MS apps

Choose appliance for workload

Install appliance

Stand-up in production

Extract and manipulate dataGenerate reportsMake decisions

Manage and adapt

Wee

ks

Extract and manipulate data

Define architecture

Acquire SW, HWEvaluate options

Install components

Assess workload

Load dataTest with POCBalance SW, HW

Integrate in environment

Monitor and troubleshoot

Generate reportsMake decisions

Design

Build

Deploy

Use

1

12+

4

8

12+ Months

Mon

ths

09.05.2012


4

Microsoft Data Warehousing SolutionsTier 1 Offerings

Scalable and reliable platform for data

warehousing on any hardware

Reference Architectures offering best price

performance for data warehousing

Scalable and reliable platform for data

warehousing on any hardware

Appliance for high-end data warehousing requiring highest

scalability, performance, or complexity

Ideal for data marts or small to mid-sized EDWs

Ideal for data marts or small to mid-sized DWs

with scan- centric workloads

Ideal for large data marts or mid-sized EDWs

Offers flexibility in hardware and architecture

Software only Reference Architectures (software and hardware) Software only

DW appliance(fully integrated

software and hardware)

Scale-up DW Scale-up DW Scale-up DW Scale-out DW with MPP

10s of TB 2 – 80 TB 10s of TB 10s - 100s of TB

09.05.2012


5

Data Warehouse – Products Positioning

1

2

3

Minimal HW tune-up/optimization; supports mixed workloads

Balanced solution for mostly scan-centric workloads.

Max HW tune-up for most DW scenarios.

4 Most flexible architecture for handling all DW scenarios.

ScaleComplexityHA by defaultSW-HW integration

SQL Server 2008 R2Fast Track

SQL Server 2008 R2Enterprise

PDWSQL Server 2008 R2Data Center

1

2

3

4

PDW with Distributed

Data Architecture

09.05.2012


6

Some (SQL) Data Warehouses today

Big SANBig 64-core ServerConnected together

What’s wrong with this picture?09.05.2012


7

Answer: system out of balance

Such servers can consume 16 GB/Sec of IO, but the SAN can only deliver 2 GB/Sec Even when the SAN is dedicated to the SQL Data Warehouse,

which it often isn’t Lots of disks for Random IOPS BUT Limited controllers Limited IO bandwidth

System is typically IO boundData Load and queries are slow Huge impact from and to other applications

Result: significant investment, not delivering performance

09.05.2012


8

The Alternative: FastTrack or A Balanced System

Design a server + storage configuration that can deliver all the IO bandwidth that CPUs can consume when executing a SQL Relational DW workloadAvoid sharing storage devices among serversAvoid overinvesting in disk drives Focus on scan performance, not IOPSLayout and manage data to maximize range scan performance and minimize fragmentation

09.05.2012


9

SQL Server Fast Track Data Warehouse

A method for designing a cost-effective, balanced system for Data Warehouse workloads Reference hardware configurations developed in conjunction with hardware partners using this methodBest practices for data layout, loading and management

Relational Database Only – Not SSAS, IS, RS- Well, may be also SSAS

09.05.2012


Fast Track Data Warehouse Components

10

Software:• SQL Server 2008

Enterprise• Windows Server 2008

Hardware:• Tight specifications for

servers, storage and networking

• ‘Per core’ building block

Configuration guidelines:• Physical table

structures• Indexes• Compression• SQL Server settings• Windows Server

settings• Loading

09.05.2012


11

Case Study

Swiss customer in energy trading business with: • ca. 2 TB data• ~ 4 GB new data/day

Traditional server infrastructure with SAN storageMain pain points:• High costs• Bad data load performance• Varying load and query

performance

09.05.2012

Fast Track

Fast Track


12

System Comparison

09.05.2012

XP 12000 XP 12000

Resource Type # CommentServer HP BL685C G6 2 Failover ClusterCPU AMD 6Core, 2.4Ghz 4 24 Cores per ServerMemory 256GB 256 GB per ServerStorage Shared Storage XP 12000 Including Replication to

second DatacenterOS Windows Server 2008SQL Server SQL Server 2008 SP1

Resource Type # CommentServer HP DL380 G7 1 FastTrack DW Reference

ArchitectureCPU Intel X5680 6 Core 3.33 Ghz 2 12 cores per serverMemory 96GBStorage Direct Attached Storage 48 Data Discs Raid-10

Total 13 TB raw capacityOS Windows Server 2008 R2SQL Server SQL Server 2008 R2 SP1

Old Infrastructure

FastTrack System


13

Balanced System Details

System-Test with SQLIO Ø 3.25 GB/sec Scan Rate (3.34 GB/sec theoretical Scan Rate)

09.05.2012

12 * 4 * 300 GB (600 GB)10K SAS 2.5 SFF DP HDD= Total 48 Data Discs


14

Migration, Final Comparison and Conclusion

Easy application migration via Backup/Restore• Existing data files distributed over the 12 mount pointsPartition process modified to allocate 12 files for each day (partition)

09.05.2012

Configuration

OldServer

Fast Track

Memory GB 256 96 CPU Cores 24 12 DB Tests Perf. Factor (Tests B,C,F) 100 207

Memory CPU DB TestsPerformance

Factor

0

50

100

150

200

250

300Current Server

Fast Track

ROI in 12 Months

FAST TRACK REFERENCE ARCHITECTURE 3.0

Mark WunderliInfra2AppsTechnology Consultant Hewlett-Packard (Switzerland) [email protected]

Fast Track Data Solution at a glance

A range of proven configurations to accelerate deployment and optimize results

80% Faster report generation

95%Faster system queries than legacy DW

$600KSavings on hardware annually

50%Faster deployment2FTEs

Redirected for innovation

10x Savings on storage consumption

16 09.05.2012Hochperformante und Kostengünstige Data Warehouse Systeme

Fast Track Reference Architecture 3.0

17 09.05.2012Hochperformante und Kostengünstige Data Warehouse Systeme

Configurations to scale from 1TB to 80 TBs• Prescriptive guidance and optimized methodology for deployment

– Targeted at query workloads patterned for large sequential data reads• Balanced HW approach ideal for data marts

– Fast Track Reference Architectures: 1– 80TB• Leading price/performance metrics• Configurations, tested performance guidance, and best practices

– HP Sizer for Microsoft SQL Server Fast Track Data Warehouse • Custom support

The choice is yours!Broadest range of solutions to meet your data warehousing needs

Entry Ref. Arch.ProLiant DL370 (2P) Internal disks (5.5 TB*)Expansion (14 TB*)

Basic Ref. Arch.ProLiant DL38x (2P) MSA P2000 G3(Rec. Capacity 20 TB*)

Mainstream Ref. Arch.ProLiant DL58x (4P) MSA P2000 G3(Rec. Capacity 40 TB*)

Premium Ref. Arch.ProLiant DL980 (8P) MSA P2000 G3(Rec. Capacity: 80 TB*)

18

* recommended data capacity with a 3.5X compression

• Server: HP ProLiant DL 580 G7 with 4 x 8-core Intel Xeon

• Storage: HP P2000 G3• Recommended User Capacity: 40 TB

4P: 32 core, 192T GB – 1 TB RAM

• Server: HP ProLiant DL980 G7 with 8 x 8-core Intel Xeon


Premium SMP: 8- Socket Processor

Configuration

Mainstream SMP: 4- Socket Processor

Configuration

8p; 64 core, 512 GB - 2TB RAM

19

• Server: HP ProLiant DL380 G7 with 2 x 12-core Intel


Basic SMP: 2- Socket Processor

Configuration2P: 12 core, 96 – 384 GB RAM

Data Warehousing Continuum – Intel options

Freeing up IT, getting more value

Without HP Factory Express:• Complexity• Confusion• Slow time to solution

With HP Factory Express:• Faster time to solution• More available IT resources• Maximized IT investment

22

Choose the service level that best meets your business needsCare Pack Services−Support for HP hardware and software,

as well as Microsoft software - 3 year 24x7

Proactive 24 Service−Integrated HW and SW support

including proactive and reactive services to improve stability and availability across IT environment

Critical Service−Comprehensive support to help

minimize business impact of downtime for mission critical apps

or

Proactive Select−Flexible way to purchase

proactive services and priority incident support

+Priority Connect−Speeds resolution to

interoperability issues, minimizes total business impact from downtime

For HP for Fast Track 3.0 deploymentsSupport options

23


24

BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN

Merci!

Thank you!

Grazie mille!

VIELEN DANK!

Hewlett-Packard (Switzerland) [email protected]

Trivadis [email protected]

09.05.2012

TechTalk

Documents

Transcript of TechTalk