Post on 24-Feb-2016
description
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
1
BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN
TechTalk Hochperformante und kostengünstige Data Warehouse Systeme
Meinrad Weiss09.05.2012
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
2
AGENDA1. Introduction Microsoft Appliances
2. Overview Microsoft Data Warehousing Solutions
3. FastTrack
4. “Case Study”
5. Concrete Offerings
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
3
Accelerate time to value, And optimized Systems
Custom-built solution Integrated, optimized appliance
1
4
2
3
6
5
Weeks
Design
Build
Deploy
Use
Acquire appliance
Extract data from existing MS apps
Choose appliance for workload
Install appliance
Stand-up in production
Extract and manipulate dataGenerate reportsMake decisions
Manage and adapt
Wee
ks
Extract and manipulate data
Define architecture
Acquire SW, HWEvaluate options
Install components
Assess workload
Load dataTest with POCBalance SW, HW
Integrate in environment
Monitor and troubleshoot
Generate reportsMake decisions
Design
Build
Deploy
Use
1
12+
4
8
12+ Months
Mon
ths
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
4
Microsoft Data Warehousing SolutionsTier 1 Offerings
Scalable and reliable platform for data
warehousing on any hardware
Reference Architectures offering best price
performance for data warehousing
Scalable and reliable platform for data
warehousing on any hardware
Appliance for high-end data warehousing requiring highest
scalability, performance, or complexity
Ideal for data marts or small to mid-sized EDWs
Ideal for data marts or small to mid-sized DWs
with scan- centric workloads
Ideal for large data marts or mid-sized EDWs
Offers flexibility in hardware and architecture
Software only Reference Architectures (software and hardware) Software only
DW appliance(fully integrated
software and hardware)
Scale-up DW Scale-up DW Scale-up DW Scale-out DW with MPP
10s of TB 2 – 80 TB 10s of TB 10s - 100s of TB
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
5
Data Warehouse – Products Positioning
1
2
3
Minimal HW tune-up/optimization; supports mixed workloads
Balanced solution for mostly scan-centric workloads.
Max HW tune-up for most DW scenarios.
4 Most flexible architecture for handling all DW scenarios.
ScaleComplexityHA by defaultSW-HW integration
SQL Server 2008 R2Fast Track
SQL Server 2008 R2Enterprise
PDWSQL Server 2008 R2Data Center
1
2
3
4
PDW with Distributed
Data Architecture
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
6
Some (SQL) Data Warehouses today
Big SANBig 64-core ServerConnected together
What’s wrong with this picture?09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
7
Answer: system out of balance
Such servers can consume 16 GB/Sec of IO, but the SAN can only deliver 2 GB/Sec Even when the SAN is dedicated to the SQL Data Warehouse,
which it often isn’t Lots of disks for Random IOPS BUT Limited controllers Limited IO bandwidth
System is typically IO boundData Load and queries are slow Huge impact from and to other applications
Result: significant investment, not delivering performance
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
8
The Alternative: FastTrack or A Balanced System
Design a server + storage configuration that can deliver all the IO bandwidth that CPUs can consume when executing a SQL Relational DW workloadAvoid sharing storage devices among serversAvoid overinvesting in disk drives Focus on scan performance, not IOPSLayout and manage data to maximize range scan performance and minimize fragmentation
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
9
SQL Server Fast Track Data Warehouse
A method for designing a cost-effective, balanced system for Data Warehouse workloads Reference hardware configurations developed in conjunction with hardware partners using this methodBest practices for data layout, loading and management
Relational Database Only – Not SSAS, IS, RS- Well, may be also SSAS
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
Fast Track Data Warehouse Components
10
Software:• SQL Server 2008
Enterprise• Windows Server 2008
Hardware:• Tight specifications for
servers, storage and networking
• ‘Per core’ building block
Configuration guidelines:• Physical table
structures• Indexes• Compression• SQL Server settings• Windows Server
settings• Loading
09.05.2012
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
11
Case Study
Swiss customer in energy trading business with: • ca. 2 TB data• ~ 4 GB new data/day
Traditional server infrastructure with SAN storageMain pain points:• High costs• Bad data load performance• Varying load and query
performance
09.05.2012
Fast Track
Fast Track
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
12
System Comparison
09.05.2012
XP 12000 XP 12000
Resource Type # CommentServer HP BL685C G6 2 Failover ClusterCPU AMD 6Core, 2.4Ghz 4 24 Cores per ServerMemory 256GB 256 GB per ServerStorage Shared Storage XP 12000 Including Replication to
second DatacenterOS Windows Server 2008SQL Server SQL Server 2008 SP1
Resource Type # CommentServer HP DL380 G7 1 FastTrack DW Reference
ArchitectureCPU Intel X5680 6 Core 3.33 Ghz 2 12 cores per serverMemory 96GBStorage Direct Attached Storage 48 Data Discs Raid-10
Total 13 TB raw capacityOS Windows Server 2008 R2SQL Server SQL Server 2008 R2 SP1
Old Infrastructure
FastTrack System
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
13
Balanced System Details
System-Test with SQLIO Ø 3.25 GB/sec Scan Rate (3.34 GB/sec theoretical Scan Rate)
09.05.2012
12 * 4 * 300 GB (600 GB)10K SAS 2.5 SFF DP HDD= Total 48 Data Discs
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
14
Migration, Final Comparison and Conclusion
Easy application migration via Backup/Restore• Existing data files distributed over the 12 mount pointsPartition process modified to allocate 12 files for each day (partition)
09.05.2012
Configuration
OldServer
Fast Track
Memory GB 256 96 CPU Cores 24 12 DB Tests Perf. Factor (Tests B,C,F) 100 207
Memory CPU DB TestsPerformance
Factor
0
50
100
150
200
250
300Current Server
Fast Track
ROI in 12 Months
FAST TRACK REFERENCE ARCHITECTURE 3.0
Mark WunderliInfra2AppsTechnology Consultant Hewlett-Packard (Switzerland) GmbHmark.wunderli@hp.com
Fast Track Data Solution at a glance
A range of proven configurations to accelerate deployment and optimize results
80% Faster report generation
95%Faster system queries than legacy DW
$600KSavings on hardware annually
50%Faster deployment2FTEs
Redirected for innovation
10x Savings on storage consumption
16 09.05.2012Hochperformante und Kostengünstige Data Warehouse Systeme
Fast Track Reference Architecture 3.0
17 09.05.2012Hochperformante und Kostengünstige Data Warehouse Systeme
Configurations to scale from 1TB to 80 TBs• Prescriptive guidance and optimized methodology for deployment
– Targeted at query workloads patterned for large sequential data reads• Balanced HW approach ideal for data marts
– Fast Track Reference Architectures: 1– 80TB• Leading price/performance metrics• Configurations, tested performance guidance, and best practices
– HP Sizer for Microsoft SQL Server Fast Track Data Warehouse • Custom support
The choice is yours!Broadest range of solutions to meet your data warehousing needs
Entry Ref. Arch.ProLiant DL370 (2P) Internal disks (5.5 TB*)Expansion (14 TB*)
Basic Ref. Arch.ProLiant DL38x (2P) MSA P2000 G3(Rec. Capacity 20 TB*)
Mainstream Ref. Arch.ProLiant DL58x (4P) MSA P2000 G3(Rec. Capacity 40 TB*)
Premium Ref. Arch.ProLiant DL980 (8P) MSA P2000 G3(Rec. Capacity: 80 TB*)
18
* recommended data capacity with a 3.5X compression
• Server: HP ProLiant DL 580 G7 with 4 x 8-core Intel Xeon
• Storage: HP P2000 G3• Recommended User Capacity: 40 TB
4P: 32 core, 192T GB – 1 TB RAM
• Server: HP ProLiant DL980 G7 with 8 x 8-core Intel Xeon
• Storage: HP P2000 G3• Recommended User Capacity: 80 TB
Premium SMP: 8- Socket Processor
Configuration
Mainstream SMP: 4- Socket Processor
Configuration
8p; 64 core, 512 GB - 2TB RAM
19
• Server: HP ProLiant DL380 G7 with 2 x 12-core Intel
• Storage: HP P2000 G3• Recommended User Capacity: 20 TB
Basic SMP: 2- Socket Processor
Configuration2P: 12 core, 96 – 384 GB RAM
Data Warehousing Continuum – Intel options
Freeing up IT, getting more value
Without HP Factory Express:• Complexity• Confusion• Slow time to solution
With HP Factory Express:• Faster time to solution• More available IT resources• Maximized IT investment
22
Choose the service level that best meets your business needsCare Pack Services−Support for HP hardware and software,
as well as Microsoft software - 3 year 24x7
Proactive 24 Service−Integrated HW and SW support
including proactive and reactive services to improve stability and availability across IT environment
Critical Service−Comprehensive support to help
minimize business impact of downtime for mission critical apps
or
Proactive Select−Flexible way to purchase
proactive services and priority incident support
+Priority Connect−Speeds resolution to
interoperability issues, minimizes total business impact from downtime
For HP for Fast Track 3.0 deploymentsSupport options
23
2012 © TrivadisHochperformante und Kostengünstige Data Warehouse Systeme
24
BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN
Merci!
Thank you!
Grazie mille!
VIELEN DANK!
Hewlett-Packard (Switzerland) GmbHmark.wunderli@hp.com
Trivadis AGmeinrad.weiss@trivadis.com
09.05.2012