Multiple instances consolidation practices

36
MS SQL Server: Multiple Instances Consolidation Practices Alexander Prusakov Senior MS SQL Server DBA May, 2010

description

There are many ways to reduce costs in IT. Consolidation is one of these ways. Many IT managers thinking only about virtualization when consider consolidation. Multi-instancing is very legitimate and effective way too. Managers and DBAs have to understand benefits and pitfalls, difference from virtualization. Presentation is unveiling real-world practice and experience of support of over 70 servers with at least 6 instances on each with over 2500 databases. This presentation can be helpful for infrastructure managers, system architects, and DBAs .

Transcript of Multiple instances consolidation practices

Page 1: Multiple instances consolidation practices

MS SQL Server: Multiple Instances

Consolidation PracticesAlexander Prusakov

Senior MS SQL Server DBAMay, 2010

Page 2: Multiple instances consolidation practices

Sr. MS SQL Server DBA (consultant) in one of the biggest financial institution in the world

20+ years of IT experience (business users, ERPs, databases and applications support, software development, data warehousing, etc.)

15+ years of experience with MS SQL Server

MBA, MCITP: Database Administrator 2005/2008

Industries: banking/finance, energy, education, health care, manufacturing, IT consulting.

Speaker’s Background:

Page 3: Multiple instances consolidation practices

Why; How; What to expect and how it

works; Summary; Q and A.

Agenda:

Page 4: Multiple instances consolidation practices

Consolidation refers to the merger from multiple computer sources into single.

Virtualization refers to the abstraction of computer resources.

Multi-instancing refers to the utilization of the same computer sources by multiple independent SQL Servers

Terms

Page 8: Multiple instances consolidation practices

Virtualization

Multi-instancing

Page 9: Multiple instances consolidation practices

Unexpected need in new SQL Server without budget for a hardware;

Buzz about virtualization; Enterprise environment; Curiosity;

How did I step in:

Page 10: Multiple instances consolidation practices

Reduce hardware cost Reduce pollution (carbon

footprint) Reduce labor/support cost Increase resources utilization Look nice in other’s eyes

Why to consolidate:

Page 11: Multiple instances consolidation practices

Actually it might not (MSRP pre-configured

estimated):› Enterprise level server: 16 sockets,

196GB (16P) about$175,000.00;› HP ProLiant DL785G5 8380 -128GB (8P)$34,999.00;› HP ProLiant DL380G6 E5504-4GB (1P)$ 2,289.00 x 8 = $ 18,312.00;$ 2,289.00 x 16 = $ 36,624.00;

Reduce hardware cost:

Page 12: Multiple instances consolidation practices

Space: 2U x 8 = 16U vs. 7U Power: 460x8 = 3,680 vs. 1,300 W Cooling cost: vary Reduced carbon footprint (including

manufacturing and usage) Ability to add physical CPUs and/or

memory

Real Benefits:

Page 13: Multiple instances consolidation practices

Cost of annual licensing;› OS – 1 to 8;› SQL Server: 8 x 5,999.00 =

47,992.00 8 x 24,999.00 =

199,992.00 Load performance improvement; Cost of SysAdmin support(1 vs. 8); Cost of DBA time (patch 1 vs. 8); Cost of real estate and other

Reduce support cost:

Page 14: Multiple instances consolidation practices

Data compression; Resource governor; Table partitioning; Hot-add CPU and memory; Policy-based management; Data collector; etc.

Extras bonus from Enterprise version:

Page 15: Multiple instances consolidation practices

Total workload throughput on the system versus total number

of databases.

http://www.dell.com/downloads/global/solutions/ServerConsolidation1.doc

Page 16: Multiple instances consolidation practices

Workload throughput on each database versus the number of

databases on the system

http://www.dell.com/downloads/global/solutions/ServerConsolidation1.doc

Page 17: Multiple instances consolidation practices

Effective memory for procedure cache in different configurations

http://www.dell.com/downloads/global/solutions/ServerConsolidation1.doc

Page 18: Multiple instances consolidation practices

Ability to re-distribute CPUs and memory between instances;

Parallel processing (especially beneficial in non-business hours);

Increase resource utilization:

Now you look GREAT!Or may be not

Page 19: Multiple instances consolidation practices

Multi-instancing vs Virtualization

Feature:Multi-

instancingVirtualization

All eggs in one basket Yes May beUse of many low-level servers as one

No Yes

Security and workload isolation

Not really Yes

System administration saving

Yes Sometimes

DBA time saving Yes NoDeployment time saving No Yes

Page 20: Multiple instances consolidation practices

Multi-instancing vs Virtualization

Feature:Multi-

instancingVirtualization

Patching time saving

OS level Yes Kind ofInstance level

Yes No

Overhead*

CPU No 10%IO No 6-8%

MemoryMay be some for

300 MB for the hypervisor;32 MB for the first GB

Page 21: Multiple instances consolidation practices

Multi-instancing vs Virtualization

Feature:Multi-

instancingVirtualization

Overhead*Memory

OS and related processes

of RAM on each VM;8 MB for every additional GB of RAM on each VM

Network latency

No less than 1 ms

Hardware limitations Server limit64GB limit per VM2 TB limit per Host

* http://msdn.microsoft.com/en-us/library/cc768536(BTS.10).aspx

Page 22: Multiple instances consolidation practices

Install multiple instances; Create multiple TempDBs; Limit CPUs and memory per

instance; Leave enough memory for OS; Monitor performance; Test performance before move to

production; Know your IO system; Set up thresholds;

How:

Page 23: Multiple instances consolidation practices

Model CPU Total Memory

IBM 3850 M2 / x3950 M28 Quad Core

66,583,112

Page 24: Multiple instances consolidation practices
Page 25: Multiple instances consolidation practices

Microsoft Performance Dashboard; Quest Foglight software; Good DBA;

What is not that much:

What is useful:

Single Instance Reports; Profiler; Sysadmins.

Page 26: Multiple instances consolidation practices

Usefulness:

Page 27: Multiple instances consolidation practices

And NOT:

Page 28: Multiple instances consolidation practices

But can be better:

Page 29: Multiple instances consolidation practices

Steady but needs a lot of patience from DBA;

Business has to follow rules; Adds extra work to manage and

keep records on DBs; Harder tune performance; Higher cost of error (including

planning).

How it works :

Page 30: Multiple instances consolidation practices

SQL Server Engines for users are separated on different instances;

SSAS and SSRS are separated from database engines;

Each instance is used by databases of one business unit;

Application has no elevated rights on any shared server;

Have a big boss on your side!

How:

Page 31: Multiple instances consolidation practices

Push back from development team on:› CPU utilization;› IO utilization (IOPS);› Database schema optimization;

› Query tuning;

What to expect:

Page 32: Multiple instances consolidation practices

Push back from business:› DBA has to be involved;› One instance down – all business units might be down;

› IT cost saving <> business cost;

› Is there a shortcut?;

What to expect:

Page 33: Multiple instances consolidation practices

Unexpected errors; A lot of work to build

monitoring and administration tools;

Fun, fun, a lot of fun

What to expect:

Page 34: Multiple instances consolidation practices

Bigger the farm – better savings;

Bigger the farm – bigger the headache;

Not that scary if design and implementation has been done carefully.

Summary:

Page 35: Multiple instances consolidation practices

Internet – find your way, do it yourself

Microsoft – excellent documentation, big community. For example:

http://msdn.microsoft.com/en-us/library/ee819082.aspx

Hardware Manufactures – hard to find the truth

Consultants – result may be vary

Where to look for more:

Page 36: Multiple instances consolidation practices

Slides can be found on:› http://

indiana.sqlpass.org/Default.aspx?tabid=2742

Email: [email protected]

Questions & Open Discussion

Thank You!