SAP ASE Using Backup Server With IBM Tivoli Storage Manager En
Keys to Optimizing Your Backup Environment: Tivoli...
-
Upload
phungkhanh -
Category
Documents
-
view
227 -
download
0
Transcript of Keys to Optimizing Your Backup Environment: Tivoli...
Hosted by
Keys to Optimizing Your Backup Environment: Tivoli Storage Manager
John MerrymanGlassHouse Technologies, Inc.
Hosted by
Introduction
Audience Profile
Storage Management Interdependence
Backup Pain Points
TSM Architecture
• Server
• Storage
• Network
• Clients
Hosted by
Audience Response
Audience Profile
Your TSM Backup/Archive Environment
Number of Years using TSM
Number of TSM Administrators
Hosted by
Hosted by
Storage Management Interdependence
Storage and Production Backup
• Growing at 65% CAGR (Gartner)
• Consuming 48% of IT hardware budgets (Gartner)
Disaster Recovery
• Enabling Recovery – RPO/RTO impact
Archiving
• Compliance
• Storage efficiency
• Disposal of data
• Application Performance
“It’s no longer just backup, it’s data management.”
Hosted by
TSM Pain PointsBusiness Problems
Backup reliability
Overwhelming data growth
Database and email data explosion
Limited budgets and staff
Regulatory / data retention requirements
Lack of data management policies
Poor operational practices
Technology ProblemsTSM architecture scalability
Lack of TSM / OS tuning
Network architecture
Client-side issues (OS, antivirus, network)
Increasingly complex requirements
Shrinking backup windows
Disconnect between application design and storage management
SolutionOptimize and right-size existing infrastructure
Improve processes and procedures
Formalize TSM program management
BenefitsLower TCO for TSM environment
Proactive management model
Lowered risks and exposures
Scalable and manageable environment
Hosted by
Business Problems
Backup reliability
Overwhelming data growth
Database and email data explosion
Limited budgets and staff
Regulatory / data retention requirements
Lack of data management policies
Poor operational practices
Hosted by
Technology Problems
• TSM architecture scalability
• Lack of TSM / OS tuning
• Network architecture
• Client-side issues (OS, antivirus, network)
• Increasingly complex requirements
• Shrinking backup windows
• Disconnect between application design and storage management
Hosted by
Solution
• Optimize and right-size existing infrastructure
• Improve processes and procedures
• Formalize TSM program management
Hosted by
Benefits
• Lower TCO for TSM environment
• Proactive management model
• Lowered risks and exposures
• Scalable and manageable environment
Hosted by
TSM Pain Points
TSM Client Administration7%
61%
7%
3%
3%
2%2%
3%2%
2%8%
TSM Certifications, De-Certifications, Re-CertificationsTSM Client Problem Resolution
TSM Client Upgrades / ChangeManagementTSM Client Process Improvement
Testing and Certifying New ClientTechnologiesPerforming Restores
TSM Server / Device ProblemResolutionTSM Server Administration
TSM Server Monitoring, Reporting,PlanningTesting and Certifying New ServerTechnologiesJoint Effort Problem Resolution forTSM Client Issues
Hosted by
TSM Architecture OverviewLAN
DatabaseRecovery Log
TSMServer
SAN
TSM Clients
Hosted by
TSMClients
SD
HEWLETTPACKARD
SD
4 5 6 7 8 9 10 11
10/ 100 BASE TX
1 2
3
5411 Enterprise Switch
POWERMGMT
4 5 6 7 8 9 1 0 11 11
22
33
33
3RR
10 00 BASE X
AMBER =GREEN =
FL ASHING GREEN =
AC TIVI TYLINK O KDISABLED
TSMServer
Tape/SAN/DiskTechnology
NetworkNetwork
SD
4 5 6 7 8 9 10 11
10/ 100 BASE TX
1 2
3
5411 Enterprise Switch
POWERMGMT
4 5 6 7 8 9 1 0 11 11
22
33
33
3RR
10 00 BASE X
AMBER =GREEN =
FL ASHING GREEN =
AC TIVI TYLINK O KDISABLED
SD
HEWLETTPACKARDTape/SAN/Disk
TechnologyTSM
Clients
TSMServer
TSM Architecture
Hosted by
TSM Server PerformanceHardware
• CPU, Memory, HBAs
Server backplane/bus architecture
HBA location
Operating System Tuning
• VMTUNE for AIX has a significant impact
Must be tuned specifically for environment
• Asynchronous I/O (requires TSM settings too)
• Direct I/O (requires TSM settings too)
• Network options tuning
Hosted by
TSM Application Tuning
TSM Application Tuning
• Database Buffer Pool Sizing Server Options bufpoolsize parameter
(up to 50%)Selftunebufpoolsize parameter (up to 10%)Relates closely to page space sizing
• Mirrorwrite db parallel and DBpageshadow
• Txngroupmax, movebatchsize, movesizethresh
Hosted by
TSM Application Tuning, II
64-bit and 32-bit code levels (and OS levels)
TSM performance tuning guide
• http://publib.boulder.ibm.com/tividd/td/TSMM/SC32-9101-01/en_US/HTML/SC32-9101-01.htm
Maintain a link between operating system, application, and device performance analysis.
Hosted by
TSM Server Performance
Other Considerations
• Backup versioning policies have an effect.
• Schedule randomization versus static schedules
• Spread production workload across backup window.
• Control batch TSM processes to avoid overlap for resource intensive processes.
• Low-level policies can have a high-level impact.
shrstatic versus shrdynamic
Changing retries settings
Hosted by
TSM Server Operations
Hosted by
Ideal TSM Batch Processing
0:00
1:00
2:00
3:00
4:00
5:00
6:00
7:00
8:00
9:00
10:00
11:00
12:00
13:00
14:00
15:00
16:00
17:00
18:00
19:00
20:00
21:00
22:00
23:00
Backup STG Process 360Backup STG Process 399Backup STG Process 400Database Backup Process 472Migration Process 365Migration Process 473Migration Process 474Expire Inventory Process 479Space Reclamation Process 480Space Reclamation Process 481Space Reclamation Process 482Space Reclamation Process 483
10/12/2003
Hosted by
Poorly Optimized TSM Batch Processing
11:00
12:00
13:00
14:00
15:00
16:00
17:00
18:00
19:00
20:00
21:00
22:00
23:00
0:00
1:00
2:00
3:00
4:00
5:00
6:00
7:00
8:00
9:00
10:00
11:00
12:00
13:00
14:00
15:00
16:00
17:00
18:00
19:00
20:00
21:00
22:00
23:00
0:00
1:00
2:00
3:00
4:00
5:00
6:00
7:00
8:00
9:00
10:00
11:00
12:00
13:00
14:00
15:00
16:00
17:00
18:00
19:00
20:00
21:00
22:00
23:00
0:00
1:00
2:00
3:00
4:00
5:00
6:00
7:00
8:00
9:00
Backup STG Process 360Migration Process 365
Migration Process 366Migration Process 367Migration Process 368Migration Process 369
Migration Process 370Migration Process 371Migration Process 372
Migration Process 373Migration Process 374Migration Process 375
Backup STG Process 376Backup STG Process 377Backup STG Process 378
Backup STG Process 379Migration Process 380Migration Process 381
Migration Process 382Migration Process 383Migration Process 384
Migration Process 385Migration Process 386Migration Process 387
Migration Process 388Migration Process 389Migration Process 390
Migration Process 391Migration Process 392Migration Process 393
Migration Process 394Migration Process 395Migration Process 396Migration Process 397
Backup STG Process 398Backup STG Process 399Backup STG Process 400
Backup STG Process 401Backup STG Process 402Backup STG Process 403
Backup STG Process 404Backup STG Process 405Migration Process 406
Migration Process 407Migration Process 408Migration Process 409
Migration Process 410Migration Process 411Migration Process 412
Migration Process 413Backup STG Process 414Backup STG Process 415
Backup STG Process 416Backup STG Process 417Migration Process 418
Migration Process 419Migration Process 420Migration Process 421Migration Process 422
Migration Process 423Migration Process 424Migration Process 425
Migration Process 426Migration Process 427Migration Process 428
Migration Process 429Migration Process 430Migration Process 431
Migration Process 432Migration Process 433Migration Process 434
Migration Process 435Migration Process 436Migration Process 437
Migration Process 438Migration Process 439Migration Process 440
Migration Process 441Migration Process 442Migration Process 443
Migration Process 444Migration Process 445Migration Process 446
Database Backup Process 447Migration Process 448Migration Process 449Migration Process 450
Migration Process 451Migration Process 452Migration Process 453
Migration Process 454Migration Process 455Migration Process 456
Migration Process 457Migration Process 458Migration Process 459
Backup STG Process 460Backup STG Process 461Backup STG Process 462
Backup STG Process 463Backup STG Process 464Backup STG Process 465
Backup STG Process 466Backup STG Process 467Backup STG Process 468
Backup STG Process 469Backup STG Process 470Backup STG Process 471
Database Backup Process 472Migration Process 473Migration Process 474
Migration Process 475Migration Process 476Migration Process 477Migration Process 478
Expire Inventory Process 479Space Reclamation Process 480Space Reclamation Process 481
Space Reclamation Process 482Space Reclamation Process 483Space Reclamation Process 484
Space Reclamation Process 485Space Reclamation Process 486Space Reclamation Process 487
Database Backup Process 488Space Reclamation Process 489Space Reclamation Process 490
Space Reclamation Process 491Space Reclamation Process 492Space Reclamation Process 493
Space Reclamation Process 494Space Reclamation Process 495Space Reclamation Process 496
Space Reclamation Process 497Space Reclamation Process 498Space Reclamation Process 499
Database Backup Process 500Migration Process 501Migration Process 502Migration Process 503
Migration Process 504Migration Process 505Migration Process 506
Space Reclamation Process 507Space Reclamation Process 508Database Backup Process 509
Space Reclamation Process 510Space Reclamation Process 511Database Backup Process 512
Migration Process 513Migration Process 514Migration Process 515
Migration Process 516Migration Process 517Migration Process 518
Database Backup Process 519Space Reclamation Process 520Migration Process 521
Migration Process 522Migration Process 523Migration Process 524
Migration Process 525Migration Process 526Database Backup Process 527
Backup STG Process 528Backup STG Process 529Backup STG Process 530Backup STG Process 531
Backup STG Process 532Backup STG Process 533Backup STG Process 534
Backup STG Process 535Migration Process 536Migration Process 537
Migration Process 538Migration Process 539Migration Process 540
Backup STG Process 541Backup STG Process 542Backup STG Process 543
Backup STG Process 544
10/11/2002 10/12/2003 10/13/2003 10/14/2003
Hosted by
SD
HEWLETTPACKARD
SD
4 5 6 7 8 9 10 11
10/ 100 BASE TX
1 2
3
5411 Enterprise Switch
POWERMGMT
4 5 6 7 8 9 1 0 11 11
22
33
33
3RR
10 00 BASE X
AMBER =GREEN =
FL ASHING GREEN =
AC TIVI TYLINK O KDISABLED
TSMServer
Tape/SAN/Disk Technology
Network
TSMClients
Tape/SAN/Disk Technology
SD
HEWLETTPACKARD
Network
TSMClients
TSMServer
SD
4 5 6 7 8 9 10 11
10/ 100 BASE TX
1 2
3
5411 Enterprise Switch
POWERMGMT
4 5 6 7 8 9 1 0 11 11
22
33
33
3RR
10 00 BASE X
AMBER =GREEN =
FL ASHING GREEN =
AC TIVI TYLINK O KDISABLED
TSM Architecture
Hosted by
SAN Architecture
Disk Fabric Design
• Dedicated SAN/Disk resources for Database/Logs
• Dedicated SAN/Disk for storage pools
Tape Fabric Design
• Load Balancing and design is important
• Develop Ratios based on throughput and SAN fabric
1 GB Fabric w/ 3590-E1A Drives
• 1:3 Ratio HBA: Drive
2 GB Fabric w/ 3590-E1A Drives
• 1:6 Ratio HBA: Drive
Hosted by
Disk Architecture
Disk architecture
• Fast, redundant, flexible and scalable
File system design
• Create naming conventions and plan for scalability.
• Raw volumes versus file systems
• Create file system schema with disk layout in mind.
• Database/log performance (Random I/O)
• Storage volume performance (sequential)
Hosted by
Disk Architecture, II
Storage device architecture
• Design/layout is key for sequential versus random disk performance requirements
• TSM is often the most I/O intensive application in the datacenter.
• Disk performance tuning is often necessary.
Hosted by
Disk Storage Pools
Capacity Planning for disk storage pools
Plan for using Migration Delay for critical client data.
• A note on storage pool caching and database performance
Disk is traditionally used in TSM as a staging area for daily migration to tape.
This paradigm is evolving.
Hosted by
Disk as a Primary Storage Pool
Considerations
• Detailed Capacity planning methods for disk storage are required.
• TSM Backup Policies have to be carefully planned.
• Formatting and Recovering Terabytes of *.dsm files is incredibly time and resource intensive.
• Performance-oriented disk storage pool design becomes even more important.
• Copies to tape will still be required, and simultaneous R/W can be a big issue for S-ATA technologies.
Hosted by
Tape ArchitectureSize and Type of Library
• Robot speed, Compression, Scalability, etc.
Number and Type of Tape Drives
• R/W Speed, Caching, Mount/Seek Times, etc.
Media Formats
• Create a media migration strategy and plan.
Consider emerging tape technologies.
• Tape is not dead and is not dying.
• High-end tape I/O is faster than low-end disk I/O.
• The real issue is random vs. sequential access to data.
Hosted by
Tape Storage Pools
Stream large database objects data directly to tape.
• Lowers disk pool requirements
• Lowers TSM batch processing time
• Optimizes use of tape resources during backup window
• Schedule and resource planning is key.
• Resource Utilization and Maxnummp settings
Synchronous Copy Storage Pool Writes (“”)
• Can reduce batch window significantly
• Use only for large object backup clients.
Recovery optimized TSM tape storage pools
• Collocation=yes (+’s an –’s)
Hosted by
SD
HEWLETTPACKARD
SD
4 5 6 7 8 9 10 11
10/ 100 BASE TX
1 2
3
5411 Enterprise Switch
POWERMGMT
4 5 6 7 8 9 1 0 11 11
22
33
33
3RR
10 00 BASE X
AMBER =GREEN =
FL ASHING GREEN =
AC TIVI TYLINK O KDISABLED
TSMServer
Tape/SAN/Disk Technology
Network
TSMClients
SD
4 5 6 7 8 9 10 11
10/ 100 BASE TX
1 2
3
5411 Enterprise Switch
POWERMGMT
4 5 6 7 8 9 1 0 11 11
22
33
33
3RR
10 00 BASE X
AMBER =GREEN =
FL ASHING GREEN =
AC TIVI TYLINK O KDISABLED
SD
HEWLETTPACKARD
TSMServer
Tape/SAN/Disk Technology
TSMClients
TSM Architecture
Network
Hosted by
Network Overview
Network Architecture
• Private / Public network configurations
Type of Architecture
• 100 Mb and Gigabit IP architectures are the defacto standard.
Develop Network Architecture Standards.
• Map network standards to SLAs and to service delivery.
• Publish metrics on network throughput.
• Enforce Standards.
Advancing a network architecture can be cost prohibitive and time consuming…so can poor recovery times and data loss.
Hosted by
Network Design
Dedicated Private VLAN architectures
• Logical network segregation and physical network segregation
• Use jumbo frames and gigabit VLANs.
Improves streaming efficiencies to tape
9000 and 9004 MTU size differences
DNS Considerations
Multiple HBA’s for client network load balancing
• Etherchannel configurations
• Load balancing for network, switches, server HBAs
• Don’t use auto-negotiate network card settings.
Hosted by
SD
HEWLETTPACKARD
SD
4 5 6 7 8 9 10 11
10/ 100 BASE TX
1 2
3
5411 Enterprise Switch
POWERMGMT
4 5 6 7 8 9 1 0 11 11
22
33
33
3RR
10 00 BASE X
AMBER =GREEN =
FL ASHING GREEN =
AC TIVI TYLINK O KDISABLED
TSMServer
Tape/SAN/Disk Technology
Network
TSMClientsTSM
ClientsSD
4 5 6 7 8 9 10 11
10/ 100 BASE TX
1 2
3
5411 Enterprise Switch
POWERMGMT
4 5 6 7 8 9 1 0 11 11
22
33
33
3RR
10 00 BASE X
AMBER =GREEN =
FL ASHING GREEN =
AC TIVI TYLINK O KDISABLED
TSMServer
Tape/SAN/Disk Technology
Network
TSM Architecture SD
HEWLETTPACKARD
Hosted by
TSM Client PerformanceFact: Client machines are often sized for application workload, not backup workload.
Client Tuning Parameters
• Resource Utilization (2-10)
• Memoryefficientbackup
• Virtualmountpoint
Network / Transaction Tuning Parameters
• Tcpnodelay
• Tcpwindowsize
• Tcpbufsize
• Txnbytelimit
Hosted by
TSM Client Configuration
File System Design and Type
• File system size and number impacts memory consumption.
• TSM client can be memory intensive (300 MB Memory / Million Objects).
Include/Exclude list size has a direct impact on processing overhead.
• Leverage domain statements.
Hosted by
TSM Client Configuration, II
Journal-based backups
• Data drives only
• Journal size is limited to 2 GB
Image backups
LAN-free backups
Hosted by
TSM Client PerformanceBackup Object Success Rates
Chart 2
1
10
100
1,000
10,000
100,000
1,000,000
INAA
2068
INAA
2073
INDA
0001
INDA
0003
INDA
2000
INDA
2001
INDA
2010
INDA
2014
INEA
2000
INEA
2007
INEA
2008
INEA
2015
INEA
2021
INPA
2000
INPS
WB
01
INSA
2005
INSA
2006
Node Name
Ave
rage
Num
ber o
f Obj
ects
Average Objects InspectedAverage Objects Backed UpAverage Objects Failed
Hosted by
TSM Client Performance
Additional Considerations
• Data characteristics
Data type, volume, volatility
Number of files
• Client workloads and backup schedule
• Client Software Version
• Network load and utilization
• Communication with application architects and developers is increasingly important.
SD
HEWLETTPACKARD
Hosted by
TSM Client PerformanceClient Versions
Version 4 Re lease 1 Level 2.0, 45 Clients
Version 5 Release 1 Level 5.0, 27 Clients
Version 4 Release 1 Level 2.12, 24 Clients
Version 3 Release 1 Level 0.5, 21 Clients
(?), 14 Clien ts
Version 5 Release 1 Level 5.14, 12 Clients
Version 4 Release 1 Level 1 .0, 11 Clients
Version 4 Release 2 Level 1.0, 8 Clients
Version 4 Release 2 Level 0.0, 4 Clients
Version 3 Release 1 Level 0.7, 4 Clients
Version 3 Release 1 Level 0.1, 3 Clients
Version 3 Release 1 Level 0.3, 3 Clients
Version 4 Re lease 1 Level 0.0, 2 Clients
Version 5 Release 1 Level 6.0, 1 Clients
Version 3 Release 1 Level 0.8, 1 Clients
Version 3 Release 7 Level 1.0, 1 Clients
Hosted by
To receive a copy of the charts seen in this presentation and more for your environment go to:
www.glasshouse.com/backup
For a “cheat sheet” see the highlighter in your conference bag.
Hosted by
Thank you.
Questions?
Mr. Merryman will be available at the Ask-the-Experts booth in the Exhibit Hall:
Tuesday 4-5 PM
Hosted by
Information. Optimized.
GlassHouse Technologies, Inc.200 Crossing BoulevardFramingham, MA 01702www.glasshousetech.com [email protected]