EMC® Service Assurance Suite® 9.4 · EMC Service Assurance Suite 9.4.2 SolutionPack Performance...
Transcript of EMC® Service Assurance Suite® 9.4 · EMC Service Assurance Suite 9.4.2 SolutionPack Performance...
Abstract
The performance and scalability guidelines outlined here are based on tests run on EMC M&R configured in a production-like environment. Both live and simulated configuration items were used to measure the performance and scalability of EMC M&R. September 2016
EMC® Service Assurance Suite® 9.4.2
SolutionPack Performance and Scalability Guidelines
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
2
Copyright © 2014-2016 EMC Corporation. All rights reserved. Published in the USA.
Published September 2016
EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice.
The information in this publication is provided as is. EMC Corporation makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license.
EMC2, EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United States and other countries. All other trademarks used herein are the property of their respective owners. For the most up-to-date regulatory document for your product line, go to EMC Online Support (https://support.emc.com). 302-003-148 Rev 01
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
3
Table of Contents Table of Contents .............................................................................................. 3
1 Overview ................................................................................................... 5
2 Audience .................................................................................................. 5
3 Purpose .................................................................................................... 5
4 Infrastructure planning guidelines ................................................................ 5
5 Deployment Planner tool ............................................................................. 6
I. Resource description and specification of deployment types .................................. 6
II. Guideline P2- Increase default disk space ............................................................. 7
6 SAS SolutionPacks Supported for Deployment ............................................... 7
6.1 SolutionPack for EMC Smarts ................................................................................. 7
I. Deployment Planner Inputs ................................................................................... 7
II. Steps to obtain Managed Ports and Interfaces ...................................................... 7
III. Comparison of 9.4.1 Vs 9.4.2 .............................................................................. 8
IV. New UI P&S ........................................................................................................ 8
a. Environment Details ............................................................................................ 8
b. Notifications Report Results ................................................................................. 8
c. Topology Map Report Results ............................................................................... 9
V. Reference.......................................................................................................... 10
6.2 SolutionPack for Optical Wavelength Services ...................................................... 10
I. Deployment Planner Inputs ................................................................................. 10
II. Comparison of 9.4 .1 Vs 9.4.2 ............................................................................ 11
6.3 SolutionPack for Huawei iManager M2000............................................................ 11
I. Deployment Planner Inputs ................................................................................. 11
II. Comparison of 9.4.1 Vs 9.4.2 ............................................................................. 11
III. Reference ......................................................................................................... 11
6.4 SolutionPack for EMC Network Configuration Manager .......................................... 12
I. Sizing Inputs ...................................................................................................... 12
II. Comparison of 9.4.1 Vs 9.4.2 ............................................................................. 12
III. Reference ......................................................................................................... 13
6.5 SolutionPack for Transaction................................................................................ 14
I. Deployment Planner Inputs ................................................................................. 14
II. Comparison of 9.4.1 Vs 9.4.2 ............................................................................. 14
6.6 SolutionPack for Traffic Flows ............................................................................... 14
I. Sizing Inputs ...................................................................................................... 14
6.7 SolutionPack for CUCM ........................................................................................ 16
I. Test Bed Details: ................................................................................................ 16
II. CDR/CMR report processing and report rendering results ..................................... 16
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
4
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
5
1 Overview The guidelines for an optimized performance and scalability are related to planning the hardware and virtual environment, disk space, network latency, and deployment and configuration.
Planning guidelines help determine the right ESX hardware and the number of virtual machines needed for a specific data center environment.
Disk space guidelines help prepare and configure datastore capacity before EMC M&R deployment.
Network latency guidelines help identify the proximity and placement of EMC M&R virtual machines with respect to the configuration items.
Deployment and configuration guidelines assist with deployment and post-deployment.
EMC M&R is fully deployable on non-ESX hosts. EMC M&R Performance and Scalability Guidelines do not address non-ESX host deployment scenarios.
EMC M&R Performance and Scalability Guidelines do not address all of the SolutionPacks contained in EMC M&R.
2 Audience This article is for EMC M&R installers, administrators or anyone who manages the EMC M&R application.
3 Purpose After reading this article, you will have guidelines to follow to ensure you can configure EMC M&R for optimal performance based on the scale of your environment.
4 Infrastructure planning guidelines Use these guidelines to plan the infrastructure such as the right ESX hardware, number of virtual machines needed, and other details described in the tables to ensure an optimum performance and scalability.
Note: Any Solution Pack that generates more than 5M metrics should have an exclusive EMC M&R deployment.
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
6
5 Deployment Planner tool The EMC M&R Deployment Planner tool can be used in conjunction with these guidelines to help scope specific environment requirements. Using known data about the environment, the tool will estimate EMC M&R hardware needs, provide metric counts (with growth factor), and include pointers to performance and scalability guidelines specific to the environment.
Access the Deployment Planner tool on the Downloads for EMC M&R page at:
https://support.emc.com/products/31946_Service-Assurance-Suite/Tools/
I. Resource description and specification of deployment types
Deployment Type Purpose of VM vCPUs Memory (GB) Disk Space(GB) VM Count
All-in-one (POC – Not for Production)
All components in a single VM
4 32 600 1
Standard Deployment (SA Suite 4-VM)
Frontend 4 16 120 1
Backend-Primary 4 24 600 - 1000 1
Backend-Secondary
4 16 1,200 - 2650 1
Collector 4 16 120 1
Scale-out Deployment (Requires Standard Deployment)
Additional Backend
4 16 1,200 - 2650 1
Additional Collector
4 8 -16 120 1
Notes:
It is recommended to remove the Generic RSC and Generic SNMP Collector Managers from the Additional Collectors if there are no hosts or SNMP devices being discovered, so as to reduce the Collector footprint.
The Frontend has been tested for 10 concurrent users
The disk space specification in this table assumes default retention policies.
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
7
II. Guideline P2- Increase default disk space
After deploying EMC M&R standard deployment (SA Suite 4-VM), the disk space must be increased for both primary and secondary backends. The default disk space on the primary and secondary backends is 150 GB.
The default disk space on Frontend is 150 GB. Increase the disk space on the Frontend
6 SAS SolutionPacks Supported for Deployment The following SAS SolutionPacks are supported by the Deployment Planner:
o SolutionPack for EMC Smarts
o SolutionPack for Optical Wavelength Services
o SolutionPack for Huawei iManager M2000
o SolutionPack for Network Configuration Manager (NCM)
o SolutionPack for Transaction
o SolutionPack for Traffic Flows
o SolutionPack for Cisco Unified Communication Manager (CUCM)
6.1 SolutionPack for EMC Smarts
I. Deployment Planner Inputs
Input Field Description
Devices Total number of Devices Performance Instrumentation
Total number of Managed Ports and Interfaces with Performance Instrumentation
Fault Instrumentation
Total number of Managed Ports and Interfaces with Fault Instrumentation
II. Steps to obtain Managed Ports and Interfaces
Execute the following command to obtain the total number of Fault and Performance Instrumentation per IP Domain Manager. This should be repeated for the all the IP Domain Managers and the total across domains should be provided as input.
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
8
# ./sm_tpmgr -s INCHARGE-AM-PM --sizes | grep "Total Number of NetworkAdapters"
Output: Total Number of NetworkAdapters: 20000 [20000/20000]
Note: In the square brackets, the first part is Fault and the second one is Performance Instrumentation Numbers.
III. Comparison of 9.4.1 Vs 9.4.2
Smarts SP 9.4.1 9.4.2
Maximum Collector Instances 2 2
Maximum Metrics per collector 2M 2M
IV. New UI P&S
New UI P&S focuses on the Notifications and Topology view.
Notifications View:
o Response time for fetching notifications from the alert-EDAA
Topology View:
o Response time for fetching the graphml xml response from the SAM via the EDAA network/topology
a. Environment Details
RHEL 6.5 VM (4 CPUs), 100 GB Disk Space, RAM 16GB.
7000 Device (34043 Ports & 114513 Interfaces)
b. Notifications Report Results
Scenarios 20K Notifications
50K Notifications
100K Notifications
Time taken for the notification page to load 218ms 245ms 593ms
Time taken for the notification page to load with 5 concurrent users 218.33ms 8.37s 59s
Time taken for reports to get loaded, after scrolling down (Pagination) 258.33ms 0.59s 4.556s
Time taken for the notification page to load data with a filter of type an Element == 'Value' 228.66ms 274ms 416ms
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
9
Time taken for the notification page to load data by applying multiple filters (Bulk actions like Acknowledge , Clear etc., on notifications) 228.66ms 552ms 452ms
Time taken for the notification page to load data after sorting a column (E.g. : Last Change column) 215.66ms 273.33ms 257ms
Time taken for notifications to appear in EDAA / M&R (When notifications are loaded for the first time) 7 min 18s 19min 4s 27min 7s
c. Topology Map Report Results
Scenarios Single User (Time taken)
5 Users (Time taken)
10 Users (Time taken)
Load a Physical Connectivity Topology Maps with containment, having hop count as 1. (2 devices)
552.6ms 488.66ms 623ms
Load a Physical Connectivity Topology Maps with containment, having hop count as 3. (3 devices)
686ms 1.25s 1.204s
Load a Physical Connectivity Topology Maps with containment, having hop count as 4. (4 devices)
730.33ms 2.775s 2.078s
Load the VLAN Topology Maps with containment, having hop count as 1. (2 devices)
577.33ms 589ms 1.119s
Load the VLAN Topology Maps with containment, having hop count as 3. (50 devices)
1.514s 2.075s 1.93s
Load the VLAN Topology Maps with containment, having hop count as 4. (700 devices)
7.647s 11.67s 11.21s
Load an UserDefined Group Map (20 Devices) 1.68s 2.268s 2.909s
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
10
V. Reference
The following sizing sheets to be used to size Smarts Domain Managers for your environment:
EMC Smarts IP Version 9.4.2 Performance Benchmarking and Sizing Guidelines
EMC Smarts SAM Version 9.4.2 Performance Benchmarking and Sizing Guidelines
EMC Smarts ESM Version 9.4.2 Performance Benchmarking and Sizing Guidelines
6.2 SolutionPack for Optical Wavelength Services
I. Deployment Planner Inputs
Input Field Description
Optical Network Elements Total number of Optical Network Elements
Equipments Average number of Equipments per Optical Network Element Physical Termination Points
Average number of Physical Termination Points per Optical Network Element.
Subnetwork Connections Total number of Subnetwork Connections(SNC)
Topological Links Total number of Topological Links
Example:- An Optical Network Element could have ~600 Physical Termination Points. The input here will be #OpticalNetworkElements * Avg. #PhysicalTerminationPoints. An Optical Network Element could have ~50 Equipments. The input here will be ##OpticalNetworkElements * Avg. #Equipments
Load an UserDefined Group Map (50 Devices) 4.08s 4.56s 4.90s
Load an UserDefined Group Map on a browser with its cache cleared (150 Devices)
10.48s 11.01s 13.23s
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
11
II. Comparison of 9.4 .1 Vs 9.4.2
Optical Wavelength Services SP 9.4.1 9.4.2
Maximum Collector Instances 3 3
Maximum Metrics per collector 2M 2M
6.3 SolutionPack for Huawei iManager M2000
I. Deployment Planner Inputs
Input Field Description
Devices Total number of Devices = Cell + Station + Controller
Counters Average number of Counters per Counter-group.
Example: “67109376” is one of the Counter-groups and “VS.RAB.AbnormRel.CS” & “VS.RAB.NormRel.CS” are 2 Counters part of this group. Get the average number of Counters of all the Counter-groups and provide this average as input to “# Counters” in the deployment planner.
II. Comparison of 9.4.1 Vs 9.4.2
Huawei iManager M2000 SP 9.4.1 9.4.2
Maximum Collector Instances 2 2
Maximum Metrics per collector 2M 2M
III. Reference
1. For Hard Disk space usage: Please refer SolutionPack for Huawei iManager M2000 -> Performing post installation tasks-> Refer point 1
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
12
6.4 SolutionPack for EMC Network Configuration Manager
I. Sizing Inputs
Input Field Description
Devices Total number of Devices
Tests
Total number of Tests = Total number of policies * Standards per policy * Tests per standard Example: If there are 10 policies, each policy has 10 Standard associated and Each standard has 5 Test associated.
Jobs This is the count of the number of jobs Average # Devices per Job The average number of devices per Job
II. Comparison of 9.4.1 Vs 9.4.2
Network Configuration Manager SP 9.4.1 9.4.2
Maximum Collector Instances 3 2*
Maximum Metrics per collector 1.6M 1.7M
* Two collector manager instances are for Compliance and Jobs (jobs + inventory) respectively
The following are the deployment recommendations for NCM Solution Pack v2.4
Option1: (Recommended for <3.5M Metrics)
M&R Platform + NCM Solution Pack -> Single VM (32G, 4vCPU)
NCM Distributed/Combo
Heap size on collector manager instance increased to 8GB
Hard disk space increased to 600GB
System instability observed beyond 4M Metrics with single VM configuration (High Memory/CPU utilization, backend and UI unresponsiveness)
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
13
Option2: (Recommended for > 3.5M Metrics and <7.8M Metrics)
M&R Platform + NCM Solution Pack -> Distributed (4VMs)
1VM for Frontend (16G, 4 vCPU)
1VM for Collector (24G, 4 vCPU)
1VM for Backend Database (24G, 4vCPU) and
1VM for Additional Backend Database(16G, 4vCPU)
NCM Distributed
Heap size on collector manager instances, load balancer, Front-end, APG backend(apg, apg1, apg2, apg3, apg4) increased to 8GB
All the 4 VMs Hard disk space increased to 600GB
System instability observed beyond 7.8M Metrics with distributed VM configuration (High Memory/CPU utilization, backend and UI unresponsiveness)
III. Reference
The following sizing sheets to be used to size NCM Core for your environment:
EMC Network Configuration Manager Version 9.4.2 Performance Benchmarking and Sizing Guidelines
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
14
6.5 SolutionPack for Transaction
I. Deployment Planner Inputs
Input Field Description
HTTP Servers Total Number of HTTP & HTTP HEAD Servers Authentication Servers Total Number of LDAP Servers
Other Servers Total Number of DNS, FTP, SFTP, TCP CONNECT, RADIUS, SQL and SCRIPT
II. Comparison of 9.4.1 Vs 9.4.2
Transaction SP 9.4.1 9.4.2
Maximum Collector Instances 3 3
Maximum Metrics per collector 40000 40000
6.6 SolutionPack for Traffic Flows
I. Sizing Inputs
Input Field Description
Devices Total number of Devices Ports & Interfaces Total number of Ports & Interfaces
Flows per second Total number of Flows per second
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
15
The following are the deployment recommendations for Traffic flow Solution Pack v3.1
Option1: Combo /Single Server Deployment
M&R Platform + Traffic Flow Solution Pack -> Single VM (32GB, 4vCPU)
Heap size on event processing manager instance increased to 8GB
3 GHz Dual-processor server
600GB (OS and Application) Disk
Separate 1TB Flow storage
Up to 10K Flows per second (per Core CPU) are processed on a single VM configuration.
Option2: Distributed Deployment
M&R Platform + Traffic Flow Solution Pack -> Distributed (3 VMs)
1VM for Frontend (32GB, 4 vCPU)
1VM for Collector (32GB, 4 vCPU)
1VM for Backend Database (32GB, 4vCPU)
Heap size on event processing manager instances, Front-end, APG backend increased to 8GB
3 GHz Dual-processor server
600GB (OS and Application) Disk
Separate 1TB Flow storage
Up to 10K Flows per second (per Core CPU) per event processing manager on a collector VM are processed. There can be only one event processing manager per collector VM.
EMC Service Assurance Suite 9.4.2 SolutionPack Performance and Scalability Guidelines
16
6.7 SolutionPack for CUCM
I. Test Bed Details:
Setup is created on a Single VM with CentOS 6.8 Operating System, 200 GB of Disk Space, RAM 32GB (dedicated), and 4 CPUs per host. Captured below are the readings for CDR/CMR records that were processed and their rendering times.
II. CDR/CMR report processing and report rendering results
Note: Average number of calls that are incrementally updated on the front-end is 7200 calls per hour.
Solution Pack for CUCM v1.1.1 with 6.5u4 beyond 250K events observed High CPU utilization, backend and UI unresponsiveness.
Scenarios CUCM SP v1.1.1 (6.5u4)
CUCM SP v2.1 (6.7u1)
Number of events -> 170K 170K 1M Time taken for Cisco-VoIP-CUCM Collector to process events
45.518s
46.466s 274.56s
Time taken for rendering Call OverView Report
0.303s 0.356s 0.825s
Time taken for rendering Call Duration OverView Report
0.795s 0.549s 1.432s
Time taken for rendering QoS Report
0.393s 0.409s 0.923s
Time taken for rendering Voice Quality by Streams
2.897s 0.377s 1.452s
Time taken for rendering Calls Statistics
2.897s 1.167s 1.601s