Milestone Solution Partner IT Infrastructure ... -...

13
Milestone Solution Partner IT Infrastructure Components Certification Report HUAWEI OceanStor 9000 Storage 31-08-2015

Transcript of Milestone Solution Partner IT Infrastructure ... -...

Page 1: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

Milestone Solution Partner IT Infrastructure Components Certification Report

HUAWEI OceanStor 9000 Storage

31-08-2015

Page 2: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

2 HUAWEI OceanStor 9000 - MTP Certification Performance Report

Table of Contents Executive Summary: .................................................................................................................................. 4

Abstract .................................................................................................................................................... 4

Certified Products................................................................................................................................... 4

Key Findings ........................................................................................................................................... 4

Topology .................................................................................................................................................. 5

Storage System Configuration ............................................................................................................. 5

Test Plan Summary: .................................................................................................................................. 7

Test Process ........................................................................................................................................... 7

Benchmark, Maximum Performance, & Failover Test Scenarios ................................................... 8

Performance Results: ................................................................................................................................ 9

Performance Tests: ............................................................................................................................... 9

Conclusion: ............................................................................................................................................... 12

Appendix A: ............................................................................................................................................... 13

Full Lab Equipment List ....................................................................................................................... 13

Page 3: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

3 HUAWEI OceanStor 9000 - MTP Certification Performance Report

About HUAWEI OceanStor:

The OceanStor 9000 is a big data storage system that can be deployed in a range of sectors such as broadcasting and TV, media assets, high-performance computing (HPC), data centers (DCs), Internet operation, and large-scale enterprises. The capacity and performance of a traditional NAS storage system are limited. Incapable of linear expansion and faced with problems of uneven system loads and raised costs during vertical expansion, they are unsuitable for meeting the capacity, speed, and expansion requirements of the massive data era.

To address the preceding challenges, Huawei introduced the OceanStor 9000, a next generation distributed NAS storage product. This product features seamless scale-out from 3 to 288 nodes and up to 40 PB capacity for a single file system. The OceanStor 9000 also supports Common Internet File System (CIFS), Network File System (NFS), and File Transfer Protocol (FTP).

About Milestone Systems:

Milestone Systems is the world’s leading provider of open platform IP video surveillance software.

Milestone has provided easy-to-use, powerful video management software in more than 100,000

installations worldwide.

Milestone XProtect® products are designed with open architecture and are compatible with more IP

cameras, encoders and digital video recorders than any other manufacturer. Because Milestone provides

an open platform, you can integrate today’s best business solutions and expand what’s possible with

future innovations. Visit www.milestonesys.com for more.

GENERAL DISCLAIMER:

All information, to include but not limited to, documentation, configuration calculations, installation and trouble-shooting advice,

consultancy and support services which may be provided within this document is delivered 'as is' without warranty of any kind.

Unless otherwise agreed in writing between you and Milestone Systems A/S or its Affiliates, you, as the recipient, agree to assume

the entire risk as to the results and performance achieved or not achieved by reliance on such information. Milestone Systems A/S

and its Affiliates shall, to the extent allowed by law, assume no liability for the Recipient’s reliance on such information and disclaims

all warranties, whether express or implied, including but not limited to, the implied warranties of merchantability, fitness for a

particular purpose, title and non-infringement, or any warranty arising out of any proposal, specification or sample with respect to the

document. Furthermore, Milestone Systems A/S and its Affiliates shall not be liable for loss of data, loss of production, loss of profit,

loss of use, loss of contracts or for any other consequential, economic or indirect loss whatsoever in respect of delivery, use or

disposition from the content of this document.

Page 4: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

4 HUAWEI OceanStor 9000 - MTP Certification Performance Report

Executive Summary:

Abstract This report highlights the performance results of certification tests performed on Huawei OceanStor 9000 storage. This system was used as the storage location for a high capacity archive video database during this certification test. OceanStor 9000 storage, with 3 nodes, was integrated with a Milestone XProtect video management system to measure the performance in terms of total disk throughput and total camera stream support. The results of the performance tests were validated by the Milestone Technology Partner program. Certification of Huawei Storage solutionss ensure that surveillance systems built using this product in combination with the Milestone XProtect components will be able to record and archive an amount of video consistent with the recommendations of the Milestone Server and Storage Calculator.

Certified Products

Huawei OceanStor 9000 (C3 nodes)

Milestone XProtect Corporate 2014 (or the most recent version)

o Listed products are certified for use with the entire XProtect product line.

Performance of the solution may vary if different XProtect products and/or system components not listed in the tests details are

included. For a complete list of all equipment used in the certification check Appendix A.

Key Findings The OceanStor 9000 performs as a storage platform for the archive video databases within the Milestone XProtect VMS system. In this scenario the OceanStor 9000 is an aggregator of several Milestone XProtect Recording Servers hosting their own live video databases. For the benchmark test and maximum performance test workloads listed below, there were three recording servers installed in the system each which recorded video to a volume from Huawei SAN Storage, and then archived hourly to OceanStor 9000 storage via 10 Gbit Ethernet synchronous SMB connection to the archive video database.

Test Scenario

Storage Solution Maximum Number of Cameras

Individual Video Stream Size (Mbps)

Throughput Disk (I/O) (MBps)

Benchmark OceanStor 9000 300 4.16 500

Maximum OceanStor 9000 390 4.16 512

Page 5: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

5 HUAWEI OceanStor 9000 - MTP Certification Performance Report

Integrators and end users designing, installing and operating surveillance systems which incorporate these solution components can have confidence that the system will record and archive video reliably. Customers who wish to gain the maximum value and performance out of their surveillance system can also refer to the best practices and performance limitations outlined in this document to help design a system that exceeds the benchmark limitations for video recording which are followed by the Milestone Server and Storage Calculator.

Solution Architecture:

Topology The test surveillance system was assembled and installed at the IT OpenLab in Chengdu. The system topology included six servers running a Microsoft Windows x64 based Server 2008 operating system hosting the Milestone XProtect Corporate Management Server, Management Client and Smart Client. 1 – Management Server –390 camera configuration 4 – Recording Servers – up to 130 cameras per server 4 – View Clients – grid of 30 playbacks per server – 90 view streams The OceanStor 9000 used 10 Gigabit Ethernet interfaces for recording servers. OceanStor 9000 is a three node NAS storage system, each nodes containing 35 data disks (4TB 7.2KM SATA hard disks). One instance of the video feed simulator and video content files were placed on each Recording Server. In this configuration video streams are sent across the IP network to be recorded first on each Recording Server and then archived to OceanStor 9000 for longer term storage. Placing the video stream sources within each recording server removes any potential network bottlenecks between cameras, encoders, or other video sources and the recording servers themselves. The specific configurations detailed above were chosen in order to conform to the recommended Milestone storage configuration; providing a live database and an archive database for each recording server.

Storage System Configuration Using the built in storage configuration tools available through Huawei OceanStor DeviceManager. One hundred five (105) 4TB 7.2K RPM SATA drives of OceanStor 9000 were built into one pool to provide the archive database. This whole pool had individual folders created to contain each recording server’s archive database for logical partitioning of video data. Data is moved from each recording servers live database to the OceanStor 9000 by synchronous SMB connection on an interleaved archive schedule every hour.

Page 6: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

6 HUAWEI OceanStor 9000 - MTP Certification Performance Report

OceanStor 9000 storage management interface display indicating share directoryies.

OceanStor 9000 storage management interface display indicating share with CIFS

Page 7: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

7 HUAWEI OceanStor 9000 - MTP Certification Performance Report

Recording Server display showing \\1.1.1.4\archive2 with 336TB of available storage.

Milestone recommends always configuring a live and an archive database. The XProtect Recording Server was configured to use 1 Terabyte available as a live volume, and 4 Terabyte as the archive database. Video is initially written to the live database, and later moved to the archive database. Once the archive is full, the oldest data will be deleted and incoming data will be stored. This process causes overhead, and is required to simulate a system in long term operations.

Live and archive video database sizes of 1 terabyte and 4 terabyte, respectively, were used to support an efficient testing process. Increasing these sizes in operational video surveillance deployments will not negatively affect performance results.

Test Plan Summary:

Test Process After installation and configuration of all required system components, the first step in the test was to establish a benchmark performance level against which to measure the performance of the system under more data-intensive levels of video recording. Once the benchmark was established, the system would remain in operation at this level long enough to completely fill the archive video database. At this point the test process calls for increasing the parameters of the video streams to add more data to each stream

Page 8: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

8 HUAWEI OceanStor 9000 - MTP Certification Performance Report

and each recording server, including the number of cameras, the video codec format, resolution, frames-per-second, and compression levels. The process of increasing the parameters involved adding additional simulated cameras to the NVR. This process used 1 megapixel resolution streams, with compression of 30% and frame rate of 15 frames per second (FPS). As far as codec options: H.264 was chosen as the only codec with which all tests would be performed due to the overwhelming utilization of this codec in new IP video surveillance installations. The performance of the array was monitored as the number of cameras was increased until we reached an unacceptable level of write latency, CPU consumption, archive event duration, or video frame loss. At that point the data load was reduced, and the performance was monitored again. If the system operates at the reduced level of data load within acceptable parameters, then a full data capture takes place and the maximum performance of the storage array is defined to be at the observed levels of data and video stream parameters. Acceptable levels of operation are defined according to the following statistics:

Less than 0.1% video frame loss

CPU values under 70% average

Archive event duration equal to live database retention (1 hour)

Write latency values under 200 ms

In the test scenarios discussed in this document the XProtect Recording Server, which was recording video to databases located on the OceanStor 9000 storage solution, was configured to record between 300 and 390 simulated cameras; and these cameras were all configured to record video continuously. In each of the tests we also had an XProtect Smart Client application running displaying recorded video. The number of streams being played back simultaneously was 60 in the benchmark test, and 90 in both the maximum and failover tests.

Benchmark, Maximum Performance, & Failover Test Scenarios Milestone’s server and storage calculator was used to determine the benchmark value for the storage solution, with 105 total disks at 7,200 RPM spindle speed and with the live database located in the disk array. The calculator indicated that the system should support 300 cameras at the chosen settings during the benchmark test. The video stream profile used for the calculator included H.264 as the codec, a resolution of one megapixel, 10 frames per second, 30 percent compression. The maximum number of cameras used in the second test scenario was 390 total cameras in order to ensure that the system would be operating under a predictable and easily maintained data load. This would allow the analysis of the measured data to focus on the maximum level of video recording possible.

Page 9: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

9 HUAWEI OceanStor 9000 - MTP Certification Performance Report

Performance Results:

Performance Tests: The data load used in the benchmark test scenario included the following parameters: Benchmark Test:

300 cameras

1 megapixel resolution (1280x720)

H.264 video codec

30% compression

10 frames per second

100% recording

Live RAID 6 using 24 SSD (1000 GB database)

Archive using 105x 7,200 RPM 4TB SATA disks (4TB database) Benchmark test results:

Average OceanStor 9000 Throughput Disk (I/O) Total During Archive Events

500MBps

Average Live Database Write Throughput 102MBps

Average Individual Camera Stream Size 4.16 Mbps

Average Recording Server CPU Utilization 7.80%

% Frames Lost 0.0%

Average Live DB Read Latency 4.66 ms

Archive Duration: (15 minutes) The following graphs only show one hour worth of data; however they very clearly show the end of the archiving process. Again, the single largest throughput event measured in this test was: 597.8MBps

Page 10: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

10 HUAWEI OceanStor 9000 - MTP Certification Performance Report

OceanStor 9000 storage management interface display indicating the storage Write/Read bandwidth

OceanStor 9000 storage management interface display indicating the storage CPU Usage

Maximum Performance Test:

390 cameras

1 megapixel resolution (1280x720)

H.264 video codec

30% compression

Page 11: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

11 HUAWEI OceanStor 9000 - MTP Certification Performance Report

10 frames per second

100% recording

Live RAID 6 using 24 SSD (1000 GB database)

Archive using 105x 7,200 RPM 4TB SATA disks (4TB database) Maximum Performance Test results:

Average OceanStor 9000(3 nodes) Throughput Disk (I/O) Total During Archive Events

512MBps

Average Live Database Write Throughput 202MBps

Average Individual Camera Stream Size 4.16 Mbps

Average Recording Server CPU Utilization 30.24%

% Frames Lost 0%

Average Live DB Read Latency 1.63 ms

Archive Duration: (25 minutes) The following graphs only show one hour worth of data; however they very clearly show the end of the archiving process. Again, the single largest throughput event measured in this test was: 578 MBps.

OceanStor 9000 storage management interface display indicating the storage Write/Read bandwidth

Page 12: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

12 HUAWEI OceanStor 9000 - MTP Certification Performance Report

OceanStor 9000 storage management interface display indicating the storage CPU Usage

The maximum performance test showed that the primary limiting factor in the performance of the Product was the ability of the Milestone XProtect Recording Server software services to move video from the live database to the archive database as quickly as possible. There were no problems with frame loss, video latency or CPU utilization caused by the hardware or software integration.

Conclusion: OceanStor 9000 is a certified storage platform for use as an archive database location with the Milestone XProtect VMS. With the chosen hard disk configuration used in the test, the OceanStor 9000 easily supported the benchmark level of performance. The calculator indicates that the solution should support 300 cameras at the benchmark level, and it was able to support a maximum of 390 cameras. The performance testing determined that the OceanStor 9000 storage solution can support about 30% more total video than the level recommended by the calculator. These test results included the use of the 10Gbps iSCSI node. All of the other nodes available for the product should provide the same, or higher, levels of performance. Integrators and end users should have confidence when building video security and surveillance systems which include the XProtect VMS and the OceanStor 9000 storage solution. The calculator indicates that the solution should support 300 cameras at the benchmark level, and it was able to support a maximum of 390 cameras.Larger systems could be built using multiple storage solutions, alternative disk configurations, and multiple Recording Servers. The XProtect and OceanStor 9000 integrated system is highly scalable with several excellent storage controller interface options, and multiple available redundancy methods to create reliable high performance surveillance and security solutions for mission critical applications.

Page 13: Milestone Solution Partner IT Infrastructure ... - Huaweisupport-open.huawei.com/ready/files/ISV/Huawei_OceanStor_9000.pdf · Milestone Solution Partner IT Infrastructure Components

13 HUAWEI OceanStor 9000 - MTP Certification Performance Report

Appendix A:

Full Lab Equipment List

Network: o 1x HUAWEI S5700 1 Gbit Ethernet Switch o 1xHUAWEI CE6850 10 Gbit Ethernet Switch

Servers: o 1x HUAWEI RH5885 (Running Vsphere5.5, 5 virtual machines are deployed which runs

Windows Server 2008 R2 SP1 operating system) o 4x HUAWEI RH5885 which runs Windows Server 2008 R2 SP1 operating system

Storage: o OceanStor 9000(3 nodes)