Better Storage Management for Data Growth

4
The era of massive data growth presents serious challenges to IT professionals, among them the need for faster, more scalable, and more cost-effective data storage options that respond to changing business requirements. To address these storage challenges, Intel and VMware have a vision for the data center that includes software-defined infrastructure, which can optimize the utilization of data center assets, reduce the cost of data center operations, and speed the time to delivery of new services to the business. Software- defined infrastructure can transform the data center from systems deployed in silos with limited scalability and inefficient utilization to a dynamic, fully automated, and flexible infrastructure that encompasses servers, storage, and network components. Intel and VMware are working together to provide foundational technologies that deliver on this vision for customers’ data centers. These technologies include intelligent storage solutions based on Intel® Solid-State Drive (SSD) Data Center Family, 10 Gigabit Intel® Ethernet Converged Network Adapters, Intel® Xeon® processor technologies, and VMware® Virtual SAN™ (VSAN) software-defined storage. Better Storage Management for Data Growth Intel and VMware deliver software-defined storage solutions Solution Brief Intel® Xeon® Processors VMware® Virtual SAN™

Transcript of Better Storage Management for Data Growth

The era of massive data growth presents serious challenges to IT professionals, among them the need

for faster, more scalable, and more cost-effective data storage options that respond to changing business

requirements. To address these storage challenges, Intel and VMware have a vision for the data center that

includes software-defined infrastructure, which can optimize the utilization of data center assets, reduce the

cost of data center operations, and speed the time to delivery of new services to the business. Software-

defined infrastructure can transform the data center from systems deployed in silos with limited scalability

and inefficient utilization to a dynamic, fully automated, and flexible infrastructure that encompasses servers,

storage, and network components.

Intel and VMware are working together to provide foundational technologies that deliver on this vision for

customers’ data centers. These technologies include intelligent storage solutions based on Intel® Solid-State

Drive (SSD) Data Center Family, 10 Gigabit Intel® Ethernet Converged Network Adapters, Intel® Xeon® processor

technologies, and VMware® Virtual SAN™ (VSAN) software-defined storage.

Better Storage Management for Data GrowthIntel and VMware deliver software-defined storage solutions

Solution BriefIntel® Xeon® Processors

VMware® Virtual SAN™

Meeting the Data Challenge with Software-Defined Storage“Big data” is a familiar phrase in the IT industry, but the real magnitude

of today’s data growth is often unappreciated. Eric Schmidt, former CEO

of Google, noted that 5 exabytes of data are produced every two days—

about the same volume of information created between the dawn of

human civilization until 2003.1 According to IDC, by the year 2020 there

will be more than 40 zettabytes of digital information worldwide.2

Storing and subsequently accessing this volume of data is a huge

challenge for IT professionals. As storage demands grow exponentially,

IT departments need storage solutions that are flexible, scalable, and

cost effective. Unfortunately, traditional storage architectures often

fall short of delivering on these capabilities, causing bottlenecks,

underutilization, and application workload inefficiencies. They require

significant capital expense, create complex management tasks for IT

departments, and lack the scalability required to keep up with data

demands. Moreover, traditional storage systems are not easily re-

provisioned on the fly, and they don’t have the flexibility needed to

adapt to fast-changing user and business demands.

Server virtualization further complicates the picture. While

virtualization has transformed the way that IT is managed and

delivered, it places new demands on storage in terms of input/output

(I/O) performance, latency, and scalability.

For IT professionals, there is a new option: Intel technologies that

work with VMware VSAN software-defined storage. With Intel

and VMware VSAN, IT professionals can create intelligent storage

solutions that take advantage of pooled direct-attached storage

(DAS) resources to achieve greater data storage agility, scalability, and

efficiency at a fraction of the cost of traditional storage architectures.

VMware® Virtual SAN™: A New Storage Technology for Enterprise DataVMware VSAN provides a software-defined storage tier that pools

compute and DAS resources through the server hypervisor. By clustering

server direct-attached hard disk drives (HDDs) and solid-state drives (SSDs),

VSAN creates a distributed, shared data store at the hypervisor layer that

is designed and optimized for virtual machines (VMs). As the needs of

virtualized applications change, the hypervisor is uniquely positioned to

make I/O optimizations and intelligent data-placement decisions to optimize

application performance. VSAN, which is part of the VMware vSphere®

kernel, is architected and positioned to deliver a high-performance storage

tier via software by taking advantage of SSDs for high performance read

caching and write buffering and HDDs for cost-effective data persistence.

VSAN also takes advantage of a highly available architecture that can

withstand failures at the disk, server, and network level with no data

loss, using built-in redundancy mechanisms that transparently store

multiple copies of the data across disks and hosts. VSAN uses a policy-

based approach to storage management that allows IT administrators

to specify storage attributes—such as capacity, performance, and

availability—in the form of simple policies that are associated with

individual virtual machines or virtual disks. Storage can then be instantly

provisioned and automatically configured according to the assigned

policies. VSAN also dynamically self-tunes and load balances to meet the

policies of each individual virtual machine, thereby adapting to ongoing

workload condition changes and helping to ensure that service-level

agreements (SLAs) are met throughout the virtual machine lifecycle.

Core Features of VMware VSAN

• Integration with VMware vSphere: VSAN is implemented inside the

VMware vSphere kernel, enabling high performance and scalability

through integration with VMware vSphere data services such as

VMware vSphere Snapshots, VMware vSphere Clones, VMware

vSphere Data Protection, and VMware vSphere Replication. VSAN is

managed from the VMware vSphere Web Client for single-pane-of-

glass management.

• Read/write I/O caching: VSAN minimizes storage latency by accelerating

read/write disk I/O traffic with built-in caching on server side flash.

• Protection from failures: VSAN has built-in distributed Redundant

Array of Independent Nodes (RAIN) data protection and synchronous

cache mirroring to ensure that data is not lost in case of disk, host, or

network failures.

• Non-disruptive scalability: The VSAN data store performance and

capacity is increased easily and non-disruptively by adding hosts to a

cluster or disks to a host.

• VM-centric policy-based management: Storage requirements

are associated with individual virtual machines or virtual disks

through policy statements that VSAN automatically translates

into system configurations.

• Self-tuning storage and dynamic storage load balancing: VSAN

automatically and non-disruptively maintains the specified

storage capacity, performance, and availability levels for each

individual virtual machine.

• Broad hardware compatibility: VSAN is hardware agnostic and

can be deployed on any standard OEM server hardware based

on Intel technology.

2

• Interoperability with VMware® Horizon View™ and VMware® vCenter™

Site Recovery Manager™: VSAN can be deployed in conjunction

with VMware Horizon View in virtual desktop infrastructure (VDI)

environments and VMware vCenter Site Recovery Manager in

disaster recovery (DR) environments.

VSAN: Radically Simple Storage for Virtual Environments

VSAN makes it easy to provision and manage storage for virtual

machines. IT professionals can quickly provision storage directly

from the VMware vSphere Web Client with just a few clicks, taking

advantage of a self-tuning system that automatically and non-

disruptively optimizes itself to deliver the right SLAs based on the

requirements for each virtual machine.

Unlike traditional storage arrays, VSAN does not require large upfront

investments to get started. A VSAN data store can be created with

as few as three servers and can be used on any standard Intel-based

server hardware. VSAN also delivers a lower total cost of ownership

(TCO) by reducing storage capital and operational expenses through

the use of inexpensive server disks and high-endurance SSDs, with

standard VMware vSphere networking, and through reduced power

and cooling costs. This means that existing high-dollar SAN devices

can be freed up to perform the mission-critical work for which they

were originally intended. Meanwhile, VSAN lets organizations increase

their storage performance and capacity incrementally and predictably.

Intel: Providing a High-Performance Storage FoundationIntel technologies and products work with VMware VSAN to deliver the

foundation for new software-defined storage solutions. These include

the Intel Xeon processor E5 family, 10 Gigabit Intel Ethernet Converged

Network Adapters, and the Intel SSD Data Center Family products.

Intel® Xeon® Processor E5 Family

VMware VSAN delivers a shared storage solution as software

that is efficient, scalable, and cost effective. However, sufficient

processing capability and increased I/O bandwidth is required to

integrate storage intelligence into virtualized servers running

multiple virtual machine workloads. Intel Xeon processors are

designed to meet these requirements with multiple cores that

power enterprise storage requirements in addition to compute tasks.

These processors deliver energy-efficient performance for the most

demanding workloads, support for automated tiering across SSDs

and HDDs, and offer Intel® Integrated I/O for up to three times higher

bandwidth to minimize performance bottlenecks.3

Intel® Ethernet Converged Network Adapters

The most demanding enterprise storage tasks can be addressed

with 10 Gigabit Intel Ethernet Converged Network Adapters. Based

on Intel’s unified networking vision for supporting all LAN data and

storage traffic on a common Ethernet infrastructure, 10 Gigabit Intel

Ethernet Converged Network Adapters offer significant benefits

in the data center over traditional storage architectures, including

a 45 percent reduction in power per rack, a significant reduction in

infrastructure costs, and twice the server I/O bandwidth.4 The 10

Gigabit Intel Ethernet Converged Network Adapters provide the

scalable, high-throughput features required to meet the demands

of combined compute and storage workloads on VSAN systems.

Hardware optimizations for I/O virtualization and native VMware

vSphere storage networking support deliver outstanding performance

while maintaining compatibility with integrated VMware vSphere

quality-of-service (QoS) and teaming features.

Intel® SSD Data Center Family

There is fast-growing interest in the use of SSDs in the data center.

Intel SSDs offer compelling advantages over HDDs. For example, SSDs

have no moving platters or actuator arms that can fail, and they use

semiconductor-based, non-volatile memory similar to what is used

in USB thumb drives, which means that data is retained even with

sudden losses of power. The Intel SSDs can withstand large amounts

of data writes, they produce less heat and noise than HDDs, and they

typically have about one-third of the power requirements of HDDs.

The Intel® SSD 910 Series, Intel® SSD DC S3700 Series, and Intel® SSD

DC S3500 Series offer significant advantages for enterprise storage

tasks. These include full end-to-end data protection, consistent

performance with low latencies, AES 256-bit encryption for excellent

data protection, and high capacities for growing storage needs.

Intel and VMware: Delivering Better Data Storage OptionsWith Intel technology and VMware VSAN, organizations can efficiently

manage large and growing data stores using standard, off-the-shelf,

Intel-based servers. By dynamically pooling DAS resources using

VSAN, enterprises can implement simple and intelligent storage

policies at the virtual-machine level to automate storage provisioning

and management in tandem with compute functions. The result is

lower upfront costs, reduced TCO, and greater flexibility and scalability

to respond to shifting business demands.

3

1 Eric Schmidt. Speech at Techonomy conference. August 2010.

2 IDC. Digital Universe Study, sponsored by EMC Corporation. December 2012. http://www.emc.com/collateral/analyst-reports/idc-the-digital-universe-in-2020.pdf.

3 Source: Intel internal measurements of average time for an I/O device read to local system memory under idle conditions comparing Intel® Xeon® processor E5-2600 product family (230 ns) versus Intel® Xeon® processor 5500 series (340 ns).

4 Results based on Intel® Ethernet Server Adapter ROI tool: http://www.event-management-online.de/LAD/calculator.aspx��%DQGZLGWK�FODLP�EDVHG�RQ�DVVXPHG�FRQ¿JXUDWLRQ�RI�WHQ���*LJDELW�(WKHUQHW��*E(��DGDSWHUV�����*E�WRWDO�EDQGZLGWK��RU�WZR����*LJDELW�(WKHUQHW�DGDSWHUV�����*E�WRWDO�EDQGZLGWK���,QIUDVWUXFWXUH�DQG�SRZHU�FRQVXPSWLRQ�¿JXUH�EDVHG�RQ�FRPSDULVRQ�RI�%ODGH�1HWZRUNV�5DFN6ZLWFK�*���� �DQG�*E(�DGDSWHU�FRQ¿JXUDWLRQ�YHUVXV�-XQLSHU�(;���� ��DQG����*E(�DGDSWHU�FRQ¿JXUDWLRQ�

� �,1)250$7,21�,1�7+,6�'2&80(17�,6�3529,'('�,1�&211(&7,21�:,7+�,17(/�352'8&76��12�/,&(16(��(;35(66�25�,03/,('��%<�(67233(/�25�27+(5:,6(��72�$1<�,17(//(&78$/�3523(57<�5,*+76�,6�*5$17('�%<�7+,6�'2&80(17��(;&(37�$6�3529,'('�,1�,17(/¶6�7(506�$1'�&21',7,216�2)�6$/(�)25�68&+�352'8&76��,17(/�$6680(6�12�/,$%,/,7<�:+$762(9(5�$1'�,17(/�',6&/$,06�$1<�(;35(66�25�,03/,('�:$55$17<��5(/$7,1*�72�6$/(�$1'�25�86(�2)�,17(/�352'8&76�,1&/8',1*�/,$%,/,7<�25�:$55$17,(6�5(/$7,1*�72�),71(66�)25�$�3$57,&8/$5�385326(��0(5&+$17$%,/,7<��25�,1)5,1*(0(17�2)�$1<�3$7(17��&23<5,*+7�25�27+(5�,17(//(&78$/�3523(57<�5,*+7��

� �$�³0LVVLRQ�&ULWLFDO�$SSOLFDWLRQ´�LV�DQ\�DSSOLFDWLRQ�LQ�ZKLFK�IDLOXUH�RI�WKH�,QWHO�3URGXFW�FRXOG�UHVXOW��GLUHFWO\�RU�LQGLUHFWO\��LQ�SHUVRQDO�LQMXU\�RU�GHDWK��6+28/'�<28�385&+$6(�25�86(�,17(/¶6�352'8&76�)25�$1<�68&+�0,66,21�&5,7,&$/�$33/,&$7,21��<28�6+$//�,1'(01,)<�$1'�+2/'�,17(/�$1'�,76�68%6,',$5,(6��68%&2175$&7256�$1'�$)),/,$7(6��$1'�7+(�',5(&7256��2)),&(56��$1'�(03/2<((6�2)�($&+��+$50/(66�$*$,167�$//�&/$,06�&2676��'$0$*(6��$1'�(;3(16(6�$1'�5($621$%/(�$77251(<6¶�)((6�$5,6,1*�287�2)��',5(&7/<�25�,1',5(&7/<��$1<�&/$,0�2)�352'8&7�/,$%,/,7<��3(5621$/�,1-85<��25�'($7+�$5,6,1*�,1�$1<�:$<�287�2)�68&+�0,66,21�&5,7,&$/�$33/,&$7,21��:+(7+(5�25�127�,17(/�25�,76�68%&2175$&725�:$6�1(*/,*(17�,1�7+(�'(6,*1��0$18)$&785(��25�:$51,1*�2)�7+(�,17(/�352'8&7�25�$1<�2)�,76�3$576��

� �,QWHO�PD\�PDNH�FKDQJHV�WR�VSHFL¿FDWLRQV�DQG�SURGXFW�GHVFULSWLRQV�DW�DQ\�WLPH��ZLWKRXW�QRWLFH��'HVLJQHUV�PXVW�QRW�UHO\�RQ�WKH�DEVHQFH�RU�FKDUDFWHULVWLFV�RI�DQ\�IHDWXUHV�RU�LQVWUXFWLRQV�PDUNHG�³UHVHUYHG´�RU�³XQGH¿QHG �́�,QWHO�UHVHUYHV�WKHVH�IRU�IXWXUH�GH¿QLWLRQ�DQG�VKDOO�KDYH�QR�UHVSRQVLELOLW\�ZKDWVRHYHU�IRU�FRQÀLFWV�RU�LQFRPSDWLELOLWLHV�DULVLQJ�IURP�IXWXUH�FKDQJHV�WR�WKHP��7KH�LQIRUPDWLRQ�KHUH�LV�VXEMHFW�WR�FKDQJH�ZLWKRXW�QRWLFH��'R�QRW�¿QDOL]H�D�GHVLJQ�ZLWK�WKLV�LQIRUPDWLRQ��

� �7KH�SURGXFWV�GHVFULEHG�LQ�WKLV�GRFXPHQW�PD\�FRQWDLQ�GHVLJQ�GHIHFWV�RU�HUURUV�NQRZQ�DV�HUUDWD�ZKLFK�PD\�FDXVH�WKH�SURGXFW�WR�GHYLDWH�IURP�SXEOLVKHG�VSHFL¿FDWLRQV��&XUUHQW�FKDUDFWHUL]HG�HUUDWD�DUH�DYDLODEOH�RQ�UHTXHVW��� �&RQWDFW�\RXU�ORFDO�,QWHO�VDOHV�RI¿FH�RU�\RXU�GLVWULEXWRU�WR�REWDLQ�WKH�ODWHVW�VSHFL¿FDWLRQV�DQG�EHIRUH�SODFLQJ�\RXU�SURGXFW�RUGHU��� �&RSLHV�RI�GRFXPHQWV�ZKLFK�KDYH�DQ�RUGHU�QXPEHU�DQG�DUH�UHIHUHQFHG�LQ�WKLV�GRFXPHQW��RU�RWKHU�,QWHO�OLWHUDWXUH��PD\�EH�REWDLQHG�E\�FDOOLQJ�����������������RU�JR�WR��KWWS���ZZZ�LQWHO�FRP�GHVLJQ�OLWHUDWXUH�KWP� �,QWHO¶V�FRPSLOHUV�PD\�RU�PD\�QRW�RSWLPL]H�WR�WKH�VDPH�GHJUHH�IRU�QRQ�,QWHO�PLFURSURFHVVRUV�IRU�RSWLPL]DWLRQV�WKDW�DUH�QRW�XQLTXH�WR�,QWHO�PLFURSURFHVVRUV��7KHVH�RSWLPL]DWLRQV�LQFOXGH�66(���66(���DQG�66(��LQVWUXFWLRQ�VHWV�DQG�RWKHU�RSWLPL]DWLRQV��,QWHO�GRHV�QRW�JXDUDQWHH�WKH�DYDLODELOLW\��IXQFWLRQDOLW\��RU�HIIHFWLYHQHVV�RI�DQ\�RSWLPL]DWLRQ�RQ�PLFURSURFHVVRUV�QRW�PDQXIDFWXUHG�E\�,QWHO��

� �0LFURSURFHVVRU�GHSHQGHQW�RSWLPL]DWLRQV�LQ�WKLV�SURGXFW�DUH�LQWHQGHG�IRU�XVH�ZLWK�,QWHO�PLFURSURFHVVRUV��&HUWDLQ�RSWLPL]DWLRQV�QRW�VSHFL¿F�WR�,QWHO�PLFURDUFKLWHFWXUH�DUH�UHVHUYHG�IRU�,QWHO�PLFURSURFHVVRUV��3OHDVH�UHIHU�WR�WKH�DSSOLFDEOH�SURGXFW�8VHU�DQG�5HIHUHQFH�*XLGHV�IRU�PRUH�LQIRUPDWLRQ�UHJDUGLQJ�WKH�VSHFL¿F�LQVWUXFWLRQ�VHWV�FRYHUHG�E\�WKLV�QRWLFH�

� �1RWLFH�UHYLVLRQ����������� �,QWHO�SURFHVVRU�QXPEHUV�DUH�QRW�D�PHDVXUH�RI�SHUIRUPDQFH��3URFHVVRU�QXPEHUV�GLIIHUHQWLDWH�IHDWXUHV�ZLWKLQ�HDFK�SURFHVVRU�IDPLO\��QRW�DFURVV�GLIIHUHQW�SURFHVVRU�IDPLOLHV��*R�WR��

http://www.intel.com/content/www/us/en/processors/processor-numbers.html.

� �&RS\ULJKW��������,QWHO�&RUSRUDWLRQ��$OO�ULJKWV�UHVHUYHG��,QWHO��WKH�,QWHO�ORJR��DQG�;HRQ�DUH�WUDGHPDUNV�RI�,QWHO�Corporation in the U.S. and other countries.

� �&RS\ULJKW��������90ZDUH��,QF��$OO�ULJKWV�UHVHUYHG��90ZDUH��WKH�90ZDUH�ORJR��9LUWXDO�6$1��90ZDUH�Y6SKHUH��Y&HQWHU��+RUL]RQ�9LHZ��DQG�6LWH�5HFRYHU\�0DQDJHU�DUH�UHJLVWHUHG�WUDGHPDUNV�RU�WUDGHPDUNV�RI�90ZDUH��,QF��LQ�WKH�8QLWHG�6WDWHV�DQG�RU�RWKHU�MXULVGLFWLRQV��$OO�RWKHU�PDUNV�DQG�QDPHV�PHQWLRQHG�KHUHLQ�PD\�EH�WUDGHPDUNV�RI�their respective companies.

�� 2WKHU�QDPHV�DQG�EUDQGV�PD\�EH�FODLPHG�DV�WKH�SURSHUW\�RI�RWKHUV��� �3ULQWHG�LQ�86$����������.%�35:�3')�������������3OHDVH�5HF\FOH���������������86

Additional ResourcesIntel: www.intel.com/storage VMware: www.vsanbeta.com