LinuxONE cavemen mmit 20160505 v1.0

28
A portfolio of hardware, A portfolio of hardware, software, and services for software, and services for an enterprise-grade Linux an enterprise-grade Linux operating environment operating environment Marcel Mitran – DE, CTO IBM LinuxONE [email protected]

Transcript of LinuxONE cavemen mmit 20160505 v1.0

Page 1: LinuxONE cavemen mmit 20160505 v1.0

A portfolio of hardware, A portfolio of hardware, software, and services for an software, and services for an

enterprise-grade Linux operating enterprise-grade Linux operating environmentenvironment

Marcel Mitran – DE, CTO IBM [email protected]

Page 2: LinuxONE cavemen mmit 20160505 v1.0

Enterprise-grade Linux

• Freedom & Agility• Standards Based• Speed of Innovation• Developer Productivity• Community

Collaboration• Quality of Software

• Dynamic Resource Allocation• Non-Disruptive Scalability • Continuous Business

Availability• Operational Efficiency• Trusted Security• Data and Transaction Serving

The best of ENTERPRISE COMPUTING

The best of LINUX & OPEN

2

Page 3: LinuxONE cavemen mmit 20160505 v1.0

IBM LINUXONE SYSTEMS

IBM LINUXONE SOLUTIONS

CloudCloud DevOpsDevOps

IBM LinuxONE Community CloudIBM LinuxONE Community Cloud

Open Mainframe ProjectOpen Mainframe Project

Open Source ContributionOpen Source ContributionMobileMobile AnalyticsAnalytics

IBM LinuxONE Elastic PricingIBM LinuxONE Elastic Pricing

IBM LinuxONE Announcements - August 2015

3

Page 4: LinuxONE cavemen mmit 20160505 v1.0

Ubuntu on LinuxONE Systems makes it easy to build, model, deploy and manage Enterprise scale out clusters and scalable cloud architectures

CloudFully supported, scalable cloud services based on OpenStack

technologies

Ecosystem developmentCommunity engagement with emerging generation of agile

developers

Target WorkloadsOptimized for leading open

source, data centric scale out workloads – web commerce,

database, NoSQL, analytics, etc. Connect systems of record to

systems of engagement.

Juju based automationAutomated deployment,

management and scaling of next generation workloads

Secure Scalable Clouds

Easy Application

Migration

Diverse Ecosystem

#1 Linux for Cloud and Scale-out

Why Ubuntu OS and Ubuntu OpenStack on LinuxONE?

Providing Significant Time to Value Advantage

4

Page 5: LinuxONE cavemen mmit 20160505 v1.0

LinuxONE Elastic PricingOn Premise Cloud Modelwhat you pay depends on what you use for your LinuxONE Deployment

Move from CapEx to OpEXas deployment models change LinuxONE has adapted to the shift

SimpleSimplified monthly or quarterly billing based on your usage

Low barrier to entry

Reduces risk of entry and cost of acquisition by as much as 75%

MeteredBased on real usage data ...

5

Page 6: LinuxONE cavemen mmit 20160505 v1.0

6

Current Members

Open Mainframe ProjectCreate an open source, technical community that industry and community participants may easily participate in and so that they may contribute to the creation of assets and materials that will benefit the development of Enterprise Grade characteristics of Linux such as:

– High Availability and Disaster Recovery– Security

– Reliability, Availability and Serviceability

– Performance and Scalability

Page 7: LinuxONE cavemen mmit 20160505 v1.0

LinuxONE – Diagonal Scale

Extreme Virtualization and Scale• Hypervisor partitioning built into firmware

• Complete isolation – EAL5+• Supports as many as 85 hypervisor instances – z/VM or KVM

• 1k Linux guests/hypervisor• +1 million docker containers

• Hypervisor communication is via fast, in-memory TCP/IP • Hipersockets or Shared-OSA – 3x less latency than discrete servers

• Massive dedicated I/O – 640 power co-processors• 960Meg L4 cache, 5Ghz core, dual-TLBs, crypto acceleration

Super Elastic System• Combine horizontal and vertical scaling• Non-disruptively add/remove resources from Linux guests• Non-disruptively add/remove Linux guests

Compose high-performance scalable applications. Dynamically and seamlessly re-allocate resources between guests. Provide right-time analytics and powerful engagement

HWHiperSocket LAN / Shared OSA

Linux guest

Docker Docker Docker Docker

7

LPAR1 LPAR2

Page 8: LinuxONE cavemen mmit 20160505 v1.0

A single LinuxONE Emperor ran more than 1 Million Docker containersWorkload: busybox httpd server (no NAT)

LinuxONE Emperor runs 2000+ Docker containers on avg 2.0x better than a compared Haswell-based systemWorkload: Apache Solr

LinuxONE Emperor can host over 10k Docker containersWorkload: 4k Apache Solr + 6k busybox httpd server (no NAT)

Extreme Virtualization with Docker®!

Docker is a registered trademarks of Docker, Inc. in the United States and/or other countries

Disclaimer:This claim is based on results from internal lab measurements. Performance results may vary depending on the workload and other factors.Benchmark: oApache Solr search queries driven by Apache Jmeter*System Stack:oLinuxONE Emperor (IBM z13): Native LPAR on 36 CPU cores with 755GB memory oHaswell-based alternative system (Lenovo System x3650 M5 w/ E5-2699 v3 processors): Native Linux on 36 CPU cores with 755GB memory oHeavy Docker Container: Apache Solr v4.10.0, WebSphere Liberty v8.5.5.2, IBM Java 1.8.0 SR1oLightweight Docker Container: BusyBoxoSystem SW: Docker 1.10.0-dev** w/ aufs storage backend, RHEL 7.1***

Note:•Each active container is driven by a client thread in Apache Jmeter, which keeps sending the same Solr query repeatedly to the container to search documents that contain given key words in a pre-loaded & pre-indexed 46GB Wikipedia snapshot. ** The docker runtime was modified to increase a thread count limit, to avoid connection time-out, and to separate a dockerinit binary from a docker binary.*** A modified Linux 4.3.0 kernel to support more than 1024 network bridge ports was installed on RHEL 7.1.

Page 9: LinuxONE cavemen mmit 20160505 v1.0

LinuxONE is designed for large, cache-intensive business workloads

9

LinuxONE also has 960 MB

per drawer off-chip L4 cache

Haswell chipE5 2600 V3

(representation)

Core0

Core1

Core2

Core3

Core4

Core5

Core6

Core7

Shared L3

Cache

LinuxONE chip(representation)

Latency introduced by

(1) hop across multiple L3 rings, and (2) CPU-to-L3 frequency differences

Latency is minimized – all cores have equal access to L3, no frequency boundaries

http://www.anandtech.com/show/6355/intels-haswell-architecture/10http://www.anandtech.com/show/8423/intel-xeon-e5-version-3-up-to-18-haswell-ep-cores-/4

Core

Shared L3

cache

Shared L3

cache

Core

CoreCoreCore

Core Core Core

CoreCoreCore

CoreCore

CoreCore

CoreCoreCore

Page 10: LinuxONE cavemen mmit 20160505 v1.0

LinuxONE is designed for high I/O bandwidth business workloads

10

Up to 141 cores for business logic

Up to 320 I/O channel processors –

each with 2 POWER cores(160 PCIe slots)

Up to 24 cores dedicated to I/O

processing

LinuxONE

HP BL460c Gen9

24 cores for both business and I/O

processing

ZERO I/O cores

4 I/O channel processors

(2 PCIe slots)

10-40% of typical business applications processing is estimated to be I/O processing*

Only LinuxONE has specialty cores dedicated to I/O processing

LinuxONE has about 80x more I/O channel processors than typical scale-out servers

Page 11: LinuxONE cavemen mmit 20160505 v1.0

3 Oracle RAC clusters4 server nodes per cluster

12 total HP DL380 servers E5-2699v3 2.3GHz 2ch/36co (432 cores)

Oracle DBworkload

Which platform provides the lowest TCA over 3 years?

$13.5M (3 yr. TCA)

$29.3M (3 yr. TCA)

TCA includes hardware, software, maintenance, support and subscription.Workload Equivalence derived from a proof-of-concept study conducted at a large Cooperative Bank.

3 Oracle RAC clusters4 nodes per cluster

Each node is a Linux guestLinuxONE with 61 cores

Customer Database Workloads each supporting

18.3K tps Oracle Enterprise EditionOracle Real Application

Cluster

Database workloads with high I/O bandwidth requirements benefit from LinuxONE architecture

11

Lower cost54%

Page 12: LinuxONE cavemen mmit 20160505 v1.0

2x Better Data-Serving with LinuxONE

MariaDB 10.1.5

1.8x to 2.1x throughput improvement on Sysbench Benchmark

PostgreSQL 9.4

1.6x to 2.2x throughput improvement on pgBench Benchmark

1.9x to 2.1x throughput improvement on YCSB Benchmark

Cloudant DBaaS

MongoDB 3.0.4 (WiredTiger, no sharding)

1.9x to 2.1x throughput improvement on YCSB Benchmark

12

Page 13: LinuxONE cavemen mmit 20160505 v1.0

Scaling-up with MongoDB on LinuxONE

Single MongoDB node on LinuxONE scales up to 2TBs with sustained

throughput and response time <5ms, while supporting

+4 Billion documents, 460,000 reads+writes/second, with no sharding required!

“We are committed to make MongoDB available on all major platforms and are excited to add support for IBM LinuxONE Enterprise Grade Linux and LinuxONE Platform. This announcement is a leap forward for customers who want to deploy modern, mission-critical applications built with MongoDB and take advantage of the performance, scalability and security of IBM’s LinuxONE platform hardware products.”--- Eliot Horowitz CTO & Founder, MongoDB

13

Page 14: LinuxONE cavemen mmit 20160505 v1.0

Scaling-out with Node.js on LinuxONE

Node.js v0.12http://www.ibm.com/developerworks/web/nodesdk

High Performance JavaScript for LinuxONE•Highly scalable, event-driven platform with non-blocking I/O•Thousands of concurrent connections with minimal overhead•Up to 2.1x more RESTful web interactions with AcmeAir in node.js

“LinuxONE can scale to up to 30B RESTful web interactions/day with Dockerized Node.js and MongoDB, driving over 470K database read and writes per second, while maintaining response-times that are 2x better than alternative platforms.”

14

Page 15: LinuxONE cavemen mmit 20160505 v1.0

SOR+SOI+SOE-in-a-Box with LinuxONE

Co-located SOR, SOI, and SOE for right-time insights and powerfull engagement TPC-E Database Aggregation Query

14

Mill

ion

Row

s/M

inut

e

# Spark Partitions

12

10

8

6

4

2

01 2 4

3.1x2.3x

1.9x

LinuxONE x86

Co-locating Node.js on LinuxONE vs. x86 results in

60% Faster Response Time 2.5x better Throughput

Apache Spark co-located on LinuxONE drove up to 3x faster than Spark running

off- platform on x86

WebSphereApp Server

Business LogicPersistent Layer DB2

Twitter SOE

SOR

15

Page 16: LinuxONE cavemen mmit 20160505 v1.0

256 variable workloads

Average server utilization = 77%

Utiliz

atio

n

Time

Statistical models show how consolidating workloads drives up CPU utilization

16

6x Peak-to-average

Average server utilization = 17%

1 variable workloadUt

ilizat

ion

Time

1.3x Peak-to-average

Service-level-guarantees require provisioning for peak utilization But costs are inversely proportional to average utilization Consolidation leads to higher average utilization levels and lower

cost/workload

Page 17: LinuxONE cavemen mmit 20160505 v1.0

Performance comparison based on IBM Internal tests comparing IBM LinuxONE private cloud with one comparably configured private x86 cloud running an aggregation of light, medium and heavy workloads designed to replicate typical IBM customer workload usage in the marketplace.  System configurations are based on equivalence ratios derived from IBM internal studies. Price comparison estimates based on a 3yr Total Cost of Ownership (TCO) using publicly available U.S. prices (including a 20% discount for middleware) current as of January 1, 2015. LinuxONE and x86 TCO estimates include costs of infrastructure (system, memory, storage, virtualization, OS, cloud management), middleware, power, floor space and labor. Results may vary based on actual workloads, system configurations, customer applications, queries and other variables in a production environment and may produce different results. Users of this document should verify the applicable data for their specific environment. 

Variable workloads consolidated on LinuxONE have lower TCO

17

32 cores

$7.2M (3yr TCO)

264 x86 cores$10.6M (3yr TCO)

32% Lower TCO*

*estimated

123 workloads(219 VMs)

32 medium workloads – 77 tps; 4GB RAM & 20GB

storage per VM(64 VMs)

27 heavy I/O workloads –

255 tps; 122GB RAM & 540GB storage per VM

(27 VMs)

64 light workloads – 14 tps; 2GB RAM &

20GB storage per VM(128 VMs)

LinuxONE with 32 cores, 3,806 GB memory, and Storwize v7000 with 47x400 GB SSDs.

11 x86 servers, each with 24 Intel E7-8857 v2 3.0 GHz cores, 512 GB memory, and 7x400 GB SSDs

I/O intensivedatabase

Oracle

Web Application

WAS DB2

Web Application

WAS DB2

Page 18: LinuxONE cavemen mmit 20160505 v1.0

A breakdown of TCO shows how software costs soar on the x86 platform

18

For LinuxONE, 78% fewer cores results in

72% lower middleware costs

Page 19: LinuxONE cavemen mmit 20160505 v1.0

In x86 environments, high priority workloads must have dedicated servers…

19

Consolidation ratios derived from IBM internal studies. LinuxONE numbers derived from measurements on similar server. Workloads running WebSphere 8.5 ND, DB210 AESE, and Monitoring software. Results may vary based on customer workload profiles/characteristics. Prices will vary by country.

Virtualized on 3Intel 40-core servers

(120 cores total - Linux)

32 cores on LinuxONE

$13.7M (3 yr. TCA)

$5.77M (3 yr. TCA)

High priority workloads

Low priority workloads

High priority online banking workloads driving a total of 9.1M transactions

per hour and low priority discretionary workloads driving 2.8M transactions

per hour LinuxHypervisor

LinuxHypervisor

High priority

workloads

High priority

workloads

High priority

workloads

Low priority

workloads

Low priority

workloads

Lower cost58%

…to avoid the effects of ‘noisy neighbors’ – causes increased proliferation of x86 servers

Page 20: LinuxONE cavemen mmit 20160505 v1.0

LinuxONE is designed to ensure highest availability and lowest downtime

20

Comprehensive, multi-layered strategy

includes…

Error PreventionHardware and firmware designed to protect against outages

Built-in redundancy eliminates single points of failure

Extensive testing and failure analysis at every level

Error Detectionand Correction

Error detection embedded in components

Built-in automated diagnostics; problem determination and isolation

Non-disruptive installation, upgrades and maintenance avoids outages

Error RecoveryAutomated failover to speed recovery and minimize system impact

Business continuity and disaster recovery solutions – GDPS, HyperDispatch, Call Home, etc.

Page 21: LinuxONE cavemen mmit 20160505 v1.0

LinuxONE is designed for minimal unplanned downtime

21Source: ITIC 2015 - 2016 Global Server Hardware, Server OS Reliability Survey

Source: IDC 2015

Unplanned Downtime of >four (4) hours on each server hardware platform (2015)

ITIC survey shows IBM LinuxONE had no – 0% – unplanned system downtime due to inherent flaws in hardware

89%

Unplanned downtime

instances per year

45% 94%

Time to resolve unplanned downtime

Productivity hours lost per year per user

Recent IDC study concludes clients who leverage LinuxONE can virtually eliminate lost productivity caused by downtime

Page 22: LinuxONE cavemen mmit 20160505 v1.0

Core0

Core1

Core2

Core3

Core4

Core5

Core6

Core7

Shared L3

Cache

Core0

Core1

Core2

Core3

Core4

Core5

Core6

Core7

Shared L3

Cache

If a core fails, a spare can be “turned on” without system or program interruption

22

• Each LinuxONE server has two cores designated as spare• Core failover (called sparing) is transparent to applications• Spares need not be local to the same chip, node or drawer• Any core can failover to a spare

x86 servers do not have core

sparing

Page 23: LinuxONE cavemen mmit 20160505 v1.0

Achieve 100% continuous availability

23

• Applications restarted in another site when disaster event occurs

• Single point of control and automation, reliable and rapid recovery

• Keeps data available and consistent• Protects against disk subsystem failures

Geographically Dispersed Parallel Sysplex – A fully integrated software solution providing continuous availability / disaster recovery for LinuxONE virtual machines

Recover from outages in 6 seconds instead of 2+ hours

GDPS Virtual Appliance requires LinuxONE/VM and the HyperSwap functionality.HyperSwap is not currently available for bare partitions or for KVM on LinuxONE

Page 24: LinuxONE cavemen mmit 20160505 v1.0

Advanced cryptography is handled at multiple levels depending on business requirements

24

• Each core has its own cryptographic co-processor

– Optimized for encryption functions• Crypto Express5S PCIe card (optional)

adds additional crypto capability– Elliptic Curve, SHA3, Visa FPE, etc.

• Meets FIPS, ANSI, PKI, and DK standards

On-chip cryptography

Optional Crypto Express5S for additional advanced cryptography features

Page 25: LinuxONE cavemen mmit 20160505 v1.0

Top to bottom security is built in, not bolted on

25

Enables application and database security without modifying applications

Reduces security complexity and expense:• Central security process that is

easy to apply to new workloads or as user base increases

• Tracks activity to address audit and compliance requirementsHardware

Architecture

LinuxONE/VM

Networks

Data & Applications

Administration

RA

CF

Resource Access Control Facility (RACF) is the backbone of LinuxONE securityAccess control to all classes of resourcesIntegrated into LinuxONE/VMSupports cryptographic servicesSupports digital certificates

Page 26: LinuxONE cavemen mmit 20160505 v1.0

Average security incursion costs on LinuxONE are much lower than other platforms

26

Customer surveys show LinuxONE average incursion costs are a fraction

of distributed platforms

Source: “Tracked, Hacked and Attacked?” © 2013, Solitaire Interglobal Ltd.

LinuxONE

Comprehensive Security: Only LinuxONE natively covers multiple dimensions of security; other platforms require augmentation and additional expense (Solitaire)

Page 27: LinuxONE cavemen mmit 20160505 v1.0

…You’re running very large I/O- or cache-intensive workloads like database applications or transaction processing

…Your insights and engagement are time-sensitive

…You’re looking to consolidate large numbers of servers

…Your software license costs are unsustainable

…Even the smallest system failure is unacceptable

…A security breach would be catastrophic to your business

…You’re looking to reduce overall operational expenses

IBM LinuxONE is a better choice if…

Page 28: LinuxONE cavemen mmit 20160505 v1.0

Thank YouMarcel Mitran – CTO IBM [email protected]