LinuxONE cavemen mmit 20160505 v1.0
-
Upload
marcel-mitran -
Category
Technology
-
view
456 -
download
15
Transcript of LinuxONE cavemen mmit 20160505 v1.0
A portfolio of hardware, A portfolio of hardware, software, and services for an software, and services for an
enterprise-grade Linux operating enterprise-grade Linux operating environmentenvironment
Marcel Mitran – DE, CTO IBM [email protected]
Enterprise-grade Linux
• Freedom & Agility• Standards Based• Speed of Innovation• Developer Productivity• Community
Collaboration• Quality of Software
• Dynamic Resource Allocation• Non-Disruptive Scalability • Continuous Business
Availability• Operational Efficiency• Trusted Security• Data and Transaction Serving
The best of ENTERPRISE COMPUTING
The best of LINUX & OPEN
2
IBM LINUXONE SYSTEMS
IBM LINUXONE SOLUTIONS
CloudCloud DevOpsDevOps
IBM LinuxONE Community CloudIBM LinuxONE Community Cloud
Open Mainframe ProjectOpen Mainframe Project
Open Source ContributionOpen Source ContributionMobileMobile AnalyticsAnalytics
IBM LinuxONE Elastic PricingIBM LinuxONE Elastic Pricing
IBM LinuxONE Announcements - August 2015
3
Ubuntu on LinuxONE Systems makes it easy to build, model, deploy and manage Enterprise scale out clusters and scalable cloud architectures
CloudFully supported, scalable cloud services based on OpenStack
technologies
Ecosystem developmentCommunity engagement with emerging generation of agile
developers
Target WorkloadsOptimized for leading open
source, data centric scale out workloads – web commerce,
database, NoSQL, analytics, etc. Connect systems of record to
systems of engagement.
Juju based automationAutomated deployment,
management and scaling of next generation workloads
Secure Scalable Clouds
Easy Application
Migration
Diverse Ecosystem
#1 Linux for Cloud and Scale-out
Why Ubuntu OS and Ubuntu OpenStack on LinuxONE?
Providing Significant Time to Value Advantage
4
LinuxONE Elastic PricingOn Premise Cloud Modelwhat you pay depends on what you use for your LinuxONE Deployment
Move from CapEx to OpEXas deployment models change LinuxONE has adapted to the shift
SimpleSimplified monthly or quarterly billing based on your usage
Low barrier to entry
Reduces risk of entry and cost of acquisition by as much as 75%
MeteredBased on real usage data ...
5
6
Current Members
Open Mainframe ProjectCreate an open source, technical community that industry and community participants may easily participate in and so that they may contribute to the creation of assets and materials that will benefit the development of Enterprise Grade characteristics of Linux such as:
– High Availability and Disaster Recovery– Security
– Reliability, Availability and Serviceability
– Performance and Scalability
LinuxONE – Diagonal Scale
Extreme Virtualization and Scale• Hypervisor partitioning built into firmware
• Complete isolation – EAL5+• Supports as many as 85 hypervisor instances – z/VM or KVM
• 1k Linux guests/hypervisor• +1 million docker containers
• Hypervisor communication is via fast, in-memory TCP/IP • Hipersockets or Shared-OSA – 3x less latency than discrete servers
• Massive dedicated I/O – 640 power co-processors• 960Meg L4 cache, 5Ghz core, dual-TLBs, crypto acceleration
Super Elastic System• Combine horizontal and vertical scaling• Non-disruptively add/remove resources from Linux guests• Non-disruptively add/remove Linux guests
Compose high-performance scalable applications. Dynamically and seamlessly re-allocate resources between guests. Provide right-time analytics and powerful engagement
HWHiperSocket LAN / Shared OSA
Linux guest
Docker Docker Docker Docker
…
7
LPAR1 LPAR2
A single LinuxONE Emperor ran more than 1 Million Docker containersWorkload: busybox httpd server (no NAT)
LinuxONE Emperor runs 2000+ Docker containers on avg 2.0x better than a compared Haswell-based systemWorkload: Apache Solr
LinuxONE Emperor can host over 10k Docker containersWorkload: 4k Apache Solr + 6k busybox httpd server (no NAT)
Extreme Virtualization with Docker®!
Docker is a registered trademarks of Docker, Inc. in the United States and/or other countries
Disclaimer:This claim is based on results from internal lab measurements. Performance results may vary depending on the workload and other factors.Benchmark: oApache Solr search queries driven by Apache Jmeter*System Stack:oLinuxONE Emperor (IBM z13): Native LPAR on 36 CPU cores with 755GB memory oHaswell-based alternative system (Lenovo System x3650 M5 w/ E5-2699 v3 processors): Native Linux on 36 CPU cores with 755GB memory oHeavy Docker Container: Apache Solr v4.10.0, WebSphere Liberty v8.5.5.2, IBM Java 1.8.0 SR1oLightweight Docker Container: BusyBoxoSystem SW: Docker 1.10.0-dev** w/ aufs storage backend, RHEL 7.1***
Note:•Each active container is driven by a client thread in Apache Jmeter, which keeps sending the same Solr query repeatedly to the container to search documents that contain given key words in a pre-loaded & pre-indexed 46GB Wikipedia snapshot. ** The docker runtime was modified to increase a thread count limit, to avoid connection time-out, and to separate a dockerinit binary from a docker binary.*** A modified Linux 4.3.0 kernel to support more than 1024 network bridge ports was installed on RHEL 7.1.
LinuxONE is designed for large, cache-intensive business workloads
9
LinuxONE also has 960 MB
per drawer off-chip L4 cache
Haswell chipE5 2600 V3
(representation)
Core0
Core1
Core2
Core3
Core4
Core5
Core6
Core7
Shared L3
Cache
LinuxONE chip(representation)
Latency introduced by
(1) hop across multiple L3 rings, and (2) CPU-to-L3 frequency differences
Latency is minimized – all cores have equal access to L3, no frequency boundaries
http://www.anandtech.com/show/6355/intels-haswell-architecture/10http://www.anandtech.com/show/8423/intel-xeon-e5-version-3-up-to-18-haswell-ep-cores-/4
Core
Shared L3
cache
Shared L3
cache
Core
CoreCoreCore
Core Core Core
CoreCoreCore
CoreCore
CoreCore
CoreCoreCore
LinuxONE is designed for high I/O bandwidth business workloads
10
Up to 141 cores for business logic
Up to 320 I/O channel processors –
each with 2 POWER cores(160 PCIe slots)
Up to 24 cores dedicated to I/O
processing
LinuxONE
HP BL460c Gen9
24 cores for both business and I/O
processing
ZERO I/O cores
4 I/O channel processors
(2 PCIe slots)
10-40% of typical business applications processing is estimated to be I/O processing*
Only LinuxONE has specialty cores dedicated to I/O processing
LinuxONE has about 80x more I/O channel processors than typical scale-out servers
3 Oracle RAC clusters4 server nodes per cluster
12 total HP DL380 servers E5-2699v3 2.3GHz 2ch/36co (432 cores)
Oracle DBworkload
Which platform provides the lowest TCA over 3 years?
$13.5M (3 yr. TCA)
$29.3M (3 yr. TCA)
TCA includes hardware, software, maintenance, support and subscription.Workload Equivalence derived from a proof-of-concept study conducted at a large Cooperative Bank.
3 Oracle RAC clusters4 nodes per cluster
Each node is a Linux guestLinuxONE with 61 cores
Customer Database Workloads each supporting
18.3K tps Oracle Enterprise EditionOracle Real Application
Cluster
Database workloads with high I/O bandwidth requirements benefit from LinuxONE architecture
11
Lower cost54%
2x Better Data-Serving with LinuxONE
MariaDB 10.1.5
1.8x to 2.1x throughput improvement on Sysbench Benchmark
PostgreSQL 9.4
1.6x to 2.2x throughput improvement on pgBench Benchmark
1.9x to 2.1x throughput improvement on YCSB Benchmark
Cloudant DBaaS
MongoDB 3.0.4 (WiredTiger, no sharding)
1.9x to 2.1x throughput improvement on YCSB Benchmark
12
Scaling-up with MongoDB on LinuxONE
Single MongoDB node on LinuxONE scales up to 2TBs with sustained
throughput and response time <5ms, while supporting
+4 Billion documents, 460,000 reads+writes/second, with no sharding required!
“We are committed to make MongoDB available on all major platforms and are excited to add support for IBM LinuxONE Enterprise Grade Linux and LinuxONE Platform. This announcement is a leap forward for customers who want to deploy modern, mission-critical applications built with MongoDB and take advantage of the performance, scalability and security of IBM’s LinuxONE platform hardware products.”--- Eliot Horowitz CTO & Founder, MongoDB
13
Scaling-out with Node.js on LinuxONE
Node.js v0.12http://www.ibm.com/developerworks/web/nodesdk
High Performance JavaScript for LinuxONE•Highly scalable, event-driven platform with non-blocking I/O•Thousands of concurrent connections with minimal overhead•Up to 2.1x more RESTful web interactions with AcmeAir in node.js
“LinuxONE can scale to up to 30B RESTful web interactions/day with Dockerized Node.js and MongoDB, driving over 470K database read and writes per second, while maintaining response-times that are 2x better than alternative platforms.”
14
SOR+SOI+SOE-in-a-Box with LinuxONE
Co-located SOR, SOI, and SOE for right-time insights and powerfull engagement TPC-E Database Aggregation Query
14
Mill
ion
Row
s/M
inut
e
# Spark Partitions
12
10
8
6
4
2
01 2 4
3.1x2.3x
1.9x
LinuxONE x86
Co-locating Node.js on LinuxONE vs. x86 results in
60% Faster Response Time 2.5x better Throughput
Apache Spark co-located on LinuxONE drove up to 3x faster than Spark running
off- platform on x86
WebSphereApp Server
Business LogicPersistent Layer DB2
Twitter SOE
SOR
15
256 variable workloads
Average server utilization = 77%
Utiliz
atio
n
Time
Statistical models show how consolidating workloads drives up CPU utilization
16
6x Peak-to-average
Average server utilization = 17%
1 variable workloadUt
ilizat
ion
Time
1.3x Peak-to-average
Service-level-guarantees require provisioning for peak utilization But costs are inversely proportional to average utilization Consolidation leads to higher average utilization levels and lower
cost/workload
Performance comparison based on IBM Internal tests comparing IBM LinuxONE private cloud with one comparably configured private x86 cloud running an aggregation of light, medium and heavy workloads designed to replicate typical IBM customer workload usage in the marketplace. System configurations are based on equivalence ratios derived from IBM internal studies. Price comparison estimates based on a 3yr Total Cost of Ownership (TCO) using publicly available U.S. prices (including a 20% discount for middleware) current as of January 1, 2015. LinuxONE and x86 TCO estimates include costs of infrastructure (system, memory, storage, virtualization, OS, cloud management), middleware, power, floor space and labor. Results may vary based on actual workloads, system configurations, customer applications, queries and other variables in a production environment and may produce different results. Users of this document should verify the applicable data for their specific environment.
Variable workloads consolidated on LinuxONE have lower TCO
17
32 cores
$7.2M (3yr TCO)
264 x86 cores$10.6M (3yr TCO)
32% Lower TCO*
*estimated
123 workloads(219 VMs)
32 medium workloads – 77 tps; 4GB RAM & 20GB
storage per VM(64 VMs)
27 heavy I/O workloads –
255 tps; 122GB RAM & 540GB storage per VM
(27 VMs)
64 light workloads – 14 tps; 2GB RAM &
20GB storage per VM(128 VMs)
LinuxONE with 32 cores, 3,806 GB memory, and Storwize v7000 with 47x400 GB SSDs.
11 x86 servers, each with 24 Intel E7-8857 v2 3.0 GHz cores, 512 GB memory, and 7x400 GB SSDs
I/O intensivedatabase
Oracle
Web Application
WAS DB2
Web Application
WAS DB2
A breakdown of TCO shows how software costs soar on the x86 platform
18
For LinuxONE, 78% fewer cores results in
72% lower middleware costs
In x86 environments, high priority workloads must have dedicated servers…
19
Consolidation ratios derived from IBM internal studies. LinuxONE numbers derived from measurements on similar server. Workloads running WebSphere 8.5 ND, DB210 AESE, and Monitoring software. Results may vary based on customer workload profiles/characteristics. Prices will vary by country.
Virtualized on 3Intel 40-core servers
(120 cores total - Linux)
32 cores on LinuxONE
$13.7M (3 yr. TCA)
$5.77M (3 yr. TCA)
High priority workloads
Low priority workloads
High priority online banking workloads driving a total of 9.1M transactions
per hour and low priority discretionary workloads driving 2.8M transactions
per hour LinuxHypervisor
LinuxHypervisor
High priority
workloads
High priority
workloads
High priority
workloads
Low priority
workloads
Low priority
workloads
Lower cost58%
…to avoid the effects of ‘noisy neighbors’ – causes increased proliferation of x86 servers
LinuxONE is designed to ensure highest availability and lowest downtime
20
Comprehensive, multi-layered strategy
includes…
Error PreventionHardware and firmware designed to protect against outages
Built-in redundancy eliminates single points of failure
Extensive testing and failure analysis at every level
Error Detectionand Correction
Error detection embedded in components
Built-in automated diagnostics; problem determination and isolation
Non-disruptive installation, upgrades and maintenance avoids outages
Error RecoveryAutomated failover to speed recovery and minimize system impact
Business continuity and disaster recovery solutions – GDPS, HyperDispatch, Call Home, etc.
LinuxONE is designed for minimal unplanned downtime
21Source: ITIC 2015 - 2016 Global Server Hardware, Server OS Reliability Survey
Source: IDC 2015
Unplanned Downtime of >four (4) hours on each server hardware platform (2015)
ITIC survey shows IBM LinuxONE had no – 0% – unplanned system downtime due to inherent flaws in hardware
89%
Unplanned downtime
instances per year
45% 94%
Time to resolve unplanned downtime
Productivity hours lost per year per user
Recent IDC study concludes clients who leverage LinuxONE can virtually eliminate lost productivity caused by downtime
Core0
Core1
Core2
Core3
Core4
Core5
Core6
Core7
Shared L3
Cache
Core0
Core1
Core2
Core3
Core4
Core5
Core6
Core7
Shared L3
Cache
If a core fails, a spare can be “turned on” without system or program interruption
22
• Each LinuxONE server has two cores designated as spare• Core failover (called sparing) is transparent to applications• Spares need not be local to the same chip, node or drawer• Any core can failover to a spare
x86 servers do not have core
sparing
Achieve 100% continuous availability
23
• Applications restarted in another site when disaster event occurs
• Single point of control and automation, reliable and rapid recovery
• Keeps data available and consistent• Protects against disk subsystem failures
Geographically Dispersed Parallel Sysplex – A fully integrated software solution providing continuous availability / disaster recovery for LinuxONE virtual machines
Recover from outages in 6 seconds instead of 2+ hours
GDPS Virtual Appliance requires LinuxONE/VM and the HyperSwap functionality.HyperSwap is not currently available for bare partitions or for KVM on LinuxONE
Advanced cryptography is handled at multiple levels depending on business requirements
24
• Each core has its own cryptographic co-processor
– Optimized for encryption functions• Crypto Express5S PCIe card (optional)
adds additional crypto capability– Elliptic Curve, SHA3, Visa FPE, etc.
• Meets FIPS, ANSI, PKI, and DK standards
On-chip cryptography
Optional Crypto Express5S for additional advanced cryptography features
Top to bottom security is built in, not bolted on
25
Enables application and database security without modifying applications
Reduces security complexity and expense:• Central security process that is
easy to apply to new workloads or as user base increases
• Tracks activity to address audit and compliance requirementsHardware
Architecture
LinuxONE/VM
Networks
Data & Applications
Administration
RA
CF
Resource Access Control Facility (RACF) is the backbone of LinuxONE securityAccess control to all classes of resourcesIntegrated into LinuxONE/VMSupports cryptographic servicesSupports digital certificates
Average security incursion costs on LinuxONE are much lower than other platforms
26
Customer surveys show LinuxONE average incursion costs are a fraction
of distributed platforms
Source: “Tracked, Hacked and Attacked?” © 2013, Solitaire Interglobal Ltd.
LinuxONE
Comprehensive Security: Only LinuxONE natively covers multiple dimensions of security; other platforms require augmentation and additional expense (Solitaire)
…You’re running very large I/O- or cache-intensive workloads like database applications or transaction processing
…Your insights and engagement are time-sensitive
…You’re looking to consolidate large numbers of servers
…Your software license costs are unsustainable
…Even the smallest system failure is unacceptable
…A security breach would be catastrophic to your business
…You’re looking to reduce overall operational expenses
IBM LinuxONE is a better choice if…
Thank YouMarcel Mitran – CTO IBM [email protected]