Si so product 1 day technical
-
Upload
bjorn-hell-larsen -
Category
Technology
-
view
103 -
download
1
description
Transcript of Si so product 1 day technical
© 2009 VMware Inc. All rights reserved
vFabric SI/SO RoadShow
vFabric Platform Deep Dive
April 18th, 2011
2
Session Roadmap
VMware’sIT as a Service
Vision
VMware vFabricCombines Spring framework and
tools with vFabric platform services to speed delivery of next-generation apps that are instantly
scalable and cloud-portable
Cloud Application
PlatformKey Drivers
3
3
vFabric
vCloudInfrastructure
End UserComputing
VMware Solutions for Cloud Computing
4
Transitioning from the Old to the New
Traditional IT
PaaS Pool
New IT - PaaS
Java
Web Servers/Load Balancers
App Servers
Cache Servers Messaging
Database
Problems:
1. Time
2. Cost
3. Static
Build:
Spring
• Portable
• Productive
Google AE
Google AE
VMForceVMForce
Public
Public/Hybrid
IaaS – vSphere/vCD
+ Blueprint
Provides:
1. Self-Service
2. Optimization of Resources
3. Dynamic
5
Users are booking rooms
Use Case: App Intelligence for “Just-in-Time” Infrastructure
PST 8 am 9 am 10 am 11 am 12 pm 1 pm 2 pm 3 pm 4 pm 5 pm
Policy-based Capacity
Traffic
Hotel room promotioncomes online
Hotel room promotion ends
6
VMware vFabric Cloud Application Platform
Application Infrastructure for the Cloud Generation
Virtual Datacenter Cloud Infrastructure and Management
Modern Frameworks and Tools
Modern Platform Services
Developer Productivity and Application
Portability
Optimized Runtime and Accelerated
Deployment Platform Services
vFabric
Frameworks and Tools
7
Spring Is Java Developers’ Choice
A majority of [enterprise Java] users interviewed by Forrester use Spring”“
Source: Indeed.com Job Trends, Feb 2010
At least 2 million Java developers have some level of proficiency
with Spring Core, and this represents at least 50% of enterprise Java developers”
“
Half say the adoption of Spring has reduced the time to complete a project
by more than 25%, and one in four have reduced the time by over 50% ”“
Spring
Websphere
WebLogic
8
8
Innovation Reigns Supreme
Web
Batch
Integration
SecuritySocial Media
Cloud Platform Services
Mobile
9
Spring Ref Arch: Robust Web 2.0 Applications Built for Scaletc
Ser
ver
REST / MVC
Plugin
GORMRabbitMQ
Plugin
Web Application Server
Application Requests
X
X
RPC Broker
tc S
erve
r
App
Controller
Application Responses
HQ Agent
Web Application Server
App Cache
Management Server
tc S
erve
r
Website
AnalyticsHQ Server
Data Cache Server
Gra
ils
HQ Agent
Sp
rin
g
File Systems
RDBMS
Other Data
Systems
Social &
Web Services
Mobile &
Security
Data
Cache
tc S
erve
r
10
Spring Ref Arch: Enterprise Integration in the Cloud
Application Events
X
X
RPC Broker
tc S
erve
r
Application Events
HQ Agent
Application Server
App Cache
Management Server
tc S
erve
r
Bus Trans
MonitoringHQ Server
tc S
erve
r
Application Server
App Cache
HQ Agent
Sp
rin
g
Sp
rin
g
SI FlowSI Flow
Data Cache Server
File Systems
RDBMS
Other Data
Systems
Data
Cache
tc S
erve
r
11
Spring Ref Arch: Distributed Partitioned Batch Processing
Scheduler
Launch
Script
tc S
erve
r
Batch
Admin
Controller
App
Controller
Partition
HandlerAggregator
Batch Server
Partition Requests
X
X
RPC Broker
tc S
erve
r
Batch
Admin
Controller
App
Controller
Partition Responses
HQ Agent HQ Agent
Batch Server
App Cache Partition
Management Server
tc S
erve
r
Batch
AdminHQ Server
Sp
rin
g
Sp
rin
g
Data Cache Server
File Systems
RDBMS
Other Data
Systems
Data
Cache
tc S
erve
r
12
VMware vFabric Cloud Application Platform
Application Infrastructure for the Cloud Generation
Virtual Datacenter Cloud Infrastructure and Management
Modern Frameworks and Tools
Modern Platform Services
Developer Productivity and Application
Portability
Optimized Runtime and Accelerated
Deployment Platform Services
vFabric
Frameworks and Tools
13
Is a New Style of Infrastructure Needed?
Developers & Architects
And… IT Operations
We need a platform that can Run these
new apps.
Dynamic Load Balancing
Performance Management
Policy Driven Automation
Elastic App Server
Global Data Management
Cloud Messaging
14
Tomcat tc ServerJEE Server
Elastic Application Server: Lightweight Application Platform
tc Server is Enterprise Tomcat – The best of both worlds
• Optimized for Cloud/Virtualization
• Same great high performance, low complexity, lean platform (10 MB Server)
• Best platform to run Spring (or any non-EJB Java) applications on
• Has Features/Capabilities Enterprises need and expect• Management, Monitoring, Diagnostics, Support
Lightweight App Container
Heavyweight App Container
Enterprise Capabilities
Enterprise Capabilities (?)
15
SpringSource tc Server: Key Highlights
Developer EfficiencyDeveloper Efficiency
Familiar Spring + Tomcat experience
Deep performance insight into Spring apps
Agile Spring development experience via STS
OperationalControlOperationalControl
Performance & SLA management of Spring apps
Application provisioning and server administration
Rich alert definition, workflows, and control actions
Group availability & event dashboards
Secure unidirectional agent communications
DeploymentFlexibilityDeploymentFlexibility
Lean server (10 MB) ideal for virtual environments
Template-driven server instance creation
Integrated experience with VMware environments
Open, secure API for all operations
16
SpringSource tc Server: Key Highlights
Developer EfficiencyDeveloper Efficiency
Familiar Spring + Tomcat experience
Deep performance insight into Spring apps
Agile Spring development experience via STS
OperationalControlOperationalControl
Performance & SLA management of Spring apps
Application provisioning and server administration
Rich alert definition, workflows, and control actions
Group availability & event dashboards
Secure unidirectional agent communications
DeploymentFlexibilityDeploymentFlexibility
Lean server (10 MB) ideal for virtual environments
Template-driven server instance creation
Integrated experience with VMware environments
Open, secure API for all operations
17
Developer Efficiency: Deep Performance Insight into Spring Apps
18
Developer Efficiency: Deep Performance Insight into Spring Apps
(cont’d)
19
Rich visual tools for rapidly building modern applications• Spring 3.0, Spring Roo, Groovy & Grails tools
Encourages agile development and testing • Tight integration with tc Server minimizes application redeploys/restarts
• Links performance issues to code traces highlighted in Spring Insight
Supports flexible deployment targets• tc Server, Java EE servers, VMware, Cloud, etc.
SpringSource Tool Suite
Spring Roo Grails
tc Server(Spring Insight)
Java Groovy
Developer Efficiency: Agile Spring Development Experience
Spring(Core, Rich Web, Integration)
20
SpringSource tc Server: Key Highlights
Developer EfficiencyDeveloper Efficiency
Familiar Spring + Tomcat experience
Deep performance insight into Spring apps
Agile Spring development experience via STS
OperationalControlOperationalControl
Performance & SLA management of Spring apps
Application provisioning and server administration
Rich alert definition, workflows, and control actions
Group availability & event dashboards
Secure unidirectional agent communications
DeploymentFlexibilityDeploymentFlexibility
Lean server (10 MB) ideal for virtual environments
Template-driven server instance creation
Integrated experience with VMware environments
Open, secure API for all operations
21
Operational Control: Production Deployment Architecture
WebDashboard
Hyperic Monitoring
Web Servers, App Servers, Databases, Caching, Messaging, Directories, Virtualization, etc.
Server 1
Agent
tc ServerInstance 1
tc ServerInstance 1
tc ServerInstance 1
Server 1
Agent
tc ServerInstance 1
Spring
tc ServerInstance 1
Spring
tc ServerInstance 1
Spring
Server 2
Agent
tc ServerInstance 1
tc ServerInstance 1
tc ServerInstance 1
Open API
Management Server
Administration, Provisioning, Groups,
Metrics, Alerts, Events, Access Control, Agent
Upgrades, etc.
Seamlessly Upgradeable
Inventory, Metric,
Audit, …
Spring
Spring
22
Apache Tomcat
Servlet 2.5 (JSR 154)
Java Server Pages 2.1 (JSR 245)
Clustering Features
• Session & context attribute replication
• Load balancing
• Improved over Tomcat 5.x
Advanced I/O Features
Improvements in Memory Usage
Stable, Fast, Lightweight
Tomcat Compatibility
• Runs existing Tomcat applications
• Leverages existing skill-sets
Enterprise Capabilities
Run multiple instances per install
• Centralizes tc Server install/updates
Enterprise-ready stable release
• Security vulnerabilities & bug fixes
• Fixes will be in upstream open source release
• Built, certified and pre-tuned
Advanced Scalability Options
• Non-blocking (NIO) connectors
• High concurrency connection pool
Advanced Diagnostics
• Detects deadlocks and slow running requests
• Provides access to SQL behind slow requests
• Identifies time spent in garbage collection
Operational Control: Enhanced Tomcat-compatible Server
23
Operational Control: Application Provisioning
Provision applications to single server or group of servers
Manage deployed applications View application status
Start, stop, reload, and undeploy applications
24
Operational Control: Server Administration & Configuration
Centralized administration of server configuration and defaults
Out of box pre-tuned configurationsJVM Options, production configurations, automated boot scripts, Windows service wrapper
Server Instance Templates
25
Operational Control: Performance & SLA Mgmt of Spring apps
Automatically Monitor Application, Data Access, Custom Components @Controller, @Service, @Component, @Transactional, @Repository, @ManagedResource
Executions Per Second, Average Execution Time, Maximum Time, Minimum Time, etc.
Monitor Performance and Execute Control Operations inside Spring Transaction Manager, Hibernate Session, Message Listener, JMS, JavaMail, Thread Pool, etc.
Start/Stop Listener, Set Max Messages, Set Receive Timeout, Set Pool Size, Set Keep Alive, etc.
26
Operational Control: Performance & SLA Mgmt of Spring apps
Monitor Application Server Status, Health, and Response Times Availability, Throughput, Utilization, Connection & Thread Pool Health, Deadlock Detection, Garbage Collection
(cont’d)
27
Operational Control: Alert Workflows and Control Actions
28
SpringSource tc Server: Key Highlights
Developer EfficiencyDeveloper Efficiency
Familiar Spring + Tomcat experience
Deep performance insight into Spring apps
Agile Spring development experience via STS
OperationalControlOperationalControl
Performance & SLA management of Spring apps
Application provisioning and server administration
Rich alert definition, workflows, and control actions
Group availability & event dashboards
Secure unidirectional agent communications
DeploymentFlexibilityDeploymentFlexibility
Lean server (10 MB) ideal for virtual environments
Template-driven server instance creation
Integrated experience with VMware environments
Open, secure API for all operations
29
Deployment Flexibility: tc Server Instance Templates
Streamlines process of spinning up new server instances
• Script-driven templates deliver uniquely named server instances in seconds
• Run multiple instances based on a single set of server binaries
• Pre-packaged templates for popular configurations provided out of the box
• Separates server runtime, configuration, and applications in a way that makes testing changes and making updates a breeze
Instance templates contain:
• Server, web, and context configuration files
• Parameterized properties files (ex. ports, etc.)
• Custom scripts, custom shared resource libraries, etc.
• Web applications (ex. Spring Insight)
Example use cases:
• Dev, QA, Performance Test, Staging, and Production templates
• Templates for multiple instances on a machine serving a specific application
30
Deployment Flexibility: tc Server Instances (large physical box)
Single lightweight (10MB) install for multiple running instances
Shared binaries eases upgrades of all instances
Separates configuration and code from server runtime
Multiple server versions can be installed per machine
Operating System & JVM
. . .
. . .
tc ServerInstance X
tc ServerInstance 1
Spring
tc ServerInstance m
Spring Spring Spring Spring
tc Server ver X(shared binaries)
tc Server ver Y(shared binaries)
31
Small VMSmall VM
Medium Virtual Machine
Deployment Flexibility: tc Server Instances (virtualized platform)
Complete flexibility to deploy large, medium, and small “machines”
Lightweight footprint ensures maximum resource utilization
Operating System & JVM
. . .
Virtual Infrastructure Platform
OS & JVM
tc ServerInstance 1
Spring
tc ServerInstance m
SpringSpring
tc Server(shared binaries) tc Server
OS & JVM
Spring
tc Server
32
Is a New Style of Infrastructure Needed?
Developers & Architects
And… IT Operations
We need a platform that can Run these
new apps.
Dynamic Load Balancing
Performance Management
Policy Driven Automation
Elastic App Server
Global Data Management
Cloud Messaging
33
Data in the Cloud
tc ServerSpring Edition
Trace, Monitor, Alert, Manage
Your JavaSpring App
Built withSpringSource Tool Suite Lightweight App Runtime
Hyperic &Spring Insight
GemFire EnterpriseDistributed Data Fabric
Session & Object/Data Store, Geo Replication & Partitioning, Active Queries & Notifications, …
File Systems Databases Other Data Systems
GemFire Data Management
34
Execution Excellence • Make your applications run 4 to 40 times faster• Ingest / Digest / Distribute vast amounts of data with extremely low latency
Higher ROI of IT investments & Lower Cost Per Transaction• A 4x Performance Increase is like getting 3 free computers that take no
space or electricity
Enables applications to survive network outages and distressed networks
Data Awareness – especially across applications/systems
Supports High Availability, Fault Tolerance, and Site Failover with zero additional design/development costs
Why YAPOM ? Yet Another Piece of Middleware?
35
What is GemFire?
• Service Loose Coupling
• Data Transformation
• System Integration
+ Service Bus
• Guaranteed Delivery
• Event Propagation
• Data Distribution
+ Messaging System
• Event Driven Architectures
• Real-time Analysis
• Business Event Detection
+ Complex Event Processor
=
GemFire combines select features from all of these products and combines them into a low-latency, linearly scalable, memory-based data
fabric
• Storage
• Persistence
• Transactions
• Queries
Database• High Availability
• Load Balancing
• Data Replication
• L1 Caching
• Map-Reduce, Scatter-Gather
• Distributed Task Assignment
• Task Decomposition
+ Grid Controller
• Result Summarization
37
Scaling the Tiers
Add/remove web/application servers
The database only grows by moving the VM to a larger machine
The web and application tiers can be easily combined and virtualized. Nodes can be added or removed on the fly.
The disk systems can be virtualized and can grow on demand
Web TierApplication Tier
Database Tier
Storage Tier
Load Balancer
38
Legacy Database Clustering Strategies
Statically Partitioned
•Failure of Server A will double workload on Server B
•Failure of Server A and Server B makes some data unavailable
•Rebalancing requires taking database offline
A B C D
A B C D
Legacy database clustering technologies tend to be either:
Shared Everything
•All servers must co-ordinate activity
•Must acquire distributed locks on data for update
•Scalability is not linear and limited to a handful of nodes
•Failure to synchronize activity can crash the entire cluster
39
Linear Scalability
Optional reliable, asynchronous feed to Data Warehouse or
Archival Database
Add/remove web/application/data
servers
ScaleGemFire can achieve near linear scalability with nodes that can be added or removed on the fly.
Disks may be direct or network attached
Web, Application and Data tiers can be collapsed into a single virtual machine.
40
Memory-based Performance
PerformGemFire uses memory on a peer machine to make data updates durable, allowing the updating thread to return 10x to 100x faster than updates that must be written through to disk, without risking any data loss. Typical latencies are in the few hundreds of microseconds instead of in the tens to hundreds of milliseconds.
GemFire can optionally write updates to disk, or to a data warehouse, asynchronously and reliably.
41
Data-Aware Function Routing
Execute
GemFire provides ‘data aware function routing’ – moving the behavior to the correct data instead of moving the data to the behavior.
Batch Controller or Client
Scatter-Gather (Map-Reduce) Function
Data Aware Function
42
Data Distribution
Distribute
GemFire can keep clusters that are distributed around the world synchronized in real-time and can operate reliably in Disconnected, Intermittent and Low-Bandwidth network environments.
43
GemFire virtualizes the database into the application tier
Optional reliable, asynchronous feed to Data Warehouse or
Archival Database
Add/remove disk
Add/remove web/application/data
servers
Cloud Ready
GemFire server is a small Java jar file that can be easily deployed with Java applications.
44
Is a New Style of Infrastructure Needed?
Developers & Architects
And… IT Operations
We need a platform that can Run these
new apps.
Dynamic Load Balancing
Performance Management
Policy Driven Automation
Elastic App Server
Global Data Management
Cloud Messaging
45
More Than Just Data – How do I Distribute Cloud Information?
RabbitMQ Message Bus
File Systems Databases Other Systems
Application Data Sleeps Here
GemFire Data Fabric
Application Data Lives Here
Cloud Services DevicesApplications
Application MessagingThat Won’t Fail
46
Who uses AMQP
Over 500 known commercial users recorded by AMQP vendors, examples:
• National Science Foundation OOI Cyber infrastructure
• Frankfurt Stock Exchange
“EUREX 12 is FIXML over AMQP Eurex is the very first exchange to introduce AMQP as a standard protocol on its system, thus easing the monitoring of positions and risk related data for its members and ensuring market integrity for all participants.”
• JPMorgan sends 1 billion AMQP messages per day
60 production system (50% CAGR, unforced)
• NASA’s Nebula Cloud Computing project
• Second Life
• Developer clouds: VMforce, Engine Yard, Joyent, Heroku
47
Basic use cases
Event
I need to know when to do something
Data fragment
I need to give you a piece of this data without you needing to understand the whole schema
Routing
Control who gets which message, without changing sender and receiver
Publish
Tell everyone who wants to know about this
Batch
Producer and consumer can run at independent times
Load share
Add more consumers to scale up
48
Where AMQP fits
SMTP ?
HTTP IIOP
What goes in here will clean up if it is
OPEN,
UBIQUITOUS,
& ADAPTABLE
reliableunreliable
sync
async
copyright (c) Rabbit Technologies Ltd.
49
How AMQP works
• Each message is stateless
• Consumers create queues; these buffer messages for push to consumers
• Queues are stateful, ordered, and can be persistent, transient, private, shared.
• Exchanges are stateless routing tables.
• Consumers tell queues to bind to named exchanges; each binding has a pattern e.g. “tony” or “*.ibm.*”
• Producers send messages to exchanges with a routing key e.g. “tony”, or ordered set of keys e.g. “buy.ibm.nyse”
• Exchanges route messages to queues whose binding pattern matches the message routing key or keys
50
50
Architectures you can build with AMQP
copyright (c) Rabbit Technologies Ltd.
51
Rabbit is great for developers
Developer platform integration
52
Is a New Style of Infrastructure Needed?
Developers & Architects
And… IT Operations
We need a platform that can Run these
new apps.
Dynamic Load Balancing
Performance Management
Policy Driven Automation
Elastic App Server
Global Data Management
Cloud Messaging
53
Is a New Style of Infrastructure Needed?
Developers & Architects
And… IT Operations
We need a platform that can Run these
new apps.
Dynamic Load Balancing
Performance Management
Policy Driven Automation
Elastic App Server
Global Data Management
Cloud Messaging
54
Need: Measure & Manage Custom Apps Against Business Goals
End-user
Is performance within SLAs?
What is source of bottlenecks?
How is infrastructure impacting application response times?
Can I automate corrective actions?
How can I improve performance?
Web-based Application Infrastructure
Web Server
App Server
App Server
Database
Physical or Virtual Infrastructure
55
Need: Go Beyond Red Light, Green Light Availability
56
Need: Application Visibility Across Physical and Virtual Worlds
57
If You Can Measure It, You Can Manage It
Identify, Organize
KPMs
Establish Baselines
Define Alerts, Automate Response
Define Escalation Workflows
Learn from Data
58
If You Can Measure It, You Can Manage It
Identify, Organize
KPMs
Establish Baselines
Define Alerts, Automate Response
Define Escalation Workflows
Learn from Data
59
Identifying Key Performance Metrics
Leading indicator metrics
SLA metrics
Custom metrics
Is trouble coming?
Are we meeting obligations?
How can unique knowledge help?
60
What to Measure for Custom Developed Applications?
Operating Systems Linux, Windows, Solaris, AIX, HP/UX, etc.
Web Servers Apache Web Server, Microsoft IIS, etc.
Application Platformsand Frameworks
Sun JVM, Spring Framework, SpringSource tc Server / Apache Tomcat, Oracle WebLogic, IBM WebSphere, JBoss, Microsoft .NET, LAMP, etc.
Databases Oracle, MySQL, Microsoft SQL Server, IBM DB2, PostgreSQL, etc.
Messaging Middleware IBM MQ Series, Apache ActiveMQ, Microsoft MQ, RabbitMQ, etc.
Directory Services Microsoft Active Directory, OpenLDAP, etc.
Virtualization VMware vSphere, etc.
61
Examples of Collected Metrics
62
Track Events Alongside Collected Metrics
Event Tracking and CorrelationProvides history of log, configuration, alert and security events with performance data.
Event Tracking and CorrelationProvides history of log, configuration, alert and security events with performance data.
63
Hyperic Inventory and Configuration Tracking
Hyperic Auto-DiscoveryContinuously runs to discover new inventory and modified inventory properties such as IP
set changes or configuration changes. These too can be used as the basis for alerts.
Hyperic Auto-DiscoveryContinuously runs to discover new inventory and modified inventory properties such as IP
set changes or configuration changes. These too can be used as the basis for alerts.
Maintain exact, real-time inventory of resources
64
Group Resources to Understand Real Utilization
Remote DiagnosticsHyperic HQ allows users to run real-time diagnostics like cpuinfor, cpuperc, df, top, netstat, ifconfig, and who across groups and operating systems simultaneously.
Remote DiagnosticsHyperic HQ allows users to run real-time diagnostics like cpuinfor, cpuperc, df, top, netstat, ifconfig, and who across groups and operating systems simultaneously.
Create groups to determine if problems are localizedCreate groups for like resources, e.g., all web serversCreate groups that share a dependency, e.g., that share a similar host
65
If You Can Measure It, You Can Manage It
Identify, Organize
KPMs
Establish Baselines
Define Alerts, Automate Response
Define Escalation Workflows
Learn from Data
66
Perform Trend Analysis
Ensure all applications are fully instrumented for monitoring
• Monitor INSIDE and OUTSIDE the virtual machines
Establish as long of a history as possible
• Long history provides more time and information to triage quickly
• Start during test
67
Correlate Performance Across Physical & Virtual
Bridge the gap between virtual and physical• Compare guest & host metrics
• CPU, Memory, Disk utilization
• Relate Physical & Virtual Performance to Individual Applications
Hyperic virtualization pluginsCollect metrics inside and outside the VMs, and monitors consumption by both allocation and availability.
Hyperic virtualization pluginsCollect metrics inside and outside the VMs, and monitors consumption by both allocation and availability.
Answer the question, “What Changed?”Was there a spike in traffic?Did someone add a new component or application?How quickly has performance degraded?
68
Establish Baselines and Automate Anomaly Detection
Automatic baseline calculation for
dynamic metrics
Out-of-Band Metrics Identified and Bubble-up
to DashboardHyperic Enterprise SmartTrend Baselines performance over any given period, and these baselines can be used to set alerts.
Hyperic Enterprise SmartTrend Baselines performance over any given period, and these baselines can be used to set alerts.
69
If You Can Measure It, You Can Manage It
Identify, Organize
KPMs
Establish Baselines
Define Alerts, Automate Response
Define Escalation Workflows
Learn from Data
70
Define Alert Conditions and Automated Response
Control ActionsAny script can be run remotely from Hyperic HQ and will be logged with the event history of the resource. With Hyperic HQ Enterprise these can be scheduled or run as a response to an alert.
Control ActionsAny script can be run remotely from Hyperic HQ and will be logged with the event history of the resource. With Hyperic HQ Enterprise these can be scheduled or run as a response to an alert.
71
Automate Response via Control Actions & Scripts
72
Define a Recovery Alert
Opposite Condition to Problem
Link to Problem Alert
This Is Set on Problem Alert. Not Available for Recovery Alert Definition
73
Example Alert-based Actions
Stop or Restart a Problem Service
Remove Server from Load Balancer Configuration
Execute External Process Script
Issue Remote API Calls
• Integrate with Issue Tracking System
• Scale Server Deployment (e.g. add additional VMs to handle load)
• Perform Actions Against HQ API
74
If You Can Measure It, You Can Manage It
Identify, Organize
KPMs
Establish Baselines
Define Alerts, Automate Response
Define Escalation Workflows
Learn from Data
75
Establish Support Escalation Workflows
76
Example Escalations
Defcon 1: Page on-call and email ops, wait 5 minutes, then page all.
High Priority: Page on-call and email ops every 30 minutes
Med Priority: Email ops every 4 hours
Med Priority w/ Suppress: Suppress for 20 minutes, then email ops every 4 hours
Low Priority: Email ops every 24 hours
Low Priority w/ Suppress: Suppress for 20 minutes, then email ops every 24 hours
Low Priority no Email: Used for warnings in Ops Center only, no notification
77
Acknowledge Escalation and Suspend Actions
78
If You Can Measure It, You Can Manage It
Identify, Organize
KPMs
Establish Baselines
Define Alerts, Automate Response
Define Escalation Workflows
Learn from Data
79
Learn from Gathered Metric Data
Discrepancies in behavior among identical Apache
servers
Load balancer configuration the culprit: Expected
results following fix
80
If You Can Measure It, You Can Manage It
Identify, Organize
KPMs
Establish Baselines
Define Alerts, Automate Response
Define Escalation Workflows
Learn from Data
81
Hyperic Provides Top Down Visibility to Meet Goals
Modern Application Management
Monitoring for custom applications
Best tool to manage Spring apps
Top to bottom insight and control
Deep visibility into applications & services
Spans physical, virtual, and cloud
Managing The World’s Largest Infrastructure
92
Is a New Style of Infrastructure Needed?
Developers & Architects
And… IT Operations
We need a platform that can Run these
new apps.
Dynamic Load Balancing
Performance Management
Policy Driven Automation
Elastic App Server
Global Data Management
Cloud Messaging
93
Private Application Cloud Platform Vision
App and deployment policy uploaded to Cloud platform
Platform configures required services and provisions app
Launch application
Configure, Provision, Control Elastic App Runtime
Load Balancer
Trace, Monitor, Alert
Inventory
Policy-based Infrastructure Platform & Resource Pools(vSphere , vCloud Director)
In-Memory SQL
Messaging Service
Elastic Data Fabric
Deployment Policy
Your JavaSpringApp
94
Cloud Foundry
Open PaaS offering from VMware
Currently in Beta
Three Primary Flavors
• CloudFoundry.com – Complete Hosted PaaS
• CloudFoundry.org – The Community Site
• Cloud Foundry Micro-Cloud – PaaS for the Enterprise
Initially, CloudFoundry.com supports Spring for Java apps, Rails and Sinatra for Ruby apps, Node.js apps and apps for other JVM frameworks including Grails. Cloud Foundry also offers MySQL, Redis, and MongoDB data services.
96
VMware vFabric Cloud Application Platform
Application Infrastructure for the Cloud Generation
Virtual Datacenter Cloud Infrastructure and Management
Modern Frameworks and Tools
Modern Platform Services
Developer Productivity and Application
Portability
Optimized Runtime and Accelerated
Deployment Platform Services
vFabric
Frameworks and Tools
97
VMware vFabric Cloud Application Platform
Dynamic Load Balancer
Performance Management
Policy-driven Automation
Elastic App Server
Cloud Messaging
Global Data Management
Application Infrastructure for the Cloud Generation
Rich Web Integration Batch Data Access Social Media Cloud APIs
Virtual Datacenter Cloud Infrastructure and Management
tc Server ERS (Apache) HypericRabbitMQGemFirevFabric
AppDirector
Frameworks & Tools
vFabricPlatform Services
99
Evolutionary Approach to Cloud Application PlatformS
tag
e
Virtualization & Spring
0VM
App Server
Virtualized Applications
1
VM
vFabric tc Server
Cloud App Runtime
2Cloud Data
Management
3Cloud
Platform
4
100
vFabric Resources
• Partner Central
• Partner Central: http://www.vmware.com/go/learnvfabric
• vFabric Overview, PaaS Whiteboard, tcServer Demo, Hyperic Demo, Gemfire Presentation
• SME Email List for Technical Questions
Webinars
• http://www.springsource.com/newsevents/webinars
• Avoid Pitfalls when Monitoring a Virtualized Environment
• Next-Generation Data Management in the Cloud for Java Apps
• Best Practices for Virtualizing Java Workloads
• Performance Tuning Production tc Server: Tuning for Throughput & Scale
• Upcoming: The NPC Story - Speedier Apps, Minimal Downtime, Lower Cost
101
VMware’s Commitment to Partners
102
Solution Provider Benefits Include...
Training and Education
Branding and Customer Recognition
Intellectual Property & SET’s
NFR & IUL Software
Demand Generation
Incentives/ Margin
Sales Engagement
103
Temporary Program for Net New VMware vFabric Partners
REGISTERED
LEVEL REQUIREMENT
Application/Agreement: Sign & CompleteAbility to Sell: ACE, Workstation, Fusion, vSphere Essentials & Essentials Plus
Go to www.vmware.com
Partners- > Partner Programs
Solution Provider - > Registered
Apply Now
Fill in the Details and Submit
104
Sign up for Partner Central and Partner University
Partner Central is the exclusive online information resource, providing a single dedicated web portal for all VMware Partners.
105
Key Takeaways
VMware’sIT as a Service
Vision
VMware vFabricCombines Spring framework and
tools with vFabric platform services to speed delivery of next-generation apps that are instantly
scalable and cloud-portable
Cloud Application
PlatformKey Drivers
© 2009 VMware Inc. All rights reserved
Questions?
vFabric Platform Deep Dive
April 18th, 2011
107
Appendix A
Use Cases
108
tcServer Successes
109
Case Study – From Level 0 to Level 1.5
Moved from Traditional to Elastic Application Server
Benefits:• Faster Testing and Live Deployments –
• From Hours to Minutes
• Rapid Turnaround on Production Fixes
• Proactive Problem Solving
• H/A – 100% Uptime on Website
• Improved Performance – 3X
• Reduced Server Costs
The Digital Services Division (DSD) of Associated
Newspapers (ANL) provides all online development and infrastructure services to ANL’s online
portfolio of newspaper web sites. This includes
the Daily Mail, UK’s largest online newspaper
website, as well as Evening Standard, This Is
Money, Metro and 150+ regional sites. ANL’s goal
is to deliver websites that offer an engaging and
satisfying experience for users and measurable
commercial benefits to advertisers. ANL is part of
the Daily Mail and General Trust plc.
“In the newspaper environment, we constantly need to find new and innovative ways to monetize our content,” Perkinson continues.
“Ideas for new features are coming through all the time, and for us to be able to turn those features around and get them to market quickly is absolutely key. But with Oracle WebLogic, developers were constantly task switching while waiting for Oracle WebLogic to deploy and start up our applications after each test and staging release.”
Notable Quote
About the Company
110
Case Study – Level 0 to Level 2
110
Confidential
NPC International, based in Overland Park, Kansas, is the largest Pizza Hut franchisee in the world and is
owned by Merrill-Lynch Global Private Equity Group. NPC International connects to its 1,200 restaurants
across the US via a web application deployed through the local POS system, providing a variety of essential
corporate functionality such as payroll, vacation requests, compliance management, invoice approval and online employee training. The web-based system
must be kept running at top performance to handle 170,000 page views per day by NPC International
users.
Virtual Cloud Infrastructure
tcServer has enabled NPC International to implement an internal, private cloud of VMware-based virtual server resources, to maximize efficient usage of existing infrastructure. Because tc Server’s footprint is small, 12 tc Server instances are running on a single physical box, with additional capacity available to install more tc Server instances when needed. Consequently, tc Server enables NPC International to maximize internal server resources by eliminating the multiple machines necessary to run numerous
application servers.
“I could not have deployed the applications within VMware-based virtual machines without tc Server,” Brisbin says. “I need a
small, lightweight server that starts in a few seconds. I need to run several instances so I can make use of all the CPU
resources.”
Benefits:
• Enhanced Application Performance
• High Availability
• Increased Developer Productivity
• Greater Scalability and Improved User Experience
• Virtual Cloud Infrastructure
• Reduced Server Costs by 75%
111
GemFire Successes
112
Use Case - ForEx
Low-latency trade insertionPermanent Archival of every tradeKept pace with fast ticking market dataRapid, Event Based Position CalculationDistribution of Position Updates GloballyConsistent Global Views of PositionsPass the BookRegional Close-of-dayHigh AvailabilityDisaster RecoveryRegional Autonomy
The project achieved:
real-life use case: Global Foreign Exchange Trading System
113
real-life use case: Global Foreign Exchange Trading System
Use Case - ForEx
In that same application, GemFire replaced:
Oracle Database In Every Region
Still need 1 instance for archival purposes
TIBCO Rendezvous for Local Area Messaging
IBM MQ Series for WAN Distribution
Veritas N+1 Clustering for H/A
In fact, we save the physical +1 node itself
3DNS or Wide IP
Admin personnel reduced from 1.5 to 0.5
114
real-life use case: Event-driven Risk and Pricing
Use Case – Event Management
Batch processing delays were costing money
Running Pricing and Risk calculations in batch mode required special applications to be written that created a ‘buffers’ to ensure that regulatory obligations were not violated (BASEL II regulations).
and limiting opportunities
An initial attempt to produce event-detection processing on legacy technology would not scale. Only 43 priority products could be managed – other products could not take advantage of a known tactical advantage.
115
real-life use case: Event-driven Risk and Pricing
Use Case – Event Management
"The breakthrough for this tool came when we decided to put the event detection logic into our pricing models"
Derek Joyce
Chief Business Technologist for Equity Derivatives
JPMorgan investment Bank
Built and deployed the Event Workstation project in under 12 months
Features: Real-time event detection, easier integration of new products, and control workflow to minimize business risk and meet all regulatory requirements
Trader UI queries reduced from 20 minute to under 5 second response time
8 CPUs re-price 6000 complex and exotic instruments in under 3 minutes
116
A mainframe-based, nightly customer account reconciliation batch run
Use Case – Mainframe Migration
min
0 12060
I/O Wait9%
CPU Busy15%
Mainframe
CPU Unavailable15%
COTS ClusterBatch now runs in 60 seconds
93% Network Wait! Time could have been reduced further with higher network bandwidth
real-life use case: Mainframe-based Nightly Batch Run
118
real-life use case: Web 2.0 Portal – Customized ads
Use Case – Web Portal
A popular online gambling site attracts new players through ads on affiliate sites
Customized Banner Ad on affiliate site
Affiliate's Web Server
1 Banner Ad Server
23
4
In a fraction of a second, the banner ad sever must:Generate a tracking id specific to the request
Apply temporal, sequential, regional, contractual and other policies in order to decide which banner to deliver
Customize the banner
Record that the banner ad was delivered
119
real-life use case: Web 2.0 Portal – Customized ads
Use Case – Web Portal
Their initial RDBMS-based system
Limited their ability to sign up new affiliates
Limited their ability to add new products on their site
Limited the delivery performance experienced by their affiliates and their customers
Limited their ability to add additional internal applications and policies to the process
Their new GemFire-based systemResponded with sub-millisecond latency
Met their target of 2500 banner ad deliveries per second
Provides for future scalability
Improved performance to the browser by 4x
Cost less
120
real-life use case: DISA / DOD Global Command and Control
Use Case – Asset/Position Monitoring
Centralized data storage was not possible
Multi-agency, multi-force integration
Numerous Applications needed access to multiple data sources simultaneously
Networks constantly changing, unreliable, mobile deployments
Upwards of 60,000 object updates each minute
Over 70 Data feeds
Needed a real-time situational awareness system to track friendly assets and enemy assets that could be used by all of the war fighters in theatre
Northrop Grumman (integrator) investigated the following technologies before deciding on GemFire• RDBMS – Oracle, Sybase, Postgres, TimesTen, MySQL
• ODBMS - Objectivity
• jCache – GemFire, Oracle Coherence
• JMS – SonicMQ, BEA Weblogic, IBM, jBoss
• TIBCO Rendezvous
• Web Services
121
real-life use case: DISA / DOD Global Command and Control
Use Case – Asset/Position Monitoring
655 sites, 11 thousand users
Real-time, 3 dimensional, NASA World Wind User Interface
Active, directed event propagation
On the desk of
President of the United States
US Secretary of Defense
Each of the Joint Chiefs of Staff
Every commander in the US Military
Likely to be adopted as the joint, common operating picture for US allies and friendlies
122
RabbitMQ Successes
123
BBC - real time content management
Source feeds are collated, transformed
and routed to their destinations
124
Pubsub at massive scale: “Twitter for Data in the Cloud”
Oceanographic Observatory Institute
125
Putting it all together: The OOI National Network
125