Si so product 1 day technical

111
© 2009 VMware Inc. All rights reserved vFabric SI/SO RoadShow vFabric Platform Deep Dive April 18 th , 2011

description

 

Transcript of Si so product 1 day technical

Page 1: Si so product 1 day technical

© 2009 VMware Inc. All rights reserved

vFabric SI/SO RoadShow

vFabric Platform Deep Dive

April 18th, 2011

Page 2: Si so product 1 day technical

2

Session Roadmap

VMware’sIT as a Service

Vision

VMware vFabricCombines Spring framework and

tools with vFabric platform services to speed delivery of next-generation apps that are instantly

scalable and cloud-portable

Cloud Application

PlatformKey Drivers

Page 3: Si so product 1 day technical

3

3

vFabric

vCloudInfrastructure

End UserComputing

VMware Solutions for Cloud Computing

Page 4: Si so product 1 day technical

4

Transitioning from the Old to the New

Traditional IT

PaaS Pool

New IT - PaaS

Java

Web Servers/Load Balancers

App Servers

Cache Servers Messaging

Database

Problems:

1. Time

2. Cost

3. Static

Build:

Spring

• Portable

• Productive

Google AE

Google AE

VMForceVMForce

Public

Public/Hybrid

IaaS – vSphere/vCD

+ Blueprint

Provides:

1. Self-Service

2. Optimization of Resources

3. Dynamic

Page 5: Si so product 1 day technical

5

Users are booking rooms

Use Case: App Intelligence for “Just-in-Time” Infrastructure

PST 8 am 9 am 10 am 11 am 12 pm 1 pm 2 pm 3 pm 4 pm 5 pm

Policy-based Capacity

Traffic

Hotel room promotioncomes online

Hotel room promotion ends

Page 6: Si so product 1 day technical

6

VMware vFabric Cloud Application Platform

Application Infrastructure for the Cloud Generation

Virtual Datacenter Cloud Infrastructure and Management

Modern Frameworks and Tools

Modern Platform Services

Developer Productivity and Application

Portability

Optimized Runtime and Accelerated

Deployment Platform Services

vFabric

Frameworks and Tools

Page 7: Si so product 1 day technical

7

Spring Is Java Developers’ Choice

A majority of [enterprise Java] users interviewed by Forrester use Spring”“

Source: Indeed.com Job Trends, Feb 2010

At least 2 million Java developers have some level of proficiency

with Spring Core, and this represents at least 50% of enterprise Java developers”

Half say the adoption of Spring has reduced the time to complete a project

by more than 25%, and one in four have reduced the time by over 50% ”“

Spring

Websphere

WebLogic

Page 8: Si so product 1 day technical

8

8

Innovation Reigns Supreme

Web

Batch

Integration

SecuritySocial Media

Cloud Platform Services

Mobile

Page 9: Si so product 1 day technical

9

Spring Ref Arch: Robust Web 2.0 Applications Built for Scaletc

Ser

ver

REST / MVC

Plugin

GORMRabbitMQ

Plugin

Web Application Server

Application Requests

X

X

RPC Broker

tc S

erve

r

App

Controller

Application Responses

HQ Agent

Web Application Server

App Cache

Management Server

tc S

erve

r

Website

AnalyticsHQ Server

Data Cache Server

Gra

ils

HQ Agent

Sp

rin

g

File Systems

RDBMS

Other Data

Systems

Social &

Web Services

Mobile &

Security

Data

Cache

tc S

erve

r

Page 10: Si so product 1 day technical

10

Spring Ref Arch: Enterprise Integration in the Cloud

Application Events

X

X

RPC Broker

tc S

erve

r

Application Events

HQ Agent

Application Server

App Cache

Management Server

tc S

erve

r

Bus Trans

MonitoringHQ Server

tc S

erve

r

Application Server

App Cache

HQ Agent

Sp

rin

g

Sp

rin

g

SI FlowSI Flow

Data Cache Server

File Systems

RDBMS

Other Data

Systems

Data

Cache

tc S

erve

r

Page 11: Si so product 1 day technical

11

Spring Ref Arch: Distributed Partitioned Batch Processing

Scheduler

Launch

Script

tc S

erve

r

Batch

Admin

Controller

App

Controller

Partition

HandlerAggregator

Batch Server

Partition Requests

X

X

RPC Broker

tc S

erve

r

Batch

Admin

Controller

App

Controller

Partition Responses

HQ Agent HQ Agent

Batch Server

App Cache Partition

Management Server

tc S

erve

r

Batch

AdminHQ Server

Sp

rin

g

Sp

rin

g

Data Cache Server

File Systems

RDBMS

Other Data

Systems

Data

Cache

tc S

erve

r

Page 12: Si so product 1 day technical

12

VMware vFabric Cloud Application Platform

Application Infrastructure for the Cloud Generation

Virtual Datacenter Cloud Infrastructure and Management

Modern Frameworks and Tools

Modern Platform Services

Developer Productivity and Application

Portability

Optimized Runtime and Accelerated

Deployment Platform Services

vFabric

Frameworks and Tools

Page 13: Si so product 1 day technical

13

Is a New Style of Infrastructure Needed?

Developers & Architects

And… IT Operations

We need a platform that can Run these

new apps.

Dynamic Load Balancing

Performance Management

Policy Driven Automation

Elastic App Server

Global Data Management

Cloud Messaging

Page 14: Si so product 1 day technical

14

Tomcat tc ServerJEE Server

Elastic Application Server: Lightweight Application Platform

tc Server is Enterprise Tomcat – The best of both worlds

• Optimized for Cloud/Virtualization

• Same great high performance, low complexity, lean platform (10 MB Server)

• Best platform to run Spring (or any non-EJB Java) applications on

• Has Features/Capabilities Enterprises need and expect• Management, Monitoring, Diagnostics, Support

Lightweight App Container

Heavyweight App Container

Enterprise Capabilities

Enterprise Capabilities (?)

Page 15: Si so product 1 day technical

15

SpringSource tc Server: Key Highlights

Developer EfficiencyDeveloper Efficiency

Familiar Spring + Tomcat experience

Deep performance insight into Spring apps

Agile Spring development experience via STS

OperationalControlOperationalControl

Performance & SLA management of Spring apps

Application provisioning and server administration

Rich alert definition, workflows, and control actions

Group availability & event dashboards

Secure unidirectional agent communications

DeploymentFlexibilityDeploymentFlexibility

Lean server (10 MB) ideal for virtual environments

Template-driven server instance creation

Integrated experience with VMware environments

Open, secure API for all operations

Page 16: Si so product 1 day technical

16

SpringSource tc Server: Key Highlights

Developer EfficiencyDeveloper Efficiency

Familiar Spring + Tomcat experience

Deep performance insight into Spring apps

Agile Spring development experience via STS

OperationalControlOperationalControl

Performance & SLA management of Spring apps

Application provisioning and server administration

Rich alert definition, workflows, and control actions

Group availability & event dashboards

Secure unidirectional agent communications

DeploymentFlexibilityDeploymentFlexibility

Lean server (10 MB) ideal for virtual environments

Template-driven server instance creation

Integrated experience with VMware environments

Open, secure API for all operations

Page 17: Si so product 1 day technical

17

Developer Efficiency: Deep Performance Insight into Spring Apps

Page 18: Si so product 1 day technical

18

Developer Efficiency: Deep Performance Insight into Spring Apps

(cont’d)

Page 19: Si so product 1 day technical

19

Rich visual tools for rapidly building modern applications• Spring 3.0, Spring Roo, Groovy & Grails tools

Encourages agile development and testing • Tight integration with tc Server minimizes application redeploys/restarts

• Links performance issues to code traces highlighted in Spring Insight

Supports flexible deployment targets• tc Server, Java EE servers, VMware, Cloud, etc.

SpringSource Tool Suite

Spring Roo Grails

tc Server(Spring Insight)

Java Groovy

Developer Efficiency: Agile Spring Development Experience

Spring(Core, Rich Web, Integration)

Page 20: Si so product 1 day technical

20

SpringSource tc Server: Key Highlights

Developer EfficiencyDeveloper Efficiency

Familiar Spring + Tomcat experience

Deep performance insight into Spring apps

Agile Spring development experience via STS

OperationalControlOperationalControl

Performance & SLA management of Spring apps

Application provisioning and server administration

Rich alert definition, workflows, and control actions

Group availability & event dashboards

Secure unidirectional agent communications

DeploymentFlexibilityDeploymentFlexibility

Lean server (10 MB) ideal for virtual environments

Template-driven server instance creation

Integrated experience with VMware environments

Open, secure API for all operations

Page 21: Si so product 1 day technical

21

Operational Control: Production Deployment Architecture

WebDashboard

Hyperic Monitoring

Web Servers, App Servers, Databases, Caching, Messaging, Directories, Virtualization, etc.

Server 1

Agent

tc ServerInstance 1

tc ServerInstance 1

tc ServerInstance 1

Server 1

Agent

tc ServerInstance 1

Spring

tc ServerInstance 1

Spring

tc ServerInstance 1

Spring

Server 2

Agent

tc ServerInstance 1

tc ServerInstance 1

tc ServerInstance 1

Open API

Management Server

Administration, Provisioning, Groups,

Metrics, Alerts, Events, Access Control, Agent

Upgrades, etc.

Seamlessly Upgradeable

Inventory, Metric,

Audit, …

Spring

Spring

Page 22: Si so product 1 day technical

22

Apache Tomcat

Servlet 2.5 (JSR 154)

Java Server Pages 2.1 (JSR 245)

Clustering Features

• Session & context attribute replication

• Load balancing

• Improved over Tomcat 5.x

Advanced I/O Features

Improvements in Memory Usage

Stable, Fast, Lightweight

Tomcat Compatibility

• Runs existing Tomcat applications

• Leverages existing skill-sets

Enterprise Capabilities

Run multiple instances per install

• Centralizes tc Server install/updates

Enterprise-ready stable release

• Security vulnerabilities & bug fixes

• Fixes will be in upstream open source release

• Built, certified and pre-tuned

Advanced Scalability Options

• Non-blocking (NIO) connectors

• High concurrency connection pool

Advanced Diagnostics

• Detects deadlocks and slow running requests

• Provides access to SQL behind slow requests

• Identifies time spent in garbage collection

Operational Control: Enhanced Tomcat-compatible Server

Page 23: Si so product 1 day technical

23

Operational Control: Application Provisioning

Provision applications to single server or group of servers

Manage deployed applications View application status

Start, stop, reload, and undeploy applications

Page 24: Si so product 1 day technical

24

Operational Control: Server Administration & Configuration

Centralized administration of server configuration and defaults

Out of box pre-tuned configurationsJVM Options, production configurations, automated boot scripts, Windows service wrapper

Server Instance Templates

Page 25: Si so product 1 day technical

25

Operational Control: Performance & SLA Mgmt of Spring apps

Automatically Monitor Application, Data Access, Custom Components @Controller, @Service, @Component, @Transactional, @Repository, @ManagedResource

Executions Per Second, Average Execution Time, Maximum Time, Minimum Time, etc.

Monitor Performance and Execute Control Operations inside Spring Transaction Manager, Hibernate Session, Message Listener, JMS, JavaMail, Thread Pool, etc.

Start/Stop Listener, Set Max Messages, Set Receive Timeout, Set Pool Size, Set Keep Alive, etc.

Page 26: Si so product 1 day technical

26

Operational Control: Performance & SLA Mgmt of Spring apps

Monitor Application Server Status, Health, and Response Times Availability, Throughput, Utilization, Connection & Thread Pool Health, Deadlock Detection, Garbage Collection

(cont’d)

Page 27: Si so product 1 day technical

27

Operational Control: Alert Workflows and Control Actions

Page 28: Si so product 1 day technical

28

SpringSource tc Server: Key Highlights

Developer EfficiencyDeveloper Efficiency

Familiar Spring + Tomcat experience

Deep performance insight into Spring apps

Agile Spring development experience via STS

OperationalControlOperationalControl

Performance & SLA management of Spring apps

Application provisioning and server administration

Rich alert definition, workflows, and control actions

Group availability & event dashboards

Secure unidirectional agent communications

DeploymentFlexibilityDeploymentFlexibility

Lean server (10 MB) ideal for virtual environments

Template-driven server instance creation

Integrated experience with VMware environments

Open, secure API for all operations

Page 29: Si so product 1 day technical

29

Deployment Flexibility: tc Server Instance Templates

Streamlines process of spinning up new server instances

• Script-driven templates deliver uniquely named server instances in seconds

• Run multiple instances based on a single set of server binaries

• Pre-packaged templates for popular configurations provided out of the box

• Separates server runtime, configuration, and applications in a way that makes testing changes and making updates a breeze

Instance templates contain:

• Server, web, and context configuration files

• Parameterized properties files (ex. ports, etc.)

• Custom scripts, custom shared resource libraries, etc.

• Web applications (ex. Spring Insight)

Example use cases:

• Dev, QA, Performance Test, Staging, and Production templates

• Templates for multiple instances on a machine serving a specific application

Page 30: Si so product 1 day technical

30

Deployment Flexibility: tc Server Instances (large physical box)

Single lightweight (10MB) install for multiple running instances

Shared binaries eases upgrades of all instances

Separates configuration and code from server runtime

Multiple server versions can be installed per machine

Operating System & JVM

. . .

. . .

tc ServerInstance X

tc ServerInstance 1

Spring

tc ServerInstance m

Spring Spring Spring Spring

tc Server ver X(shared binaries)

tc Server ver Y(shared binaries)

Page 31: Si so product 1 day technical

31

Small VMSmall VM

Medium Virtual Machine

Deployment Flexibility: tc Server Instances (virtualized platform)

Complete flexibility to deploy large, medium, and small “machines”

Lightweight footprint ensures maximum resource utilization

Operating System & JVM

. . .

Virtual Infrastructure Platform

OS & JVM

tc ServerInstance 1

Spring

tc ServerInstance m

SpringSpring

tc Server(shared binaries) tc Server

OS & JVM

Spring

tc Server

Page 32: Si so product 1 day technical

32

Is a New Style of Infrastructure Needed?

Developers & Architects

And… IT Operations

We need a platform that can Run these

new apps.

Dynamic Load Balancing

Performance Management

Policy Driven Automation

Elastic App Server

Global Data Management

Cloud Messaging

Page 33: Si so product 1 day technical

33

Data in the Cloud

tc ServerSpring Edition

Trace, Monitor, Alert, Manage

Your JavaSpring App

Built withSpringSource Tool Suite Lightweight App Runtime

Hyperic &Spring Insight

GemFire EnterpriseDistributed Data Fabric

Session & Object/Data Store, Geo Replication & Partitioning, Active Queries & Notifications, …

File Systems Databases Other Data Systems

GemFire Data Management

Page 34: Si so product 1 day technical

34

Execution Excellence • Make your applications run 4 to 40 times faster• Ingest / Digest / Distribute vast amounts of data with extremely low latency

Higher ROI of IT investments & Lower Cost Per Transaction• A 4x Performance Increase is like getting 3 free computers that take no

space or electricity

Enables applications to survive network outages and distressed networks

Data Awareness – especially across applications/systems

Supports High Availability, Fault Tolerance, and Site Failover with zero additional design/development costs

Why YAPOM ? Yet Another Piece of Middleware?

Page 35: Si so product 1 day technical

35

What is GemFire?

• Service Loose Coupling

• Data Transformation

• System Integration

+ Service Bus

• Guaranteed Delivery

• Event Propagation

• Data Distribution

+ Messaging System

• Event Driven Architectures

• Real-time Analysis

• Business Event Detection

+ Complex Event Processor

=

GemFire combines select features from all of these products and combines them into a low-latency, linearly scalable, memory-based data

fabric

• Storage

• Persistence

• Transactions

• Queries

Database• High Availability

• Load Balancing

• Data Replication

• L1 Caching

• Map-Reduce, Scatter-Gather

• Distributed Task Assignment

• Task Decomposition

+ Grid Controller

• Result Summarization

Page 36: Si so product 1 day technical

37

Scaling the Tiers

Add/remove web/application servers

The database only grows by moving the VM to a larger machine

The web and application tiers can be easily combined and virtualized. Nodes can be added or removed on the fly.

The disk systems can be virtualized and can grow on demand

Web TierApplication Tier

Database Tier

Storage Tier

Load Balancer

Page 37: Si so product 1 day technical

38

Legacy Database Clustering Strategies

Statically Partitioned

•Failure of Server A will double workload on Server B

•Failure of Server A and Server B makes some data unavailable

•Rebalancing requires taking database offline

A B C D

A B C D

Legacy database clustering technologies tend to be either:

Shared Everything

•All servers must co-ordinate activity

•Must acquire distributed locks on data for update

•Scalability is not linear and limited to a handful of nodes

•Failure to synchronize activity can crash the entire cluster

Page 38: Si so product 1 day technical

39

Linear Scalability

Optional reliable, asynchronous feed to Data Warehouse or

Archival Database

Add/remove web/application/data

servers

ScaleGemFire can achieve near linear scalability with nodes that can be added or removed on the fly.

Disks may be direct or network attached

Web, Application and Data tiers can be collapsed into a single virtual machine.

Page 39: Si so product 1 day technical

40

Memory-based Performance

PerformGemFire uses memory on a peer machine to make data updates durable, allowing the updating thread to return 10x to 100x faster than updates that must be written through to disk, without risking any data loss. Typical latencies are in the few hundreds of microseconds instead of in the tens to hundreds of milliseconds.

GemFire can optionally write updates to disk, or to a data warehouse, asynchronously and reliably.

Page 40: Si so product 1 day technical

41

Data-Aware Function Routing

Execute

GemFire provides ‘data aware function routing’ – moving the behavior to the correct data instead of moving the data to the behavior.

Batch Controller or Client

Scatter-Gather (Map-Reduce) Function

Data Aware Function

Page 41: Si so product 1 day technical

42

Data Distribution

Distribute

GemFire can keep clusters that are distributed around the world synchronized in real-time and can operate reliably in Disconnected, Intermittent and Low-Bandwidth network environments.

Page 42: Si so product 1 day technical

43

GemFire virtualizes the database into the application tier

Optional reliable, asynchronous feed to Data Warehouse or

Archival Database

Add/remove disk

Add/remove web/application/data

servers

Cloud Ready

GemFire server is a small Java jar file that can be easily deployed with Java applications.

Page 43: Si so product 1 day technical

44

Is a New Style of Infrastructure Needed?

Developers & Architects

And… IT Operations

We need a platform that can Run these

new apps.

Dynamic Load Balancing

Performance Management

Policy Driven Automation

Elastic App Server

Global Data Management

Cloud Messaging

Page 44: Si so product 1 day technical

45

More Than Just Data – How do I Distribute Cloud Information?

RabbitMQ Message Bus

File Systems Databases Other Systems

Application Data Sleeps Here

GemFire Data Fabric

Application Data Lives Here

Cloud Services DevicesApplications

Application MessagingThat Won’t Fail

Page 45: Si so product 1 day technical

46

Who uses AMQP

Over 500 known commercial users recorded by AMQP vendors, examples:

• National Science Foundation OOI Cyber infrastructure

• Frankfurt Stock Exchange

“EUREX 12 is FIXML over AMQP Eurex is the very first exchange to introduce AMQP as a standard protocol on its system, thus easing the monitoring of positions and risk related data for its members and ensuring market integrity for all participants.”

• JPMorgan sends 1 billion AMQP messages per day

60 production system (50% CAGR, unforced)

• NASA’s Nebula Cloud Computing project

• Second Life

• Developer clouds: VMforce, Engine Yard, Joyent, Heroku

Page 46: Si so product 1 day technical

47

Basic use cases

Event

I need to know when to do something

Data fragment

I need to give you a piece of this data without you needing to understand the whole schema

Routing

Control who gets which message, without changing sender and receiver

Publish

Tell everyone who wants to know about this

Batch

Producer and consumer can run at independent times

Load share

Add more consumers to scale up

Page 47: Si so product 1 day technical

48

Where AMQP fits

SMTP ?

HTTP IIOP

What goes in here will clean up if it is

OPEN,

UBIQUITOUS,

& ADAPTABLE

reliableunreliable

sync

async

copyright (c) Rabbit Technologies Ltd.

Page 48: Si so product 1 day technical

49

How AMQP works

• Each message is stateless

• Consumers create queues; these buffer messages for push to consumers

• Queues are stateful, ordered, and can be persistent, transient, private, shared.

• Exchanges are stateless routing tables.

• Consumers tell queues to bind to named exchanges; each binding has a pattern e.g. “tony” or “*.ibm.*”

• Producers send messages to exchanges with a routing key e.g. “tony”, or ordered set of keys e.g. “buy.ibm.nyse”

• Exchanges route messages to queues whose binding pattern matches the message routing key or keys

Page 49: Si so product 1 day technical

50

50

Architectures you can build with AMQP

copyright (c) Rabbit Technologies Ltd.

Page 50: Si so product 1 day technical

51

Rabbit is great for developers

Developer platform integration

Page 51: Si so product 1 day technical

52

Is a New Style of Infrastructure Needed?

Developers & Architects

And… IT Operations

We need a platform that can Run these

new apps.

Dynamic Load Balancing

Performance Management

Policy Driven Automation

Elastic App Server

Global Data Management

Cloud Messaging

Page 52: Si so product 1 day technical

53

Is a New Style of Infrastructure Needed?

Developers & Architects

And… IT Operations

We need a platform that can Run these

new apps.

Dynamic Load Balancing

Performance Management

Policy Driven Automation

Elastic App Server

Global Data Management

Cloud Messaging

Page 53: Si so product 1 day technical

54

Need: Measure & Manage Custom Apps Against Business Goals

End-user

Is performance within SLAs?

What is source of bottlenecks?

How is infrastructure impacting application response times?

Can I automate corrective actions?

How can I improve performance?

Web-based Application Infrastructure

Web Server

App Server

App Server

Database

Physical or Virtual Infrastructure

Page 54: Si so product 1 day technical

55

Need: Go Beyond Red Light, Green Light Availability

Page 55: Si so product 1 day technical

56

Need: Application Visibility Across Physical and Virtual Worlds

Page 56: Si so product 1 day technical

57

If You Can Measure It, You Can Manage It

Identify, Organize

KPMs

Establish Baselines

Define Alerts, Automate Response

Define Escalation Workflows

Learn from Data

Page 57: Si so product 1 day technical

58

If You Can Measure It, You Can Manage It

Identify, Organize

KPMs

Establish Baselines

Define Alerts, Automate Response

Define Escalation Workflows

Learn from Data

Page 58: Si so product 1 day technical

59

Identifying Key Performance Metrics

Leading indicator metrics

SLA metrics

Custom metrics

Is trouble coming?

Are we meeting obligations?

How can unique knowledge help?

Page 59: Si so product 1 day technical

60

What to Measure for Custom Developed Applications?

Operating Systems Linux, Windows, Solaris, AIX, HP/UX, etc.

Web Servers Apache Web Server, Microsoft IIS, etc.

Application Platformsand Frameworks

Sun JVM, Spring Framework, SpringSource tc Server / Apache Tomcat, Oracle WebLogic, IBM WebSphere, JBoss, Microsoft .NET, LAMP, etc.

Databases Oracle, MySQL, Microsoft SQL Server, IBM DB2, PostgreSQL, etc.

Messaging Middleware IBM MQ Series, Apache ActiveMQ, Microsoft MQ, RabbitMQ, etc.

Directory Services Microsoft Active Directory, OpenLDAP, etc.

Virtualization VMware vSphere, etc.

Page 60: Si so product 1 day technical

61

Examples of Collected Metrics

Page 61: Si so product 1 day technical

62

Track Events Alongside Collected Metrics

Event Tracking and CorrelationProvides history of log, configuration, alert and security events with performance data.

Event Tracking and CorrelationProvides history of log, configuration, alert and security events with performance data.

Page 62: Si so product 1 day technical

63

Hyperic Inventory and Configuration Tracking

Hyperic Auto-DiscoveryContinuously runs to discover new inventory and modified inventory properties such as IP

set changes or configuration changes. These too can be used as the basis for alerts.

Hyperic Auto-DiscoveryContinuously runs to discover new inventory and modified inventory properties such as IP

set changes or configuration changes. These too can be used as the basis for alerts.

Maintain exact, real-time inventory of resources

Page 63: Si so product 1 day technical

64

Group Resources to Understand Real Utilization

Remote DiagnosticsHyperic HQ allows users to run real-time diagnostics like cpuinfor, cpuperc, df, top, netstat, ifconfig, and who across groups and operating systems simultaneously.

Remote DiagnosticsHyperic HQ allows users to run real-time diagnostics like cpuinfor, cpuperc, df, top, netstat, ifconfig, and who across groups and operating systems simultaneously.

Create groups to determine if problems are localizedCreate groups for like resources, e.g., all web serversCreate groups that share a dependency, e.g., that share a similar host

Page 64: Si so product 1 day technical

65

If You Can Measure It, You Can Manage It

Identify, Organize

KPMs

Establish Baselines

Define Alerts, Automate Response

Define Escalation Workflows

Learn from Data

Page 65: Si so product 1 day technical

66

Perform Trend Analysis

Ensure all applications are fully instrumented for monitoring

• Monitor INSIDE and OUTSIDE the virtual machines

Establish as long of a history as possible

• Long history provides more time and information to triage quickly

• Start during test

Page 66: Si so product 1 day technical

67

Correlate Performance Across Physical & Virtual

Bridge the gap between virtual and physical• Compare guest & host metrics

• CPU, Memory, Disk utilization

• Relate Physical & Virtual Performance to Individual Applications

Hyperic virtualization pluginsCollect metrics inside and outside the VMs, and monitors consumption by both allocation and availability.

Hyperic virtualization pluginsCollect metrics inside and outside the VMs, and monitors consumption by both allocation and availability.

Answer the question, “What Changed?”Was there a spike in traffic?Did someone add a new component or application?How quickly has performance degraded?

Page 67: Si so product 1 day technical

68

Establish Baselines and Automate Anomaly Detection

Automatic baseline calculation for

dynamic metrics

Out-of-Band Metrics Identified and Bubble-up

to DashboardHyperic Enterprise SmartTrend Baselines performance over any given period, and these baselines can be used to set alerts.

Hyperic Enterprise SmartTrend Baselines performance over any given period, and these baselines can be used to set alerts.

Page 68: Si so product 1 day technical

69

If You Can Measure It, You Can Manage It

Identify, Organize

KPMs

Establish Baselines

Define Alerts, Automate Response

Define Escalation Workflows

Learn from Data

Page 69: Si so product 1 day technical

70

Define Alert Conditions and Automated Response

Control ActionsAny script can be run remotely from Hyperic HQ and will be logged with the event history of the resource. With Hyperic HQ Enterprise these can be scheduled or run as a response to an alert.

Control ActionsAny script can be run remotely from Hyperic HQ and will be logged with the event history of the resource. With Hyperic HQ Enterprise these can be scheduled or run as a response to an alert.

Page 70: Si so product 1 day technical

71

Automate Response via Control Actions & Scripts

Page 71: Si so product 1 day technical

72

Define a Recovery Alert

Opposite Condition to Problem

Link to Problem Alert

This Is Set on Problem Alert. Not Available for Recovery Alert Definition

Page 72: Si so product 1 day technical

73

Example Alert-based Actions

Stop or Restart a Problem Service

Remove Server from Load Balancer Configuration

Execute External Process Script

Issue Remote API Calls

• Integrate with Issue Tracking System

• Scale Server Deployment (e.g. add additional VMs to handle load)

• Perform Actions Against HQ API

Page 73: Si so product 1 day technical

74

If You Can Measure It, You Can Manage It

Identify, Organize

KPMs

Establish Baselines

Define Alerts, Automate Response

Define Escalation Workflows

Learn from Data

Page 74: Si so product 1 day technical

75

Establish Support Escalation Workflows

Page 75: Si so product 1 day technical

76

Example Escalations

Defcon 1: Page on-call and email ops, wait 5 minutes, then page all.

High Priority: Page on-call and email ops every 30 minutes

Med Priority: Email ops every 4 hours

Med Priority w/ Suppress: Suppress for 20 minutes, then email ops every 4 hours

Low Priority: Email ops every 24 hours

Low Priority w/ Suppress: Suppress for 20 minutes, then email ops every 24 hours

Low Priority no Email: Used for warnings in Ops Center only, no notification

Page 76: Si so product 1 day technical

77

Acknowledge Escalation and Suspend Actions

Page 77: Si so product 1 day technical

78

If You Can Measure It, You Can Manage It

Identify, Organize

KPMs

Establish Baselines

Define Alerts, Automate Response

Define Escalation Workflows

Learn from Data

Page 78: Si so product 1 day technical

79

Learn from Gathered Metric Data

Discrepancies in behavior among identical Apache

servers

Load balancer configuration the culprit: Expected

results following fix

Page 79: Si so product 1 day technical

80

If You Can Measure It, You Can Manage It

Identify, Organize

KPMs

Establish Baselines

Define Alerts, Automate Response

Define Escalation Workflows

Learn from Data

Page 80: Si so product 1 day technical

81

Hyperic Provides Top Down Visibility to Meet Goals

Modern Application Management

Monitoring for custom applications

Best tool to manage Spring apps

Top to bottom insight and control

Deep visibility into applications & services

Spans physical, virtual, and cloud

Managing The World’s Largest Infrastructure

Page 81: Si so product 1 day technical

92

Is a New Style of Infrastructure Needed?

Developers & Architects

And… IT Operations

We need a platform that can Run these

new apps.

Dynamic Load Balancing

Performance Management

Policy Driven Automation

Elastic App Server

Global Data Management

Cloud Messaging

Page 82: Si so product 1 day technical

93

Private Application Cloud Platform Vision

App and deployment policy uploaded to Cloud platform

Platform configures required services and provisions app

Launch application

Configure, Provision, Control Elastic App Runtime

Load Balancer

Trace, Monitor, Alert

Inventory

Policy-based Infrastructure Platform & Resource Pools(vSphere , vCloud Director)

In-Memory SQL

Messaging Service

Elastic Data Fabric

Deployment Policy

Your JavaSpringApp

Page 83: Si so product 1 day technical

94

Cloud Foundry

Open PaaS offering from VMware

Currently in Beta

Three Primary Flavors

• CloudFoundry.com – Complete Hosted PaaS

• CloudFoundry.org – The Community Site

• Cloud Foundry Micro-Cloud – PaaS for the Enterprise

Initially, CloudFoundry.com supports Spring for Java apps, Rails and Sinatra for Ruby apps, Node.js apps and apps for other JVM frameworks including Grails. Cloud Foundry also offers MySQL, Redis, and MongoDB data services.

Page 84: Si so product 1 day technical

96

VMware vFabric Cloud Application Platform

Application Infrastructure for the Cloud Generation

Virtual Datacenter Cloud Infrastructure and Management

Modern Frameworks and Tools

Modern Platform Services

Developer Productivity and Application

Portability

Optimized Runtime and Accelerated

Deployment Platform Services

vFabric

Frameworks and Tools

Page 85: Si so product 1 day technical

97

VMware vFabric Cloud Application Platform

Dynamic Load Balancer

Performance Management

Policy-driven Automation

Elastic App Server

Cloud Messaging

Global Data Management

Application Infrastructure for the Cloud Generation

Rich Web Integration Batch Data Access Social Media Cloud APIs

Virtual Datacenter Cloud Infrastructure and Management

tc Server ERS (Apache) HypericRabbitMQGemFirevFabric

AppDirector

Frameworks & Tools

vFabricPlatform Services

Page 86: Si so product 1 day technical

99

Evolutionary Approach to Cloud Application PlatformS

tag

e

Virtualization & Spring

0VM

App Server

Virtualized Applications

1

VM

vFabric tc Server

Cloud App Runtime

2Cloud Data

Management

3Cloud

Platform

4

Page 87: Si so product 1 day technical

100

vFabric Resources

• Partner Central

• Partner Central: http://www.vmware.com/go/learnvfabric

• vFabric Overview, PaaS Whiteboard, tcServer Demo, Hyperic Demo, Gemfire Presentation

• SME Email List for Technical Questions

[email protected]

Webinars

• http://www.springsource.com/newsevents/webinars

• Avoid Pitfalls when Monitoring a Virtualized Environment

• Next-Generation Data Management in the Cloud for Java Apps

• Best Practices for Virtualizing Java Workloads

• Performance Tuning Production tc Server: Tuning for Throughput & Scale

• Upcoming: The NPC Story - Speedier Apps, Minimal Downtime, Lower Cost

Page 88: Si so product 1 day technical

101

VMware’s Commitment to Partners

Page 89: Si so product 1 day technical

102

Solution Provider Benefits Include...

Training and Education

Branding and Customer Recognition

Intellectual Property & SET’s

NFR & IUL Software

Demand Generation

Incentives/ Margin

Sales Engagement

Page 90: Si so product 1 day technical

103

Temporary Program for Net New VMware vFabric Partners

REGISTERED

LEVEL REQUIREMENT

Application/Agreement: Sign & CompleteAbility to Sell: ACE, Workstation, Fusion, vSphere Essentials & Essentials Plus

Go to www.vmware.com

Partners- > Partner Programs

Solution Provider - > Registered

Apply Now

Fill in the Details and Submit

Page 91: Si so product 1 day technical

104

Sign up for Partner Central and Partner University

Partner Central is the exclusive online information resource, providing a single dedicated web portal for all VMware Partners.

Page 92: Si so product 1 day technical

105

Key Takeaways

VMware’sIT as a Service

Vision

VMware vFabricCombines Spring framework and

tools with vFabric platform services to speed delivery of next-generation apps that are instantly

scalable and cloud-portable

Cloud Application

PlatformKey Drivers

Page 93: Si so product 1 day technical

© 2009 VMware Inc. All rights reserved

Questions?

vFabric Platform Deep Dive

April 18th, 2011

Page 94: Si so product 1 day technical

107

Appendix A

Use Cases

Page 95: Si so product 1 day technical

108

tcServer Successes

Page 96: Si so product 1 day technical

109

Case Study – From Level 0 to Level 1.5

Moved from Traditional to Elastic Application Server

Benefits:• Faster Testing and Live Deployments –

• From Hours to Minutes

• Rapid Turnaround on Production Fixes

• Proactive Problem Solving

• H/A – 100% Uptime on Website

• Improved Performance – 3X

• Reduced Server Costs

The Digital Services Division (DSD) of Associated

Newspapers (ANL) provides all online development and infrastructure services to ANL’s online

portfolio of newspaper web sites. This includes

the Daily Mail, UK’s largest online newspaper

website, as well as Evening Standard, This Is

Money, Metro and 150+ regional sites. ANL’s goal

is to deliver websites that offer an engaging and

satisfying experience for users and measurable

commercial benefits to advertisers. ANL is part of

the Daily Mail and General Trust plc.

“In the newspaper environment, we constantly need to find new and innovative ways to monetize our content,” Perkinson continues.

“Ideas for new features are coming through all the time, and for us to be able to turn those features around and get them to market quickly is absolutely key. But with Oracle WebLogic, developers were constantly task switching while waiting for Oracle WebLogic to deploy and start up our applications after each test and staging release.”

Notable Quote

About the Company

Page 97: Si so product 1 day technical

110

Case Study – Level 0 to Level 2

110

Confidential

NPC International, based in Overland Park, Kansas, is the largest Pizza Hut franchisee in the world and is

owned by Merrill-Lynch Global Private Equity Group. NPC International connects to its 1,200 restaurants

across the US via a web application deployed through the local POS system, providing a variety of essential

corporate functionality such as payroll, vacation requests, compliance management, invoice approval and online employee training. The web-based system

must be kept running at top performance to handle 170,000 page views per day by NPC International

users.

Virtual Cloud Infrastructure

tcServer has enabled NPC International to implement an internal, private cloud of VMware-based virtual server resources, to maximize efficient usage of existing infrastructure. Because tc Server’s footprint is small, 12 tc Server instances are running on a single physical box, with additional capacity available to install more tc Server instances when needed. Consequently, tc Server enables NPC International to maximize internal server resources by eliminating the multiple machines necessary to run numerous

application servers.

“I could not have deployed the applications within VMware-based virtual machines without tc Server,” Brisbin says. “I need a

small, lightweight server that starts in a few seconds. I need to run several instances so I can make use of all the CPU

resources.”

Benefits:

• Enhanced Application Performance

• High Availability

• Increased Developer Productivity

• Greater Scalability and Improved User Experience

• Virtual Cloud Infrastructure

• Reduced Server Costs by 75%

Page 98: Si so product 1 day technical

111

GemFire Successes

Page 99: Si so product 1 day technical

112

Use Case - ForEx

Low-latency trade insertionPermanent Archival of every tradeKept pace with fast ticking market dataRapid, Event Based Position CalculationDistribution of Position Updates GloballyConsistent Global Views of PositionsPass the BookRegional Close-of-dayHigh AvailabilityDisaster RecoveryRegional Autonomy

The project achieved:

real-life use case: Global Foreign Exchange Trading System

Page 100: Si so product 1 day technical

113

real-life use case: Global Foreign Exchange Trading System

Use Case - ForEx

In that same application, GemFire replaced:

Oracle Database In Every Region

Still need 1 instance for archival purposes

TIBCO Rendezvous for Local Area Messaging

IBM MQ Series for WAN Distribution

Veritas N+1 Clustering for H/A

In fact, we save the physical +1 node itself

3DNS or Wide IP

Admin personnel reduced from 1.5 to 0.5

Page 101: Si so product 1 day technical

114

real-life use case: Event-driven Risk and Pricing

Use Case – Event Management

Batch processing delays were costing money

Running Pricing and Risk calculations in batch mode required special applications to be written that created a ‘buffers’ to ensure that regulatory obligations were not violated (BASEL II regulations).

and limiting opportunities

An initial attempt to produce event-detection processing on legacy technology would not scale. Only 43 priority products could be managed – other products could not take advantage of a known tactical advantage.

Page 102: Si so product 1 day technical

115

real-life use case: Event-driven Risk and Pricing

Use Case – Event Management

"The breakthrough for this tool came when we decided to put the event detection logic into our pricing models"

Derek Joyce

Chief Business Technologist for Equity Derivatives

JPMorgan investment Bank

Built and deployed the Event Workstation project in under 12 months

Features: Real-time event detection, easier integration of new products, and control workflow to minimize business risk and meet all regulatory requirements

Trader UI queries reduced from 20 minute to under 5 second response time

8 CPUs re-price 6000 complex and exotic instruments in under 3 minutes

Page 103: Si so product 1 day technical

116

A mainframe-based, nightly customer account reconciliation batch run

Use Case – Mainframe Migration

min

0 12060

I/O Wait9%

CPU Busy15%

Mainframe

CPU Unavailable15%

COTS ClusterBatch now runs in 60 seconds

93% Network Wait! Time could have been reduced further with higher network bandwidth

real-life use case: Mainframe-based Nightly Batch Run

Page 104: Si so product 1 day technical

118

real-life use case: Web 2.0 Portal – Customized ads

Use Case – Web Portal

A popular online gambling site attracts new players through ads on affiliate sites

Customized Banner Ad on affiliate site

Affiliate's Web Server

1 Banner Ad Server

23

4

In a fraction of a second, the banner ad sever must:Generate a tracking id specific to the request

Apply temporal, sequential, regional, contractual and other policies in order to decide which banner to deliver

Customize the banner

Record that the banner ad was delivered

Page 105: Si so product 1 day technical

119

real-life use case: Web 2.0 Portal – Customized ads

Use Case – Web Portal

Their initial RDBMS-based system

Limited their ability to sign up new affiliates

Limited their ability to add new products on their site

Limited the delivery performance experienced by their affiliates and their customers

Limited their ability to add additional internal applications and policies to the process

Their new GemFire-based systemResponded with sub-millisecond latency

Met their target of 2500 banner ad deliveries per second

Provides for future scalability

Improved performance to the browser by 4x

Cost less

Page 106: Si so product 1 day technical

120

real-life use case: DISA / DOD Global Command and Control

Use Case – Asset/Position Monitoring

Centralized data storage was not possible

Multi-agency, multi-force integration

Numerous Applications needed access to multiple data sources simultaneously

Networks constantly changing, unreliable, mobile deployments

Upwards of 60,000 object updates each minute

Over 70 Data feeds

Needed a real-time situational awareness system to track friendly assets and enemy assets that could be used by all of the war fighters in theatre

Northrop Grumman (integrator) investigated the following technologies before deciding on GemFire• RDBMS – Oracle, Sybase, Postgres, TimesTen, MySQL

• ODBMS - Objectivity

• jCache – GemFire, Oracle Coherence

• JMS – SonicMQ, BEA Weblogic, IBM, jBoss

• TIBCO Rendezvous

• Web Services

Page 107: Si so product 1 day technical

121

real-life use case: DISA / DOD Global Command and Control

Use Case – Asset/Position Monitoring

655 sites, 11 thousand users

Real-time, 3 dimensional, NASA World Wind User Interface

Active, directed event propagation

On the desk of

President of the United States

US Secretary of Defense

Each of the Joint Chiefs of Staff

Every commander in the US Military

Likely to be adopted as the joint, common operating picture for US allies and friendlies

Page 108: Si so product 1 day technical

122

RabbitMQ Successes

Page 109: Si so product 1 day technical

123

BBC - real time content management

Source feeds are collated, transformed

and routed to their destinations

Page 110: Si so product 1 day technical

124

Pubsub at massive scale: “Twitter for Data in the Cloud”

Oceanographic Observatory Institute

Page 111: Si so product 1 day technical

125

Putting it all together: The OOI National Network

125