Cloud Computing and Its Impact on Test and Evaluation ITEA Conference 2012

Mark Ryland Chief Solutions Architect Worldwide Public Sector Team

Background: Amazon as Cloud Pioneer?

• More than 10 years ago began an internal transition to a rich web services / SOA architecture

• Enabled engineers to focus on differentiated value rather than re-creating / maintaining undifferentiated “stuff”

• Recognized value of these innovations to all organizations

• Amazon Web Services launched in 2006

• AWS now major force in “cloud” aka utility computing

Perspective on Scaling: Infrastructure

Each day Amazon Web Services adds enough new capacity to support all of Amazon.com’s global

infrastructure through the company’s first 5 years, when it was a $2.76B annual revenue enterprise

Perspectives on Scaling: S3 Scales…

Total Number of Objects Stored in Amazon S3

2.9 Billion 14 Billion 40 Billion 102 Billion

262 Billion

762 Billion

Peak Requests: 700,000+ per second

1 Trillion

Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q4 2011 June 2012

AWS, Start-ups, and Beyond

Cloud has had huge impact on the start-up world

Two recent examples • “Scaling Instagram” – architecture and lessons learned: 30M

active users with 3 dev/ops engineers

• pinterest.com: see presentation at recent AWS NYC Summit

Agility, flexibility, high scalability, zero capex

The transition to utility computing now underway in enterprise and government

Security & Compliance Resources

• Security & Compliance Center: http://aws.amazon.com/security

• Security Overview & Best Practices

• AWS Risk & Compliance Whitepaper

• Creating HIPAA Compliant Applications

Hardware, Software & Network

• Systematic change management

• Phased updates deployment

• Safe storage decommission

• Continuous monitoring and self-audit

• Advanced network protection systems

Certifications and Accreditations

• FISMA Moderate Controls and GSA ATO

• DIACAP MAC III / Sensitive ATO

• SSAE 16 / ISAE 3402 / SOC1 (formerly U.S. standard SAS-70 Type II); ISO 27001

• Payment Card Industry (PCI) DSS Level 1

• HIPAA applications certified on AWS

• ITAR region -- GovCloud

Physical

• Datacenters in nondescript facilities

• Physical access strictly controlled

• Must pass two-factor authentication at least twice for floor access

• Physical access logged and audited

• Logical access logged and audited

Built to Enterprise & Gov’t Security Requirements

No Up-Front

Capital Expense

Pay Only for

What You Use

Self-Service

Infrastructure Easily Scale

Up and Down

Improve Agility &

Time-to-Market

Low Cost

Cloud Computing Benefits

Deploy

AWS Platform Overview

Compute Storage

AWS Global Infrastructure

Database

App Services

Deployment & Administration

Networking

Map View US West x 2 (N. California and

Oregon)

US East (Northern

Virginia)

Europe

West (Dublin)

Asia Pacific

Region (Singapore)

Asia Pacific

Region (Tokyo)

8 AWS Regions and growing

30+ AWS Edge Locations for CloudFront (CDN) & Route 53 (DNS)

US GovCloud (US ITAR Region

-- Oregon)

LATAM (Sao Paola)

See http://aws.amazon.com/about-aws/globalinfrastructure/

Create NoSql database with 100k reads, 50k writes per second provisioned thru-put (total 150,000 I/Os per sec) • AND synchronous replication of all writes for extreme

durability … across three datacenters … with internal latency of less 10 milliseconds

We’ll launch a 60 node cluster to test the database • And observe the powerful introspection capabilities that enable

cloud automation

Join the demo fun soon at http://demo.dynaspeed.net • Home page www.dynaspeed.net

Cloud Computing Demo

[screen capture]

Showed this screen-capture video: http://www.dynaspeed.net/DynamoDB-table-creation-longer.mp4

Region

Availability Zone Availability Zone Availability Zone

DynamoDB DDB storage node

All SSD drives

DDB storage node

All SSD drives

DynamoDB authn /

distributed partition

manager (auto-

partitioning)

Cluster

controller

120 c1.medium

instances / 240

virtual CPUs

DDB storage node

All SSD drives

DDB storage node

All SSD drives

DynamoDB authn /

distributed partition

manager (auto-

partitioning)

DDB storage node

All SSD drives

DDB storage node

All SSD drives

DynamoDB authn /

distributed partition

manager (auto-

partitioning)

Data bus across availability zones (sync/async replication)

Showed master node and worker nodes simulating a web/analytics tier • App-level automation: all application functionality built in to

single pre-configured OS image – launch and go

Added 60 more worker nodes (120 vCPUs) to the test cluster

Added load to the database and observe scaling behavior, throttling at high end

Cloud Computing Demo…

Implications for Test & Eval

Cloud computing revolution also about a fundamentally new application architecture • A new way to deliver highly available and highly scalable

applications on commodity (read: cheap and unreliable) hardware and networks

• Assume that nodes will fail willy-nilly, and build a distributed system that keeps running…

• Users and software trained by web to “retry” upon failure

• Background reading: CAP theorem, Paxos clusters

Implications…

Build and deploy a system for which there is zero intended downtime

Big mind-shift required to make that possible

Side-by-side deployment of different versions of each system tier on scaled-out (virtual) machines

Careful staging and dynamic upgrading to new features when all nodes in all tiers are deployed

Implications…

“Dev/Ops” [Dev/Test/Ops] is the new normal • Developers with pagers

Testing becomes much more meaningful and central to the process, yet at the same time basically impossible (at scale)

Change management becomes fundamental: both roll forward and roll back (quickly)

Cloud: challenge and (part of) solution

Fundamental new challenges

Powerful new tools to meet those challenges • Basically unlimited, flexible, automateable

infrastructure available “for rent” anytime

• Using the cloud to test the cloud • Google “bees with machine guns”

Exciting new era for test & evaluation in the world of information technology

Thank You!

Mark Ryland markry@amazon.com