AWS Webcast - Amazon RDS - Running Low Admin High Performance Databases in the Cloud
-
Upload
amazon-web-services -
Category
Documents
-
view
108 -
download
3
description
Transcript of AWS Webcast - Amazon RDS - Running Low Admin High Performance Databases in the Cloud
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Amazon RDS
Shakil Langha ([email protected]) Business Development Manager
Running Low Admin High Performance Databases in the Cloud
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
What is AWS?
Compute Storage
AWS Global Infrastructure
Database
Application Services
Deployment & Administration
Networking
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Amazon DynamoDB Fast, Predictable, Highly-Scalable NoSQL Data Store
Amazon RDS Managed Relational Database Service for
MySQL, Oracle and SQL Server
Amazon ElastiCache In-Memory Caching Service
Amazon Redshift Fast, Powerful, Fully Managed, Petabyte-Scale
Data Warehouse Service
Compute Storage
AWS Global Infrastructure
Database
Application Services
Deployment & Administration
Networking
AWS Database Services
Scalable High Performance Application Storage in the Cloud
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Amazon DynamoDB Fast, Predictable, Highly-Scalable NoSQL Data Store
Amazon RDS Managed Relational Database Service for
MySQL, Oracle and SQL Server
Amazon ElastiCache In-Memory Caching Service
Amazon Redshift Fast, Powerful, Fully Managed, Petabyte-Scale
Data Warehouse Service
Compute Storage
AWS Global Infrastructure
Database
Application Services
Deployment & Administration
Networking
AWS Database Services
Scalable High Performance Application Storage in the Cloud
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
backup & recovery, data load & unload
performance tuning 25% 40%
5% 5%
scripting & coding security planning
install, upgrade, patch and migrate
documentation, licensing & training
Why Managed Databases?
differentiated effort increases the uniqueness
of an application
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Amazon RDS RDS is a fully managed relational database service that is simple to deploy, easy to scale, reliable and cost-effective
Ease of Deployment and Patching
Push Button Scalability
Choice of DB Engines and Application Compatibility
Automated Backups and Disaster Recovery
User Snapshots and Cloning
Monitoring and Automatic Host Replacement
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Case Study: Samsung saved $34M
Problem
Needed to reduce IT costs and were looking to create a more flexible IT environment
Solution
AWS and RDS services. With every request, the application authenticates devices, delivers apps and content, and pushes notifications.
Business Benefits
Saved $34M in hardware and maintenance expenses, 85% less than running on-premises
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Problem
Outgrew existing IT environment
Solution
AWS’s elasticity made it easy to respond to demand peaks and saved money during off peak times
Business Benefits
Scaled to handle 10 million visitors per day
Reduced time-to-market and dev time
Case Study: Gumi serves millions of users
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Challenges
Time to Market – Faster release cycles
Cost – Millions of users, Seasonal peaks
Reliability – Fast, Always ON
Solution
Use Amazon EC2, RDS, CloudFormation
Multiple Availability Zones (by default)
Business Benefits
Uptime greater than 99.9%
Hands free recovery using Amazon RDS
Monthly to weekly release cycles
Case Study: Intuit Live Community
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Flipboard Serves Billions of Pages With RDS
Challenges
6 months to deploy a real-time, socially relevant magazine
5 million users, 2 billion page flips per month
Allow frequent changes system and user requirements
Solution
Amazon EC2, RDS, ElastiCache
Multiple Availability Zones
Business Benefits
High performance, reliable, proven DB technology
Better Response time (Milliseconds) and uptime
Complex queries on user and relevancy data
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Low Admin
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Key Features • Manageability
• Rapid deployment with pre-configured parameters • Patch Management • Monitoring and Metrics
• Availability and Data Durability • Automated Backups and Point-In-Time-Recovery • DB Snapshots • Automatic Host Replacement (Single-AZ) • Multi-AZ deployments
• Scalability • Push-Button Scaling (Storage, Memory and Compute) • Read Replicas
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Rapid deployment via Web Console
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Backups and Recovery • DB Snapshots
• User-driven snapshots of database • Kept until explicitly deleted
• Automated Backups • Nightly system snapshots + transaction backup • Enables point-in-time restore to any point in retention period, up to the last 5 minutes • Max retention period = 35 days
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Push Button Scaling
• Scale nodes vertically up or down • M1.small (1 virtual core, 1.7GB) • M2.4XLarge (8 virtual cores, 64GB)
• Scale out nodes horizontally • Shard based on data or workload characteristics
• Scale Storage vertically without incurring downtime
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
High Availability: Multi-AZ Deployments
• Enterprise-grade fault tolerance solution for production databases
• With a few clicks, Amazon RDS creates and synchronously maintains a standby in a different Availability Zone
• Automatic failover in case of: • Loss of availability in primary AZ • Loss of connectivity to primary • Host or storage failure on primary • Vertical Scaling • Software patching
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Do It Yourself MySQL replication
Potentially ~100+ Manual steps
Set up primary and standby instances
Set up identical volumes
Create synchronous replication
Create and manage DNS entries
Detect instance failure conditions
Detect network failure conditions
Detect storage failure conditions
Decide when to fail-over….
Re-establish primary secondary connections.
Amazon RDS Multi-AZ
HA with a mouse click
Creating High Availability Databases
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Horizontal Scaling with Read Replicas • Add Read Replicas
• Horizontal scaling of read heavy workloads • Offload reporting
• Keep in mind • Asynchronous, native tech • Single threaded and brittle • Currently available for MySQL
• Overcoming challenges • RDS makes it easy to re-create if fallen behind • Deploy a proxy to round robin requests
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Amazon RDS Read Replica
Read Replica with a mouse click
Do It Yourself MySQL Read Replica
~30+ manual steps
Creating a Read Replica
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
High Performance
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
High Performance RDS
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
• Able to run applications on AWS without changing the existing technology
stack or user interface
• Test confirmed that utilizing Amazon RDS for Oracle Database and Amazon
RDS Provisioned IOPS reduced processing time from 96 to 24 hours
• Estimates a 50% cost savings over a three-year period
The Story Business Benefit
• Australian consulting firm that provides software development services to the energy,
telecommunications, finance and retail industries
• Enterprise clients found the Oracle-based applications costly to run on an on-premises
infrastructure
• Shine wanted to run the applications as a cloud-based service but had to port a large, ten-
year-old Oracle Database
• Using Amazon RDS for Oracle Database, Amazon RDS Provisioned IOPS, Amazon EC2,
Amazon VPC, and Multi-AZ
“We leveraged Amazon RDS Provisioned IOPS to decrease processing time for our Oracle applications from 96 to 24 hours.”
- Adam Kierce, Principal and Co-Founder
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Provisioned IOPS: Details Provision up to 3TB and 30,000 IOPS
Provisioning more than max per engine reduces latency
Convert from Standard to Provisioned IOPS storage
Scale storage and IOPS independently on-line
Engine Max IOPS for m2.4xlarge
Oracle (3TB) 25,000
MySQL (3TB) 12,500
SQL Server (1TB) 10,000
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Parameters of RDS Performance
Instance Size CPU Memory Bandwidth P-IOPS Optimized
Provisioned IOPS I/O Performance
Allocated Storage # of Storage Volumes
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Amazon RDS Configuration
Improve Availability
Increase Throughput
Reduce Latency
Push-Button Scaling
Multi AZ
Read Replicas
Provisioned IOPS
Read Replicas Push-Button Scaling Provisioned IOPS
Region
Multi-AZ
Availability zone Availability zone
RDS for Production Workloads
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Data Migration
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Migrating to RDS
Advanced Migrations
Incremental Loads
3rd Party Tools
Basic Migrations
Export/Import
Bulk Load
Not Supported
Restore from backup
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Basic Migration
On Premises AWS
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
RDS Basic Migration
MySQL
mysqldump
mysqlimport
Oracle
Data Pump
SQL*Loader
SQL Server
Gen./Publish Scripts
Bulk Copy
Advantages • Simple • Ideal for initial load • Can be used for small
or large datasets
Disadvantages • Requires downtime
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Advanced Migration
On Premise
Dump Copy Backup
AWS
Apply Delta Changes
DB
T1 T1 T2 T2
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
RDS Advanced Migration
MySQL
mysqlbinlog
Tungsten Replicator
Oracle
Mview replication
GoldenGate
Dbvisit
SQL Server
Linked Servers
SSIS
Advantages • Incremental loads • Inbound replication • Minimizes downtime
Disadvantages • Complex
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Post-migration Steps
• Turn on Backups • Turn on Multi-AZ • Create Read Replicas • Tighten down security • Notifications via CloudWatch, DBEvents
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
• RDS Home Page: https://aws.amazon.com/rds/ • RDS FAQs: http://aws.amazon.com/rds/faqs/ • RDS Webinars: https://aws.amazon.com/resources/databaseservices/webinars/ • RDS MySQL Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/MySQL.Procedural.Importing.html • RDS SQL Server Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/SQLServer.Procedural.Importing.html • RDS Oracle Import: http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Oracle.Procedural.Importing.html
More Information
©2013, Amazon Web Services LLC or its affiliates. All rights reserved.
Questions?