Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema...

16
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Julius Sacramento Sr. Solutions Architect, Microsoft Platform 4/23/2020 Introduction to: Amazon Aurora Database Migration Service Schema Conversion Tool

Transcript of Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema...

Page 1: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Julius Sacramento

Sr. Solutions Architect, Microsoft Platform

4/23/2020

Introduction to:Amazon Aurora

Database Migration Service

Schema Conversion Tool

Page 2: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Amazon RDS is . . .

Open source engines Commercial engines

RDS platform

• Automatic fail-over

• Backup & recovery

• X-region replication

• Isolation & security

• Industry compliance

• Automated patching

• Advanced monitoring

• Routine maintenance

• Push-button scaling

Image credit: By Mackphillips - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=55946550

Cloud native engine

Page 3: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Amazon Aurora is . . .. . .

Cloud native engine Open source engines Commercial engines

RDS platform

• Automatic fail-over

• Backup & recovery

• X-region replication

• Isolation & security

• Industry compliance

• Automated patching

• Advanced monitoring

• Routine maintenance

• Push-button scaling

Image credit: By Mackphillips - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=55946550

Page 4: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Amazon Aurora - databases reimagined for the cloud

Speed and availability of high-end commercial databases

Simplicity and cost-effectiveness of open source databases

Drop-in compatibility with MySQL and PostgreSQL

Simple pay as you go pricing

Delivered as a fully managed service

Page 5: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Availability zone 1

Region

Availability zone 2 Availability zone 3

Scale-out, distributed, multi-tenant design . . .

Purpose-built log-structured,

distributed storage

Shared storage volume

Storage nodes with SSDs

Master

SQL

Transactions

Caching

Reader

5

Reader

9

SQL

Transactions

Caching

SQL

Transactions

Caching

Reader

1

SQL

Transactions

Caching

Reader

8

SQL

Transactions

Caching

Reader

15

SQL

Transactions

Caching

… … …10GiB stripes

Master and up to 15 Readers all point to the same storage

6-way replication, 2 per AZ

Quorums survive AZ+1 failure

Page 6: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Availability zone 1

Region

Availability zone 2 Availability zone 3

With provisioned Aurora, you size the master yourself

Shared storage volume

Storage nodes with SSDs

Master

SQL

Transactions

Caching

Size for the peak load

-or-

Continuously monitor and manually scale up/down

Page 7: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Aurora Serverless . . .

Responds to your application automatically

• Start up

• Shut down

• Scale capacity

Page 8: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Aurora Serverless . . .

Responds to your application load automatically

• Scale capacity with no downtime

• Multi-tenant proxy is highly available

• Scale target has warm buffer pool

• Shuts down when not in use

Page 9: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Database Migration Service

• Start your first migration in 10 minutes or less

• Keep your apps running during the migration

• Replicate within, to or from Amazon EC2 or RDS

• Move data to the same or a different database engine

AWS

Database Migration

Service

Page 10: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Database Migration Service

Benefits:

• Simple and straightforward to use

• Minimal downtime

• Supports widely used databases

• Low cost

• Fast and easy to setup

Page 11: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Database Migration Service

Use Cases:

• Migration or Replication

• Multiple Sources

• Consolidation

• Multiple Targets

• Sharding

• Reporting

• Disaster Recovery

• Cross Engine

• Same / Same (SQL Server -> SQL Server)

• Same / Different (SQL Server -> Aurora)

Page 12: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

DMS Components

• Replication Instances• Basically EC2 instances designed and configured with DMS

software, managed by AWS

• Endpoints• Defines the connections used by the replication instances

• Tasks• Defines the workload of the replication instances

Page 13: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Schema Conversion Tool

Page 14: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

AWS Schema Conversion Tool

Features

Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL

Database Migration Assessment report for choosing the best target engine

Code browser that highlights places where manual edits are required

The AWS Schema Conversion Tool helps

automate many database schema and code

conversion tasks when migrating from Oracle

and SQL Server to open source database

engines.

Page 15: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

SCT - Convert Tables, Views & Code

• Sequences

• User Defined Types

• Synonyms

• Packages

• Stored Procedures

• Functions

• Triggers

• Schemas

• Tables

• Indexes

• Views

Page 16: Introduction to - aws-labs.net · AWS Schema Conversion Tool Features Oracle and SQL Server schema conversion to MySQL/Aurora/MariaDB and PostgreSQL Database Migration Assessment

© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark

Database Migration Assessment Report

1. Connect To

Source And

Target

2. Run Assessment

Report

3. Read Executive

Summary

4. Follow Detailed

Instructions