Create an Amazon Redshift Cluster with FlyData!

25
www.flydata.com Creating a Redshift Cluster with FlyData Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Transcript of Create an Amazon Redshift Cluster with FlyData!

Page 1: Create an Amazon Redshift Cluster with FlyData!

www.flydata.com

Creating a Redshift

Cluster with FlyData

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 2: Create an Amazon Redshift Cluster with FlyData!

Step 1: Select a

Region and Create

a Security Group

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 3: Create an Amazon Redshift Cluster with FlyData!

Sign into the AWS Console at aws.amazon.com

Copyright © 2014 FlyData Inc. All rights reserved.

1. <todo1>

2. <todo2>

3. ...

http://flydata.com/

Page 4: Create an Amazon Redshift Cluster with FlyData!

Under the “Database” section,

click on “Redshift”

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 5: Create an Amazon Redshift Cluster with FlyData!

Before we set your cluster up, we first need to

select an appropriate region and create a security

group.

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 6: Create an Amazon Redshift Cluster with FlyData!

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 7: Create an Amazon Redshift Cluster with FlyData!

But wait!

1. Your newly created group isn’t authorized!

2. This makes sense, given that we haven’t even authorized any IPs to access the

cluster.

3. In the drop-down menu, select “CIDR/IP” and enter the IP addresses of the

machines you want to authorize. In this demo, we simply want to give our own

computer access, so we will just paste the IP address of our own computer.

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 8: Create an Amazon Redshift Cluster with FlyData!

Step 2: Configure

Your Cluster!

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 9: Create an Amazon Redshift Cluster with FlyData!

The following is straightforward.

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 10: Create an Amazon Redshift Cluster with FlyData!

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 11: Create an Amazon Redshift Cluster with FlyData!

Types of Nodes

1. On the “Node Configuration” page, you’ll notice that there are

four different types of nodes! Make sure you a choose a type

according to what your organization requires.

- dw1.xlarge: 4.4 EC2 Compute Units per node, 15GB of

memory, and 2TB HDD storage per node; moderate I/O

performance

- dw1.8xlarge: 35 EC2 Compute Units per node, 120GB of

memory, and 16TB HDD storage per node; very high I/O

performance

- dw2.large: 7 EC2 Compute Units per node, 15GB of memory,

and 160GB SSD storage; moderate I/O performance

- dw2.8xlarge: 104 EC2 Compute Units per node, 244GB of

memory, and 2.56TB SSD storage; very high I/O performance

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 12: Create an Amazon Redshift Cluster with FlyData!

Additional Configuration

- On the “Additional Configuration” page, we will be

using “default.redshift-1.0” as our cluster parameter

group. This group will apply all of its parameters to

all of the databases you create on this cluster.

- For more information on managing parameter

groups, check out this AWS guide on parameter

groups. As for encryption, we will be selecting “none”

for tutorial purposes but if you have a hardware

security module or will want to use Amazon Web

Services’ “key management service”, choose

accordingly.

- On the bottom section, choose the security group

you created earlier!

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 13: Create an Amazon Redshift Cluster with FlyData!

Additional Configuration

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 14: Create an Amazon Redshift Cluster with FlyData!

CloudWatch

- On this page you will also have the

option to create an alarm

(CloudWatch) to monitor your disk

usage and alert you when the nodes

reach a certain percentage, but we

will be leaving it off in this tutorial.

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 15: Create an Amazon Redshift Cluster with FlyData!

Additional Configuration

- After additional configuration, you will

finally reach the review page. Here,

there is a summary of all the settings

you configured for this cluster. At the

bottom, there will also be the hourly

rate for your cluster. Once you’re

done reviewing, you are ready to

launch!

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 16: Create an Amazon Redshift Cluster with FlyData!

Review of Configuration

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 17: Create an Amazon Redshift Cluster with FlyData!

Hourly Rate

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 18: Create an Amazon Redshift Cluster with FlyData!

Step 3: Launch!

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 19: Create an Amazon Redshift Cluster with FlyData!

It will take a few minutes...

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 20: Create an Amazon Redshift Cluster with FlyData!

Finished!

Copyright © 2014 FlyData Inc. All rights reserved.

- Once it’s finished, click on the name and you will see a

summary of the properties and status of your cluster.

- You will also see ODBC and JDBC URLs that you will use

to connect to your cluster.

- On the top left, there is a drop-down box with options to

reboot, resize, shutdown, or reboot your cluster.

http://flydata.com/

Page 21: Create an Amazon Redshift Cluster with FlyData!

Summary

Copyright © 2014 FlyData Inc. All rights reserved. http://flydata.com/

Page 22: Create an Amazon Redshift Cluster with FlyData!

That’s all!

Copyright © 2014 FlyData Inc. All rights reserved. https://www.flydata.com/

Page 23: Create an Amazon Redshift Cluster with FlyData!

Moving Your Data, on the Fly!

You should now have a Redshift cluster configured and running!

Now that your setup is complete, you can start loading data to

your cluster!

At FlyData we offer data integration solutions to Amazon

Redshift. As an AWS partner, our mission is to securely and

seamlessly integrate your data with our solutions, so you can

easily access fresh data when you need it. If you’d like to read

further on how to setup FlyData with your Redshift cluster,

please proceed to the appropriate guide below:

- Syncing with MySQL

- Syncing with RDS MySQL

- Getting Started with FlyData Autoload

- FlyData Heroku Gem

Copyright © 2014 FlyData Inc. All rights reserved. https://www.flydata.com/

Page 24: Create an Amazon Redshift Cluster with FlyData!
Page 25: Create an Amazon Redshift Cluster with FlyData!

www.flydata.com www.flydata.com

Check us out!

-> http://flydata.com

[email protected]

Toll Free: 1-855-427-9787

http://flydata.com

We are an official data integration

partner of Amazon Redshift