Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata...

21
#TDPARTNERS16 Sept 11,2016 GEORGIA WORLD CONGRESS CENTER Enabling the Hybrid Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata

Transcript of Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata...

Page 1: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

#TDPARTNERS16 Sept 11,2016 GEORGIA WORLD CONGRESS CENTER

Enabling the Hybrid Cloud

David GilbreathUnity Ecosystem Architect, Teradata

Paul LaPointeUnity Architect, Teradata

Page 2: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

At Teradata, we believe…

Analytics and data unleash the potential of great companies

Page 3: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Enabling The Hybrid Cloud

3

• What is the Hybrid Cloud?• Why is the Fluid Hybrid Cloud Interesting?• Moving Workload to the Cloud• Building a Sandbox in the Cloud

• passive routing to an analytic sandbox• Synchronizing objects and data with the cloud

• managed routing • Cloud based DR

• full system copy in the cloudList of Tools

Page 4: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

4

Teradata Workload-Specific Platform Family

Teradata Managed Cloud

Teradata Database on …

On-Premises Managed Cloud Public Cloud

Teradata Hybrid Cloud: Same Software, Many Options

What is the Hybrid Cloud?

Fluid Hybrid Cloud: Same Schema, Same Data, Everywhere

Page 5: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Why is the Fluid Hybrid Cloud Interesting?

5

• Fluid Hybrid Cloud - expand/retract capacity• Populate cloud instances with real existing EDW objects • Build analytic sandboxes from real objects• Move workload to the cloud• Build test environments• Deploy applications to the cloud • Provide DR in the cloud

Analytics Tools and

Users

INTEGRATED DATA WAREHOUSE

Source Systems

INTEGRATED DATA WAREHOUSE

Page 6: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Rules of a Fluid Hybrid Cloud

6

A Fluid Hybrid Cloud should follow certain rules• Users should route to and from the cloud seamlessly

• Routing by kind of work• Sandboxes cannot alter production• Workload should be allowed to move to and

from the cloud in a controlled way• Systems in the cloud should be easily stood up

and shutdown• Everything should be scriptable• No manual steps required• Capacity level is always changing

Page 7: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Proof: Moving an application to the Cloud

7

We have set up a demo to show a simple case of moving a workloadStart with an existing Unity managed Teradata EDW then:• Add a cloud system• Copy a simple application to the cloud• Automatically route users to Cloud or EDW based on login

INTEGRATED DATA WAREHOUSE

Source workload Systems

Page 8: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Provisioning and Configuration

8

Standing up a system and add it to a Unity clusterwithout navigating the vendor UI to order a system

Steps:• Generate X.509 certificates – PEM files (1 time)• Simple Vagrant Script – provisions system and creates host entry• Configure Unity

Page 9: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Vagrant Script

9

VAGRANTFILE_API_VERSION = "2"Vagrant.configure(VAGRANTFILE_API_VERSION) do |config|

config.vm.define :delta do |x|x.vm.box = "dummy"x.vm.hostname = "awsCloud"

x.vm.provider :virtualbox do |v|v.name = "awsCloudHost"

end

x.vm.provider :aws do |aws, override|

aws.access_key_id = "<ACCESS KEY ID>"aws.secret_access_key = "<SECRET ACCESS KEY>"aws.keypair_name = "Vagrant-aws"aws.ami = "ami-68f51e08"aws.region = "us-west-2"aws.instance_type = "m4.4xlarge"aws.monitoring = "false"aws.security_groups = ["Teradata Database Base Edition EBS 5TB -Single Node--15-10-01-06-AutogenByAWSMP-"]

override.vm.box = "dummy"override.ssh.username = "ec2-user"override.ssh.private_key_path = "/path/to/Vagrant-aws.pem"

endend

end

Page 10: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Add to the Unity Cluster

10

Steps:• Add system to Unity /etc/hosts files• Configure proxy on the database• Add system to Unity• unityadmin -u admin -P admin -e "system add tdpid“

• Create management user• Add dispatcher processes for each region• Update configuration• Add routing rules

Page 11: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

More to Configure

11

• Configure Query Grid• Open Ports• Share certificates

• Add jobs to Data Mover• Create Schema • Create Users and databases

INTEGRATED DATA WAREHOUSE

Query Grid

Data Mover

Schema Users

Page 12: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Workflows Provided

12

• Ecosystem manager workflows that manage all scripts are being made available

• Identify your preferred cloud vendor• Identify your application objects (all dependencies) • Execute the workflow

Run from the EM UI or execute automatically based on alerts:

sendevent --et START -r Workload_PublicCloud –tds WORKFLOW -w WORKFLOW -t WORKFLOW

Page 13: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Moving workload to the Cloud

13

• Identify all dependencies• Missing dependencies results in applications that fail• Using passive routing in Unity allows you to identify these

dependencies in a sandbox• Choose your goal state:

• Simple Sandbox – Schema only• Isolated analytics – Schema and Point in time

synchronization• Active Data Synchronization – Full Active - Active

Page 14: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Building a Sandbox in the Cloud

14

Cloud resources can be temporary by their nature.Users should not have remember which cloud system is active.

“The Fluid Cloud solution including Unity allows users to connect to the same virtual system over and over again even if actual system has moved in the cloud to a new system or even a new cloud vendor.”

Passive Routing in Unity can direct users to any Teradata System, Anywhere.

Page 15: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Data Synchronization in the Cloud

15

Data synchronization with the cloud can be done using all common methods available today.• Data Mover• Dual Load • UnitySome methods of synchronization have risks• Possible interruption of objects in the EDW• Requires strong understanding of object dependenciesUnity Roadmap addresses these issues as well

Page 16: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

DR in the Cloud

16

Stand up a swing system in the cloud • cover loss of a primary system• Support an EDW expansion• Data Center MoveUsing these same methods you can: Add cloud system to a cluster Restore any Archive of an existing system Coming late 2017

Begin using a pilot light system for DR allow Unity to catch up transactions since the last

Archive

Page 17: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Availability

17

Sandboxes in the CloudTechnology is available today

Active data synchronization in the cloudData Mover and Query Grid available now

With UnityLimited cases – technology available todayExpanded cases – rolling out starting Q2 2017

System Seeding - DREcosystem Manager driven – Q2 2017

Unity is licensed by the systems it manages

Page 18: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

The Tool Set

18

We chose a set of common Teradata tools and some third party tools in our sample.

Unity - Workload routing, data synchronization Data Mover – Object CopyEcosystem Manager – Script execution - WorkflowVagrant – Scripted system creationPython – Scripted system creation and activation

Teradata Client Tools:FastLoad, Multiload and BTEQ

Page 19: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

More on Unity at Partners

19

Be sure to see• Unity/Hybrid Cloud at the Teradata Booth

• Demo of Unity in the cloud • Glimpse into the future of the cloud

• Unity Presentation by the REWE Group • Demo of a phased implementation of Unity

• Hybrid Cloud Reception at the Omni

Page 20: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

At Teradata…

We empower companies to achieve high-impact business outcomes

through analytics at scale on an agile data foundation

Page 21: Enabling the Hybrid Cloud - Amazon S3...Cloud David Gilbreath Unity Ecosystem Architect, Teradata Paul LaPointe Unity Architect, Teradata At Teradata, we believe… Analytics and data

Thank You

Questions/CommentsEmail:

Follow MeTwitter @

Rate This Session #with the PARTNERS Mobile App

Remember To Share Your Virtual Passes

[email protected]@teradata.com

21