Post on 19-Jan-2017
Introducing Cloudera DirectorJuly 28, 2015 @ Big Data Bash!
Andrei Savu, asavu@cloudera.com
Tech Lead, Cloudera Director
© 2014 Cloudera, Inc. All rights reserved.
Agenda
IntroductionProduct DemoWhat’s next?Questions
Journey to the Cloud
© 2014 Cloudera, Inc. All rights reserved.
DeploymentEasy deployment; no post-setup configurations
AWS Quick Start
Cloning clusters
Support for elasticity of compute and storage
Enterprise Deep security integration: Kerberos & Sentry
Cloudera Navigator : Audit / Lineage / Workflow
High Availability and resilient services
Manageability Manage clusters across multiple environments – on-premises and cloud
One dashboard to view all deployed clusters
Templates for saved workloads
IntegrationOpen console API for simple scripting and automation for scheduled actions
Open API plugin for cloud vendor of choice
Flexible Integration for controlled deployment in the cloud
© 2014 Cloudera, Inc. All rights reserved.
Object Storage (AWS S3, WASB, Swift, Google Cloud Storage)
Short running clustersElastic workloadNo local storage
Long-running clusters Sized to demandSome local storage
Fixed clusters Periodic syncLocal storage
App delivery - HBaseBI / Analysis – Impala, Search
ETL / Modeling– MR, Spark
Source Data DR/BackupSeed data
© 2014 Cloudera, Inc. All rights reserved.
Cloudera Director
Cloudera Navigator
Cloudera Manager CDH
Cluster
Cloudera Navigator
CLOUDERA ENTERPRISE
CDH Cluster
CDH
Cluster
Cloudera Navigator
Cloudera Manager CDH
Cluster
Cloudera Navigator
CLOUDERA ENTERPRISE
CDH Cluster
CDH
Cluster
Product Demo
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
© 2014 Cloudera, Inc. All rights reserved.
What’s next?
© 2014 Cloudera, Inc. All rights reserved.
Extensibility
AWS us-east-1Web UI
API console
SDKs
Orchestration EngineAPI SPI
Your Cloud
Cloudera Director
Cloudera Manager
© 2014 Cloudera, Inc. All rights reserved.
Improved User Interface
© 2014 Cloudera, Inc. All rights reserved.
Objectives for the cloud
Best performing Hadoop on any cloud environment – public or on-premises
Optimized software for new cloud deployment models
Deep integration with object stores for storage management
Cloud specific capabilities: elasticity, shared data across clusters, DevOps development model, flexible usage models
© 2014 Cloudera, Inc. All rights reserved.
Open questions. Got answers? Join us!
• How can 10s of minutes of configuration be reduced to a single digit?
• How can the size of the cluster be determined by usage?
• Do we need to expose clusters at all? Or just service endpoints?
• How can we create self-managing systems? And enable higher level ops?
• How can we scale to 10s of clusters with 100s of instances?
• What are the best ways to leverage cloud platform services?