Deploying OBIEE in the Cloud - Collaborate'14 Las Vegas

T : +44 (0) 1273 911 268 (UK) or (888) 631-1410 (USA) or +61 3 9596 7186 (Australia & New Zealand) or +91 997 256 7970 (India)

E : [email protected] : www.rittmanmead.com

Deploying OBIEE in the Cloud:Options and Deployment ScenariosMark Rittman, CTO, Rittman MeadCollaborate’14, Las Vegas, April 2014





About the Speaker

•Mark Rittman, Co-Founder of Rittman Mead•Oracle ACE Director, specialising in Oracle BI&DW•14 Years Experience with Oracle Technology•Regular columnist for Oracle Magazine•Author of two Oracle Press Oracle BI books•Oracle Business Intelligence Developers Guide•Oracle Exalytics Revealed•Writer for Rittman Mead Blog :http://www.rittmanmead.com/blog

•Email : [email protected]•Twitter : @markrittman

http://www.rittmanmead.com/blog

mailto:[email protected]





About Rittman Mead

•Oracle BI and DW Gold partner•Winner of five UKOUG Partner of the Year awards in 2013 - including BI•World leading specialist partner for technical excellence, solutions delivery and innovation in Oracle BI

•Approximately 80 consultants worldwide•All expert in Oracle BI and DW•Offices in US (Atlanta), Europe, Australia and India•Skills in broad range of supporting Oracle tools:

‣OBIEE, OBIA‣ODIEE‣Essbase, Oracle OLAP‣GoldenGate‣Endeca



Deploying OBIEE in the Cloud

•Many OBIEE customers are considering deploying their BIinfrastructure in the “cloud”

•“Push” and “Pull” factors in-play‣Perceived benefits in reducing amount of on-premise servers,software installs, upfront-license costs

‣May also be prompted by migration of rest of IT infrastructureto the cloud

‣To enable business agility - deploy the system now•But there are lots of ways you can deploy OBIEE in the cloud•This presentation will outline the main options and scenarios,as of January 2014



Enabling Business Agility - Rapid Development in the Cloud

•Example cloud use of OBIEE - accelerating the BI development process‣Combines agile development (“ExtremeBI”) with OBIEE deployed into Amazon AWS‣Cloud element allows development to start now‣Options for repatriating on-premise afterwards

•Based on Amazon AWS (EC2, S3) and Oracle BI•More details at http://www.rittmanmead.com/cloudbi/

http://www.rittmanmead.com/cloudbi/





Deploying OBIEE in the CloudPart 1 : Oracle’s (Proposed) OBIEE11g Cloud Offering



Oracle Cloud Business Intelligence

•As announced at Oracle Openworld 2013•As of Jan’ 2014, in “preview” - web page only•Expected (by me) in second half of 2014•Part of the wider PaaS (platform-as-a-service)offering including database, Java, documents etc

•Aimed at a very specific set of use-cases initially‣Adding BI and analytics to cloud-based apps‣Departmental sandbox-type analysis



Self-Service, Consumer-Style Experience



Initial Announced Functionality (Sep’ 2014)



Oracle Cloud Business Intelligence - How it Works

•Runs in Oracle’s public cloud environment - multi-tenant?‣No upfront license cost‣Pay monthly (?)

•Uses new thin-client RPD modelling tool (thick-client BI Administration tool still supported?)

•Only reports against a single Oracle database schema (Oracle Cloud Schema-as-a-Service)

•“Standard” OBIEE - but will possibly preview newfunctionality before on-premise versions‣Proposed data-mashup feature

•Patched automatically by Oracle‣Customer able to be max one version behind?

Cloud

On-PremiseAdmin accessover HTTP

Oracle Schema-as-a-serviceDatabase (single source)

Oracle BI-as-a-Service



Thin-Client Data Modeler (Subject to Change)

•Announced at Oracle Openworld 2013 - but could change as product evolves•Cloud mandates a tool strategy that supports both Cloud and On-Premise development

‣Thin-Client Modeler to be delivered with BI Cloud Service v1‣Web-based tool designed for the business user

•Masks complexity in creating a full model using thick-client Admin Tool

•But does not initially support multi-source, RPD federation etc‣Future goal is to deliver thin-client tool with comparable functionality to replace the legacy Admin Tool





Deploying OBIEE in the CloudPart 2 : Deploying “Full” OBIEE into the Public Cloud



Deploying “Full” OBIEE into the Public Cloud

•Oracle’s Cloud Business Intelligence offering is consumer-style BI-as-a-service•Simple provisioning, setup, maintenance - but with significant limitations (at present)

‣No ability to access non-Oracle cloud DB data‣No ability to federate data sources‣No access to Essbase, BI Publisher, Agents, Maps etc

•So why not deploy OBIEE yourself directly into the public cloud?‣Amazon AWS‣Rackspace etc‣VMWare Hybrid Cloud



Cloud Definitions: Public vs. Private Cloud

•Public Cloud: Shared infrastructure provided over the internet, to the public as a service‣Organizations rent compute resource on this shared platform‣Key vendors include Amazon (AWS), Rackspace, Microsoft (Azure) - and Oracle‣Base offering is Infrastructure-as-a-Service (Iaas) - compute, storage, network‣Also typically offer Platform-as-a-Service (PaaS) - e.g. Amazon RDS, Hosted JEE

•Private Cloud: Provisioning and Efficiency Benefits of cloud, but on private infrastructure‣Similar principles: shared resource that can be provisioned on-demand‣But internal to organization: improved security, potentially better value‣Key vendors: VMWare, OpenStack‣But elasicitity of service limited by hardware within the private cloud

•Hybrid Cloud: Combination of public + private cloud‣Majority of workload run on private cloud, but with “burst out” to public cloud



Key Cloud Vendors: Amazon AWS (+ Rackspace etc)

•Dominant vendor in public cloud infrastructure‣Amazon EC2: Virtual servers in the cloud‣Amazon S3: Storage in the cloud

•Usually the cheapest for compute/storage etc•Some free options available•Pay by the hour for various instance sizes•Also offers IaaS and PaaS services such as

‣Amazon RDS (Oracle DB, mySQL etc)‣Amazon Elastic MapReduce etc

•Other competitors include Rackspace, Google,Microsoft‣But AWS 5 x larger than next 14 competitors(combined)



Typical Single-Node Amazon EC2 Deployment

•OBIEE + RCU Database install deployed on a single EC2 instance‣Various instance size options available based on RAM, vCPU etc‣OBIEE licensing: 1vCPU = 1 proc(http://www.oracle.com/us/corporate/pricing/cloud-licensing-070579.pdf)

•DW Database on Amazon RDS instance‣Managed Database instance (backups etc)‣BYOL: 1vCPU = 1 proc DB EE

•Run BI Administrator either on-premise, oron another EC2 (Windows) instance

Instance Examples:

m3.xlarge (4 vCPU, 15GB RAM) = $328/mm2.2xlarge (4 vCPU, 34GB RAM) = $598/m

Oracle BI EE licensing: 1vCPU = 1 procOracle DB SE1 licensing: >4vCPU = 1 proc

OBIEE FMW Install+ RCU Oracle SE1(Amazon EC2)

DW Database Install(Amazon RDS)

Amazon RDS Examples (BYOL):

XL DB Instance: 4vCPU, 15GB RAM = $467/mHi-Mem 4XL DB Instance: 8vCPU, 68GB RAM= $1613/m

Oracle DB EE licensing: 1vCPU = 1 proc

http://www.oracle.com/us/corporate/



RDS Multi-Availability Zones

Amazon EC2 HA Configuration #1: (Stretch) WLS Cluster

•Multiple EC2 instances organised intoa WLS cluster‣Instances can be placed intodifferent EC2 availabilityzones (stretch cluster)

‣But watch latency…•Uses Elastic Load Balancerto route incoming requests

•Amazon RDS multi-availabilityzones for automatic replicationto another availability zone‣RCU DB cannot be on RDSas no support for SYS as SYSADMIN (req. for RCU)

OBIEE FMW Install(FMW Node 1)

OBIEE FMW Install(FMW Node 2)

OBIEE FMW Install(FMW Node n)

Amazon Elastic Load Balancer

RCU Database Install(Amazon EC2)


Oracle Data Guard

WebLogic Domain



Amazon EC2 HA Configuration #2: Replicated Single-Nodes

•Multiple EC2 instances, but configuredas WLS single-node‣Bi-directional webcat replication keeps separate catalogs in-sync

‣Could use EBS storage tocreate shared FMW_HOMEas per HA EDG topology

‣Potentially place each instance in separate EC2availability zone

•Each node has own RCU Oracle DB SE1 DB•Single Amazon RDS Oracle DB EEinstance for DW database, usingmulti-availability zones

RDS Multi-Availability Zones

OBIEE FMW Install+ RCU Oracle SE1(FMW Node 1)

OBIEE FMW Install+ RCU Oracle SE1(FMW Node 2)

OBIEE FMW Install+ RCU Oracle SE1(FMW Node n)

Amazon Elastic Load Balancer


Oracle Data Guard

WebLogic Domain WebLogic DomainWebLogic Domain

Bi-directional Webcat Replication



Pros and Cons of Amazon EC2 for OBIEE

•Pros:‣Cheapest mass-market cloud vendor: effectively sets base price‣Extremely well-developed IaaS and PaaS offering - load balancing, HA, monitoring, databases etc

‣Easy availability of skillets, well-known platform•Cons:

‣Not “native” to OBIEE, Oracle - aimed more at general web apps‣Some ambiguity around licensing - multi-availability zones etc‣Not fully-tested AWS HA with OBIEE HA - could be some incompatibilities etc around clustering, failover etc

‣RCU DB hard to host in RDS - versions, SYSDBA access etc



Key Cloud Vendors: Oracle

•Announced at Oracle Openworld 2013: Infrastructure-as-a-Service (IaaS) offerings‣Complements the existing PaaS services; aimed more at Amazon AWS

•From later in 2014, ability to rent compute, storage, documents, network etc fromOracle, similar to Amazon AWS‣For now though, focus is on service - DBaaS, Java etc - and Apps (HCM etc)



Future Oracle Cloud Deployment?

•OBIEE in the Cloud - initially “sandbox” single source, in future - more features/sources?•Hyperion EPM apps - Planning, FR•DBaaS - full database in the cloud, supports ETL, OLAP etc?

•Storage / Documents• Identity Management?•Enterprise Manager?•But - what will it cost vs. Amazon AWS?

‣How scriptable / extensible will it be?‣Limitations on product functionality?‣But Oracle can be creative on licensing





Deploying OBIEE in the CloudPart 3 : Multi-tenant OBIEE in the Cloud



Multi-Tenant OBIEE in the Cloud

•Typically used by application providers to provide tenanted access to OBIEE dashboards•Goes beyond application roles to support SaaS deployments•New multi-tenant-specific application roles

‣BIGlobalAdministrator - full systems administrator‣BITenantAdministrator - catalog admin privileges‣Tenant Users - linked to tenant ID through FMW identity store (init blocks not supported)

•Still uses single RPD, catalog•Restricted set of features

‣No FMW control for Tenant admins‣No Essbase‣No BI Administration tool for Tenant Admins‣No Scorecards, RTD, BI Publisher, BI Mobile



Enabling Multi-Tenancy in OBIEE 11g

•Multi-tenancy isn’t enabled by default, needs to be enabled and configured•Supported from OBIEE 11.1.1.7+•Probably only really meant for Oracle’s own (cloud) use•Provides three main capabilities vs. home-grown multi-tenancy‣Tenant-specific catalog permission admins‣TenantGUIDs to prevent GUID clashes across tenants‣Prompts, user lists etc scoped to just that tenant

•To enable multi-tenancy:‣Follow the steps at http://docs.oracle.com/cd/E28280_01/bi.1111/e10541/configtenant.htm#BABCGBBC

http://docs.oracle.com/cd/





Deploying OBIEE in the CloudPart 3 : Cloud Databases for OBIEE



Supporting Databases for OBIEE

•OBIEE 11g requires one or more RDBMSs for data sources, metadata etc‣DW database (or DB sources) for reporting data‣RCU database for supporting schemas (BIPLATFORM, MDS etc)

•Likelihood is that Cloud OBIEE data sources willbe a mixture of on-premise, cloud (and app?)

• If OBIEE is deployed in the cloud, chances arethat it’s because its DW database is also there

•But what are the options if you want to deploysupporting databases into the cloud?

Cloud

On-PremiseBI Admin ToolRPD Access

BI AdministrationTool

On-Premise Data Sources

Cloud-baseddata sources



Amazon Relational Database Service

•Database PaaS offering from Amazon AWS, provides a range of databases as a managed service‣Oracle SE1/SE/EE, mySQL, MS SQL Server, Postgres

• Includes license (Oracle SE1/SE) or BYOL (Oracle EE)•Managed service, provides backups etc•Multi-availability zones for resilience/high-availability

‣Automatically replicates DB to other region•Mostly “full” Oracle, but no SYS as SYSDBA access

‣So no use for the RCU database



Postgres on Amazon AWS

•Postgres is a mature RDBMS product, free core features, similar capability to Oracle 7/8•Enterprise DB offer paid support and their own admin tools (Postgres Plus)•Rather than license + install on-premise, can also be hosted on Amazon AWS •Offered as an hourly-charged SaaS database, includes support + tools

•Accessed by (unsupported) Postgres ODBC drivers•Typically costs around the same price as Oracle SE1

‣$6.48/hour, or approx $56k for each server (includes hosting though)

‣But need to factor in AWS storage + bandwidth costs‣Likely annual costs : $120k/year



Left-Field Alternative: Amazon Redshift hosted on Amazon AWS

•Another database-as-a-service offering from Oracle AWS•Based on ParAccel, cut-down version and native to Amazon Cloud

‣Column-store, analysis-optimised•Can connect to OBIEE via PostgreSQL drivers, but like Postgres Plus, not Oracle supported

•Similar cost to Postgres Plus on AWS, but includes AWS storage and bandwidth costs



For the Future : Hadoop / Impala (Big Data Sources)

•New in OBIEE 11.1.1.7 : Hadoop Connectivity through Hive•Hive is a query environment over Hadoop/MapReduce to support SQL-like queries•Hive server accepts HiveQL queries via HiveODBC or HiveJDBC, automaticallycreates MapReduce jobs against data previously loaded into the Hive HDFS tables

•Approach used by ODI and OBIEE to gain access to Hadoop data•Allows Hadoop data to be accessed just like any other data source•But … it’s quite slow, for ad-hoc BI queries



Addressing Hadoop / Hive Latency : Cloudera Impala

•Hive is slow - because it’s meant to be used for batch-mode queries•Many companies / projects are trying to improve Hive - one of which is Cloudera•Cloudera Impala is an open-source but commercially-sponsored in-memory MPP platform

•Replaces Hive and MapReduce in the Hadoop stack•Can we use this, instead of Hive, to access Hadoop?•It will need to work with OBIEE•Warning - it won’t be a supported data source (yet…)





How Impala Works

•A replacement for Hive, but uses Hive concepts anddata dictionary (metastore) ‣but not officially supported with OBIEE (yet)

•MPP (Massively Parallel Processing) query enginethat runs within Hadoop‣Uses same file formats, security,resource management as Hadoop

•Processes queries in-memory•Accesses standard HDFS file data•Option to use Apache AVRO, RCFile,LZO or Parquet (column-store)

•Designed for interactive, real-timeSQL-like access to Hadoop

Impala

Hadoop

HDFS etc

BI Server

Presentation Svr

Cloudera ImpalaODBC Driver

Impala

Hadoop

HDFS etc

Impala

Hadoop

HDFS etc

Impala

Hadoop

HDFS etc

Impala

Hadoop

HDFS etc

Multi-NodeHadoop Cluster





Deploying OBIEE in the CloudPart 5 : ETL in the Cloud



Why is ETL Important (& Why Would it Also Move to Cloud)?

•OBIEE needs a data source to report on, typically a data warehouse•Initially these are on-premise, but over time they may migrate to the cloud•Once all sources and targets are in the cloud - where does the ETL live?‣Doesn’t make sense for it to be the only on-premise component

‣Can we also run this in the cloud?



ETL Tools Provided by Cloud Vendors

•Cloud infrastructure vendors (Amazon, Google, Oracle etc) typically provide tools toimport data into the cloud, and keep it refreshed

•These are good options if only this single target, and typically a single source‣Usually free‣Optimized for that platform

•But beyond that - you need an ETL tool‣Complex transformations‣Different metadata stores‣Orchestrated loading



Cloud ETL Requirements (DIaaS)

•DIaaS (Data Integration as a service) should be a service‣Self-provisioned, no software install or configuration‣Charged by the day/hour‣Multi-tenant‣A range of DB and cloud application adapters‣All thin-client, web-based‣Easy scale-out, HA, compatibility with Amazon EC2 etc

•Could just do the same as on-premise ETL, but “cloud expectations are different” - consumer, service, simple UI



Oracle’s Cloud Data Integration Offerings

•ODI 11g/12c could theoretically run in the cloud•But its ELT approach means there’s no (usual) mid-tier ETL transform element

‣Agents typically are installed on sources and targets‣Transformation happens on target

•SaaS application adapters typically provided through Jdeveloper and SOA Suite‣Functional, but not “consumer-simple”

•Forthcoming OBIA cloud adapters assume on-premise install of OBIA/OBIEE, with Oracle cloud apps as sources



Cloud ETL Alternative #1 : Informatica Cloud

•A version of Informatica PowerCenter that runs in the cloud (sort of)‣Metadata and application layer components run in the cloud (as a multi-tenant app)‣“Secure Agent” runtime runs on-premise - cut-down version of PowerCenter

‣Data transformation etc therefore happens on-premise•Some interaction between on-premise and cloud

‣PowerCenter mapplets can be copied to the cloud•Obvious cloud option for Informatica customers



Cloud ETL Alternative #2 : SnapLogic Integration Cloud

• “Cloud native” data integration platform•Focuses on “data paths” and applicationintegration, with data streamed point-to-point

•Transformations are done through “Snaplexes”‣Java JVMs similar to ODI agents‣Can run in-cloud or on-premise‣Uses Amazon S3 storage for temp files etc‣Elastic scale-out when running in cloud

•Weakness is the “last mile” of DW data‣Lacks KMs and other templates for SCDs etc‣Not as strong as an ELT tool for complexdatabase transformations



Conclusions

•There are lots of reasons customers are considering deploying OBIEE in the cloud‣All their other applications are moving to the cloud‣Reduce cost and complexity around infrastructure‣Enable business agility with services available now

•Several options for cloud OBIEE deployment‣Oracle’s upcoming Cloud Business Intelligence offering‣Deploying “full” OBIEE into a public cloud‣Access OBIEE as a service using multi-tenancy

•Need to also consider database, IDM, ETL elements•And also licensing, security etc







Thank You for Attending!

•Thank you for attending this presentation, and more information can be found at http://www.rittmanmead.com

•Contact us at [email protected] or [email protected]•Look out for our book, “Oracle Business Intelligence Developers Guide” out now!•Follow-us on Twitter (@rittmanmead) or Facebook (facebook.com/rittmanmead)

http://www.rittmanmead.com/





Deploying OBIEE in the Cloud:Options and Deployment ScenariosMark Rittman, CTO, Rittman MeadCollaborate’14, Las Vegas, April 2014

Deploying OBIEE in the Cloud - Collaborate'14 Las Vegas

Technology

Transcript of Deploying OBIEE in the Cloud - Collaborate'14 Las Vegas