Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud...

Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|

DataWarehousingforEverybody:OracleAutonomousDataWarehouseCloud

GeorgeLumpkin,VicePresident,ProductManagementYasin Baskan,Sr PrincipalProductManager

OracleDatabaseServerTechnologyOctober2,2017

Confidential– OracleInternal/Restricted/HighlyRestricted


Thefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,timingandpriceofanyfeaturesorfunctionalitydescribedforOracle'sproductsmaychangeandremainsatthesolediscretionofOracleCorporation.FeesapplyfornewDatabaseproductofferings.

SafeHarbor Statement

2


Oracle’sVision forAutonomousDatabase

• Self-Driving–Userdefinesservicelevels,databasemakesthemhappen

• Self-Securing–Protectionfrombothexternalattacksandmaliciousinternalusers

• Self-Repairing–Automatedprotectionfromalldowntime

3

AutonomousDatabase


IngredientsofanAutonomousDatabase• OracleDatabase18c–Dozensofautomateddatabasefeatures

+• OracleCloudinfrastructure–Single,standardplatformasfocusforself-drivingautomation

+• OracleAutonomousDatabaseCloudtooling–Automationforoptimalconfigurationforeachworkload

4

AutonomousDatabase


OneAutonomousDatabase– OptimizedbyUseCase

5

OracleAutonomousDatabase

EnterpriseOLTP,Mixed

Workloads

DataWarehousing

Departments,Developers

2017 2018 Now

DataWarehousing


Introducing:AutonomousDataWarehouseCloud

• Easy–Automatedmanagement–Automatedtuning:Simplyloaddataandrun

• Fast–BasedonExadatatechnology

• Elastic– Instantscalingofcomputeorstoragewithnodowntime

6

ExpectedCY2017


GettingStartedwithAutonomousDataWarehouseCloud• Provisioningrequiresonly5simplequestions:– Databasename?–Whichdatacenter?– HowmanyCPU’s?– HowmanyTB’s?– Adminpassword?

• Newservicecreatedin<30seconds(regardlessofsize)– Readytoconnectviasqlnet

Confidential


Demo:Provisioning

Confidential


Whatdidn’t youjustsee?• Nodecisionsfor:–Detailsofthedatabasesoftware–Configurationofhardware–Characteristicsofthedatabase–Architectureforbackupsandavailability

• Allofthis(andmore)isautomaticallyconfigured

Confidential


Automatedmanagement• Oracleautomatesend-to-endmanagementofdatawarehouse– Provisioningnewdatabaseinstances– Growing/shrinkingstorageand/orcompute– Patchingandupgrades– Backupandrecovery

• FulllifecyclemanagedusingADWCServiceConsole

Confidential– OracleInternal/Restricted/HighlyRestricted 10


Automated

• Thecarsimplifiesoperationsbyautomatingtasks:– Cruisecontrol– Emergencystopping–Warningsforlanechanges

• Thedatabasesimplifiesoperations:– Automaticstoragemanagement,automaticstoragemanagement,…

– Dozensofotherfeatures

Autonomous

• Thecardrivesitself– Noneedtousethesteeringwheelorbrake.

– Simplytellthecarwhereyouaregoing.

• Thedatabasemanagesitself– Allfeaturesautomaticallyimplemented– Simplytellthedatabaseyourgoals

11

Automatedvs.Autonomous


WhatdoesAutonomousDatabasemeanfortheDBA?

LesstimeonAdministration

• Lesstimeoninfrastructure• Lesstimeonpatching,upgrades• Lesstimeonensuringavailability• Lesstimeontuning

12

MoretimeonInnovation

• Moretimeondatabasedesign• Moretimeondevelopingnewapps• Moretimeondataanalytics• Moretimeonsecuringdata

Challenge:Therearemoredatamanagementtasksthanhumanstodothework


AutomatedTuning• “Loadandgo”– Definetables,loaddata,runqueries• Notuning• Nospecialdatabaseexpertiserequired

– Goodperformanceoutofthebox

• Queryusinganybusinessanalyticstoolorcloudservice– Built-inSQLnotebookalsoincluded

Confidential


HippocraticOathofAutonomousPerformance

• Performancefeaturesarecarefullyselected:– Noperformancedegradation– Nosignificantoverhead

Confidential

“Donoharm”


• Evaluationofrealcustomerworkloadsandstandardbenchmarks– PerformanceAs-IsversusADWC– Runonidenticalhardware

• ADWCout-of-the-box–Optimized,pre-configuredDBsetup

• Schemaasprovidedbycustomer– Indexes,Partitioning,manualDOP

Confidential

AutonomousDataWarehouseCloud:PerformanceProofPoint

OracleADWC CustomerSchema

Customer#1 39 34

Customer #2 52 53

Customer #3 1032 911

Customer #4 2138 3051

Customer #5 132 196

Customer #6 1478 1831

Customer #7 2551 5137

MSTR 1163 1504

SSB 232 209


AutonomousDataWarehouseCloud:Reliability• Enterprise– 99.95%–Fault-tolerant,highly-availableExadata infrastructure• Triple-mirroreddisksfordiskfailures• RealApplicationClustersforcomputenodefailures• Andmore…

–Automaticbackups• Pointintimerecoverytoanytimeinlast30days

•MissionCritical– 99.995%–Standbydatabase

Confidential


InstantElasticity• Customerspecifiesnumberofdatabasecores(inOCPU)anddatabasesize(inTB)– CPU’sandstorageareindependent– Databasescangrowandshrinkineitherdimension– PricingbaseduponCPU($/CPU/hour)andStorage($/TB/Month)

• Examples:– Addingnewstorageorcomputecapacityisjustaclickonthecloudconsole– CPUcapacitycanbeaddedon-demandforend-of-quarterprocessing,thenreducedaftertheprocessingiscompleted

– CPUcapacitycanbesettozero,whilestorageremainsinplace(forexample,toreducecostsfordatabaseswhicharenotusedduringweekends/nights)

Confidential


InstantElasticity:PayforExactlyWhatyouUse• SizetheDWtotheexactnumberofOPCU’sandTB’srequired– Notconstrainedbyfixedbuildingblocks

• ScaletheDWondemand– Independentlyscalecomputeorstorage– Resizingoccursinstantly,fullyonline

• Shutoffidlecomputesavemoney– Restartinstantly

Confidential


EasyMigrationtoAutonomousDataWarehouseCloudMigrationofexistingOraclesystems• DatapumpimportusingADWC-awaresettings– Ensurescompatibledataimport– Violatingdatastructureswillbeignoredorconverted

MigrationofRedshiftsystems• End-to-endmigrationusingmigrationworkbench– Convertandcreatedatawarehouseschema– UnloadRedshiftdataintoS3– LoaddataintoADWC

Migrationofothersystems• Migrationworkbenchassistanceormanual

19


SupportedbyarichDataWarehouseEcosystem

• Existingtools runningon-premiseorinOracleCloud– OracleBIanddata-integrationtools– 3rd partyBItools– 3rd partydata-integrationtools

• ConnectivityviaSQL*Net

Confidential

OracleCloudServices–OracleAnalyticsCloud–OracleDataIntegrationPlatformCloud–andothers…

OracleAutonomousDataWarehouseCloudsupports:


AutonomousDataWarehouseCloud:SupportFromStrategicPartners

Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.| Confidential

AutonomousDataWarehouseCloud:Architecture

OracleExadataCloudService

OracleDatabase CloudService

ExpressCloudService

DataWarehouseServices(EDWs,DW,departmentalmartsandsandboxes)

AutonomousDataWarehouseCloud

ServiceConsole

Built-inAccessTools

SQLWorksheet OracleML

ServiceManagement

DWDatabase

SQLDeveloper

DeveloperTools

DataIntegrationServices

3rd PartyBIon-premises

OracleDataIntegrationCloudService

3rdPartyDIonOracleCloudCompute

3rdPartyDIOn-premises


OracleML:Built-innotebook

• CollaborativeUIfordatascientists– Easyaccesstosharednotebooks,templates,permissions,scheduler,etc.

• BasedonApacheZeppelin• Roadmap:CommonUIfordatascientistsacrossmultipleservices

23


QueriesacrossCloudStorageandmore

• Externaltablescanbecreatedondatainobjectstores–OracleObjectStoreorAWSS3– AnysupportedOracle-loaderfileformat• OranyHadoopfileformat(e.g.Parquet)– comingsoon

– BigDataSQLintegration– comingsoon

• Seamlessqueriesoverobjectstore• Seamlessqueriesacrossobjectstoreanddatabase

ElasticDataWarehouseCompute

DataStorage

ExadataStorage

ObjectStorageKafka HDFS

DataStorage

OracleConfidentialandRestricted


MoreonAutonomousDatabaseStep-by-StepGuidetoOracleAutonomousDatabaseCloudforDataWarehousing–Wednesday,Oct04,12:00pm- 12:45pm|Moscone West- Room3010

PreviewofOracleAutonomousDatabase–Wednesday,Oct04,3:30pm- 4:15pm|Moscone West- Room3014

Confidential

Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud...

Documents

Transcript of Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud...