Role of a DBA · Any Data, Streaming Spark/Cloud DATA MESH Schema on Write Schema on Read Big Data...

Role of a DBA

IN3020 and IN4020

Trond BrennaPrincipal Solution EngineerOracle NorwayMay 04, 2020

Safe harbor statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, timing, and pricing of any features or functionality described for Oracle’s products may change and remains at the sole discretion of Oracle Corporation.

2 Copyright © 2020, Oracle and/or its affiliates |

Agenda

1 My Background

2 Traditional Role of a DBA

3 Changes in Data Management

4 Future DBA challenges and role

5 Summary


Trond Brenna

Principal Solution Engineer

Oracle Norway4th May 2020


My Background

Experience• Ergo Enet 96-01: Consultant

- Support, Training and Technical Advisor• Oracle Norway 01-05: Senior Instructor

- DBA admin, DBA Backup & Recovery and Database Tuning- SQL Basic

• Bluegarden 05-11: DBA/Team Manager DBA- Operations - Developing Database Platform- Lead DBA

• Oracle Norway 11-dd: Principal Solution Engineer- Database Solution Architect- IaaS/PaaS Architect- Strategic Customer work- Speaker on internal and external conferences


Traditional Role of a DBA


Traditional Role of a DBAWhere did they come from?


Charateristics• IT education

• Basic database understanding• Data Modelling

• Job experience• The SysAdmin way• The Developer way

Traditional Role of a DBAThe SysAdmins


• Linux/Unix admins• DataCenter/Operating System consultants

• Storage• Server

• OS scripting

This was the guys (guessing about 99% guys) working on the floor

Traditional Role of a DBAThe Developers


• SQL Background• Database Procedure Language (i.e. PL/SQL)• Performance focus

• Indexing• Application Data Model responsibilty/focus• Worked between DBA and Developers

• App patching

Worked as DevOps before this term was «invented»

Traditional Role of a DBAWhat did they do?


• Creating databases • Scripts• Wizard

• Monitoring • SQL -> Tuning• Storage• Memory• Locks• Backup configure/status

• Updating Test/Dev/QA/Staging/Pre-prod databases• Upgrades and patches

• Reasonable level

Keeping the system up and running with an acceptable performance

Traditional Role of a DBAWhat did they not have time to do?


• Planning for the future• Get involved in Business related projects• Evaluate Database-platform security level

• Security patches• Patching• Compliance

• Focus on Quality of Service

Too little time to focus on getting value of the business data

Traditional Role of a DBA

Command Line Interface (CLI)• Require deep knowledge of DB

system• Good for scripting• Some automation

DBA/Developer Tools• Combination of SQL and GUI• Access to objects• Drag-and-drop and

simplification of tasks

Graphical User Interface (GUI)• Monitoring/Alerts• Dashbords• Jobs/Scheduler• Task Wizards• Advisors


Tools

Changes in Data Management


Changes in Data ManagementTraditional Data Management

• Realational Databases (RDBMS)• Online Transaction Processing (OLTP)• Descision Support System/Datawarehouse

(DSS/DW)

Multimodel Databases• Spatial and Graph• JSON• XML• Data Mining (R)• Machine Learning


15

Generational Change of Data Platform Technologies

Relational

Structured Data

BIG DATA DATA LAKE

Multi-structured data

HadoopNoSQL

Any Data, Streaming

Spark/Cloud

DATA MESH

Schema on ReadSchema on Write Big Data 2.0 –in-memory streaming

User/Domain FocusDistributedDocker/KubernetesMicroServicesDevOps

DATSIS. discoverableaddressable trustworthy self-describing, inter-operablesecurePolyglot

Multi-model

Future DBA challenges and role


Future DBA challenges and roleImpact of Cloud -> Operational

Infrastructure-as-Service• Infrastructure created• Do-it-Yourself install DB-

system• DBA customer

responsibility • Full access to OS

Platform-as-a-Service Automated• Infrastructure created

and DB system installed

• Customer give input to DB configuration

• Tooling and API available

• Customer have responsibility to most of tasks

• Often full access to OS

Platform-as-a-Service Managed• DB and OS Managed

by Cloud vendor• Customer responsible

to data quality• API available

Platform-as-a-Service Autonomous• DB and OS Managed

by Cloud vendor• Customer responsible

to data quality• API available• AI and ML used for

monitoring and performance


Level of Customer MgmtMore Less

Future DBA challenges and roleWill DBAs be redundant?


• Maria Colgan• Master Product Manager• Oracle Corp

InnovationMaintenance

Today More Time is Spent on Maintenance vs Innovation

20

Today More Time is Spent on Maintenance vs Innovation

Copyright © 2019, Oracle and/or its affiliates. All rights reserved.

Maintenance

72% of IT Budget is spent on Generic Maintenance

Tasks vs Innovation- ComputerWorld

Cost and Complexity Reliability

91% Experience Unplanned Data Center Outages

- Healthcare IT News

Database downtime costs $7,900 / minute

- DB Maestro

¾ Cost of Database Managementspent on labor

- IDC

91%72% 75%

http://www.computerworld.com/article/2486278/it-management/how-to-balance-maintenance-and-it-innovation.html

https://www.healthitoutcomes.com/doc/beware-the-high-cost-of-data-center-outages-0001

https://www3.dbmaestro.com/blog/5-ways-to-prevent-database-downtime

http://www.oracle.com/us/products/database/idc-oracles-autonomous-database-4497146.pdf

Copyright © 2019, Oracle and/or its affiliates. All rights reserved. |

What Autonomous Database Means for DBAs

21

Value Scale

Innovation

Maintenance

•Tasks Specific to the Business– Architecture, planning, data modeling– Data security and data lifecycle management– Application-related tuning– End-to-End service level management

•Tactical Operations– Configuration and tuning of systems, network, storage– Database provisioning, patching– Database backups, H/A, disaster recovery– Database optimization

Copyright © 2019, Oracle and/or its affiliates. All rights reserved. |

What Autonomous Database Means for DBAs

•Tasks Specific to the Business– Architecture, planning, data modeling– Data security and data lifecycle management– Application-related tuning– End-to-End service level management

•Tactical Operations– Configuration and tuning of systems, network, storage– Database provisioning, patching– Database backups, H/A, disaster recovery– Database optimization

22

Removes tactical drudgery, more time to innovate Value Scale

Innovation

Maintenance

InnovationMaintenance

Autonomous Database Enables More Innovation

Future DBA challenges and roleWhat does the experts say?


• Three experienced DBA/Architects about the DBA future

“….DBAs need to stop thinking like maintenance workers and engineers who keep things operational, and more like data scientists. Penny Avril, Oracle's VP of database project management even goes so far as to tell DBAs to drop the "B" and think of themselves more as "DAs," or data administrators.”

"A data administrator isn't just keeping data in a database, but understands the importance of that data to key business stakeholders and in driving the business forward.”

Brandon Vigliarolo quote Penny Avril VP Oracle PMTechRepublic.com 11th April 2019


“The first point I always like to make to IT professionals is that the most important thing you can do in your career is to not chase the new, shiny technology………..However, it is equally important to have a grounding in your main focus area before trying to expand into new technologies.”

“Having strong DBA skills like data security, data protection and performance tuning will make you marketable for the foreseeable future. Nearly all of these skills will translate to the cloud, even if you are using a Database as a Service offering like Azure SQL Database or Amazon RDS.”

Joey D’AntoniRedmond – The Independent Voice of the Microsoft IT Community – 30th May 2018


“ ……listed below are three of my beliefs in regards to the future of the DBA job:

1. The DBA job as we know it today, will change, it will evolve into something else.2. You better start learning new skills today, so you can evolve with the DBA job3. If you have not automated repetitive task until now, then now is the time to do it.”

Diana RobeteFounder of DBA Paradise – 23rd October 2019


Future DBA challenges and roleMore focus on business related data management


• «Data is the new oil»• Data Quality• Analytics/Business Intelligence (BI)• Data Science, Big Data, Artifical Intelligence (AI)

Future DBA challenges and roleNew tasks for DBA


• Architect• New projects• Developing the data platform

• Closer to Business• Make sure updated data is available for analyst

• Analytics• Support• Involved

• Data platform advisor• Where

• Hybrid• Cloud• On premis

• Choose right data platform• RDBMS• NoSQL• File based (Hadoop)• Distributed

Future DBA challenges and roleNew tasks for DBA


• Developing Data Platform• Security• High Availability• Disaster Recovery• Change Management

• Growt• Consolidation

SummaryNew role of DBA


• DBA role will change• Data management changes• Cloud impact

• DBA should • Become more Data Architets• Get closer to the Business

• Always useful knowlegde• Security• Automation

SummaryReferences


• https://www.techrepublic.com/article/will-automated-databases-kill-the-dba-position/• https://redmondmag.com/articles/2018/05/30/dba-in-the-cloud-era.aspx• http://dbaparadise.com/2019/10/my-three-beliefs-about-the-future-of-the-dba-job/• DataMesh: https://trustgrid.io/what-is-a-data-mesh/• Data Lake: https://en.wikipedia.org/wiki/Data_lake• Big Data: https://en.wikipedia.org/wiki/Big_data

https://www.techrepublic.com/article/will-automated-databases-kill-the-dba-position/

https://redmondmag.com/articles/2018/05/30/dba-in-the-cloud-era.aspx

http://dbaparadise.com/2019/10/my-three-beliefs-about-the-future-of-the-dba-job/

https://trustgrid.io/what-is-a-data-mesh/

https://en.wikipedia.org/wiki/Data_lake

https://en.wikipedia.org/wiki/Big_data

Thank You

[email protected]


Role of a DBA · Any Data, Streaming Spark/Cloud DATA MESH Schema on Write Schema on Read Big Data...

Documents

Transcript of Role of a DBA · Any Data, Streaming Spark/Cloud DATA MESH Schema on Write Schema on Read Big Data...