The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform
-
Upload
idera-software -
Category
Software
-
view
241 -
download
3
Transcript of The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform
![Page 1: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/1.jpg)
The Future of The DBADevOps, the Cloud Paradigm, & the Microsoft
Data Platform
Stuart R Ainsworth
http://codegumbo.com
![Page 2: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/2.jpg)
Agenda
Explore (high-level) the Microsoft Data Platform
Describe the typical state of database administration
Define & describe DevOps and the cloud computing
paradigm
Discuss the implications for data professionals
3
1
2
4
1
![Page 3: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/3.jpg)
Assumptions About You
Learning-centered
SQL Server experience
Exposure to database admin & architecture
Desire to build modern skills
3
1
2
4
2
![Page 4: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/4.jpg)
About Me 3
Manage IT for financial services company
Former Data Architect, DBA, developer
AtlantaMDF Chapter Leader
Infrequent blogger: http://codegumbo.com
My
career
trajectory
![Page 5: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/5.jpg)
4
You have brains in your head
And SQL Skills to boot
You'll soar to great heights
On the Data Platform too
You're on your own,
And you know what you know,
And YOU are the one
who'll decide where to go.
http://bit.ly/2j8Wi5z
![Page 6: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/6.jpg)
Where Are We?
Typical SQL Server Person
5
![Page 7: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/7.jpg)
6Typical SQL Server Person
• Specialized knowledge
• May have exposure to other infrastructure or
development tools
• Usually reports to Operations (not Development)
• Often one of the “last stops” in deployment chain
![Page 8: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/8.jpg)
Typical SQL Server Person 7
SQL (DDL & DML)
Performance Tuning
(Code)
Index Analysis
Data Warehousing
Reporting
Development
Skills
Administration
Skills
Server Configuration
Performance Tuning
(Server)
Index Maintenance
Backups and Restores
Security
![Page 9: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/9.jpg)
8MCSA SQL 2012\2014
• 70-461: Querying Microsoft SQL Server 2012/2014
• 70-462: Administering Microsoft SQL Server 2012/2014
Databases
• 70-463: Implementing a Data Warehouse with Microsoft
SQL Server 2012/2014
![Page 10: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/10.jpg)
What’s coming… 9
• Data production is accelerating– Est .79ZB in 2009
– Est 7.9ZB in 2015
– Est 35ZB in 2020 (44 times greater than 2009)
• Data is diversifying– Relational Data
– Big (Size) Data
– Fast Data
– Dark Data
– Lost Data
– New Data
![Page 11: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/11.jpg)
DevOps
Philosophy, not Methodology
10
![Page 12: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/12.jpg)
A (Very) Brief Overview 11
• DevOps is focused on delivering quality, faster.
• Philosophical approach, not methodological– Automation, infrastructure as code, continuous deployment
– Emphasis on communication; silo reduction
• Born out of Agile, several innovators contributing– Patrick Debois & Andrew Clay Shafer – Agile Infrastructure (Agile 08)
– John Allspaw & Paul Hammond – 10+ Deploys Per Day (Velocity 09)
– Gene Kim, Kevin Behr, & George Spafford – The Phoenix Project
![Page 13: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/13.jpg)
The Phoenix Project 12
![Page 14: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/14.jpg)
The Phoenix Project 13
![Page 15: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/15.jpg)
The Phoenix Project 14
![Page 16: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/16.jpg)
Key Takeaways 15
• DevOps is rooted in a sense of continuous improvement
• People over tools
• Reduce silos by focusing on shared goals, not
technology
![Page 17: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/17.jpg)
The Cloud Paradigm
Infrastructure, Platform, Software
16
![Page 18: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/18.jpg)
What do we mean by “The Cloud”?
17
• Trendy marketing term?
• Network hosting?
• Internet connected services?
• Distributed, scalable, shared computing resources?
![Page 19: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/19.jpg)
Product-Focused Paradigm 18
![Page 20: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/20.jpg)
Cloud Paradigm 19
Applications
Data
Runtime
Middleware
O/S
Virtualization
Servers
Storage
Networking
![Page 21: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/21.jpg)
Cloud Paradigm 20
![Page 22: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/22.jpg)
Cloud Paradigm 21
![Page 23: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/23.jpg)
Cloud Paradigm 22
![Page 25: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/25.jpg)
Ideal System Architecture 24
• Scalable
• Resilient to Failure (Redundant)
• Service-Oriented Architecture
• Automated Monitoring, Configuration and Build
• “Infrastructure As Code”
![Page 26: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/26.jpg)
• Completely Automatic
– Code checked in -> new build
– Unit & regression testing
– User acceptance testing
– Continuous Integration
– Dependent on “infrastructure as code”
• Micro-releases (100 deployments per day)
• No rollbacks
Ideal Release Process 25
![Page 27: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/27.jpg)
Ideal Operations 26
• Automatic instrumentation (Logging)
– Long Term Storage
– Predictive Analytics
• Automatic Error Logging & Alerting
– Respond to Every Error
– On-call Rotation includes Developers
• Automatic Scaling
– Scale Up
– Scale Down
• “Zero Maintenance”
![Page 28: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/28.jpg)
Ideal Data Architecture 28
Consistent
Available Partition
Tolerant
SQL Server
Relational
Engine
Hadoop
Cassandra
CAP Principle (Gilbert & Lynch)
![Page 29: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/29.jpg)
Microsoft Data Platform
Diversity in Data
29
![Page 31: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/31.jpg)
Microsoft Data Platform 31
![Page 32: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/32.jpg)
Microsoft Data Platform 32
![Page 33: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/33.jpg)
Impact on Careers
Future Prognostications
33
![Page 34: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/34.jpg)
Current Trends 35
• Companies are recognizing the value of different kinds of
data, and an increased need for analytics.
– Adoption of Big Data technologies is on the rise
– Data Science jobs are increasing
– The Internet (or Fog) of Things is coming.
• Operational methodologies like Agile and DevOps are
pushing companies toward the Cloud Paradigm.
![Page 35: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/35.jpg)
Current Trends 36
• The Cloud Paradigm with its separation of duties is
causing companies to realign resources.
– Infrastructure Teams
– Platform Teams
– Software Teams
• Operational technologies (virtualization, scripting) are
allowing organizations to scale out computing resources
with fewer human resources.
![Page 36: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/36.jpg)
Cloud Paradigm 34
Applications
Data
Runtime
Middleware
O/S
Virtualization
Servers
Storage
Networking
SQL
SERVER
SOFTWARE
PLATFORM
INFRA-
STRUCTURE
![Page 37: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/37.jpg)
My Predictions 37
• Increased segregation between Development and
Administration roles.
• Number of development jobs will increase
– Diversity of data platform.
– Need for integration.
– Data mining and analysis skills.
• Number of administrative jobs will decrease
– Infrastructure as code, scripting, virtualization
– Product specific specialists for initial configuration
![Page 38: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/38.jpg)
What does this mean for YOU? 38
• Choose your path: Development or Administration
• Developers have opportunities for breadth:
– Big Data (Hadoop, HDInsight)
– Data Science (Statistics, R)
– Visualizations (Reporting, Power BI)
• Administrators have opportunities for depth:
– Always On
– Infrastructure & Platform impacts
– Scripting & configurations
![Page 39: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/39.jpg)
MCSA SQL 2016 39
Querying Data with
Transact-SQL
Developing SQL
Databases
Administering a SQL Database Infrastructure
Provisioning SQL Databases
Implementing a SQL Data Warehouse
Developing SQL Models
![Page 40: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/40.jpg)
40
![Page 41: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/41.jpg)
Contact Me
Stuart R. Ainsworth
Twitter: @codegumbo
Email: [email protected]
Blog: http://codegumbo.com
Slides available: http://bit.ly/2j7lFVb
41
![Page 42: The Future of the DBA: DevOps, the Cloud Paradigm, and the Microsoft Data Platform](https://reader031.fdocuments.us/reader031/viewer/2022021508/58ed1eeb1a28ab591f8b4675/html5/thumbnails/42.jpg)
Be Good at Getting Better
Continuous Improvement for your career