SQL Server 2019, Containers & Linux · for models Integrating all data Managing all data AI over...
Transcript of SQL Server 2019, Containers & Linux · for models Integrating all data Managing all data AI over...
The evolution of SQL Server
SQL Server 2008
SQL Server 2008 R2
SQL Server 2012
SQL Server 2014
SQL Server 2016 & 2017*
Transparent DB encryption
PowerPivot ● SharePoint integration ● Master Data Services
AlwaysOn ● In-Memory ColumnStore ● Data quality services ● Power View ● Cloud
In-memory across workloads ● Performance & scale ● Hybrid cloud optimized ● HDInsight ● Cloud BI
Industry-leading performance ● End-to-end mobile BI ● AI built-in ● Choice of language & platform ● Easy migration to the cloud
SQL Server 2019
Intelligence over all data ● Big data clusters with Spark and HDFS ● R and Python built-in ● Data classification & compliance tracking ● Azure Data Studio
*Support for Linux and Docker first available in SQL Server 2017
Agenda
Mission critical performance
Security and compliance
Developer and DBA tools
Operating system choices
Intelligence over all data
1
2
3
4
5
Security and
compliance
Developer and
DBA tools
Choice across OS
and containers
Intelligence over
all data
SQL Server 2019What’s new?
Mission-critical
performance
#1 OLTP performance
#1 DW performance on 1TB, 10TB, and 30TB
#1 OLTP price/performance
#1 DW price/performance on 1TB, 10TB, and 30TB
Industry-leading, mission-critical performance
Now with higher concurrency and scale through
HW innovations including persistent memory
support NEW
Persistent memory can offer a query
performance boost of up to 30% for I/O intensive
workloads (Hybrid Buffer Pool)
Combine in-memory technologies for analytics
on your operational data using HTAP
Mission-critical performance
The intelligent database
Accelerate parallel queries and improve scaling
of frequent queries with enhanced Intelligent
Query Processing NEW
Gain performance insights anytime and
anywhere with Lightweight Query Profiling NEW
Table Variable Deferred Compilation provides
50%+ faster query execution through improved
query plans NEW
Bold indicates new and improved features in SQL Server 2019
The Intelligent Query Processing feature family
Intelligent QP
Adaptive Joins
Batch Mode
Interleaved
Execution
Memory Grant
Feedback
Row ModeBatch Mode
Approximate
Count Distinct
Mission-critical performance
Adaptive QP
Table Variable
Deferred
Compilation
Approximate
QP
Batch Mode
for Row Store
Scalar UDF
inlining
Data classification and assessments
Classification tool allows you to tag
columns stored in a SQL Server
database with pre-defined set of GDPR-
related labels
Data Classification and auditing built-
in to the engine NEW
Get visibility into your security state and
meet compliance standards with SQL
Server Vulnerability Assessment
Security and compliance
Modern editor experience independent of OS and data sources
Azure Data Studio (formerly SQL Operations
Studio) is a lightweight, open source, cross-
platform graphical management tool and
code editor NEW
Support across Windows, Linux and MacOS
for SQL Server, Azure SQL Database, Azure
SQL Data Warehouse, and SQL Server 2019
big data
Use SQL Server Management Studio 18.0
to access, configure, manage, and administer
all SQL Server components NEW
Developer and DBA tools
Enhancing the developer experience
Build new types of apps through
extended Java language supportNEW
Enhanced graph support enables
new query types including edge
constraints and merge DMLNEW
Leverage native support for UTF-8
character encodingNEW
Launch pad
SQL
Developer and DBA tools
More deployment choices than ever before
Support for Red Hat Enterprise Linux,
SUSE Linux Enterprise Server, Ubuntu,
and Windows
Linux and Windows Docker containers
SQL Server in Red Hat containers NEW
Linux-native installation: Yum Install, Apt-Get
Application and database compatibility
Replication, DTC, and Machine Learning in
SQL Server 2019 NEW
Choice across OS and containers
SQL Platform Abstraction Layer
(SQLPAL)
RDBMS IS AS RS
Windows Linux
Windows Host Ext. Linux Host Extension
SQL Platform Abstraction Layer(SQLPAL)
Host extension mapping to OS system calls(IO, Memory, CPU scheduling)
Win32-like APIsSQL OS API
SQL OS v2
All other systemsSystem resource &
latency sensitive code paths
Platform abstraction layer - SQL Server on Linux
Choice across OS and containers
VM 1 VM 2
Containers – High Level Overview
Host OS
Hypervisor
Guest OS Guest OS
Bins / Libs
Application
Bins / Libs
Application
Host OS
Container 1 Container 2
Bins / Libs
Application
Bins / Libs
Application
Container Engine
Shared storage HA in Kubernetes on SQL Server
Persistent Volume Storage
User
Node
Pod
SQL Server
Node
Load Balancer Service
Node
Pod
SQL Server
Pod
SQL Server
Choice across OS and containers
Mission critical availability
Use Availability groups on
Kubernetes to implement a full
AG system integrated into SQL
Server NEW
Accelerated Database
Recovery performs versioning
to ensure recovery and
availability of data NEW
Objects outside the database
can now automatically failover,
avoiding the need for custom
data replicationsA
G
Pod
Operator
Pod
SQL Server
primary
AG agent
Load
balancer
Pod
SQL Server
secondary
AG agent
Pod
SQL Server
secondary
AG agent
SQL Server
primary
SQL Server
secondary
Load
balancer
SQL Server 2019 enables intelligence over all your data
Build intelligent apps and
AI with all your data
AI over all data
Easily and securely manage
data big and small
Managing all data
Simplified management and analysis through a unified deployment, governance, and tooling
Unified access to all your data with
unparalleled performance
Integrating all data
Intelligence over all data
SQL Server 2019 big data, analytics, and AI
Managed data lake with
SQL Server and Spark
SQL Server
Data virtualization
T-SQLAnalytics Apps
Open
database
connectivity
NoSQL Relational
databases
HDFS
Complete AI platform
SQL Server External Tables
Compute pools and data pools
Spark
Scalable, shared storage (HDFS)
External
data sources
Admin portal and management services
Integrated AD-based security
SQL Server
ML Services
Spark &
Spark ML
HDFS
REST API containers
for models
Managing all dataIntegrating all data AI over all data
Store high volume data in a data lake and access it
easily using either SQL or Spark
Management services, admin portal, and
integrated security make it all easy to manage
Combine data from many sources without moving
or replicating it
Scale out compute and caching to boost
performance
Easily feed integrated data from many sources to
your model training
Ingest and prep data and then train, store, and
operationalize your models all in one system
Intelligence over all data
Data virtualization easily combines data from many sources and eliminates data silos
Intelligence over all data
SQL Server
T-SQLAnalytics Apps
NoSQL Relational databases Big data
PolyBase external tables
SQL Server is the hub for integrating data
Easily combine across relational and
non-relational data stores
Intelligence over all data
Data virtualization creates solutions
CostsLower storage costs
Less dev time spent on integration
Rapid iterations and prototypes
Timely data
Smaller attack surface area
Consistent security model
Fresh and accurate data
Easier data governance
Speed
Security
Quality
Compliance
Data virtualization integrates data from
disparate sources, locations and formats,
without replicating or moving the data, to
create a single "virtual" data fabric
Intelligence over all data
Deploy and manage a SQL Server + big data cluster
Easily deploy and manage a big data cluster using
Microsoft’s Kubernetes-based big data solution
built-in to SQL Server
Hadoop Distributed File System (HDFS) storage,
SQL Server relational engine, and Spark analytics
are deployed as containers on Kubernetes in one
easy-to-manage package
Intelligence over all data
SQL Server
master instance
Persistent storage
Custom apps AnalyticsBI
SQL
Server
HDFS Data Node
Spark
Kubernetes pod
SQL
Server
HDFS Data Node
SparkSQL
Server
HDFS Data Node
Spark
Node Node Node
Scale out big data compute and storage
SQL Server 2019 includes Spark and HDFS,
enabling you to read and write directly in HDFS
using SQL Server or Spark NEW
Elastically scale compute and storage on demand
using the Kubernetes architecture NEW
Apps, BI, and analytics access all your relational
and big data through the SQL Server master
instance using T-SQL NEW
Scale-out data marts combine and cache data
from relational and non-relational data sources
for fast querying NEW
SQL
Intelligence over all data
Increase analytics and apps performance
Compute pool
SQL Compute
Node
SQL Compute
Node
SQL Compute
Node…
Compute pool
SQL Compute
Node
IoT data
Directly
read from
HDFS
Persistent storage
…
Storage pool
SQL
ServerSpark
HDFS Data Node
SQL
ServerSpark
HDFS Data Node
SQL
ServerSpark
HDFS Data Node
Kubernetes pod
AnalyticsCustom
apps BI
SQL Server
master instance
Node Node Node Node Node Node Node
SQL
Data pool
SQL Data
Node
SQL Data
Node
Compute pool
SQL Compute
Node
Storage Storage
Intelligence over all data
Resources
Intelligence over all data
What’s New in SQL Server 2019TPC OrganizationKubernetesRed Hat ContainersSQL Server Workshops