AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look...

50
AN E ARLY L OOK AT ASE 15.7 ENHANCING DEVELOPER / DBA PRODUCTIVITY AND OPERATIONAL SCALABILITY WHILE REDUCING TCO PETER THAWLEY SENIOR DIRECTOR / ARCHITECT , CTO OFFICE SEPTEMBER 2011

Transcript of AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look...

Page 1: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

AN EARLY LOOK AT ASE 15.7

ENHANCING DEVELOPER / DBA PRODUCTIVITY AND

OPERATIONAL SCALABILITY WHILE REDUCING TCO

PETER THAWLEY

SENIOR DIRECTOR / ARCHITECT, CTO OFFICE

SEPTEMBER 2011

Page 2: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

2 – Company Confidential – November 3, 2011

<INCLUDE STANDARD.DISCLAIMER>

The development, release, and timing on any features and functionality described for our products remains at our sole discretion. The information on roadmaps is intended to outline our general product direction and should not be relied on in making a purchasing decision.

This presentation discusses Sybase product futures and includes Sybase proprietary and confidential information.

Page 3: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

3 – Company Confidential – November 3, 2011

COMMON VISION: SAP AND SYBASE ASECO-INNOVATION FOR SHARED CHALLENGES

Packaged Apps/SAP

Business Suite

Custom Apps/High

End

Custom Apps/Most

Market Verticals

• Price/performance

• Availability/Planned Downtime

• Minimal/Self Management

• Price/performance

• Operational Scalability

• Availability/Planned Downtime

• Developer Flexibility

• Extreme Performance

• Extreme Scale

Expanded Market

Power for Sybase ASE

Partners/Ecosystem

Market Reach and Mind Share

Investment & Co-innovation

Page 4: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

4 – Company Confidential – November 3, 2011

SAP AND SYBASE ASE

• SAP business applications run on ASE

– Strong alignment across R&D, sales & marketing opens up huge growth opportunity for ASE

– Strong early interest from SAP customers looking to migrate to ASE & partners

• SAP’s focus on strong business value and low TCO aligns well with Sybase ASE focus on TCO

Page 5: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

5 – Company Confidential – November 3, 2011

SAP ON SYBASE ASE

Rollout plan

• Support of SAP Business Suite running on Sybase ASE will be rolled out in phases in 2011

• Pilot phase

– Starts April 1st 2011

– Select SAP ERP customers pilot SAP on ASE

• Ramp up

– Starts June 14, 2011

– Customers in pilot program enter ramp up

– New customers added to ramp up

– Extended to additional modules/applications

• General availability

– Targeted for Q4, 2011

Page 6: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

6 – Company Confidential – November 3, 2011

SAP ON SYBASE ASE

Rollout plan

ASE 15.7GALate Q3’11

ASE 15.7R&D

SAP on ASEGAQ4’11

SAP on ASERelease toCustomersJune ‘11

SAP on ASEPilot CustomersApril ‘11

• Tightly knit integration teams• SAP Business Suite testing & certification as

part of ASE GA will enhance quality for ASE releases

Page 7: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

7 – Company Confidential – November 3, 2011

ASE 15.7

• All ASE 15x releases part of same release family (ASE 15x).

• ASE 15.5 & ASE 15.7 are ASE 15x IRs

• ASE 15.7 is next intermediate release on ASE 15x

– Follows ASE 15.5

– There is no ASE 15.6

• Now GA!

ASE/CE 15.7

ASE/CE 15.5

ASE/CE 15.0.3

ASE/CE 15.0.1

ASE 15.0

Page 8: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

8 – Company Confidential – November 3, 2011

Application Development /Productivity

Large Data Sets

Operational Scalability / Lower TCO

Security

Performance / Scalability

ASE 15: KEY FOCUS AREAS

Mixed Workloads

(Transactions & ODSS)

Page 9: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

9 – Company Confidential – November 3, 2011

Application Development /Productivity

Large Data Sets

Operational Scalability / Lower TCO

Security

Performance / Scalability Mixed

Workloads

(Transactions & ODSS)

ASE 15.7 FEATURE SETS

• LOB Management• Concurrency / Isolation Controls• Language / syntax• Scripting language drivers• Diagnostics & MDA enhancements • Row / LOB Compression

• In-row LOBs• DDLs with storage

optimizations

• Online Utils (Reorg rebuild)• Fully recoverable DDLs• Increased data availability

w/ DDLs• Ease of administration updates

• PCI-DSS support

• Query latency reduction

• Kernel updates• Replication

performance

Page 10: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

10 – Company Confidential – November 3, 2011

ENHANCED LOB MANAGEMENT

LOB Locators

• Reduced Network Traffic

• Reduced Client Side Memory

T-SQL And JDBC/ODBC

API

• Flexible Handling of LOBs

• Reduced Coding Complexity

LOBS as Parameters

in Stored Procs

• Flexible Handling of LOBs

• Reduced Coding Complexity

In-Row Storage

• Storage Savings

• Performance Benefits for Small LOBs

Page 11: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

11 – Company Confidential – November 3, 2011

ENHANCED LOB MANAGEMENTLOB LOCATORS

LOB locators / LOB datatype support

• Handle to a LOB that can be referenced in T-SQL statements and can be passed between serverand clients

• Client applications can send and receive locators as host variables and parameter markers

• Reference to a LOB value in ASE memory

• Can be passed between ASE and client instead of actual LOB

• Can reduce memory requirement on client side when LOB value not needed on client side

• Supports LOB handling by ODBC and JDBC drivers

Locator/LOB Locator

Page 12: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

12 – Company Confidential – November 3, 2011

ENHANCED LOB MANAGEMENTT-SQL & DRIVERS SUPPORT FOR LOCATORS

T-SQL Updates

• truncate lob <locator> [(result-length)]

• Truncate to a specific length or deallocate

• return_lob (<datatype>, <locator>)

• Return actual LOB value

• setdata (<locator>, <offset>, <new_value>

• Overwri te some or part of LOB

• substring(<locator>, <start>, <length>)

• Extract a substring from the LOB and return new locator

• Also

• concatenate two LOBs

• Updated functions:

• charindex, char_length, datalength, patindex,

• jConnect JDBC Driver Support

• Client applications can access the locators using Blob, Clob and Nclob classes from the java.sql package.

• Adaptive Server ODBC Driver Support

• ODBC API does not directly support LOB locators

• ODBC client must use T-SQL functions on the locators and manipulate LOB values

• Adaptive Server ODBC driver introduces several stored procedures to facilitate the use of these T-SQL functions

Page 13: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

13 – Company Confidential – November 3, 2011

ENHANCED LOB MANAGEMENTLOBS AS STORED PROCEDURE PARAMETERS

Before

• Couldn’t declare varchar/varbinary/univarchar data exceeding ASE page size

Now

• Declare text/image/unitext LOB for local variable

• Pass local variable as input parameter to stored procedure

• Can prepare SQL statements that include LOB parameters

• Statement cache caches SQL statements with LOBs

create procedure proc_name [@parameter_name LOB_datatypeas {SQL_statement}

jConnect and Adaptive Server ODBC Driver both updated to handle LOBs as input parameters in stored procedures

Page 14: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

14 – Company Confidential – November 3, 2011

ENHANCED LOB MANAGEMENTIN-ROW & OFF-ROW LOBS

Before

• LOBs always OFF-ROW: ASE always allocates a separate page chain for LOBs regardless of LOB size.

• Can be very wasteful especially when dealing with small LOBs; mostly empty pages

• Performance penalty

Now

• IN-ROW & OFF-ROW support

• Can maintain LOBs IN-ROW for a pre-defined LOB size with automatic transfer to OFF-ROW on expansion (due to updates of LOBs exceeding threshold size or other variable length columns expanding)

• Big benefit to applications making heavy usage of small LOBs

“Bonjour”

Page 15: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

15 – Company Confidential – November 3, 2011

OPTIMIZED STORAGE

Compression

• Storage Savings

• Reduced Memory Consumption

• Lower I/O Demands

ALTER TABLE w/o Data Copy

• Space savings

• Performance

• Availability

Deferred Table Materialization

• Storage Savings

• Ease of Enterprise App. deployment & DB Provisioning

In-Row Storage

• Storage Savings

• Performance Benefits for Small LOBs

Page 16: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

16 – Company Confidential – November 3, 2011

OPTIMIZED STORAGECOMPRESSION

Data Compression

• Compression of regular relational data in ASE

LOB Compression

• Compression of LOB data

Storage• Reduce storage costs for online data

I/O

• Savings in I/O cost when caching compressed data

Memory

• Reduces memory consumption when caching compressed data

Page 17: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

17 – Company Confidential – November 3, 2011

OPTIMIZED STORAGEDATA COMPRESSION

Row Compression

Page Compression

Data Compression

ABC 1 XX “AC”

ABC 1 XX “AC”

Row Compression

Compress Away Empty Spaces/zeroes in

Fixed Length Columns

Database

Table

Partition

• Database Attribute for default

• Individual Columns can be excluded

• Treat active partitions differently from non-active ones.

Page Compression

• Page Dictionary Compression

• Repeatedly referenced data replaced by symbol which is recorded in a page dictionary

• Page Index Compression

• Set of columns with duplicated values stored one place and referenced by marker in row.

Page 18: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

18 – Company Confidential – November 3, 2011

OPTIMIZED STORAGELOB COMPRESSION

• Each LOB can be up to 2GB! Compression can be very handy!

• ASE backups can already be compressed

• LOB compression will follow same compression levels and algorithm choices

• Compression Techniques

• FastLZ and ZLib - Both are dictionary based lossless compression schemes

• FastLZ has lower CPU usage and execution times; ZLib has higher compression ratios

• Compression scheme and level can be specified for each LOB column

• 9 compression levels overall (2 for FASTLZ and 9 for ZLib)

• LOB datatypes supported

• Text/Image/UniText and off-row Java Object

• XML is NOT supported

• Database, Table level and Column level support

Page 19: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

19 – Company Confidential – November 3, 2011

STORAGE SAVINGS – IMPACT ON TPC-H(BLIND SWITCH TO COMPRESSION – NO TUNING)

• Scale Factor

• 4K ASE page size

• Data loaded by BCP-in

• Reorg rebuild to generate page compression

• DB Size reduced from 1215 MB to 800 MB

• 34% compression ratio

• Run1 – 3 tables compressed

• Run2 – 5 tables compressed

nation

region

supplier

customer

part partsupp

orders

lineitem

Uncomp 1 1 2 27 30 130 180 846

PgComp 1 1 2 19 18 90 111 561

0100200300400500600700800900

Spac

e U

sage

(M

B)

TPC-H Space usage

Compression Ratio 30% 40% 31% 38% 34%

Run-1

Run-2

Page 20: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

20 – Company Confidential – November 3, 2011

TPCH COLD CACHE QUERY PERFORMANCE

%age improvement in query response time. Each query run n-times, performing I/O from disk for compressed tables inolved in the run. Data for uncompressed tables remains cached.

-10

0

10

20

30

40

50

60

70

80

90

Q1 Q2 Q3 Q4 Q7 Q8 Q9 Q11 Q12 Q16 Q17 Q18 Q19 Q21 Q22

%ag

e im

pro

vem

ent

in a

vg. r

esp

on

se t

ime,

ove

r u

nco

mp

ress

ed

ru

ns

Comparison of %age improvement in response times v/s # of tables compressed

Run-1

Run-2

Average improvement

10.25%

19.56%

Page 21: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

21 – Company Confidential – November 3, 2011

STORAGE IMPROVEMENTS – SAP ERP INSTALL

0

100

200

300

400

500

600

Vanilla CompressedTotal Space 509,56 142,32

Spac

e U

sage

(G

B)

3.5X saving

Page 22: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

22 – Company Confidential – November 3, 2011

OPTIMIZED STORAGEDEFERRED TABLE MATERIALIZATION

Table1

Table2

Table3

Table4

Table5

Table6

Table7

Table8

Table9

Table10 … Table

10001Table 10002

Table10003

Table 10004

Enterprise Wide Universal Schema

ERP

Server

Financials

Server

SCM

ServerCRM

Server

Table10001

Table 10002 … Table

9003

Table10001

Table 10002 … Table

8509Table1

Table 2029 … Table

9003

Table1

Table 2034

Table13

Table 1004

Materialized sub-set of Universal Schema

Materialized sub-set of Universal Schema

Materialized sub-set of Universal Schema

Materialized sub-set of Universal SchemaAll Servers Have Same Schema

Post ASE 15.7 GA

Page 23: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

23 – Company Confidential – November 3, 2011

OPTIMIZED STORAGEALTER TABLE W/O DATA COPY

ALTER TABLE works on copy of data

for several operations, resulting in high

temporary space usage

ALTER TABLE in ASE 15.7

• Add a non-null column

• Drop a column

• Modify column type and nullabilityPost ASE 15.7 GA

No Data Copy

• Performance (time savings)• Data availability (potentially reduced “outage” by

hours depending on table size)• Temporary space / disk requirements reduced /

removed (previously full table copy made)

Page 24: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

24 – Company Confidential – November 3, 2011

DIAGNOSTICS & MONITORING

Analyzing QP plans: Show cached plans

in XML

Analyzing QP plans:

Analyze dynamic

parameters

Analyze statistics & histograms

Field diagnostics

utility

• See show plan output in XML for a statement in cache

• Shows execution plan, optimizer cost estimate, params at compilation, paramscausing lowest query performance

• Can analyze dynamic parameters before running a query

• Display information about parameters in dynamic sql statements

• SQL interface to statistics and histograms • New stored procedure sp_showoptstats

(similar to optdiag standalone utility) extracts and displays in an XML document statistics and histograms for various types of data objects from system tables

• Collects comprehensive configuration, monitoring, OS / platform environment and external ASE files data

• Generates a .zip output file with HTML and data files that can be viewed in a browser

Page 25: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

25 – Company Confidential – November 3, 2011

DIAGNOSTICS & MONITORINGFIELD DIAGNOSTICS UTILITY

Customer hits a issue

Single Command Zips up Commonly Required

Diagnostics and Environment Info

Sybase CS&S Can

View Diagnostics Data

in Browser

• Help expedite customer case management and

problem diagnosis processes

• Reduces communication cycles & time burden

on both customer and Sybase CS&S

Page 26: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

26 – Company Confidential – November 3, 2011

APPLICATION DEVELOPMENT

Scripting Language

Drivers• Sybase supported drivers

T-SQL Updates

• MERGE/UPSERT

• Sub-SELECT syntax

• Quoted Identifier

• Wider DOL rows

• No truncation of trailing 0x0 for binary data during INSERT

Concurrency Enhancements

• SELECT FOR UPDATE

• Release read locks on cursor close for Isolation level > 1

• Procedures/DDL commands in chained transaction mode

Page 27: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

27 – Company Confidential – November 3, 2011

APPLICATION DEVELOPMENTSCRIPTING LANGUAGES

DBCAPI

Sybase Python

Sybase PHP

Sybase PERL

Sybase Ruby

Sybase Django

CT-Library

Post ASE 15.7 GA

Post ASE 15.7 GA

Post ASE 15.7 GA

Page 28: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

28 – Company Confidential – November 3, 2011

APPLICATION DEVELOPMENTT-SQL UPDATES & CONCURRENCY ENHANCEMENTS

Feature Description BenefitMerging data from source to target table (MERGE/UPSERT)

• MERGE command allows transfer of rows from a source table (table, view, derived table) to a target table

• Inserts rows without matching key columns in target; if matching ones found updates the target table with values from source row

• Simplify data merge use cases• Easy handling of duplicate key

errors

Sub-SELECT enhancements • Allow asterisk in sub-select with single column• Allow column alias in sub-select• Allow multiple column names in sub-select under

EXISTS

• Programming flexibility

Quoted Identifier support • Will work on index names, and stored proc invocation of object names (table, view, column, index)

• Programming flexibility

No truncation of trailing 0x0during INSERT into VarBinarycolumns

• Preserve any trailing zeroes for image / binary data • Maintain integrity of binary data stored in a column

SELECT FOR UPDATE locking semantics

• Allows selected rows to be locked for a later update • Enhanced concurrency controls & isolation semantics

• Reduced deadlocks

Start offset on DOL Varlencolumns increased for 16K pages

• DOL variable length columns can begin at a larger offset (32767 vs. previous 8192)

• Can have “wider” DOL rows in schema

Release read cursor locks at cursor close even for isolation level > 1

• Read locks can be released on closing of a cursor at isolation level 2 & 3 for active transaction

• Configurable at cursor level

• Programming flexibility• Free up resources when not

required

Allow procs / DDL commandsin chained transaction mode

• All system procedures and select DDLs can run in chained transaction mode

• Programming flexibility

Page 29: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

29 – Company Confidential – November 3, 2011

PERFORMANCE

Reduced Query

Latency

Updated Kernel

Replication Performance

Page 30: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

30 – Company Confidential – November 3, 2011

PERFORMANCE

Feature Description Benefit

QP latency reduction

• Several individual enhancements to reduce QP latency, esp. for dynamic SQL

• Reduce overhead to prepare for query execution (optimized codepath, shared query plans across sessions via dynamic global sql cache)

• Improved performance of query execution engine• Reduced communication overhead between client

and ASE when sending SQL statements to ASE• Reduced communication overhead when ASE sends

query results to client

• Application transparent changes to reduce query response times.

• In-house tests how 2X performance improvement on JDBC / ODBC based TPCC workload

K21 — Kernel updates

• Better utilize parallel h/w (core, h/w threads)• Better integration of i/o event processing and

reduction of i/o overhead

• Performance / scaling on parallel h/w

• Lower latency for critical system tasks with greater predictability and consistency

Page 31: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

31 – Company Confidential – November 3, 2011

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROCsta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

Process

Engine

DIO NIO CTIO

OS resExec

ctxt

Process

Engine

DIO NIO CTIO

OS resExec

ctxt

Process

Engine

DIO NIO CTIO

OS resExec

ctxt

ASE 15.0.X BASICS

Page 32: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

32 – Company Confidential – November 3, 2011

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROCsta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

PSS

KPROC

sta

ck

ASE Process

OS resources

Engine

Execution

Context

Engine

Execution

Context

Engine

Execution

Context

Engine

Execution

Context

Engine

Execution

Context

Disk I/O Net I/O CT-lib I/O

K21 BASICS

Page 33: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

33 – Company Confidential – November 3, 2011

WHY K21 WORKS FOR CMT

• Modern operating system schedulers geared toward multi-threaded process, not multi-process parallelism

• Single address space makes core - thread context switch less expensive

• Engines lighter, more efficient as they don’t spin on i/o polling

• Elimination of i/o affinity “unclogs” ASE scheduling

Page 34: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

34 – Company Confidential – November 3, 2011

EARLY PERFORMANCE RESULTS OF K21

Test Scenario – Contrived BCP Test to Show Extremes

Rows perSecond

TotalTime vs. K21

K21 – Similar to 15.0.x best case• No “Network Engine” dependencies now!

15,000 51 sec n/a

15.0.x – average case• Execution & Network engine affinity split

2,800 276 sec - 5 X

15.0.x – worst case• Execution & Network engine affinity intentionally

split • Kept net engine “CPU busy” to add scheduler

latency

25 ~10 hours - 600 X

Test Scenario – Replication Agent Thread Throughput Performance

KB’s perSecond

Latency(µs) vs. K21

ASE 15.7 Threaded Mode 2,000 200 n/a

ASE 15.7 Process Mode 160 9,200 - 12 X

Page 35: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

35 – Company Confidential – November 3, 2011

ASE 15.7 – VIRTUAL SERVER ARCHITECTURE (VSA)CORE COMPONENTS OF THE K21 KERNEL (SINGLE NODE VIEW)

Operating System

Shared Executable (Program Memory)

Other Memory

Lock Chains

Pending I/Os

D

I

S

K

N

E

T

Shared MemoryProcedure and

Statement Caches

Disks and Databases

Hash

Data & Index Caches

Hash Hash

Engine 0

SPID 1

PSS

KPROC

sta

ck

Run Queues of “Tasks”

Sleep Queue of “Tasks”

locksleep

diskI/O

sendsleep

Engine 1

SPID 7

PSS

KPROC

sta

ck

Engine N

SPID 3

PSS

KPROC

sta

ck

CPUs, Cores, and Threads

User LogCaches

ASE OS Thread Pools

System PoolClock, Link Monitor,

Disk & Net I/O,

CT-Lib, CIPC

Blocking

PoolBlocking Requests

Page 36: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

36 – Company Confidential – November 3, 2011

SECURITY

Object Ownership

Change

Login Profiles

Dual Key Control

Single Sign-On

Stronger P/W &

Hidden Text Encryption

Page 37: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

37 – Company Confidential – November 3, 2011

SECURITYOBJECT OWNERSHIP CHANGE

•Allows change of ownership of object(s) from one owner / login to another

• Single command to transfer all objects owned by a login

• Person who created an object may not be the

person maintaining it

• Changing employee responsibilities

• Employees joining and leaving

• Mergers and acquisitions

• Outsourced development, maintenance

• Solution: A DDL Utility to Change Object

Ownership conveniently

Page 38: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

38 – Company Confidential – November 3, 2011

SECURITYLOGIN PROFILES

• Managing large numbers logins can be difficult– Organizational policies change

and security systems need to quickly implement changes

• Login Profiles are SQL-Defined containers of login attributes and their values– Groups of logins can share login

profiles

– Easier to administer

– Provides flexibility to implement security policies and comply with regulations

Security Attributes

Default Database

Default Language

Authenticate With

Login Script

Auto Activated

Roles

Stale Period

Track Last Login

Profile Id

Page 39: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

39 – Company Confidential – November 3, 2011

SECURITY

Feature Description Benefit

Split knowledge & dual control of keys

• No one person alone can enable decryption of encryption-keys

• Stronger protection of encrypted data from unauthorized access

• Compliance with PCI DSS (PaymentsCard Industry Data Security Standards Section 3.5/3.6) requirements

Stronger password and hidden text encryption

• Role passwords are now hashed using one-way secure hash (SHA-256); password complexity rules enforced

• Strong encryption of external passwords and hidden text (e.g. in syscomments) (using FIPS-140-2 modules)

• Enhanced password security• FIPS 140-2 standards compliance

Single sign-on & E-2-E Kerberoscredential forwarding

• Automatic passing of user credentials between client, mid-tier and server layers

• Single sign-on ASE to ASE connection through CIS

• Ease of use• Single sign-on

Page 40: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

40 – Company Confidential – November 3, 2011

OPERATIONAL SCALABILITY

Online REORG

Fully Recoverable

DDLs

ALTER TABLE w/o Data Copy

Page 41: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

41 – Company Confidential – November 3, 2011

OPERATIONAL SCALABILITY

Feature Description BenefitOnline reorgrebuild

• Perform reorg-rebuild online without blocking DML operations

• Increased data availability and decreased data disruption to business operations

Fully recoverable DDLs

• Use DUMP TRANSACTION to fully recover SELECT INTO, ALTER TABLE commands that require data movement, REORG REBUILD

• These commands were minimally logged before• Use sp_dboption to fully log these commands

• Continuous & point in time recoverability of a database (even after DDL and minimally logged operations)

• No need for DUMP DATABASE after these operations are performed

• Operations can readily be embedded within application logic

ALTER TABLEoperations without data copy

• Add a non-null column to a table without data copy; allows creation of non-materialized non-null columns; table’s physical data is not changed

• Drop a column• Modify column type and nullability

• Performance (huge time savings)• Data availability (potentially reduced

“outage” by hours depending on table size)

• Temporary space / disk requirements reduced / removed (previously full table copy made)

Post ASE 15.7 GA

Post ASE 15.7 GA

Page 42: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

42 – Company Confidential – November 3, 2011

PLATFORM AVAILABILITY

ASE 15.5 ASE 15.7

HP-UX Itanium 64-bit

IBM AIX 64-bit

Linux Power 64-bit

Linux x86-64

Solaris SPARC 64-bit

Solaris x86-64

Windows x86-64

Windows x86

HP-UX PA-RISC 64-bit

Linux x86

Solaris SPARC 32-bit

Page 43: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

43 – Company Confidential – November 3, 2011

SUMMARY

• SAP Business Suite available on ASE Q4 2011

– Huge opportunities for ASE growth

– SAP and Sybase teams strongly aligned

– SAP / ASE focus on TCO benefits custom applications and install base

• ASE 15.7

– Look forward to GA in Q3 2011

– Continuation of ASE 15x and follow-on release to ASE 15.5

– Major areas of focus

Storage optimization & data and LOB compression

Application development & application performance

Operational scalability & TCO

Page 44: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while
Page 45: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

45 – Company Confidential – November 3, 2011

APPENDIX

Page 46: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

46 – Company Confidential – November 3, 2011

OPTIMIZED STORAGE

Feature Description Benefit

Compression of in-row as well off-row data

• Compressed storage of in-row relational data as well as LOB data (text / image / unitext, off-row Java objects, XML columns)

• Data compression (row and page compression)• Table or partition level (with option to not

compress certain columns)

• Storage savings• Reduced memory consumption• Lower I/O demands for better

performance

In-row storage of text /image data with automatic transition to off-row

• Store text and image data in-row up-to some defined size limit

• Move to off-row if size exceeds limit on update

• Storage savings• Performance benefits for small

LOBs

ALTER TABLE operations without data copy

• Add a non-null column to a table without data copy• Drop a column w/o data copy• Modify column type and nullability w/o data copy

• Space • Performance• Data availability

Deferred table materialization on CREATE TABLE

• Creation of catalog only schemas on initial table creation (CREATE TABLE); no space allocated to table

• Space allocated only after first insert into table

• Ease of enterprise application deployments & DB provisioning

• Storage savings

Page 47: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

47 – Company Confidential – November 3, 2011

TEXT MANAGEMENT

Feature Description Benefit

LOB locators / LOB datatypesupport

• Handle to a LOB that can be referenced in T-SQL statements and can be passed between serverand clients

• Client applications can send and receive locators as host variables and parameter markers

• Significantly reduced network traffic between client and server

• Reduced amount of memory required by clients to process LOBs

API support for partial read / write of LOB data with support of ODBC / JDBC drivers

• Fetch a substring from a LOB starting at specified position

• Insert text at a specified position in LOB• Truncate a LOB to a specified length• Concatenate lobs• Search within a LOB for string or byte sequence

• Flexible handling of LOBs• Reduced coding and complexity

LOBs as parameters in stored procedures

• Previously could not declare data larger than page size

• Now can declare LOBs and pass these as parameters to stored procs

• Prepare sql stmts containing LOB parameters• Sql stmts with LOBs can be cached

• Flexible handling of LOBs• Reduced coding and complexity

Page 48: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

48 – Company Confidential – November 3, 2011

DIAGNOSTICS

Feature Description BenefitAnalyzing QP plans: Show cached plans in XML

• See show plan output in XML for a statement in cache

• Shows execution plan, optimizer cost estimate, params at compilation, paramscausing lowest query performance

• Easily diagnose performance issues due to inefficient query plans

Analyzing QP plans: Analyze dynamic parameters

• Can analyze dynamic parameters before running a query

• Display information about parameters in dynamic sql statements

• Easily diagnose performance issues due to inefficient query plans

Analyze statistics & histograms

• SQL interface to statistics and histograms • New stored procedure sp_showoptstats

(similar to optdiag standalone utility) extracts and displays in an XML document statistics and histograms for various types of data objects from system tables

• Easily diagnose performance issuesdue to inefficient query plans

Field diagnostics utility forefficient interaction and information sharing with Sybase CS&S

• Collects comprehensive configuration, monitoring, OS / platform environment and external ASE files data

• Generates a .zip output file with HTML and data files that can be viewed in a browser

• Help expedite customer case management and problem diagnosis processes

• Reduces communication cycles & time burden on both customer and Sybase CS&S

Page 49: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

49 – Company Confidential – November 3, 2011

APPLICATION DEVELOPMENT & DATABASE SUPPORT

Feature Description BenefitSELECT FOR UPDATE locking semantics

• Allows selected rows to be locked for a later update

• Enhanced concurrency controls & isolation semantics

• Reduced deadlocks

Release read cursor locks at cursor close even for isolation level > 1

• Read locks can be released on closing of a cursor at isolation level 2 & 3 for active transaction

• Configurable at cursor level

• Programming flexibility• Free up resources when not

required

Start offset on DOL Varlencolumns increased for 16K pages

• DOL variable length columns can begin at a larger offset (32767 vs. previous 8192)

• Can have “wider” DOL rows in schema

Allow procs / DDL commandsin chained transaction mode

• All system procedures and select DDLs can run in chained transaction mode

• Programming flexibility

Sub-SELECT enhancements • Allow asterisk in sub-select with single column• Allow column alias in sub-select• Allow multiple column names in sub-select

under EXISTS

• Programming flexibility

Quoted Identifier support • Will work on index names, and stored proc invocation of object names (table, view, column, index)

• Programming flexibility

No truncation of trailing 0x0during INSERT into VarBinarycolumns

• Preserve any trailing zeroes for image / binary data

• Maintain integrity of binary data stored in a column

Scripting language drivers • Support for PhP, Python, Perl, Ruby, Django • Broad based application programming support via popular scripting languages

Page 50: AN EARLY LOOK AT ASE 15imagestmc.masterbase.com/2011/Tech1Group/2011.10.28/4.pdf · an early look at ase 15.7 enhancing developer / dba productivity and operational scalability while

50 – Company Confidential – November 3, 2011

SECURITY

Feature Description Benefit

Object ownership change

• Allows change of ownership of object(s) from one owner / login to another

• Single command to transfer all objects owned by a login

• Ease of administration and management of employee lifecycle processes

Split knowledge & dual control of keys

• No one person alone can enable decryption of encryption-keys

• Stronger protection of encrypted data from unauthorized access

• Compliance with PCI DSS (PaymentsCard Industry Data Security Standards Section 3.5/3.6) requirements

Login profiles • Attribute based policies for logins• Automatic user role assignment through login policy• New cleaner, extensible and maintainable T-SQL

syntax

• Easier administration of large number of users with differing security policies

• Easier implementation of flexible security policies and compliance with regulations

Stronger password and hidden text encryption

• Role passwords are now hashed using one-way secure hash (SHA-256); password complexity rules enforced

• Strong encryption of external passwords and hidden text (e.g. in syscomments) (using FIPS-140-2 modules)

• Enhanced password security• FIPS 140-2 standards compliance

Single sign-on & E-2-E Kerberoscredential forwarding

• Automatic passing of user credentials between client, mid-tier and server layers

• Single sign-on ASE to ASE connection through CIS

• Ease of use• Single sign-on