Gummadi-HP33-ConnectingtoNonStopSQL-Scale
-
Upload
ajaya-gummadi -
Category
Documents
-
view
36 -
download
0
Transcript of Gummadi-HP33-ConnectingtoNonStopSQL-Scale
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Ajaya Gummadi
WW NonStop Data & Cloud Product Manager
November 18, 2014
HP33: Building your Connectivity App for Scale
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
This is a rolling (up to three year) Roadmap and is subject to change without notice.
Forward-looking statements
– This document contains forward looking statements regarding future operations, product development, product capabilities and availability dates. This information is subject to substantial uncertainties and is subject to change at any time without prior notification. Statements contained in this document concerning these matters only reflect Hewlett Packard's predictions and / or expectations as of the date of this document and actual results and future plans of Hewlett-Packard may differ significantly as a result of, among other things, changes in product strategy resulting from technological, internal corporate, market and other changes. This is not a commitment to deliver any material, code or functionality and should not be relied upon in making purchasing decisions.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Database Connectivity
• NonStop SQL/MX uses industry standards such ODBC and JDBC for off-platform connectivity
• Enables transparent use of 3rd Party or Open Source software based on these standards
• Standard, published APIs used for communication with NonStop SQL database
• Clients can access both native MP and MX tables
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application Architecture
C/C++ app Perl app PHP app Java appPython app
ODBC API ODBC API ODBC API JDBC APIODBC API
ODBC Driver ODBC Driver ODBC Driver JDBC DriverODBC Driver
NonStop SQL/MX DatabaseSupports both MP and MX tables
MXCS Subsystem
ODBC Drivers available for
NonStop OSS, Microsoft Windows, Linux, HP-UX, IBM AIX, Oracle Solaris
(Restricted availability)
32 and 64 bit
JDBC Drivers available for
NonStop (T2) and for all other platforms
(T4)
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5
MXCS Connectivity Services Architecture
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6
MXCS Connectivity Architecture
CLI zclidll
Executor zclipdll
Filesystem
MXOSRVR
MXOASCLI zclidll
Executor zclipdll
Filesystem
CatmanSQL
Compile
r
Compiler mxcmp
JDBC
T4/ODBC
Applications
MFC Module
files
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
2
3
On-platform, OSS ODBC/MX driver gives the best performance
Supports multi-threaded applications, work on increasing number of supported threads
Handles multiple concurrent requests from different connections using nowait, asynchronous processing
1
On-platform OSS ODBC/MX Apps
4New revision of driver under test does data movement optimizations
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
2
3
Off-platform, JDBC Apps port as-isNot much prior knowledge of NonStop platform requiredMulti-threaded apps supportedEach app can have multiple db connections
Type 4 driver connects to the MXCS subsystemUses socket communication
Each JDBC T4 connection has a dedicated MXOSRVR process
1
Off-platform Java JDBC T4 Apps
4
MXOSRVR communicates with the SQL Executor using a waited interfaceExecutor CLI call returns control to MXOSRVR only after the operation completes
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
2
3
On-platform, offers a no-waited call-level interface (CLI) to SQL Executor
An app can support multiple database connectionsT2 driver can switch between connections using nowait CLI, with minimal switching overheads
With NSASJ and NSMQ, JDBC T2 apps are now commonly being used
1
On-platform Java JDBC T2 Apps
4Memory limitations could be hit when there is a high number of connections per JVM instance, with each connection executing a high number of SQL statements
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP NonStop Connectivity apps for scale
• For a very high number of concurrent connections (few thousands), consider distributing your
metadata tables
• Typically SQL/MX metadata tables reside on one volume
• A volume has a limit of 65,000 opens
• Each mxosrvr process has an associated mxcmp process
• For example, if you are trying to spawn 4000 concurrent connections,
• 4000 mxosrvr processes, 4000 mxcmp processes
• Every instance of mxosrvr, has 5 opens on the metadata
• Every instance of mxcmp has 16 opens on the metadata
• MXOSRVR will close these opens after metadata operations are complete
(upcoming TCF)
• Distribute metadata tables is an option (CQDs required)
• Metadata access management is under architecture discussion
This is a rolling (up to three year) Statement of Direction and is subject to change without notice.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP NonStop Connectivity enhancements in CY13-14
• Any JDBC T4 application in cloud can access NonStop SQL instance over an
encrypted SSL connection
• 64-bit JDBC T2 driver
• 64-bit ODBC driver for Linux 6.2
• ODBC Applications running on HP-UX IA64, Solaris (Restricted) can access
NonStop SQL database instance in a 2-Tier application architecture
• ODBC Applications running on Windows can insert/select UTF-16 encoded
Unicode data
• IPv6 support in MXCS
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP NonStop Connectivity Enhancements
• Unicode support in T2 and T4 driver
• Improve MFC capability in T2 driver, OSS ODBC/MX driver, and all other *NIX
drivers
• Provide EXEC DIRECT support for MFC in T2 driver
• SSL across all off-platform drivers
• Ability to link data source to a specific Association server
• Recognize username/password in T2 driver
• Provide Transaction AutoAbort
• Mxcmp timeout and cleanup
This is a rolling (up to three year) Statement of Direction and is subject to change without notice.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.… 2015 would see more innovations
HP NonStop SQL: 2014 was a year focused on quality and stability
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP NonStop SQL Roadmap
14 This is a rolling (up to three year) Statement of Direction and is subject to change without notice.
SQL/MX 3.0
H06.22/J06.11
Feb ‘11
SQL/MX 3.1
H06.23/J06.12
Oct ‘11
SQL/MX 3.2
H06.25/J06.14
Sep’12
SQL/MX 3.2.1
H06.26/J06.15
Feb ‘13
Connectivity
H06.26/J06.15
Aug’13
SQL/MX 3.3
H06.29/J06.18
Feb’15
SQL/MX 2.1.1 – G06.27 September 2005, mature and supported
SQL/MX 2.3.4
H06.20 / J06.09
Feb’10
SQL/MX AQL
Bundle
H06.28/J06.17
April’14
Annual cadence of feature/function
releases
2011 2014 2012 20132010 2015
SQL/MX ARA
H06.28/J06.17
September’14
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP NonStop SQL – next release candidates
• Online mxci help
• PAK2/UNPAK2 to archive/un-archive MX files in OSS
• MXDM support for create/alter database objects
• Safeguard Delete User protection and respect Volume ACLs and Display
Object permissions
• BR2 enhancements – schema and table names could differ, no need to pre-
create Catalogs for a Restore operation
• Query Plan Quality Improvements
• Executor performance enhancements – 64 bit EID
• Currently planned for 1QCY2015
This is a rolling (up to three year) Statement of Direction and is subject to change without notice.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP NonStop – future release candidates
• EBCDIC collation of Ascii data
• Configurable ESP placement
• T2 driver should not ignore username/pwd
• Support for External Sequence in Triggers
• User Defined Functions
• DDL and DML support for Materialized Views
• Oracle Migration features: TO_DATE, TO_TIMESTAMP, LAST_DAY, MONTHS_BETWEEN
• MXDM – close the gap with NSM/Web
• Improved MDAM selection
• Reduce memory footprint of mxcmp, resource cleanup
• Currently planned for 1QCY2016
This is a rolling (up to three year) Statement of Direction and is subject to change without notice.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP NonStop SQL Future Revision Candidates
• Table Maintain
• SQL Statement Logging
• SPJ Debug and Profiling
• Customer requests
• Interop within 3.x releases
• JDBC 4.0 standard
• ODBC 3.8 standard
• Optimizer hints
• MXDM integration with VQA,
NSKBUSY, Listlocks, Design
Advisor…
• Parallelism in Utilities like
Fastcopy, DUP, Import
• Shared memory for query
plans
Annual cadence of feature/function releases
This is a rolling (up to three year) Statement of Direction and is subject to change without notice.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
In summary,
• We have pushed Connectivity apps – 3000 tps, 12,000 tps, 20,000 tps …
• Concurrent connections – 2000++
• Projects identified on Roadmap would further push MXCS limits and throughput
rates
This is a rolling (up to three year) Statement of Direction and is subject to change without notice.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Resources
Contacts & Resources
Contacts
www.hp.com/go/NonStopDatabase(Customer accessible web portal)
www.hp.com/go/NonStop-Docs (All NonStop publications available for customers)
Worldwide NonStop Product Manager:
Performance specialists: Talk to your
Nonstop Sales Rep; ask for NonStop ATC
resources
Thank [email protected]
WW NonStop Product Management