Farmers QM

© 2009 IBM Corporation

IBM Software Group

Farmers

Query Monitor

Ken Kelley

Certified Technical Sales Specialist

May 27, 2009

2 © 2009 IBM Corporation

Agenda

� Query Monitor

– Overview

– Activity Summary

– Exceptions and Alerts

– Negative SQL Codes

– DB2 Commands

– Current Activity

– History

– Display Customization

– Consolidation Analysis Engine


Query Monitor Overview

� Collect, summarize and display SQL resource consumption

– Dynamic and static SQL down to the SQL statement level

– DB2 object access statistics down to the individual table and index level

� View current activity

� Identify exception SQL

� Display negative SQL codes

� Display DB2 command activity

� View historical statistics

– VSAM interval data sets

– Load into DB2 tables for further analysis

� ISPF and GUI interfaces


z/OS MV01

ISPF

WS

CAE Client

CAE Server

DB2A

Monitoring Agent

Unix System Services

CAE Agent

Backstore data sets

z/OS MV02

DB2B

Unix System Services

CAE Agent

ISPF

WS

CAE Client

Query Monitor Subsystem

Monitoring Agent

Backstore data sets

Query Monitor Subsystem

Query Monitor Architecture


Getting Started With Query Monitor

2009/05/26 19:30:46 ---- IBM DB2 Query Monitor for z/OS -----------------------

Option ===> __________________________________________________________________

DB2 QM Subsystem ID: ? (? to Select) User: DNET315

Release: CQM V2R3M0

-------------------------------------------------------------------------------

0. Settings

1. View Activity Summaries 2. View SQLCODEs

3. View Current Activity 4. View DB2 Command Activity

5. View Exceptions

6. Work with Monitoring Agents 7. Setup

8. Work with Profiles 9. Exit Query Monitor

Enter END command to return to ISPF.

Enter ? In the DB2 QM Subsystem

field to get a list of QM subsystems

This is not a DB2 subsystem


Getting Started With Query Monitor

2009/05/26 19:31:20 ------ QM Subsystem Discovery ------ Row 1 of 3

Option ===> Scroll ===> PAGE

C:S-Select

------------------------------------------------------------------------------

CMD QM VER DB2 VER GROUP MSTATUS CURRENT INTERVAL STRT PROFILE SMF

___ _______ ___ ____ ___ ________ ________ _____________________ ________ ____

__ DQ2B 230 DSNB 810 ACTIVE 05/26/2009 - 13:00:00 DSNBPROF MVSE

S_ DQ2C 230 DSNC 810 ACTIVE 05/26/2009 - 13:00:00 DSNCPROF MVSE

__ DQ2A 230 DSNA 810 ACTIVE 05/26/2009 - 13:00:00 DSNAPROF MVSE

***************************** Bottom of Data **********************************

Select the QM subsystem that monitors

the DB2 subsystem you want to view


� Summaries

– OPERATIONAL - SQL activity summarized by

• DB2

• Plan

• DBRM / Package

• Authid

– STRUCTURAL - Objects referenced by SQL summarized by

• DB2

• Database

• Buffer Pool

• Page set

Activity Summary


� Resource Usage

– DB2 CPU time

– DB2 Elapsed time

– DB2 Wait time

– Delays

– Locks

– Getpages

– Buffer Pool usage

– I/O activity

– Save negative SQL codes in history

� Grouped by

– DB2 subsystem, Plan, Package / DBRM

– Optional keys - Text, Authid, Corrid, Corrname

– Optional keys - WSUser, WSName, WSTran, Calls

Activity Summary


Activity Summary

2009/05/26 19:31:54 ---- IBM DB2 Query Monitor for z/OS -----------------------

O .-----------------------------------------------------------------. _________

| ----------------- Select Summary Level ------------------ |

| Option ===> 1 | ET315

| | M V2R3M0

- | -- Operational -- -- Structural -- | ---------

| 1) Plan 5) DB2 |

| 2) DB2 6) Database |

| 3) DBRM/Package 7) Buffer Pool |

| 4) AuthID 8) Page Set |

| |

| |

| |

'-----------------------------------------------------------------'

Enter END command to return to ISPF.

Operational means SQL

Structural means Objects


Activity Summary

2009/05/26 19:33:13 ------- Operational Summaries ------- Row 1 of 6


DB2 QM Subsystem: DQ2C Interval Start Date: 05/26/2009 Time: 13:00:00

Filters Enabled: N Interval End Date: CURRENT Time: CURRENT

DB2: Plan: Pgm: Authid:

Section: Call: Type:

WSUser: WSName:

WSTran: CorrID:

C: 2-DB2(Op),3-Pgm,4-Authid,5-DB2(St),6-DBase,7-Buff,8-Pageset,9-Objs,

10-Corr,11-Sect,12-Call,13-WSUser,14-WSName,15-WSTran,16-SQL,19-Delay,

20-Locks,21-Misc,22-Buffstat,23-Excp,24-CurrAct

------------------------------------------------------------------------ >

CMD Plan Calls Elapsed %Elap Avg Elapsed

-- -------- -------------- --------------- ------ --------------

__ DB2PM 711984 1:38.114384 96.87 0.000137

__ ASNQC910 3135 0.823313 0.81 0.000262

__ DSNESPCS 407 0.035829 0.03 0.000088

16 ADB 4432 0.886261 0.87 0.000199

__ KO2PLAN 7096 0.981657 0.96 0.000138

__ CQMPLAN1 458 0.436238 0.43 0.000952

***************************** Bottom of Data **********************************

PF1 - HELP

Line commands to drill down or get more details


Activity Summary

2009/05/26 19:33:41 ---- Activity by SQL Text ---- Row 1 of 13




DB2: Plan: ADB Pgm: Authid:


WSUser: WSName:

WSTran: CorrID:

C: 1-Plan,2-DB2(Op),3-Pgm,4-Authid,5-DB2(St),6-DBase,7-Buff,8-Pageset,

9-Objs,10-Corr,11-Sect,12-Call,13-WSUser,14-WSName,15-WSTran,17-View,

18-Analyze,19-Delay,20-Locks,21-Misc,22-Buffstat

------------------------------------------------------------------------ +>

CMD SQL Text Calls DB2 Plan

-- ---------------------------------------- -------------- ---- --------

__ CONNECT 2 DSNC ADB

__ DECLARE C1 CURSOR FOR S1 12 DSNC ADB

__ SELECT * FROM "DNET315"."GLWTDPT" FOR FE 34

17 SELECT * FROM SYSIBM.SYSINDEXES WHERE TB 14

__ SELECT "SQLID" , LEVEL INTO : H , : H FR 2 DSNC ADB

__ SELECT C.*,HEX(HIGH2KEY),HEX(LOW2KEY) FR 30

__ SELECT K.COLSEQ,K.ORDERING,C.*,HEX(C.HIG 6

__ SELECT K.COLSEQ,K.ORDERING,C.*,HEX(C.HIG 12

__ SELECT T.* FROM SYSIBM.SYSTABLES T WHER 44

View the complete SQL statement text


Activity Summary

2009/05/26 19:34:27 ---- Display SQL Statement Text ---- Row 1 of 4

Option ===> EXPORT__________________________________________ Scroll ===> PAGE

DB2: Plan: ADB Pgm: AuthID:


WSUser: WSName:

WSTran: CorrID:

------------------------------------------------------------------------

SELECT *

FROM SYSIBM.SYSINDEXES

WHERE TBNAME = 'GLWTDPT' AND TBCREATOR = 'DNET315' AND DBNAME =

'DNET315' FOR FETCH ONLY

***************************** Bottom of Data **********************************

Valid Commands: (Export, End)

EXPORT the SQL statement to a data set


Activity Summary

2009/05/26 19:34:27 ---- Display SQL Statement Text ---- Row 1 of 4

O .---------------------------------------------------------------------. PAGE

| --------------------- Export SQL Text to DSN --------------------- |

D | Option ===> _________________________________________________ |

| |

| Export to data set ... 'DNET315.SQL' |

| Member. QMSEL___ (Required if data set is a PDS) |

- | |

| Execute SQL/PA against exported data set Y/N Y |

| |

| Press Enter to process request or PF3/CANCEL to exit |

| |

'---------------------------------------------------------------------'

***************************** Bottom of Data **********************************

Valid Commands: (Export, End)

Provide the data set name and member name

Pass the SQL statement to SQL PA for analysis


Activity Summary

2009/05/26 19:37:21 ------- Structural Summaries ------- Row 1 of 7




DB2: DBname: BPool: PageSet:

C: 1-Plan,2-DB2(Op),3-Pgm,4-Authid,5-DB2(St),7-Buff,8-Pageset,9-Objs,


20-Locks,21-Misc,22-Buffstat,23-Excp,24-CurrAct

------------------------------------------------------------------------ >

CMD DATABASE GetPages Elapsed SyncRead SyncWrit SeqPftch

-- -------- -------------- --------------- -------- -------- --------

__ SAQRDBAS 19118 0.014426 0 0 0

9_ DNET315 13 0.002561 3 0 2

__ ADBDCHG 14 0.000041 0 0 0

__ DB2PM 737054 0.129312 0 0 0

__ DSNDB07 1075703 0.027067 0 0 0

__ DSNDB06 262631 0.784328 22 0 0

__ DSNDB01 59 0.000056 21 0 0

***************************** Bottom of Data **********************************

Object usage statistics


Activity Summary

2009/05/26 19:37:21 ------- Object Detail ------- Row 1 of 1




DB2: Plan: Pgm: AuthID:


WSUser: WSName:

WSTran: CorrID:

C: 1-Plan,2-DB2(Op),3-Pgm,4-Authid,5-DB2(St),6-DBase,7-Buff,8-Pageset,


20-Locks,21-Misc,22-Buffstat,31-Usage

------------------------------------------------------------------------ >

CMD Creator Name Type DataBase BPool PageSet GetPages

-- -------- ------------------ ----- -------- ------ -------- --------------

16 DNET315 GLWTDPT TABLE DNET315 BP15 GLWSDPT 13

***************************** Bottom of Data **********************************

Display SQL that referenced the table


� Capture SQL statements that exceed specified thresholds

– Exceptions occur when statements are completed

– Alerts occur as soon as thresholds are exceeded

� Event thresholds (more than 1 can be used)

– C – CPU time

– E – Elapsed time

– G – Get pages

– N – Negative SQLCODE

– S – SQLCALL count

� Option to collect host variable values

� Can be defined via ISPF or GUI interface

– GUI interface can propagate exception definitions to all LPARs

– ISPF interface, user has to go into each LPAR and set them up

Exceptions and Alerts


� Definition is stored in the CQMPROFS file

– Multiple profiles can be defined

– One or more entries in a profile to include or exclude workloads

– Workloads can be filtered by

• DB2 subsystem, plan, package / DBRM, authid, job name

• Connection id, corrid, corrname, wsuser, wsname, wstran

– Entries are read sequentially - order is important

• Excludes at the top

• When a match is found, the activity is collected and no further detail lines are considered

� One active monitoring profile per collector

– Can be modified while the data collector is active

– Can activate / deactivate dynamically

� Control what is to be monitored

– Disable summary reporting for specific work loads

– Exclude -SQLCODE reporting for specific work loads

– Set exception and alert thresholds

– Specify whether or not to gather host variables

CQMPROFS

Monitoring Profiles


Exceptions

2009/05/26 19:39:58 ------- Display Exceptions ------- Row 1 of 7




C:9-Objects,12-Calls,16-SQL,18-Analyze,19-Delays,20-Locks,21-Misc Stats

22-Buffer Pool Stats,25-Host Variables,26-Parallel Activity

------------------------------------------------------------------------ >

CMD SSID Plan Program DB2 CPU Time DB2 Elapsed GETPAGES

-- ---- -------- -------- -------------- -------------- --------------

__ DSNC DB2PM DGO@PC2 0.004735 0.005245 21

__ DSNC DB2PM DGO@PC2 0.004495 0.004576 21

__ DSNC DB2PM DGO@PC2 0.004488 0.004547 21

__ DSNC DB2PM DGO@PC2 0.004511 0.004582 21

__ DSNC DB2PM DGO@PC2 0.004479 0.004564 21

16 DSNC ADB ADBMAIN 0.004042 0.004339 247

__ DSNC ANLCHECK ANLCHECK 0.001697 0.108317 23

***************************** Bottom of Data **********************************

Exceptions displayed in yellow

Alerts displayed in red


Monitoring Profiles

2009/05/26 19:40:26 ----- Update Monitoring Profile ---- Row 1 of 8


Profile Name: DSNCPROF

C:1-Insert,2-Update,4-Repeat,5-Delete,6-Copy,9-Move,10-Before,11-After

------------------------------------------------------------------------ >

CMD INCL\EXCL SSID Plan Program AUTHID JOBNAME CONN CORRID

- - ---- -------- -------- -------- -------- -------- ------------

__ E DSNC FPEPLAN * * * * *

__ I DSNC DSNREXX * * * * *

__ I DSNC TJHPGM* * DNET0* * * *

__ I DSNC DB2PM * * * * *

__ I DSNC DISTSERV * * * * *

__ I * ANL* * DNET315 * * *

2_ I * * * DNET315 * * *

__ I DSNC * * * * * *

***************************** Bottom of Data **********************************

Each line item defines a workload

Order is important


Monitoring Profiles

--------------------- Update Profile Line for DSNCPROF ---------------------

Option ===> ________________________________________________ Scroll ===> PAGE

More: +

INCLUDE/EXCLUDE I (I=Include, E=Exclude)

Disable Summary Reporting N (Y/N) Gather Host Variables Y (Y/N)

DB2 Subsystem *___ Plan Name *_______

Program Name *_______

AUTHID DNET315_ JOBNAME *_______

Connection ID *_______ CORRID *___________

CORRNAME *___________

Workstation User *_______________

Workstation Trans *_______________________________

Workstation Name *_________________

Workload Name ________________________________

Exception CPU 00 : 00 : 00 . 500000

Exception Elapsed 00 : 00 : 01 . 000000

Exception Getpages 100___________

Exception SQL Calls 0_____________

Press <PF7/PF8> to scroll for additional options.

Specify filters and thresholds


Monitoring Profiles

--------------------- Update Profile Line for DSNCPROF ---------------------


More: - +

Exception Limit 10____________

Generate SQLCODE Exceptions Y (Y/N)

Exclude Exception SQLCODEs N (Y/N)

Alert CPU 00 : 00 : 05 . 000000

Alert Elapsed 00 : 00 : 10 . 000000

Alert Getpages 200___________

Alert SQL Calls 0_____________

Generate SQLCODE Alerts N (Y/N)

Exclude Alert SQLCODEs N (Y/N)

Exclude Summary SQLCODEs N (Y/N)

Override OPTKEYS Y (Y/N)

OPTKEYS(TEXT) Y (Y/N)

OPTKEYS(AUTHIDS) Y (Y/N)

OPTKEYS(CORRID) N (Y/N)

OPTKEYS(CORRNAME) N (Y/N)

OPTKEYS(WSUSER) N (Y/N)

Press <PF7/PF8> to scroll for additional options.

Specify alerts and optional keys


� View Negative SQL Codes

– Group codes: SQLCODE, Authid, DBRM/Package, Plan or none

– Display the SQL statement text

– Display the SQLCA

– Limit number of negative SQL codes captured (CQMPARMS)

• MAX_SQLCODES - maximum unique SQL codes

• MAX_SQLCODES_DETAIL - maximum for each SQL code

– Exclude specific negative SQL codes in Monitoring Profile

– Save negative SQL codes in history

� View DB2 Commands

– Only tracks commands that have been executed

CQMPARMS

Negative SQL Codes and DB2 Commands


Negative SQL Codes

2009/05/26 19:42:27 ------ DB2 QM SQL Code Summary ----- Row 1 of 1



Interval End Date: CURRENT Time: CURRENT

Group by 30 (1-Plan, 3-DBRM/Package, 4-Authid, 30-SQLCode)

Specify "*" for no grouping

C: S-Select detail, 1-Plans, 3-DBRMs/Packages, 4-AUTHIDs

------------------------------------------------------------------------

CMD SQLCODE Occurrences

-- --------- --------------

S_ -551 1

***************************** Bottom of Data **********************************

Number of occurrences for each SQL code

An asterisk (*) indicates the number of occurrences

exceeds the maximum being collected


Negative SQL Codes

2009/05/26 19:42:49 --- DB2 QM SQL Code Detail Display --- Row 1 of 1



Interval End Date: CURRENT Time: CURRENT

Detail data captured for SQLCODE: -551

C: 16-SQL TEXT, 28-SQLCA

------------------------------------------------------------------------ >

CMD SSID Plan DBRM/Package JOBNAME STMT# Collection ID SECT# AUTHID

-- ---- -------- ------------- -------- ------ ------------- ----- --------

28 DSNC ADB ADBMAIN TDCD001 4,503 ADBL 1 TDCD001

***************************** Bottom of Data **********************************

View SQL text or the SQLCA


Negative SQL Codes

2009/05/26 19:43:15 ----------- SQLCA Display ---------- Row 1 of 33


DB2 SSID: DSNC Plan: ADB DBRM: ADBMAIN Coll: ADBL

Cursor: C1 Section: 1

Stmt: 4,503 Type: PREPARE

------------------------------------------------------------------------ +

DSNT408I SQLCODE = -551, ERROR: TDCD001 DOES NOT HAVE THE PRIVILEGE TO

PERFORM OPERATION SELECT ON OBJECT DNET315.GLWTDPT

DSNT418I SQLSTATE = 42501 SQLSTATE RETURN CODE

DSNT415I SQLERRP = DSNXOSC SQL PROCEDURE DETECTING ERROR

DSNT416I SQLERRD = -100 0 0 -1 0 0 SQL DIAGNOSTIC INFORMATION

DSNT416I SQLERRD = X'FFFFFF9C' X'00000000' X'00000000'

X'FFFFFFFF' X'00000000' X'00000000' SQL DIAGNOSTIC

INFORMATION

SQLCAID SQLCA

SQLCABC 136

SQLCODE -551

SQLERRML 30

SQLERRMC TDCD001.SELECT.DNET315.GLWTDPT

Valid Commands: (End)


DB2 Commands

2009/05/26 19:43:53 ------- DB2 Command Activity ------- Row 1 of 82




------------------------------------------------------------------------ +>

SSID JOBNAME AUTHID Command Timestamp Command Text

---- -------- -------- --------------------- ---------------------------------

DSNC CXEGO2 DB2PM 05/26/2009 - 13:02:53 -DISPLAY GROUP

















� Statement level (vs. the thread)

� Report SQL calls prior to the call’s termination

– Statement refers to a group of one or more SQL calls (ex. OPEN, FETCH, CLOSE for a cursor makes a statement)

� Exceptions and alerts - noted in Current Activity if the monitoring profile thresholds are exceeded

� Must be identified with a workload definition line in a monitoring profile

� Query Monitor must see the ‘start’ of an SQL call

� May cancel a thread

Current Activity


Current Activity

2009/05/26 19:48:55 ------- Current SQL Activity ------- Row 1 of 12

Option ===> Scroll ===> CSR



C:9-Objects,12-Calls,16-SQL,18-Analyze,19-Delays,20-Locks,21-Misc Stats

22-Buffer Pool Stats,25-Host Variables,26-Parallel Activity,27-Cancel

------------------------------------------------------------------------ >

CMD SSID Plan Program DB2 CPU Time DB2 Elapsed GETPAGES

-- ---- -------- -------- -------------- -------------- --------------

__ DSNC ASNQC910 ASNMSGT 0.000305 0.000308 0

__ DSNC ASNQC910 ASNSQLCF 0.000104 0.000106 0

__ DSNC ASNQC910 ASNSQLCZ 0.000093 0.000095 0

__ DSNC ASNQC910 ASNDBCON 0.000086 0.000086 0

__ DSNC ASNQC910 ASNQCAP 0.000296 0.000302 2

__ DSNC ASNQC910 ASNQCAP 0.000072 0.000072 0


__ DSNC ASNQC910 ASNQSQL 0.002086 0.002554 30





***************************** Bottom of Data **********************************


History Commands

� INTERVAL

– View a list of available intervals

– Abbreviate INTV

� CURRENT

– Navigate to the current interval

– Abbreviate CUR

� PREV

– Navigate to the previous interval

– Can also use PF4

� NEXT

– Navigate to the next interval

– Can also use PF6


Current Activity

2009/05/27 04:43:56 -------- Interval Selection -------- Row 1 of 5

Option ===> Scroll ===> CSR

C:S-Select Interval,1-Datasets,

------------------------------------------------------------------------

CMD AVAIL START END INTERVAL NUMBER

-- ------ --------------------- --------------------- ----------

__ YES 05/24/2009 - 13:00:00 05/25/2009 - 1:00:00 3592

S_ YES 05/25/2009 - 1:00:00 05/25/2009 - 13:00:00 3593

S_ YES 05/25/2009 - 13:00:00 05/26/2009 - 1:00:00 3594

__ YES 05/26/2009 - 1:00:00 05/26/2009 - 13:00:00 3596

__ YES 05/26/2009 - 13:00:00 3597

***************************** Bottom of Data **********************************

Select one or more intervals


Customize Display Commands

� CSETUP - Displays the SETUP primary option menu

� CFIX - Fix a column in a data view

� CORDER - Change the order of columns in a data view

� CSIZE - Change the width of a column

� CSORT - Change the sort order of a column

� CRESET -Restore settings to ‘as shipped’

� CREMOVE - Remove all customizations for a data view / sets all columns to their maximum size

� PVIEW - toggle between a temporary or a permanent view


� Common interface to view all the data collected by ALL QM subsystems in the enterprise

– Activity Browser

• Create / organize favorite views

• View data sharing at the group level or the member level

– Alert Browser

• Configurable message board

� Proactive event notification

– Provides alerts to exceptional events on a monitored DB2 subsystems

– Knowledge-based analysis examines exceptional events to determine underlying problems

� Autonomic functionality enables DB2 Query Monitor to execute user-configurable responses

– including e-mail notifications

– corrective actions such as console commands and batch job submission

Query Monitor GUI


� CAE Agent - z/OS started task

– Required for every MVS image hosting a QM subsystem

� CAE Server - Windows Server or USS (can run on any host that has network access to CAE Agent hosts and GUI hosts)

– Consolidator

• Combines data and events from multiple QM subsystems for GUI presentation

• Dispatches queries, profile changes, automated actions and interactive user

actions from the GUI clients to QM subsystem(s)

– Analysis Engine

• evaluate events and establish relationships with existing events to determine root

cause

• Associate specific or general event scenarios with automated actions - generate

advisories to operators

� CAE Client (GUI client) - Workstation

– Any number of CAE Clients can look at the CAE Server

Consolidation and Analysis Engine (CAE)


Navigation

Tree

Detail

Activity

Browser

Alert

Browser

Query Monitor GUI


DB2

Tools

V9 Ready!

Utilities and Utility Management

�DB2 Utilities Suite

�DB2 High Performance Unload

�DB2 Automation Tool

�DB2 Cloning Tool

�DB2 Storage Management Utility

�DB2 Utilities Enhancement Tool

IBM DB2 Tools

Information Integration

�InfoSphere Replication Server

�InfoSphere Data Event Publisher

�InfoSphere Classic Event Publisher

�InfoSphere Classic Federation Server

�InfoSphere Classic Replication Server

�InfoSphere DataStage

�InfoSphere QualityStage

�InfoSphere Information Analyzer

Database Administration

�DB2 Administration Tool

�DB2 Object Comparison Tool

�DB2 Change Management Expert

Recovery Management

�DB2 Log Analysis Tool

�DB2 Object Restore

�DB2 Change Accumulation Tool

�DB2 Archive Log Accelerator

�DB2 Recovery Expert

�IBM Application Recovery for IMS and

DB2 Data Bases

Performance Management

�OMEGAMON XE for DB2 Performance Expert

�OMEGAMON XE for DB2 Performance Monitor

�DB2 Performance Expert

�DB2 Buffer Pool Analyzer

�DB2 Query Monitor

�DB2 SQL Performance Analyzer

�DB2 Optimization Expert

Application Management

�DB2 Table Editor

�DB2 Bind Manager

�DB2 Path Checker

http://www.ibm.com/software/data/db2imstoolsRed Indicates DB2 Multiplatform support

Data Governance

�DB2 Audit Management Expert

�IBM Data Encryption for IMS and DB2 Databases

�Database Encryption Expert

�Optim Data Growth

�Optim Data Privacy

�Optim Test Data Management

Business Analysis

�DataQuant

�DB2 Web Query Tool

�DB2 QMF


Thank You

For more information contact:

Ken Kelley

Certified Technical Sales SpecialistSystem z DB2 Tools

[email protected]

http://www.ibm.com/software/data/db2imstools

Farmers QM

Documents

Transcript of Farmers QM