Leveraging sysmaster to Leveraging sysmaster to Graphically Monitor IDSGraphically Monitor IDS

Peter RichardsonPeter RichardsonRocket SoftwareRocket Software

Informix User Forum 2005 Moving Forward With Informix

Atlanta, Georgia December 8-9, 2005

Agenda Graphically leveraging sysmaster information

Demonstration of Visionary-powered SMI Application

How it works - review of the sysmaster database Configuration Database structure Performance

How it works – review of Rocket Visionary

‘Sysmaster’ – An introduction A ‘special’ database that contains tables related to the

performance, configuration and structure of your Informix server

Collectively, these tables provide the Informix ‘System Monitoring Interface’, known as SMI

Lester Knutsen covers the sysmaster database in detail: See his session at this conference See his web site for additional SMI documentation

We’ll review a few key tables but will primarily focus on leveraging this resource to graphically monitor your Informix servers

What is Visionary? Provides a means of rapidly building and deploying database

visualization solutions

Product heritage: From a Berkeley research project (1995) To an Illustra prototype (1996) To an Informix product (1996) To an IBM product (2001) To a Rocket Software product (2002)

Fundamental value propositions: Exceptionally good data visualization capabilities Rapid Application Development model – an ‘app in a day’ product Informix heritage – first class support for Informix databases

Visionary-Powered Performance Monitor Provides comprehensive analysis and monitoring of Informix

servers across all platforms

Reports performance and configuration information for all databases running within each designated server

Displays the broad range of information available within the sysmaster database

Implemented as a real-time, interactive graphical dashboard

Available as a desktop application (Windows or Java) or as a 3-tier web-based application

Information Categories Performance

Engine configuration & profile information Virtual processor & log statistics Summary of user sessions and current locks Summary of databases and associated dbspaces List of current SQL statements (incl. SQL text)

Configuration Lists all configuration settings, along with documentation for each

Databases DB summary with drilldown to underlying details (tables, locks, etc.)

DBSpaces Dbspace summary with drilldown to supplementary details Lists allocations, devices, configuration and performance data

Sample Performance Screens

Server Configuration Review

Sample Database Screens

Sample DBSpace Screens

Product Architecture

`

Java Application

WebSphere Application Server

Servlet

Data Access

Content

JDBC

HTTP(S)Web Browser

Java Applet

`

Win32 Application

ODBC

JDBC

Informix Dynamic Server

Three deployment options:

1. Client/Server Windows application.

2. Client/Server Java application.

3. Web-based (3-tier) Java applet.

Rocket Software, Inc. Confidential

Demonstration

How it Works The system monitoring interface (SMI) consists of tables and pseudo-

tables that the database server automatically maintains

Although the SMI tables appear to the user as tables, the database server constructs the tables in memory, on demand, based on information in shared memory at that instant

When you query an SMI table, the database server reads information from these shared-memory structures

Since the database server continually updates the data in shared memory, the information that SMI provides lets you examine the current state of your Informix server

The SMI tables provide information about the following topics:

Auditing Disk usage User profiling

Database-logging status Tables Chunks

Chunk I/O Dbspaces Locks

Extents SQL statement cache statistics Virtual-processor CPU usage

System profiling

Documented SMI Tables/ViewsTable Description

sysadtinfo Auditing configuration information

sysaudit Auditing event masks

syschkio Chunk I/O statistics

syschunks Chunk information

sysconfig Configuration information

sysdatabases Database information

sysdbslocale Locale information

sysdbspaces Dbspace information

sysdri Data-replication information

sysextents Extent-allocation information

sysextspaces External spaces information

syslocks Active locks information

syslogs Logical-log file information

sysprofile System-profile information

sysptprof Table information

syssesprof Counts of various user actions

syssessions Description of each user connected

sysseswts User's wait time on each of several objects

systabnames Database, owner, and table name for the tblspace

sysvpprof User and system CPU used by each virtual processor

Source: http://publib.boulder.ibm.com/infocenter/ids9help/topic/com.ibm.adref.doc/adrefmst193.htm#sii02rsmi1011428

Reading the Server Configuration Information The sysconfig table describes the effective, original, and default

values of the server’s configuration parameters

150+ rows in IDS 10

Provides read-only access

Column Type Description

cf_id integer Unique numeric identifier

cf_name char(128) Configuration parameter name

cf_flags integer Reserved for future use

cf_original char(256) Value in the ONCONFIG file at boot time

cf_effective char(256) Value currently in use

cf_default char(256)Value provided by the database server if no value is specified in the ONCONFIG file

Source: http://publib.boulder.ibm.com/infocenter/ids9help/index.jsp?topic=/com.ibm.adref.doc/adrefmst199.htm

DBSpace Summary Uses sysdbspaces and syschunks

select d.dbsnum, d.name dbspace, d.owner,sum(c.chksize) SumPageSize, sum(c.chksize) - sum(nfree) SumPagesUsed,sum(nfree) SumPagesFree, round ((sum(nfree)) / (sum(c.chksize)) * 100, 2) PercentFreefrom sysdbspaces d, syschunks cwhere d.dbsnum = c.dbsnumgroup by 1, 2, 3order by 1;

Looking at the locks… Provides locks by database, table, row (where applicable) and lock

owner (user session)

Combine with syssessions to determine user informationColumn Type Description

dbsname char(128) Database name

tabname char(128) Table name

rowidlk integer Real rowid, if it is an index key lock

keynum smallint Key number of index key lock

type char(4)

Type of lock

B Byte lock

IS Intent shared lock

S Shared lock

XS Shared key value held by a repeatable reader

U Update lock

IX Intent exclusive lock

SIX Shared intent exclusive lock

X Exclusive lock

XR Exclusive key value held by a repeatable reader

owner integer Session ID of the lock owner

waiter integer Session ID of the user waiting for the lock. If more than one user is waiting, only the first session ID appears.

Source: http://publib.boulder.ibm.com/infocenter/ids9help/topic/com.ibm.adref.doc/adrefmst206.htm

User Sessions Session information

is available via thesyssessions view

Many of the performance-related tables refer to this table using the OwnerID FK to the sid PK

Column Type Description

sid integer Session ID

username char(32) User ID

uid smallint User ID number

pid integer Process ID of the client

hostname char(16) Hostname of client

tty char(16) Name of the user's stderr file

connected integer Time that user connected to the database server

feprogram char(16) Reserved for future use

pooladdr integer Session pool address

is_wlatch integer 1 If the primary thread for the session is waiting for a latch

is_wlock integer 1 If the primary thread for the session is waiting for a lock

is_wbuff integer1 If the primary thread for the session is waiting for a buffer

is_wckpt integer1 If the primary thread for the session is waiting for a checkpoint

is_wlogbuf integer1 If the primary thread for the session is waiting for a log buffer

is_wtrans integer1 If the primary thread for the session is waiting for a transaction

is_monitor integer 1 If the session is a special monitoring process

is_incrit integer1 If the primary thread for the session is in a critical section

state integer State of primary thread (see reference for list)

Source: http://publib.boulder.ibm.com/infocenter/ids9help/topic/com.ibm.adref.doc/adrefmst211.htm

Additional Details Available online at:

http://publib.boulder.ibm.com/infocenter/ids9help/topic/com.ibm.adref.doc/adrefmst185.htm

Look at the SQL in the Visionary SMI application Email me for a free copy of the SMI application I’ll also provide you with the project sources prichardson@rocketsoftware.com

Rocket Software, Inc. Confidential

Rocket Visionary Overview

Rocket Visionary Provides a means of rapidly building and deploying database

visualization solutions, putting enterprise data into the hands of non-technical executives and decision makers

The product is well seasoned: From a Berkeley research project (1995) To an Illustra prototype (1996) To an Informix product (1996) To an IBM product (2001) To a Rocket Software product (2002)

For a major airline

For a wireless equipment manufacturer

For IBM DB2 tools customers

For a telco operations center

Rocket Developments Rocket Visionary V3

Java-based World Server for 3-tier content distribution Over 20 three-dimensional controls Team development support

Rocket Visionary V4 Java Applet for rich client rendering (unsigned for auto-download) Linear regression and numerous other analysis functions Full National Language Support (NLS)

The Business Need Enterprises generate an abundance of

key operational data

Traditional forms and reports are inadequate – users need rich visualizations to accelerate understanding

Reports should be dynamic, with on-demand drilldown, tailoring content to the type of user (analyst, manager, executive)

Rocket Visionary Solutions Ideally suited to the development and deployment of interactive,

graphical database applications:

Executive dashboards Information portals ‘What if’-style analytical applications Data mining applications

Key benefits:

Rapid development model - ‘app in a day’ onsite prototyping Intuitive, browser-like interface – no end user training required Flexible programming model to meet wide array of industry-specific

needs

Visual Concepts – Graphical Motifs

Contains over 20 ‘stock’ visual layouts Line and bar charts Geographic maps Pie charts Horizon charts Hierarchical charts Tabular layouts

Flexible rendering Motifs can be nested indefinitely (e.g. pie charts

upon bars within maps etc.) Customized graphical ‘templates’ – build your

own chart types

Native Support for Geospatial Data Efficiently visualize operational data by geography

On-demand drilldown to geographic ‘trouble areas’

Supports both the SDE and Spatial DataBlade

Rocket Visionary Architecture

DB2

Oracle

MS AccessSQL Server

IDS / XPS

Red Brick

Web Server

Visionary World Server

Data Access

Content Definition(Published Solutions)

ODBC or JDBC

HTTP(S)

Web Browser

Java Applet

HTTP(S)

Web Browser

ActiveX Control

`

Visionary Developer Studio

Summary Powerful database visualizations

‘At a glance’ knowledge On demand drill-down Interactive real-time visualizations Data insight, not just access

Rapid authoring model Rapidly build or customize reporting solutions No coding required

Enterprise Deployment Java Servlet-based ‘World Server’ Application or browser-based end user delivery

• ActiveX or Java Applet Viewer Concurrent JDBC access to multiple database types & instances

Rocket Software, Inc. Confidential

Visionary Demonstrations

1) Sample Visionary Applications

2) Visionary Developer Studio

Leveraging sysmaster to Leveraging sysmaster to Graphically Monitor IDSGraphically Monitor IDS

Peter RichardsonPeter Richardsonprichardson@rocketsoftware.cprichardson@rocketsoftware.c

omom

Informix User Forum 2005 Moving Forward With Informix

Atlanta, Georgia December 8-9, 2005