Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense...

18
Log Files & Log Files & Analyzing Tools Analyzing Tools Jonathan Yip Jonathan Yip

Transcript of Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense...

Page 1: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Log Files &Log Files &Analyzing ToolsAnalyzing Tools

Jonathan YipJonathan Yip

Page 2: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Introducing Logs in Introducing Logs in WebsphereWebsphere

• The first line of defense against problemsThe first line of defense against problems• Websphere provides many logs that give Websphere provides many logs that give

information about progress, status, and information about progress, status, and problemsproblems

3 Types of Format for different level of output:3 Types of Format for different level of output:• BasicBasic • AdvancedAdvanced• LoganalyzerLoganalyzer

Page 3: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Websphere’s Informational Websphere’s Informational LogsLogs

Log NameLog Name Log SourceLog SourceWasdb2.logWasdb2.log CreateDB.batCreateDB.bat

Wssetup.logWssetup.log Setup.exeSetup.exe

Access.logAccess.log IBM HTTP ServerIBM HTTP Server

Error.logError.log IBM HTTP ServerIBM HTTP Server

Native.logNative.log Plug-inPlug-in

Adminserver-stderr.logAdminserver-stderr.log Administrative ServerAdministrative Server

TracefileTracefile Administrative ServerAdministrative Server

Activity.logActivity.log Administrative ServerAdministrative Server

Stderr.logStderr.log Application ServerApplication Server

Stdout.logStdout.log Application ServerApplication Server

Default-server-Default-server-stderr.logstderr.log

Default Application Default Application ServerServer

Default-server-Default-server-stdout.logstdout.log

Default Application Default Application ServerServer

Page 4: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Log File: Level of Output Log File: Level of Output

• Output information neededOutput information needed• Adjust level of output in logging property Adjust level of output in logging property

filefileAudit (default): Record all messagesAudit (default): Record all messages

Error: Report severity errorsError: Report severity errors

Warning: Warning indicate a problem Warning: Warning indicate a problem occurred and should be corrected. occurred and should be corrected.

Report both severity errors or warningsReport both severity errors or warnings

Page 5: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Installation LogsInstallation Logs

wssetup.logwssetup.log• Created during processing of setup.exeCreated during processing of setup.exe• Hardware configurationHardware configuration• Software prerequisites presentSoftware prerequisites present• Configuration of the Administrative ServerConfiguration of the Administrative Server

wasdb2.logwasdb2.log• Record the process of creation and Record the process of creation and

configuration of Administrative databaseconfiguration of Administrative database

Page 6: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Administrative Server LogsAdministrative Server Logs

3 logs to monitor progress and errors:3 logs to monitor progress and errors:• _adminserverFatalError.log_adminserverFatalError.log

Serious error logSerious error log

• TracefileTracefile

Logs the startup and shutdown of the Logs the startup and shutdown of the Administrative ServerAdministrative Server

• Adminserver-stderr.logAdminserver-stderr.log

Record error during start upRecord error during start up

Page 7: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Application Server LogsApplication Server Logs

default_server_stdout.logdefault_server_stdout.log• Indicates failures within the Java Indicates failures within the Java

components under Application Servercomponents under Application Server• Contains exceptions thrown by the Contains exceptions thrown by the

applications running under the applications running under the default_serverdefault_server

Page 8: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

IBM HTTP Server LogsIBM HTTP Server Logs

2 logs from HTTP Server:2 logs from HTTP Server:access.logaccess.log• Provides HTTP request informationProvides HTTP request information• Returns responses by Web serverReturns responses by Web server

169.254.255.129 - -[13/Feb/2002:21:11:44 –800] “GET 169.254.255.129 - -[13/Feb/2002:21:11:44 –800] “GET /whole.jpg HTTP/1.1” 200 85708/whole.jpg HTTP/1.1” 200 85708

• Created by CustomLog directiveCreated by CustomLog directive

(Common Log Format Standard)(Common Log Format Standard)

LogFormat “%h %l %u %t \%r|” %>s %b” commonLogFormat “%h %l %u %t \%r|” %>s %b” common

Page 9: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

IBM HTTP Server Logs IBM HTTP Server Logs (con’t)(con’t)

error.logerror.log• Logs any errors HTTP server encountersLogs any errors HTTP server encounters• ErrorLog directive to setup formatErrorLog directive to setup format

Both CustomLog and ErrorLog are stored inBoth CustomLog and ErrorLog are stored in

<IBM_HTTP_HOME>\conf\httpd.conf<IBM_HTTP_HOME>\conf\httpd.conf

• adminAccess.logadminAccess.log & & adminError.logadminError.log provides the same provides the same logging services as the access and error logs generated logging services as the access and error logs generated by HTTP Administration service outputsby HTTP Administration service outputs

Page 10: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Plug-in LogsPlug-in Logs

native.lognative.log• Contains error and informational messages Contains error and informational messages

generated by the Web server plug-ingenerated by the Web server plug-in• Shows information about the startup and Shows information about the startup and

changes applied to the serverchanges applied to the server

Page 11: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Log AnalyzerLog Analyzer

• Reads error conditions in the Activity logReads error conditions in the Activity log• Analyze error conditions to provide error Analyze error conditions to provide error

message explanations and, error message explanations and, error message recovery instructionsmessage recovery instructions

• Takes one or more activity logs merges Takes one or more activity logs merges all the data, & displaysall the data, & displays

Page 12: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

TracesTraces

• Same as Logs, but needs to be enabledSame as Logs, but needs to be enabled• Gets additional information from IBM code baseGets additional information from IBM code base• Get operational aspects of WebsphereGet operational aspects of Websphere• Options can be chosen on what to traceOptions can be chosen on what to trace• If enabled, a huge system overhead generatedIf enabled, a huge system overhead generated

Page 13: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Tracefile Log EntryTracefile Log Entry

Trace Log Components:Trace Log Components:

Timestamp: Timestamp: [2/27/02 6:10:06:727 PST][2/27/02 6:10:06:727 PST]

Thread ID:Thread ID: 44da728544da7285

Component short name:Component short name: StaleConnectiStaleConnecti

Level:Level: A=Audit; W=Warning; X=Error; E=Event; D=Debug; A=Audit; W=Warning; X=Error; E=Event; D=Debug; T=Terminate; F=Fatal; I=Informational;T=Terminate; F=Fatal; I=Informational;

Message:Message: Detail informationDetail information

Page 14: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Resource AnalyzerResource Analyzer

• Use to retrieve performance data from application serversUse to retrieve performance data from application servers• Data is collected continuously Data is collected continuously

Resource Analyzer can accomplish:Resource Analyzer can accomplish:• View performance data in real time View performance data in real time • Record performance information into log fileRecord performance information into log file• Monitor and estimate the load on application servers & the Monitor and estimate the load on application servers & the

average wait time for clientsaverage wait time for clients• View historical performance data from the log fileView historical performance data from the log file• View information captured in a chartView information captured in a chart• Perform a comparison evaluation for a single resource to a Perform a comparison evaluation for a single resource to a

group of resources on a single nodegroup of resources on a single node

Page 15: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Resource AnalyzerResource Analyzer

Represents a physical machine

Represents a server

provides functionality over network

manipulate the raw data that is collected about the application server.

Data type to hold

performance data

Represents one or more

resource categories

Eg. (EJB)

Manipulate rawdata that is collected about the application server.

Page 16: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Resource Analyzer (con’t)Resource Analyzer (con’t)

It can collect and report performance on:It can collect and report performance on:• Java runtimeJava runtime• Database connection poolsDatabase connection pools• EJBs EJBs • EJB methodsEJB methods• Enterprise bean object poolsEnterprise bean object pools• TransactionsTransactions• Web ApplicationsWeb Applications

Page 17: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

Websphere Application Server Bible, Kataoka (2002)Websphere Application Server Bible, Kataoka (2002)

About the Websphere Resource AnalyzerAbout the Websphere Resource Analyzerhttp://www-3.ibm.com/software/webservers/appserv/doc/v40/ae/infocenter/was/06060012.html#FIGEPMTREE-FIGhttp://www-3.ibm.com/software/webservers/appserv/doc/v40/ae/infocenter/was/06060012.html#FIGEPMTREE-FIG

Getting Started with Websphere Application ServerGetting Started with Websphere Application Serverhttp://www-3.ibm.com/software/webservers/appserv/doc/v40/aee/wasa_content/welcome.htmlhttp://www-3.ibm.com/software/webservers/appserv/doc/v40/aee/wasa_content/welcome.html

References:References:

Page 18: Log Files & Analyzing Tools Jonathan Yip. Introducing Logs in Websphere The first line of defense against problemsThe first line of defense against problems.

ENDEND