Workflow Troubleshooting 2012

7/25/2019 Workflow Troubleshooting 2012

1/90

Presented by Susan Behn

VP, Oracle Practice

Infosemantics, Inc.

Workflow Troubleshooting in R12


2/90

Agenda

Overview/Business Benefit

Workflow Troubleshooting by Role

Workflow Administration for End Users andSuper Users

Workflow Troubleshooting for Administrators

Workflow Troubleshooting for Developers and

DBAs

Workflow Analyzer (New)

References


3/90

Overview

Workflow Functionality in Release 12 andRelease 11i.10 (if patched current) are nearlyidentical

Forms may look different due to new R12 look-

and-feel

Release 12 forms will be used in screen shots

Focus on efficiency

Empower Users


4/90

CALL CO-WORKER

(AGAIN)

CALL ORACLE (AGAIN)

NOTIFY HELP DESK

HELP DESK DISPATCHES

ADDITIONAL HELP

CUSTOMER INQUIRY

OVERRIDE THROUGH

MANUAL PROCESS

RESOLVE THROUGH

SELF KNOWLEDGE NET SAVINGS

PROBLEM

OCCURS

WITH TROUBLESHOOTING EDUCATION

PROCESS TIME

CUSTOMER GETS

PRODUCT


5/90

WORKFLOW TROUBLESHOOTINGFOR END USERS


6/90

Improved Efficiencies for Users

Provide end users tools for efficiency

Add personal worklist to menus

Provide training for use of the status monitor andother features

Set owner attribute in workflows where needed Provide access to diagnostic reports

Security is built in you can only access reports relatedto responsibilities you are assigned

Add concurrent programs to Superuser menus ifmissing


7/90

Seeded User Menu

Workflow User Web Applications

Advanced Worklist Self Service Workflow

Home Page Status Monitor Notifications same as Advanced Worklist


8/90

Personal Worklist

Add the function Personal Worklist to the Workflow User

menu for additional features Not on any menus by default Whats great about this?

Create a personal worklist view to separate notifications by type PO Approval more important than Invoice Approval so respond to

these first

Add the PersonalWorklist function to themenu for additionalfeatures


9/90

Personal Worklist

Personal Worklist additional Features

Simple Search search for specificnotifications

Personalize create newviews or change existing view(example in later slides)

Export downloadsto .csv fileformat


10/90

Personal Worklist Simple Search

Use Simple Search to search for specificnotifications in your worklist


11/90

Status Monitor

Check the status of approval of your requisitions

Click on status monitorEnter search criteria

Click on status monitorEnter search criteriaClick Go to search

Click the radio button next to aprocessThen click the NotificationHistory, Status Diagram orParticipant Responses button


12/90

Status Monitor

Notification History Page

Shows all notifications sent by the workflow process Click recipient name to send an email

Reassign if recipient is unavailable


13/90

Status Diagram

Follow the green line to follow the process


14/90

Status Diagram

Double click in the process box to drill down


15/90

Status Diagram

Tabs below the status diagram provide

information about the node Notification has been sent to Catherine Baker

Catherine has not responded

Process hasstopped here

Click on status tab tosee who was notified


16/90

Status Monitor

Errored items appear outlined in red

The Status Tab showsthe error message


17/90

Status Monitor

Status Monitor!Participant Responses Tab

shows responses to all the notifications for theworkflow process selected


18/90

Worklist Flexfields

Introduced in RUP 3

Allows any value in the message body to be displayedin the notification worklist Only Available Using Personal Worklist

Specific to particular workflow

Best used when creating special view for that workflow

Whats great about this? Create a personal worklist view to see error messages

(example in this presentation)

Create a personal worklist to find expense reportapprovals with a specific project number (recent examplefrom client)


19/90

Worklist Flexfields Create Flexfield Rule

Example Add the error text to the worklist

Workflow Administer must create flexfield rules End Users can then access the flexfields created

Click Create Rule to assign message attribute toflexfield


20/90


Name the rule and leave other attributes as

shown

ClickNext


21/90


Select the System: Error workflow using

display name and move it from the availablefilter to the selected filter


22/90


Select the message attributes you want to add to

the worklist for the workflow chosen in step 2


23/90


Map the message attributes to a mapped

column based on data type (Text, date, etc) Click the Find Conflicts button to confirm no

duplicate mappings


24/90

Worklist FlexfieldsCreate Personal Worklist View

Use the Personalize button to create a new

view


25/90


Click the Rename

Columns button toassign a name to theattributes created

This will be the columnname on the worklist


26/90


Limit the search to WFERROR workflows

Create one view where the Subject containsEvent and another view without this limitation

W kli Fl fi ld


27/90

Worklist FlexfieldsSample Views for WFERROR

Errors from Item Types

Errors from Events


28/90

Notification Search for End Users

Introduced in RUP 5

Assign function Workflow NotificationSearch (WF_WORKLIST_SEARCH) to end-user menus

This is the Notifications Administrator Web Page But.in end-user menus, allows users to search

only for their own notifications

Better Efficiency - When someone calls about

a specific notification, this feature allows youto find the notification quickly

N ifi i S h f E d U


29/90

Notification Search for End Users

More options than the simple search

f


30/90

Preferences

Users can change the notification type

preference via the preferences button Changing global preferences do NOT override

preferences set individually Preferences button can be removed by setting profile

option General Preferences Show Flag to No

I t P f C P bl


31/90

Incorrect Preferences Cause Problems

If users are not getting

emails or emailsdisplay incorrectly,check the email stylein the preferences If users choose

summary email styles,the summary emailnotification must bescheduled in themailer setup

C t P R t E d


32/90

Concurrent Program - Retry ErroredWorkflows

Dates - based on error date not on original

start date Perform Commit

No = commit at end Yes = commit after each retry

C t P R d F il d/


33/90

Concurrent Program - Resend Failed/Error Workflow Notifications

Introduced in RUP6

Resend notifications with a mail status ofFAILED or ERROR Make corrections first such as email address

corrections

Concurrent Program Resend Failed/


34/90

Concurrent Program - Resend Failed/Error Workflow Notifications

Caution

You dont always want old notifications to be sent

Many workflow systems need cleanup and haveorphaned workflows and notifications many years old

Consider first a SQL update to set Mail_Status tonull where status = CLOSED or CANCELLED

Status is the workflow status

Mail_status is the notification status

Refer to the workflow book for more details oncleanup of your workflow system

Concurrent Program Workflow Directory


35/90

Concurrent Program - Workflow DirectoryServices User/Role Validation

Symptoms

Not receiving notifications

Missing responsibilities for users

What it does

Data fix for user/role associations inWF_LOCAL_ROLES

WF_LOCAL_ROLES is a critical workflow table

Refer to workflow foundation presentation for detailtable descriptions and relationships

Concurrent Program Workflow Directory


36/90

Concurrent Program - Workflow Directory

Services User/Role Validation Run Twice Metalink Doc ID: 418765.1 Fix Dangling User/Roles

Fix Dangling User/Roles=Yes

Removes invalid associations fromWF_LOCAL_USER_ROLES (if user orrole is missing)

Add Missing User/RoleAssignments=No

Add Missing User/Role Assignments

Fix Dangling User/Roles=No Add Missing User/Role = Yes

Adds missing associations in theWF_LOCAL_USER_ROLES to havecorresponding user/role assignments in

WF_USER_ROLE_ASSIGNMENTS

S h i WF LOCAL t bl


37/90

Synchronize WF LOCAL tables

Symptom user not receiving emails

Synchronizes data from applications to WF_LOCAL_ROLES WF_LOCAL_USER_ROLES

Synchronize Workflow LOCAL Tables request

set Runs a separate request of Synchronize WF LOCAL

tables for each application

Run this program if the applications incremental

synchronization fails If on 11.5.10 RUP3 or earlier, this should be

scheduled nightly

Di ti R t


38/90

Diagnostic Reports

Need Oracle Diagnostic Tool Responsibility Starting in 12.0.6, RBAC is utilized for Diagnostics

See MetaLink Note Id: 358831.1

Sample of workflow related user tests

Other workflow related tests are available

Presentation on R11i/R12 Diagnostics delivered at Collaborate 09 Presentation specific to 11i only is also on our web site

Diagnostics


39/90

Diagnostics

MetaLink Note Id: 342459.1 shows full catalog

Drill down on application hyperlink for list of reports

Includes extensive documentation for R11 and R12

Summary Review Tools for Users


40/90

Summary Review Tools for Users

Workflow End Users and Functional Super

Users Personalize notification page

Monitor your own workflows

Use flexfields to create specific views Run workflow specific concurrent programs

Run Diagnostic Reports for Functional Areas


41/90

WORKFLOW TROUBLESHOOTINGFOR ADMINISTRATORS

OAM vs Workflow Administration


42/90

OAM vs Workflow Administration

OAM Workflow Page

Use to monitor the workflow system as a whole

Research all errors

Drill down to workflow type and process

Set up mailer Monitor Agents and Queues

Workflow Administration Menus

Troubleshoot specific errors Troubleshoot specific notifications


43/90

TROUBLESHOOTING IN OAM

OAM W kfl P


44/90

OAM Workflow Page

OAM Dashboard


45/90

OAM Dashboard

Notification mailer will not show if

notification mailer is not activated Notifications still appear in worklist

All other icons should be green

Background Engines, Purge and Control QueueCleanup show if concurrent requestsscheduled

OAM Work Items


46/90

OAM Work Items

Hovering mouseover bar yieldsexact count

Active includeserrored processes

Click on bar to drilldown Active

Value: 34442 ErrorValue: 14132

OAM Work Items Drill down


47/90


Shows errored work items by item type

Workflow types with high error counts most likelyindicate a problem in the process

Click on itemtype hyperlink to

drill down further



48/90


Shows process in error for item type

Click on processname hyperlink todrill down further

Default is 30 days



49/90


Shows specific workflows in error for specific

processAbort All and Retry All buttons unique to OAM

Select workflow and launchworkflow monitor

--Same as admin menus



50/90


Also includes links to ActivityHistory, Participant Responses and

Workflow Details--Also in admin menus

New Look for Activity History


51/90


Introduced in RUP6

Activity History Hierarchy Section


52/90

Activity History Hierarchy Section

Expand the list to show child workflows

Click the process name hyperlink to showactivity history for the child workflow

Click the Errorhyperlink to get the full

error stack



53/90

y yProcess Detail

Added Notification Column

Click notification icon toview and respond tonotification

OAM Participant Responses


54/90


Participant Responses view list of all

notification activity and status

Click on the notificationicon to see responsedetails



55/90


Participant response detail including any notes

OAM Workflow Details


56/90

OAM Workflow Details

Workflow attributes

Shows all valuesrelated to theworkflow processincluding error

messages Partial list shown here

Workflow

administrator can editattributes and rewind/restart process

OAM Throughput Section of Main Page


57/90

g p g

If mailer is down,

notifications waiting willcontinue to grow Common in cloned

environments See workflow book for

proper cloning steps Processed

Status = OPEN Mail_Status = SENT

Waiting Mail_Status = MAIL

Waiting

Value: 72

ProcessedValue: 7


58/90

TROUBLESHOOTING INWORKFLOW ADMINISTRATION

MENUS

Workflow Administration


59/90


Troubleshooting tools are in Status Monitor

and Administration tabs



60/90

Status Monitor

Search for specific workflows here

Activity history, status diagram, participantresponses and workflow detail same as OAM

Need invoice idLook for itemsin error



61/90

Administration

Notification search in this window allows

search for notifications for others


62/90

WORKFLOW TROUBLESHOOTINGFOR DEVELOPERS AND DBAS

Tips Refresh Button


63/90

Tips Refresh Button

RUP4 and later, OAM forms do not perform new

queries (unless refresh button is pressed) Schedule the following programs for refresh

Workflow Agent Activity Statistics concurrent Program

Workflow Mailer Statistics Concurrent Program

Workflow Work items Statistics Concurrent Program

Workflows MUST be configured


64/90

g

AccountGenerators

If Using Projects,MUST customizePOWFPOAG,POWFRQAG,PAAPINVW

Workflows MUST be configured


65/90

g

Attributes

Example CREATEPO,POERROR

Auto Create AllowedAuto Approval Allowed

Is contact required

Tips Clean up to Improve Performance


66/90

Close orphan WFERROR, POERROR workflows

bde_wf_clean_worklist MetaLink Note 255048.1 Closes WFERROR workflows where the parent is complete Duplicate script and replace WFERROR with

POERROR Closes POERROR workflows where the parent is complete

Schedule Purge Processes Purge completed workflows > 30 days old

Schedule Control Queue Cleanup every 12hours

Removes inactive Subscriptions that occur when amiddle tier Process dies

Tips Workflow Administrator


67/90

p

Problem:

Patching resets Workflow Administrator toSYSADMIN

Cannot troubleshoot all workflows withoutWorkflow Administrator access

Solution: MetaLink Doc. ID: 274842.1 "How To Set The

Workflow System Administration Role To Be

Performed By A Specific Responsibility Instead OfThe User SYSADMIN And Not Letting AutoconfigOverwrite It"

Tips Worklist Access


68/90

p

In order to monitor notifications to SYSADMIN

Grant Worklist Access

Grant access toSYSADMIN messagesto Workflow

Administrator Users

SYSADMIN User Profile Options


69/90

Recommended Profile Option Values for user

SYSADMIN (not site level) ICX:Session Timeout 12000

ICX: Limit connect 1000000 (one million)

ICX: Limit time 192

See MetaLink Doc. ID: 414376.1 "You HaveInsufficient Privileges For the Current

Operation" On Reqapprv Notif"

Mailer Parameter Changes


70/90

g

Processor Close on Read Timeout

On Step 2 of Mailer setups (Advanced)

Should be checked

MetaLink Doc. ID: 422870.1 "Java mailer not Removing

Processed Emails from Inbox after Folder RUP4" MetaLink Doc. ID: 437986.1 "E-Mail Notifications AreNot Getting Processed, Remain Sitting In The Inbox"

MetaLink Doc. ID: 418077.1 "Workflow Notification

Mailer Stops Processing" MetaLink Doc. ID: 332152.1 "OWF.H Diagnostics andSolutions"



71/90




72/90

g

Expunge Inbox on Close

On Step 3 of Mailer setups (Advanced)

Should be checked

MetaLink Doc. ID: 422870.1 "Java Mailer not RemovingProcessed Emails from Inbox after Folder RUP4"



73/90

a e a a e e C a ges



74/90

g

Must be WF admin orhave resp assigned asWF admin

Must contain WF admin menuand be assigned to user above

Must be ID for Resp above

120 to avoid insufficient

privileges error



75/90

Framework User, Responsibility, Application ID

On Step 4 of Mailer Setups (Advanced) User assigned to Mailer must be the workflowadministrator or be assigned the responsibilityassigned as workflow administrator

Responsibility assigned to the mailer must be

assigned to this user and contain the workflowadministration menu

Application_id assigned to the mailer must be sameas responsibility assigned to the mailer

MetaLink Doc. ID: 344936.1 "Email Body Contain:ORA-20002: 3207: User SYSADMIN does not haveaccess to notification" describes how to set theseparameters



76/90

Framework URL Timeout

On Step 4 of Mailer Setups (Advanced) Set to 120

MetaLink Doc. ID: 414376.1 ""You have InsufficientPrivileges For The Current Operation" On ReqapprvNotif"

Tips - Mailer Maintenance


77/90

For installations that run 24/7, mailer needs to

be shut down and re-started once/week Schedule events that will do this

Page 5 of Advanced Setup

10080 represents 7 days MetaLink Doc. ID: 443643.1 "How To Automatically

Restart Workflow Mailer Processes Regularly

Workflow Diagnostic Reports


78/90

g p

Diagnostics

toolalternative forscripts in$FND_TOP

Partial listshown

Overview


79/90

Oracle has provided a workflow analyzer

script for analyzing the health of the workflowenvironment

Why not diagnostics? Diagnostics was developed to put these scripts in

a front end tool for end users

This workflow script was developed outside ofdiagnostics so the most current versions could be

downloaded from My Oracle Support Diagnostics is not always up to date if patching isbehind

Download Workflow Analyzer


80/90

Workflow Analyzer script for E-Business Suite

Workflow Monitoring and Maintenance [ID 1369938.1]

Run from Sql*Plus as the APPS user Log into sql*plus as the APPS user and SPOOL a

meaningful output file name and run the script

$ sqlplus apps/

SQL> SPOOL wf_analyzer__.html

@workflow_analyzer.sql

Oracle does not guarantee proper display from Toad

or SQL developer

See MOS Note: 1425053.1 to run as a concurrentrequest

Report Output


81/90

Workflow Analyzer report output

Whats in the report


82/90

Workflow Analzyer

Overview- E-Business SuiteVersion- Workflow Database

Parameter Settings

Note new 11g

recommendation tounset JOB-QUEUE_PROCESSESdatabase parameter

Note new 10grecommendation tounset AQ-TM databaseparameter

Whats in the report


83/90


- Verify the Workflow AdministratorRole- SYSADMIN User Setup for ErrorNotifications- SYSADMIN WorkList Access- SYSADMIN Notification RoutingRules

- Verify AutoClose_FYI Setting- E-Business Suite Profile Settings- Workflow Profile Settings- Verify Error Messages- Verify #STUCK Activities- Totals for Notification Preferences

- Check the Status of WorkflowServices

Identifies workflowadministrator

Assign worklist accessto sysadmin msgs

Identifies relevantprofile options with

recommendations Provides summary

counts of errored andstuck workflows and

notification preferences Validates workflowservices are working

Whats in the report


84/90

Workflow Footprint

- Volume of Workflow RuntimeData Tables- Verify Closed and PurgeableTEMP Items- SUMMARY Of WorkflowProcesses By Item Type

- Check the Volume of Open andClosed Items Annually- Average Volume of OpenedItems in the past 6 Months,Monthly, and Daily- Total OPEN Items Started Over90 Days Ago- Check Top 30 Large Item

Activity Status History Items

Provides performancerecommendations

Logical space analysis oftables and impact onperforming full table scans

Identifies purgeable items

Provides summary Countsof workflow items bystatus

Volume analysis Analysis of old items

Analysis of large activityitems

Whats in the report


85/90

Workflow ConcurrentPrograms

- Verify Concurrent ProgramsScheduled to Run- Verify Workflow Background

Processes that ran- Verify Status of theWorkflow Background EngineDeferred Queue Table- Verify Workflow Purge

Concurrent Programs- Verify Workflow ControlQueue Cleanup Programs

Are all needed

concurrentprograms runningat recommended

intervals

Whats in the report


86/90

Workflow NotificationMailer

- Check the status of theWorkflow Services- Check the status of theWorkflow Notification

Mailer(s)- Check Status ofWF_NOTIFICATIONS Table- Check Status ofWF_NOTIFICATION_OUTTable- Check for OrphanedNotifications

Is the mailer running?

Are messages beingsent? Provides counts by

status need toaddress messages

with error and highcounts with a MAILstatus

Are there a largenumber of orphanednotifications where theparent is complete?

Whats in the report


87/90

Workflow Patch Levels

- Applied ATG Patches- Known 1-Off Patches ontop of ATG Rollups

- Verify Status ofWorkflow Log Levels- Verify WorkflowServices Log Locations

Identifies patch

levels Identifies known

one off patches byrelease

Identifies log

levels andlocations

Whats in the report


88/90

References Provides hyperlinks

to various currentMy Oracle Supportnotes to helpmanage workflow

system Direct link toWorkflowcommunity for

additional supportfrom Oracle Acesand others

Summary


89/90

Enabling users increases efficiencies

Increased efficiencies reduce cost and makeemployees happy further increasingefficiencies

Reducing costs increases profitability Increased profitability secures jobs making

employees even happier increasing

efficiencies more Go back to #1


90/90

Workflow Troubleshooting 2012

Documents

Transcript of Workflow Troubleshooting 2012