Dynamic Batch Processing March 19 10:00 AM David Steger.

42
Dynamic Batch Processing March 19 10:00 AM David Steger

Transcript of Dynamic Batch Processing March 19 10:00 AM David Steger.

Page 1: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch ProcessingMarch 19 10:00 AM

David Steger

Page 2: Dynamic Batch Processing March 19 10:00 AM David Steger.

Batch Types

• Run my routine in background right now • Run my routine in the evening or another day• Run my group of programs when requested• Run my programs on a regular schedule• Others?

Page 3: Dynamic Batch Processing March 19 10:00 AM David Steger.

Batch Processing with 36.14 Today

Page 4: Dynamic Batch Processing March 19 10:00 AM David Steger.

36.14.1 and 36.14.13

Page 5: Dynamic Batch Processing March 19 10:00 AM David Steger.

36.14.13

Page 6: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Processing

Page 7: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Processor

Batch Entries

Batch ParameterDefinitions

Dynamic BatchEntries

+

=

Page 8: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Processor

Batch Entries

Batch ParameterDefinitions

Dynamic BatchEntries

+

=

Standard QAD MFG/Pro

Page 9: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Processor

Batch Entries

Batch ParameterDefinitions

Dynamic BatchEntries

+

=

Date Formulas, Operations,

Etc.

Page 10: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic OperationsBlank

Literal - the data entered in the value field

UUnix Environment Variable: The Unix environment variable name is entered in the value field.

DThe date that is returned by the Date Formula that is entered in the value field

SSubstring of a value. Three parameters are entered in the value field:

P Value of another parameter

MMMonth of a date returned by the Date Formula that is entered in the value field

DDDay of a date returned by the Date Formula that is entered in the value field

Y2Year of a date returned by the Date Formula that is entered in the value field - the 2 digit year is returned

Y4Year of a date returned by the Date Formula that is entered in the value field - 4 digit year is returned

VValue of another parameter. This is used when "con-cating" the values of fields together.

Page 11: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Date FormulasEOM End of Month

BOM Beginning of Month

EOY End of year

BOY Beginning of Year

TODAY Today's date

HI QAD High Date

HIGH QAD High Date

LO QAD Low Date

LOW QAD Low Date

LYD Last year's date (this date, but last year)

EOQ End of Quarter

BOQ Beginning of Quarter

ECP End of GL Calendar Period

BCP Beginning of GL Calendar Period

PER Period

Sun,Mon,Tue,Wed,

Thu,Fri,SatSelect this day of this week

+n Add n number of days

-n Subtract n number of days

Page 12: Dynamic Batch Processing March 19 10:00 AM David Steger.

Example 1: User Run Batch

Page 13: Dynamic Batch Processing March 19 10:00 AM David Steger.

Determine the Parameters

Page 14: Dynamic Batch Processing March 19 10:00 AM David Steger.

Determine the Parameters

Capture frame object“a”

Page 15: Dynamic Batch Processing March 19 10:00 AM David Steger.

Determine the Parameters

Page 16: Dynamic Batch Processing March 19 10:00 AM David Steger.

Load the Parameters

Page 17: Dynamic Batch Processing March 19 10:00 AM David Steger.

Load the Parameters

Page 18: Dynamic Batch Processing March 19 10:00 AM David Steger.

Modify Static Parameters

Page 19: Dynamic Batch Processing March 19 10:00 AM David Steger.

Modify Static Parameters

Page 20: Dynamic Batch Processing March 19 10:00 AM David Steger.

Define Dynamic Parameters

Page 21: Dynamic Batch Processing March 19 10:00 AM David Steger.

Using Date FormulasEOM End of Month

BOM Beginning of Month

EOY End of year

BOY Beginning of Year

TODAY Today's date

HI QAD High Date

HIGH QAD High Date

LO QAD Low Date

LOW QAD Low Date

LYD Last year's date (this date, but last year)

EOQ End of Quarter

BOQ Beginning of Quarter

ECP End of GL Calendar Period

BCP Beginning of GL Calendar Period

PER Period

Sun,Mon,Tue,Wed,

Thu,Fri,SatSelect this day of this week

+n Add n number of days

-n Subtract n number of days

Page 22: Dynamic Batch Processing March 19 10:00 AM David Steger.

Using Date FormulasEOM End of Month

BOM Beginning of Month

EOY End of year

BOY Beginning of Year

TODAY Today's date

HI QAD High Date

HIGH QAD High Date

LO QAD Low Date

LOW QAD Low Date

LYD Last year's date (this date, but last year)

EOQ End of Quarter

BOQ Beginning of Quarter

ECP End of GL Calendar Period

BCP Beginning of GL Calendar Period

PER Period

Sun,Mon,Tue,Wed,

Thu,Fri,SatSelect this day of this week

+n Add n number of days

-n Subtract n number of days

Page 23: Dynamic Batch Processing March 19 10:00 AM David Steger.

Test the Formula

Today, BCP, -1, ECP

Page 24: Dynamic Batch Processing March 19 10:00 AM David Steger.

Define Output

Page 25: Dynamic Batch Processing March 19 10:00 AM David Steger.

Run the Batch

Page 26: Dynamic Batch Processing March 19 10:00 AM David Steger.

Example 2: Scheduled Batchs

Page 27: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Scheduling

Queue Processor

Batch Schedule

Run Queue(batches)

+

=

Page 28: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Scheduling

Queue Processor

Batch Schedule

Run Queue(batches)

+

=

Run by cron:DB, Queue, at HH:MM

Page 29: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Scheduling

Queue Processor

Batch Schedule

Run Queue(batches)

+

=

Run this Queue onDate, Hour, etc.

Page 30: Dynamic Batch Processing March 19 10:00 AM David Steger.

Key Scripts

• bpsched

– The batch processor script bpsched is run on regular intervals each hour, up to once each minute. This script is executed by cron under the crontab file for the userid batproc. bpsched checks the minute number (00-59) to determine which combination of queue and database to execute that specific minute.

• schedpro2

– bpsched executes the script schedpro2. schedpro2 can launch multiple instances of the batch processor based on the data in it's configuration file. The configuration file lists database and pf file combinations. Configuration files are stored in the system batchproc directory.

• m9sched

– schedpro2 executes m9sched for each database defined in the configuration file. The m9sched script executes the progress session which runs t2bpstart.p from the QAD menu.

Page 31: Dynamic Batch Processing March 19 10:00 AM David Steger.

What is a Queue?

• Configured in bpshed

case $M in 00) $BP -q Q00 -c live 15) $BP -q Q15 -c live 30) $BP -q Q30 -c live45) $BP -q Q45 -c liveesac

Page 32: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Output

Queue Processor

Batch Output

Processor Run Logand

creates

Page 33: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Output

Queue Processor

Batch Output

Processor Run Logand

creates

Text Output, PDF Output,

Email to user, etc.

Page 34: Dynamic Batch Processing March 19 10:00 AM David Steger.

Define the Scheduled Batch

Page 35: Dynamic Batch Processing March 19 10:00 AM David Steger.

How the batch id can alter results

Page 36: Dynamic Batch Processing March 19 10:00 AM David Steger.

How the batch id can alter results

Page 37: Dynamic Batch Processing March 19 10:00 AM David Steger.

How the batch id can alter results

Page 38: Dynamic Batch Processing March 19 10:00 AM David Steger.

Other Operation TypesBlank

Literal - the data entered in the value field

UUnix Environment Variable: The Unix environment variable name is entered in the value field.

DThe date that is returned by the Date Formula that is entered in the value field

SSubstring of a value. Three parameters are entered in the value field:

P Value of another parameter

MMMonth of a date returned by the Date Formula that is entered in the value field

DDDay of a date returned by the Date Formula that is entered in the value field

Y2Year of a date returned by the Date Formula that is entered in the value field - the 2 digit year is returned

Y4Year of a date returned by the Date Formula that is entered in the value field - 4 digit year is returned

VValue of another parameter. This is used when "con-cating" the values of fields together.

Page 39: Dynamic Batch Processing March 19 10:00 AM David Steger.

Logs

Page 40: Dynamic Batch Processing March 19 10:00 AM David Steger.

Logs

Batch Log

Page 41: Dynamic Batch Processing March 19 10:00 AM David Steger.

Future SOX Enhancements

• Error detection via keywords– Email notification for job errors– Email notification for report errors

• Batch Run Access Restrictions– Group ID batproc can run all batch events– “Submitted by” used to restrict users to their batch events

• Enable/Disable extended to individual batch events– New “batch” or “background” events default to enable– All other new events default to disable

Page 42: Dynamic Batch Processing March 19 10:00 AM David Steger.

Dynamic Batch Processing