Overview of MID, MIR, & Extracts

forDEWG

9/24/07

Steve Cox

2 9/24/2007

Acronyms and Definitions

• MID – Market Information Distribution system. The overall process for selecting, processing, and presenting reports and extracts to TML.

• MIR – Market Information Repository. The data base that stores the reports and extracts within MID.

• ODS – Operation Data Store. The data base that is the “data warehouse” for ERCOT’s source systems, ie, EMMS, Lodestar, Siebel, Paperfree, EIF, and TCR.

• DDM – Data Distribution Module. The software platform that maintains what reports and extracts are available to be generated from the ODS and for whom. Also stored within the DDM is the actual PL/SQL code and processing audit trails.

• PL/SQL – Oracle’s procedural language extension to the structured query language that provides an interface to relational data bases.

• TIBCO – A software platform that enables systems integration and interoperability via asynchronous message transfer – referred to as the “Data Bus”.

• Appworx – A software platform for job scheduling and business process automation.

3 9/24/2007

High Level Process Flow

1) Developer – Registers* a report/extract with the system

3) Control Model - Incorporate opt-in data into the system

2) Portal - Market Participant opts-in for the report/extract via portal

4) Enterprise Scheduler - Run report/extract

7) Processing Layer - Log Audit Information

6) Processing Layer – Compress to Zip files

5) Processing Layer - Generate data files

8) Processing Layer - Post for portal access

Post to Market

Post to Market

* Assumes the report/extract has already been designed, coded, and tested.

4 9/24/2007

High Level Architecture

DDMRegistration Info

PL/SQLAudit Files

DDM metadata

Appworx

Enterprise Scheduler

The Market

Ercot.com

Digital Cert Verification

Texas Market Link (TML)

Report Explorer

Drop offpoints/folders

EMMS

Lodestar

Siebel

Paperfree

EIF

TCR

MIR

ODS

Tibco

Data Bus

Web Services

Web Services

Browse

Download

Note: Other applications post files/reports to MIR

5 9/24/2007

Data Bases and Data Flow

Enterprise Information Services Systems

Package 2 Source Systems

Package 1 Source Systems

ODS

TCR

Paperfree

Siebel

Lodestar

EMMS

Tibco Active DB Adapter

Shareplex

Shareplex

Shareplex

Dataguard

Lodestar RSS

EMMS RSS

EIF

TCR

EIF

Paperfree

Siebel

Lodestar

EMMS

Shareplex

Shareplex

Shareplex

DataDeliveryModule

WebServices

ApplicationMetadataEngine

BusinessIntelligence

Layer

ConformedData Warehouse

CommonDimensions

BusinessSubject Area D

BusinessSubject Area Z

BusinessSubject Area A

BusinessSubject Area B

BusinessSubject Area C

Business Logic

MIR

Future

6 9/24/2007

Daily ODS Extracts -- 33

AS Deployments DAILY

Ancillary Services – DAILY DAILY

Bids and Schedules – DAILY DAILY

DC TIE Automation DAILY

Daily Siebel Service Order Extract 1 DAILY

Daily Siebel Service Order Extract 2 DAILY

Disclosure of Local Congestion - Instructions/EnergyQuantities DAILY

Disclosure of Local Congestion – Instructions DAILY

Energy Schedules DAILY

ESIID Extract Daily Supplemental kVA 1 DAILY

ESIID Extract Daily Supplemental kVA 2 DAILY

Forecast Data Daily DAILY

GEN_Daily DAILY

LOD_Daily DAILY

Market Information Daily DAILY

PRDE Extract DAILY

Recorder - DAILY DAILY

Resource ID - DAILY DAILY

ESIID Extract DAILY

ESIID Extract Supplemental DAILY

Market Shadow Prices (SHP) Extract DAILY

Settlement Input Data (SID) Extract DAILY

SNB_Daily DAILY

Daily Scheduled and Actual Load DAILY

Daily Self-Scheduled Energy Services DAILY

Actual Resource Output DAILY

Commercially Significant Constraints (CSC) 1 DAILY

Commercially Significant Constraints (CSC) 2 DAILY

Dynamic Load Obligations and Generation Resources DAILY

Tradable Generation Rights (TGR) 1 DAILY

Tradable Generation Rights (TGR) 2 DAILY

Zonal Operational Constraints (OC1) 1 DAILY

Zonal Operational Constraints (OC1) 2 DAILY

7 9/24/2007

On-Demand ODS Extracts -- 34

DATA_AGGR_ALL_ES_WS Provide all ESIID extract records

ESH_ALL_ES_WS Provide all ESIID extract records

ESH_AUDIT_LGKLST_ES_WS Provide all ESIID extract records

ESH_TD_ALL_ES_WSProvide CMZONE assignments for a trade

date

ESIID_ALL_ES_WS Provide ESIID account records

ESIID_AUDIT_ALL_ES_WS Provide ESIID account records

ESIID_AUDIT_CNT_ES_WS Provide ESIID account records

ESIID_AUDIT_LGKLST_ES_WSProvide ESIID extract records for Logical

Keys

ESIID_AUDIT_LGK_ES_WSProvide ESIID extract records for Logical

Keys

ESIID_CMZONE_LST_ES_WSProvide ESIID extract records for Logical

Keys

ESIID_ESH_ALL_ES_WSProvide ESIID extract records for Logical

Keys

ESIID_ESH_TD_ALL_ES_WSProvide ESIID extract records for Logical

Keys

ESIID_TD_ALL_ES_WS Provide ESIIDs I own for a trade date

ESIID_TD_LST_ES_WS Provide ESIIDs I own for a trade date

ESUG_AUDIT_LGKLST_ES_WS Provide ESIIDs I own for a trade date

IDR_DATA_LSCH_ES_WS Provide ESIIDs I own for a trade date

IDR_DATA_LSCH_LSCD_ES_WSProvide ESIIDs where IDR usage data not

loaded for a trade date

IDR_DATA_LST_ES_WSProvide ESIIDs where Non-IDR usage data not loaded for a trade date

IDR_DATA_NOTLOADED_LST_WSProvide ESIIDs where Non-IDR usage data not loaded for a trade date

IDR_DATA_TWOTD_LSCH_ES_WSProvide IDR transaction data for ESIIDs I own

IDR_DATA_TWOTD_LSCH_LSCD_ES_WS

Provide IDR transaction data for ESIIDs I own

IDR_TRAN_LSCH_ES_WSProvide IDR transaction data for ESIIDs I own

IDR_TRAN_LSCH_LSCD_ES_WS Provide IDR usage data for a trade date

IDR_TRAN_LST_ES_WS Provide IDR usage data for a trade date

LSCD_AUDIT_LGKLST_ES_WS Provide IDR usage data for a trade date

LSCH_AUDIT_LGKLST_ES_WSProvide IDR usage data for particular ESIIDs I own

NIDR_DATA_ALL_ES_WSProvide IDR usage data for particular ESIIDs I own

NIDR_DATA_LST_ES_WSProvide Non-IDR transaction data for ESIIDs I own

NIDR_DATA_NOTLOADED_ALL_ES_WS

Provide Non-IDR transaction data for ESIIDs I own

NIDR_DATA_NOTLOADED_LST_ES_WS

Provide Non-IDR usage data for a trade date

NIDR_DATA_TWOTD_ALL_ES_WSProvide Non-IDR usage data for a trade date

NIDR_TRAN_ALL_ES_WSProvide Non-IDR usage data for ESIIDs I own

NIDR_TRAN_LST_ES_WS Provide public data extract

PUBLIC_REQUEST_ES_WSVerify records used in data aggregation for a trade date

8 9/24/2007

Other ODS Extracts -- 23

Ancillary Services - INITIAL INITIAL

Bids and Schedules - INITIAL INITIAL

Forecast Data Initial INITIAL

GEN_Initial INITIAL

Initial Siebel Service Order Extract INITIAL

Initial Siebel Service Order Extract INITIAL

Initial Siebel TDSP ESIID extract INITIAL

LOD_Initial INITIAL

Market Information Initial INITIAL

Resource ID - INITIAL INITIAL

ESIID Extract INITIAL

SNB_Initial INITIAL

Ancillary Services Schedules MONTHLY

Generation Outages MONTHLY

Individual AS Bids MONTHLY

Individual BES Bids MONTHLY

Individual RPRS Bids MONTHLY

Resource Plan Details MONTHLY

Weekly Siebel Service Order Extract WEEKLY

Weekly Siebel Service Order Extract WEEKLY

Weekly Siebel TDSP ESIID extract WEEKLY

Daily Total Exposure COLLATERAL_CALC

Weekly EAL by QSE COLLATERAL_CALC

9 9/24/2007

Market Extracts Stats (averages over last 6 months)

Statistic Daily Weekly Monthly Annually

Zip Files Generated

1,324 9,268 39,720 483,260

CSV Files Generated

8,008 56,056 240,240 2,922,920

Total Records (Rows) Generated

12,044,828 84,313,796 361,344,840 4,396,362,220

90 - Number of Possible Extracts

1,306 - Number of Registered Recipients

1,745 - Daily Opt-In Count

10 9/24/2007

Questions?