July 7, 2008 TPTF Texas Nodal Market Implementation: Metrics Revisions Jerry Sullivan.

July 7, 2008TPTF

Texas Nodal Market Implementation:Metrics Revisions

Jerry Sullivan

2Texas Nodal Program UpdateJuly 7, 2008 2

Agenda: Metrics Revisions

• IBM Audit

• ERCOT/MP Metrics Review– Format Changes– Suggested Revisions– Suggested New Metrics

• Metric Review Schedule

• Suggested Revisions (details)

• Suggested New Metrics (details)


IBM Audit

IBM conducted an assessment of readiness metrics and determined that a review of several metrics was in order

• Audit focused on:– Market Participant readiness visibility on the scorecard– Interviews with volunteer Market Participants– Adequacy and coverage of the metrics

• ERCOT is reviewing all metrics (MPs, EDS, ERCOT Staff, and ORMS) to:– Update criteria– Review RAG rules– Revisit timelines and linkages to the schedule– Ensure accurate and consistent reporting


Format Changes: Existing Metric Format

Metric Number – Metric Name

Reported By: Indicates if the metric is discoverable by ERCOT, Market Participants, WEMM or any combination thereof.

EDS: Indicates the related Early Delivery System, if applicable.

Target Completion: Indicates the time period that the metric result will be published.

Category: Indicates how the data will roll up functionally in the Readiness Dashboard tool.

Metric Description: Provides a description of the metric.

Background: Indicates the intent of the metric.

Criteria: Outlines the criteria used to determine if the metric has been successfully completed.Provides a concrete measurement standard to evaluate the metric against

Reporting Data Sources: Indicates the source of the data to be used when evaluating the measurement standard and or the individual or team responsible for reporting status.

References TP: Cross reference to the Transition Plan

TNP: Cross reference to the Texas Nodal Protocols

The existing metric format is missing a few key pieces of information


Format Changes: Revised Metric Format

Metric Number: Metric Name

Reporting Source: Where the data comes from Metric Active Date: When the metric will be measured

Impacted Entities: Which entity types will be measure by the metric

Target Completion Date:

Scoring Category: Where the metric falls on the scorecard

When the metric will be completed

Metric Definition

Simple text of what the metric will accomplish

Metric Criteria

Overview of how the metric will be measured

RAG Rule

For Market Participants Individually – IF APPLICABLE (indicate red/amber/green criteria)

For Market Segment (indicate red/amber/green criteria)

References TP: Reference to Transition Plan TNP: Reference to Texas Nodal Protocols

The new metric format is more complete and easier to read


Suggested Revisions

Through collaborative review efforts between Wholesale Client Services, Account Managers, the Early Delivery System team, and the Project Management Office, ERCOT proposes revisions to the following 18 metrics

MP# Metric Title Proposed ChangeMP1 Market Participant Engagement RAG RulesMP2 QSE with Resources Connectivity to EDS Environment Close MetricMP3 QSE with Resources Upload of SCED Offers to EDS Close MetricMP5 ICCP Point to Point Telemetry Test Close MetricMP6 QSE and TSP Telemetry/ICCP System Availability SpecificsMP8 QSE Ability to Submit Transactions via MIS Close MetricMP9 QSE Ability to Submit Web Service Transactions Close MetricMP10 Mapping of Resources to Resource Nodes and Resources to EPS Meters CriteriaMP11 Market Participant Registration Activities CriteriaMP12 Market Participant EDS-3 Related Training Focus, RAG RulesMP13 Market Participant EDS-4 Related Training Focus, RAG RulesMP14 Market Participant EDS-2 Trials Participation ScopeMP15 Market Participant EDS-3 Trials Participation ScopeMP16 Market Participant EDS-4 Trials Participation TBDMP17 Market Participant Qualification Activities SpecificsMP18 Mapping of Resources and Loads in Private Area Networks Remove MetricMP19 Load Serving Entitles Engagement and Readiness RAG RulesMP20 Market Participant Ability to Submit Outage Close Metric


Suggested New Metrics

Additionally, it has become apparent that there is a need for the followingsix metrics

MP# Metric Title RationaleMP21 Wind Generation Entities/Telemetry Presentation this AfternoonMP22 MP14.2 - EDS-2 Trials Participation Increased GranularityMP23 MP14.3 - EDS-2 Trials Participation Increased GranularityMP24 MP15.2 - EDS-3 Trials Participation Increased GranularityMP25 New Entrants to the Market Enhanced TransparencyMP26 Outage Participation Trials Necessary to Track


Metric Review Schedule

In efforts to allow Market Participant involvement, we have drafted the following schedule:

Monday Tuesday Wednesday Thursday Friday7 Presentation of revised format, revised metrics, and new metrics

8 9 10 11

14Distribution of change/revision tracker doc. and MP comments

15 16 17 18

21Vote on revised metrics and new metrics

22 23Metric changes reflected on the scorecard

24 25

Presentation of TPTF approved metrics to TAC on August 7th

Review of revised metrics and new metricsPlease send questions/comments to [email protected]

Further review, consideration of received commentsPlease send questions/comments to [email protected]


Suggested Revisions (details) – Supplemental Document

MP# Metric Title Proposed ChangeMP1 Market Participant Engagement RAG RulesMP2 QSE with Resources Connectivity to EDS Environment Close MetricMP3 QSE with Resources Upload of SCED Offers to EDS Close MetricMP5 ICCP Point to Point Telemetry Test Close MetricMP6 QSE and TSP Telemetry/ICCP System Availability SpecificsMP8 QSE Ability to Submit Transactions via MIS Close MetricMP9 QSE Ability to Submit Web Service Transactions Close Metric

MP10 Mapping of Resources to Resource Nodes and Resources to EPS Meters CriteriaMP11 Market Participant Registration Activities CriteriaMP12 Market Participant EDS-3 Related Training Focus, RAG RulesMP13 Market Participant EDS-4 Related Training Focus, RAG RulesMP14 Market Participant EDS-2 Trials Participation ScopeMP15 Market Participant EDS-3 Trials Participation ScopeMP16 Market Participant EDS-4 Trials Participation TBDMP17 Market Participant Qualification Activities SpecificsMP18 Mapping of Resources and Loads in Private Area Networks Remove MetricMP19 Load Serving Entitles Engagement and Readiness RAG RulesMP20 Market Participant Ability to Submit Outage Close Metric


Suggested New Metrics (details) – Same Supplemental Document

MP# Metric Title RationaleMP21 Wind Generation Entities/Telemetry Presentation this AfternoonMP22 MP14.2 - EDS-2 Trials Participation Increased GranularityMP23 MP14.3 - EDS-2 Trials Participation Increased GranularityMP24 MP15.2 - EDS-3 Trials Participation Increased GranularityMP25 New Entrants to the Market Enhanced TransparencyMP26 Outage Participation Trials Necessary to Track


Questions ?

July 7, 2008 TPTF Texas Nodal Market Implementation: Metrics Revisions Jerry Sullivan.

Documents

Transcript of July 7, 2008 TPTF Texas Nodal Market Implementation: Metrics Revisions Jerry Sullivan.