Market Trials Weekly Update – Friday Meeting December 6, 2013.

Market Trials

Weekly Update – Friday MeetingDecember 6, 2013

Agenda• IDT Debrief: 9:00 – 10:00A

• IDT Conditions, 9:00-9:10A• IDT Report Review: IDT 11/19 and IDT 11/21, 9:10-9:30A• IDT 12/3 Preliminary Debrief, slides for reference only• IDT 12/5 Preliminary Debrief, 9:30-10:00A

• Analysis: 10:00 – 10:20A• Parallel Ops Participation and QuickStart Reminders, 10:00-10:10A • Scenario Analysis, 10:10-10:20A

• Look-Ahead: 10:20 – 10:50A• Announcements and Release Updates, 10:20-10:30A • Look-Ahead, 10:30-10:40A• Updates, 10:40-10:50A

• Release Scorecard• Migration Report• Known Issues Log

• Settlements: 10:50 – 11:00A

2

IDT Conditions page 1 of 2

3

• IDT Conditions posted to spp.org here spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test

Casey Cathey

IDT Date Condition Notes

12/10/13 Resource Drop SPP will induce a Resource drop.SPP will coordinate with individual MP.

12/12/13 Follow Resource Online

SPP will coordinate with a Resource-owning MP such that if they have a planned Resource start, SPP will put it in COP as normal; however, the MP will monitor the start signals from SPP during the start window.

There will be no official commitment from SPP, meaning no MWPs.

SPP will monitor this condition and report any anomalies from either end.

SPP is soliciting MPs to participate in this IDT condition. If you have a Resource already planning on coming online during a regularly scheduled IDT, please let us know via RMS.

http://www.spp.org/section.asp?group=2703&pageID=27

https://spprms.issuetrak.com/Login.asp?IsNewSignIn=true

IDT Conditions page 2 of 2

4Casey Cathey

IDT Date Condition Notes

12/17/13

Mirroring Off SPP will require additional monitoring and reporting during the 12/17 IDT as this is the first IDT after webMirroring is disabled on 12/16.

EDR

Pumping Loads

12/19/13 Pseudo Tied In Resources An MP requested permission to test a Pseudo Tied In Resource during the 12/19 deployment test. SPP had asked the MP not to include the Resource in deployment testing before 12/19 due to the pseudo-tie issue.

1/7/13 Regulation Pre-Selection / Co-Optimize Regulation

SPP will exercise Regulation pre-selection during the 01/07 IDT. This will run through normal ID-RUC regulation pre-selection, allow BA Operators to change Resources from certain regulation, etc.

1/9/13 ICCP Failover SPP has requested that an MP perform an ICCP failover in the middle of the January 9th IDT. This was a request from the CWG for a real world condition.SPP will coordinate with individual MP.

IDT 11/19 ReportIDT reports to be posted to spp.org here 7 calendar days after each IDT

spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test

IDT 11/21 ReportIDT reports to be posted to spp.org here 7 calendar days after each IDT

spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test

5Brian Strickland / Carrie Simpson





12-03-13 Deployment Test Debrief• Overall the Third Deployment test was another great success

– Overall SPP BA ACE and frequency were in acceptable ranges throughout the duration of the test

– EIS BA’s had no problems switching from EIS setpoints to IM setpoints and back again

– No major problems were reported by SPP or the MPs during the test

– Able to start and stop the test on time as scheduled with no delay, reduction or extension

6For Reference only

12-03-13 Deployment Test Debrief• Though a “Success” there are things we can improve upon

– MATCHING EIS and IM Offers – Parallel Operations vs. IDTs During all of Parallel Operations EIS offers, unit parameters and Ancillary

Service plans should closely track to those in the IM

– The Parallel Operations MP Guide describes a close tolerance between EIS and IM that applies to all of Parallel Operations

For IDTs SPP needs MPs to start matching offers 4 hours prior to IDTs to allow time to work out any mismatches – by the time the open calls start all mismatches should be worked out

For IDTs getting Ancillary Service plans consistent is critical for all hours of the tests

7For Reference only



– Participants need to be on the calls when they start 60 minutes prior to each IDT When the calls were initiated there were BAs and MPs that needed to be

individually contacted to get them to call in and give a “Go” vote.

– Minor problems were addressed quickly and didn’t create any reliability concerns COP True-up wasn’t dealing with a specific unit correctly and SPP worked

with the MP to manually get the unit on-line.

8For Reference only

12-05-13 Deployment Test Debrief• Overall the Fourth Deployment test was another great

success– Able to start and stop the test on time as scheduled with no

delay, reduction or extension

– EIS BA’s had no problems switching from EIS setpoints to IM setpoints and back again Smooth entry into the test

– No major problems were reported by SPP or the MPs during the test Saw a number of schedule changes throughout the IDT – no issues

Line came of at 0800 – no issues



– Slightly out of balance ~0800

– CPS 2 violation during the test from 0800 – 0810

– MATCHING EIS and IM Offers – Parallel Operations vs. IDTs During all of Parallel Operations EIS offers, unit parameters and Ancillary

Service plans should closely track to those in the IM

– The Parallel Operations MP Guide describes a close tolerance between EIS and IM that applies to all of Parallel Operations

For IDTs SPP needs MPs to start matching offers 4 hours prior to IDTs to allow time to work out any mismatches – by the time the open calls start all mismatches should be worked out

10

Brian Strickland / Carrie Simpson



– SPP wants to understand what is preventing MP Resources from following deployments Please follow deployments

Please communicate any issues with SPP

– Participants need to be on the calls when they start 60 minutes prior to each IDT All BA’s were on the call on time – Thank You!

4 MPs needed to be individually contacted to get them to call in and give a “Go” vote.


Integrated Marketplace RTBM Submissions

• Currently, SPP is having to request updates to IM offers just before IDTs to be consistent with EIS offers

• During Parallel Operations, members should keep Integrated Marketplace offers consistent with EIS offers

From the Parallel Operations MP Guide:

• SPP has begun to track EIS vs IM offer percentages, and will send a reminder email each week to all MPs who are not participating consistently

12

Market Participants shall update RTBM submissions as follows:• If a unit goes offline or comes online in the EIS market, update RTBM submissions• If a unit’s min/max capacity changes by >10% or 5 MW, whichever is greater, in the

EIS market, update RTBM submissions• If a unit’s offer curve changes by >10% or $2 per 5 MW, whichever is greater, in the

EIS market, update RTBM submissions

Casey Cathey

Quick Start Resources

• In Marketplace there a two different types of quick start resources

1. Quick Start resources similar to “Quick Start Status” in EIS Market• Dispatched only in the RTBM

• No Start instruction sent to MPs

2. Resources that can quickly get online (less than 10 minutes) and qualified for off-line supplemental• Committed by SPP in RUC or Contingency Reserve Deployment

process

• Start Instructions are sent to MPs

13Carrie Simpson

Quick Start Resources

14Carrie Simpson

TRL-01: MP Participation in Parallel Ops

• Reminder! Participation in Parallel Ops is still being tracked via Readiness Metric TRL-01– As of 12/6, the metric is RED due to insufficient

participation by one BA (KBPU)

• The status of the Readiness Metrics as of 12/20 will be included in the 12/27 FERC Readiness Filing

• The status can go back to GREEN if Target Mass participates sufficiently (i.e. in at least 80% of the ODs) during the first part of December– Metric measurement criteria is available in v5.0 of the

Readiness Metrics posted in the Readiness folder

15Erin Jester


OPS-16: MP Response to Deployment Testing

• Reminder! Participation in Deployment Testing is being tracked via Readiness Metric OPS-16– In order to be GREEN, one or more of the MP’s online

units must respond to dispatch instructions during a deployment test

– Participation in IDT calls (pre, post, and test) is required for MPs with online units

• The status of the Readiness Metrics as of 12/20 will be included in the 12/27 FERC Readiness Filing – Metric measurement criteria is available in v5.0 of the

Readiness Metrics posted in the Readiness folder16

Erin Jester


Preliminary Scenario Results

17

• Scenario 24 Re-pricing ran Tuesday Dec 3• SPP recalculated Real-Time LMP and MCP prices for the interval(s) listed

below due to bad or missing SCADA for operating day 12/04/2013

• Substitute prices will be included on the initial settlements statements 7 days from the OD

• Repricing on initial settlements statement will be posted on 12/11/2013

• Re-calculated prices are available on the IM Portal in the Public Data section

Intervals (CPT):12-04-2013 09:25 12-04-2013 09:3012-04-2013 09:35 12-04-2013 09:4012-04-2013 09:45 12-04-2013 09:5012-04-2013 09:55 12-04-2013 10:0012-04-2013 10:05 12-04-2013 10:1012-04-2013 10:15 12-04-2013 10:2012-04-2013 10:25 12-04-2013 10:3012-04-2013 10:35 12-04-2013 10:40

Alan Adams

Scenario Results

18

• Scenario 15 Commitment Mismatch Part 2• Successfully executed on Nov 25 for OD Nov 26

• 20 Resources participated

• Resources with commit status of “Outage” recommended for Call Off

• Scenario results were posted to the UI and notifications were generated and sent

• If MPs did not see their commitment due to the COP True Up process, MPs can check their past commitments in the MUI

• Resources Offers tab: Date > Resources > Resource Name > Commitment History

Alan Adams

19

• Summary – Scenarios in Parallel Ops:– 1 Scenario and 2 Partial Scenarios Executed successfully to date:

Scenario 7 Must Offer pending Settlements results

Scenario 28a Successful

Scenario 15 Commitment Mismatch Part 2

• Summary – Retests Pending:– 13 individual retest requests pending

6 MPs requested retest for Scenario 34


1 MP requested retest for Scenario 3


1 MP requested retest for Scenario 33

Scenario Tracker as of Dec 4

Ginny Watson

webMirroring webMirroring Disabled Disabled Dec 16 Dec 16

20Casey Cathey

Start Start Practicing Practicing

TagsTags21

Casey Cathey

MOS 1.9 Functionality

22

• Functionality Coming in 1.9• FERC Mitigation Changes• Pre-RTBM now has Time Coupled scenarios available (previously just non-time coupled, now

both are available)• RTBM DVER MCE Logic• External Interfaces NNLLimits Fixes• RRC Additional Functionality• RTBM EDR Fixes• Markets UI, Validation, and Web Service fixes

• Internal Scenario Retests with 1.9• New Mitigation FERC Changes

• Scenarios: 16.1, 16.2, 16.3• KIL #742

• Scenarios: 5.1, 5.2, 6.1, 6.2

• Known Issues Log Coming in 1.9• 706, 817, 781, 139, 262, 467, 724, 752, 837, 786, 787, 793, 796, 822, 820, 815, 813, 812, 810,

806, 805, 804, 827, 742, 771, 789, 794, 823, 811, 848

Carrie Simpson

MOS 1.9 Testing Approach

23

• Accelerated installation schedule is planned to comply with the 1/1/14 system wide freeze• All regression testing and defect retesting planned to complete by 12/20 (before Holiday

breaks)

• Extended hours and weekend work to sprint through testing to make 12/20 goal

• 1.9 and 1.9Plus Testing Approach• Full regression of new Mitigation FERC Changes • Full MCE Regression • Standard regression and defect testing across all functional areas

• Risks:• Resource time and capacity constraints for accelerated testing schedule

• Mitigating risk by working additional hours• SPP has seen approximately a 10% defect failure rate from previous releases• Pending the failure rate of 1.9 and 1.9Plus, and what defects fail in these releases, there is a

potential the system freeze will be at risk• If another patch is required after 1.9Plus, it will move testing into January

Carrie Simpson

MOS 1.9 Testing Approach

24

• MOS 1.9 Install Schedule• PROD: 12/30/13

• Mos 1.9Plus Install Schedule • PROD: 12/30/13

Carrie Simpson

Announcements

25

• Second Dual listener working as of R1.8

• Scenario 29 RSG will be run Monday Dec 16– Originally scheduled Tuesday Dec 17

Ginny Watson

Announcements

26

• Posting TCR model through True Share now

Wendy Reynolds

Announcements

27

IDT Schedule Updates on Parallel Ops Calendar on spp.orgspp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test (as part of Parallel Ops)

•IDT Call on Dec 17 2:30a – 8:30a4hr IDT begins at 3:30aOriginally scheduled 12/17 for 9:30P to 12/18 1:30A

•IDT in January to cross midnight (TBD which one)

•IDT times listed on the calendar reflect the call start times IDT Calls begin 60 minutes before the IDT officially starts

Casey Cathey


Dispatch Simulator

28

•*Scenario document on spp.org here–spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents > Scenarios in Parallel Ops

0:00 12/06 to 23:59 12/09

•MPs should offer their Resources as they expect to do in Production

•SPP will not be running any COP True-ups

•Commitments will only come from DBDA, DA Market, DARUC, IDRUC, and MP Self Commitments

– MPs should be looking at commitment notifications and understand that this is how SPP expects to run at Go Live

•SPP will overwrite meter settlement data for the four Operating days Dec 6, 7, 8, and 9 with RTBM setpoint instructions

Alan Adams

http://www.spp.org/publications/Dispatch%20Simulator.pdf

Look-Ahead: Nov 25 – Dec 1

29

Parallel Ops Calendar on spp.orgspp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace

Parallel Operations Project Documents• Settlements details on the Settlements Calendar marketplace.spp.org > Public > Settlements > Calendars

Dec 9: IDT Prep Call 3P

Dec 10: IDT Call 12:30 – 4:30P

Dec 11: Scenario 31 BDR Scenario 13 DDR IDT Debrief and Prep Call 3P

Dec 12: IDT Call 5:30A – 10:30A

Dec 13: Parallel Ops/Go Live Checkpoint & IDT Debrief 9A IDT Sunday Dec 15 Prep Call

Non-Functional Scenario 10:00P – 12:00A

Dec 15: IDT Call 11:30A – 5:30P

Ginny Watson


https://marketplace.spp.org/web/guest/calendars1

Scenario 31 BDR w/ Settlements

30

*Scenario document on spp.org herespp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents > Scenarios in Parallel Ops

Scenario Description• Verify functionality specific to BDRs

MP Activities• Verify that BDRs have valid offer data for all products

• Ensure all required real-time measurements are defined and being submitted to SPP via ICCP

• Submit hourly DRL forecasts when required for BDR resources

• Verify that Dispatch Instructions are received via XML the same as other Resources

• Submit meter data for time that BDR is dispatched

Alan Adams

http://www.spp.org/publications/31.0%20Block%20Demand%20Response.pdf

Scenario 13 DDR w/ Settlements

31


Scenario Description• Verify functionality specific to DDRs

MP Activities• Verify that DDRs have valid offer data for all products

• Offers should be such that DDR will clear and be dispatched

• Ensure that all required real-time measurements are defined and being submitted via ICCP

• Submit hourly DRL forecasts when required for BDR and Calculated DDR resources

• Verify that Dispatch Instructions are received via XML the same as other Resources

Alan Adams

http://www.spp.org/publications/13.0%20-%20Demand%20Response.pdf

Non-Functional Testing

32


Scenario Description• SPP will simulate an outage at the Chenal facility for Reliability and Markets redundancy

• Non-Functional Test includes critical Tier 0 and Tier 1 components to demonstrate that those systems can be entirely supported and function independently in the back-up Operations Data Center in Maumelle

Expected Result• EMS is fully functioning with RTGEN for CBA

• ICCP is fully functioning and sending setpoint instructions

• Marketplace Portal User Interface and API is available for data entry and retrieval

• Web Services (RTO_SS) is available

• Markets system is fully functioning and solving RTBM for approximately one hour

• Email is available for sending and receiving communication

Casey Cathey


Non-Functional Testing

33

MP Activities• MPs should continue normal operations with no expected downtime.

• If any unexpected results occur, please submit a detailed RMS Ticket here

• Verify the following during Non-Funct Testing Dec 13 at 10P – Dec 14 at 12A CPT

• ICCP setpoint instructions are received

• XML notifications are received

• Marketplace Portal User Interfaces and API’s are available for data entry and retrieval

Casey Cathey

https://spprms.issuetrak.com/login.asp

Schedule Dec 9 - 15

34

Dec 9: IDT Prep Call 3P

Dec 10: IDT Call 12:30 – 4:30P (2 hr test begins at 1:30P)

Dec 11: Scenario 31 BDR Scenario 13 DDR IDT Debrief and Prep Call 3P

Dec 12: IDT Call 5:30A – 10:30A (3 hr test begins at 6:30A)

Dec 13: Parallel Ops/Go Live Checkpoint & IDT Debrief 9A IDT Sunday Dec 15 Prep Call

Non-Functional Scenario 10:00P – 12:00A

Dec 15: IDT Call 11:30A – 5:30P (4 hr test begins at 12:30P)

Ginny Watson

Schedule Dec 16 - 22

35

Dec 16: Scenario 29 RSG webMirroring Disabled IDT Debrief and Prep Call 3P

Dec 17: Scenario 11 EDR IDT Call 2:30A – 8:30A (4 hr test begins at 3:30A)

Dec 18: CWG IDT Debrief and Prep Call 3P

Dec 19: IDT Call 5:30A – 9:30A (2 hr test begins at 6:30A)

Dec 20: Parallel Ops/Go Live Checkpoint & IDT Debrief 9A MP Readiness Cert Form

Ginny Watson

Migration and Maintenance Report

36

Migration and Maintenance Report posted to spp.orgspp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents

Wendy Reynolds


37

Release Scorecard posted to spp.org:spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents

Release Scorecard

Ginny Watson


Known Issues Log

38

• Please review the Market Trials Known Issues Log on spp.orgspp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test > Integrated Marketplace Market Trials Project Documentation Folder

Carrie Simpson

Issue # Component Synopsis Severity

852Markets Systems

During Model uploads, resources maybe removed or added into a model. When RTBM solves for the first interval with new resources, IE 00:05, an issue with RTGEN could occur since the new resource does not have a 'Next' and 'Past' breakpoints since there was no solution for the new resource in the past two solutions

To correct this issue, SPP requests that when Caseid and Intervaltime (RTGENDATA_TIME) for 'Next' and 'Past' breakpoints are valid (NOT 'NA') and if a resource doesn't have valid 'Next' and 'Past' solutions information (NA), then MDB should set the 'Next' and 'Past' breakpoint info to 'Far' breakpoint solution information.

Severity 2: High

844 Markets UIThe Reserve Notification publish job takes up to two minutes to complete. This job is responsible for publishing XML notifications for Real-Time Cleared OR offers.

Severity 2: High

http://www.spp.org/publications/MTKnownIssues20130703.xls

Known Issues Log

39

Carrie Simpson

Issue # Component Synopsis Severity

848 Markets UI

The Markets UI is missing Resource Offer Mitigation displays for BDR and DRRs. When viewing the Parameters (Daily) and Parameters (Hourly) pages for BDRs and DRRs, the UI should present the user with options to submit for Day-Ahead (DA), Real-Time (RT) and Mitigation (MI), but the Mitigation displays are not available.

Severity 3: Medium

Market Trials Useful ResourcesIntegrated Marketplace Parallel Operations Project Documents spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents

•Parallel Ops Presentations, Statistics, MP Meetings Folder•Parallel Ops Reference Documents Folder•Scenarios in Parallel Ops Folder > Scenarios Schedule•Parallel Ops Communication Plan•Parallel Ops MP Guide•Parallel Ops Calendar•Known Issues Log•Release Scorecard•Migration Report

Integrated Deployment Test (as part of Parallel Ops)spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test

•IDT MP Guide•Parallel Ops Calendar

Additional documents:•Settlements Calendar marketplace.spp.org > Public > Settlements > Calendars•Change Tracker spp.org > Integrated Marketplace > Marketplace Documents•Integrated Marketplace Structured/Unstructured Test Project Documents spp.org > Integrated Marketplace > Market Trials > Structured / Unstructured Test> Integrated Marketplace Structured / Unstructured Test Project Documents

40













Settlements Status

• The November ETSE release was moved into production 12/5/2013. – Included the following charge types: DaDRHrlyAmt ,

DaDRDistHrlyAmt, RtDR5minAmt, RtDRDistHrlyAmt

– DaGFAAoAmt, DaGFAAoMnthlyAmt, DaGFAAoYrlyAmt, RtRnuMnthlyAmt, RtRnuYrlyAmt were also included but (as previously communicated) due to recent FERC changes the final version of these will be in the December release

– The 12/1 initial and the 11/23 final are the first Operating Days processed using this new release

41Brent Wilcox

Settlements Status

• The December release is due from Alstom today (12/6/2013). This release is what we will take into the code freeze (installed into production early January).

42Brent Wilcox

Market Trials Weekly Update – Friday Meeting December 6, 2013.

Documents

Transcript of Market Trials Weekly Update – Friday Meeting December 6, 2013.