Structured /
Unstructured
Market Trials
Kick-Off Meeting
May 31, 2013
Agenda
• Structured Market Trials Dates
• Release Scorecard
• Known Issues Log
• Migration Report (when needed)
• *Note: As of 5/31/2013 the Migration Report is not yet available
• Reporting and Metrics
• Extended Connectivity Testing Update – Brett Crane
• TCR Market Trials Update – Brett Crane
3
Structured Market Trials Daily Calendar
June 3 – June 9
–
Find the Market Trials Daily Calendar on spp.org:

spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test >
Integrated Marketplace Market Trials Project Documentation Folder
4
Calendar Reminders
• SPP Hotline: Critical and High Issues
• Phone Number: 501-482-2222
• Monday – Friday, 8:00 am – 5:00 PM CPT
• Critical Issue: one or more systems, or a function within a system, are
rendered inaccessible or stop functioning all together
• An example of a critical issue is: "An MP cannot update RTBM
offers for the current Operating Day."
• High Issue: One or more key functions within a system are nonoperational, or a severe error exists in its processing, and there is no
workaround
• Call the hotline when “stuck” (cannot move forward without help)
• Examples: data submission issue, real-time ICCP issues, etc.
5
Calendar Reminders
 Bi-weekly Meetings
 Mondays 9AM CPT: Review activities planned for upcoming week
 Fridays 9AM CPT: Review results of activities that week
 Friday Maintenance
 Member-impacting maintenance will happen on Friday afternoons
 24-hour notice if member impacts are expected
 Saturday - Reserved for MP Testing
 SPP will not override offer data
 Studies will be run, system permitting
6
Release Scorecard
•
Release Scorecard
–
Find the Release Scorecard on spp.org:

spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test >
Integrated Marketplace Market Trials Project Documentation Folder
7
Known Issues Log
•
Market Trials Known Issues Log
–
Find the Known Issues Log on spp.org:

spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test >
Integrated Marketplace Market Trials Project Documentation Folder
–
Details on issues as currently impacting the Market Trials
–
5/30/13: Bug with Internet Explorer when used to submit virtual beds and offers

Solution for Internet Explorer 8:

– After inserting /changing data in a cell press “Enter” on your keyboard. This should
turn the cell yellow. Use “Tab” or cursor to select other cells. Press “Enter” after
modifying any cell. Repeat this process until you are satisfied and press “Save.”
Solution for Internet Explorer 9:
– After inserting/changing data in a cell press “Tab” on your keyboard. This should
turn the cell yellow. Use “Tab” or cursor to select other cells. Press “Tab” after
modifying any cell. Repeat this process until you are satisfied and press “Save.”
8
Migration Report
•
Migration Report
–
Not yet available
9
Readiness Metrics
View Readiness Metrics on iDashboard on spp.org
•
•
TRL-01: Structured/Unstructured Test Markets Participation – starting June 07
•
•
•
•
•
Monthly: % of Structured/Unstructured scheduled operational scenarios executed & passed
Overall : % of Structured / Unstructured Operational scenarios complete
OPS-02: State Estimator Availability – starting July 1
•
•
•
Resource Owning MPs: Maintain offers for each operating day
Load Owning MPs: Submit market energy bids based on load forecasts for each operating day
Financial Only MPs: Submit virtual bids and offers for each operating day
Overall : % of Target Mass Participating in Structured/Unstructured Phase of Market Trials
TRL-02: Structured/Unstructured Test Complete – starting June 7
•
•
•
spp.org > Integrated Marketplace > Readiness Center > View the Integrated Marketplace
iDashboard > Readiness Dashboard > Executive Dashboard
Measured by checking for a solved SE solution during each 5-min period in a calendar day
State Estimator has 97% availability of 5 minute solutions for 7 consecutive days prior to Parallel Ops
OPS-03: State Estimator Accuracy – starting July 1
•
•
Measures the quality of the State Estimator
State Estimator solves 90% of the time with Mismatch level lower than 50 MW for 7 consecutive
days prior to Parallel Ops
10
Readiness Metrics
•
OPS-04: Short-Term Load Forecast Accuracy – starting July 1
•
•
•
OPS-05: Mid-Term Load Forecast Accuracy – starting July 1
•
•
•
Compares the load forecast values calculated by the Mid Term forecast engine with the raw ICCP
values (i.e. telemetered values)
Mid-term load forecast for conforming loads for the SPP market footprint solves 97% of time
with +/- 3% accuracy for seven consecutive days prior to Parallel Ops
OPS-06: Wind Forecast Accuracy – starting July 15
•
•
•
Compares the load forecast values calculated by the Short Term forecast engine with the raw ICCP
values (i.e. telemetered values)
Short term load forecast for the SPP Market footprint used for RTBM for conforming loads solves
97% of time with +/-1% accuracy for 7 consecutive days prior to Parallel Ops
Compares the wind forecast values calculated by the wind forecast engine with the real-time
output of the wind resources
Wind forecast for SPP Market footprint solves with +/- 20% accuracy for six out of seven
consecutive days prior to Parallel Ops
OPS-07: Market Flow Calculations Availability – Current Hour – starting Aug 1
•
•
Calculates calculating the number of successful studies during the reporting period for the current hr.
Market Flow Calculations successful 97% of 5 minute solutions for seven consecutive days prior to
Parallel Ops
11
•
Readiness Metrics
OPS-08: Market Flow Calculations Availability – Next Hour – starting Aug 1
•
•
•
OPS-09: DA Market Results Posted – starting June 7
•
•
•
Measures whether LMPs are generated after each Day-Ahead Market execution
LMPs are made available for each settlement location every day by 4pm for 5 consecutive days
during Parallel Ops
OPS-11: RTBM Calculation Availability – starting June 7
•
•
•
Measured by validating that the results of the Day-Ahead Market are posted to all required access
points
Day-Ahead Market results are posted every day by 4pm for 5 consecutive days during Parallel Ops
OPS-10: Generate DA LMPs and Settlement Point Prices – starting June 7
•
•
•
Calculates the number of successful studies during the reporting period for the next hour
Market Flow Calculations successful ninety-seven percent (97%) of 5 minute solutions for seven
consecutive days during Parallel Ops
Measures RTBM calculation availability
Real-Time Calculations successful ninety-nine percent (99%) of five (5) minute solutions for 7
consecutive days during Parallel Ops
OPS-12: Operating Reserves Requirements – starting Aug 1
•
•
Validates that Operating Reserves are calculated and posted on time (7:00 am Central) during
Parallel Operations phase of Market Trials for 7 consecutive days
Operating Reserves are calculated and posted on time for 7 consecutive days during Parallel Ops
12
Weekly Reporting
•
Scheduled Scenarios – starting June 7
•
•
Scheduled Scenarios Successful / Unsuccessful
DA Market Results – starting June 7
•
Number of MPs Participating
•
•
Total Amount of Bids
•
•
•
Min and Max
Prices
•
•
•
Hourly Data (RegUp, RegDn, Spin, Supp)
Percent of load forecast that was cleared
•
•
Min and max
Virtual (min and max), Cleared (min and max), Cleared Virtual (min and max)
Reserve Requirements
•
•
Fixed (min and max), Price Sensitive (min and max)
Virtual (min and max), Cleared (min and max), Cleared virtual (min and max)
Total Amount of Offers
•
•
•
Bids, Offers, Virtual Bids/Offers
LMPs (min and max per Hub)
MCPs (min and max per Reserve Zone)
Binding Constraints
•
•
Top Binding Constraints, Intervals, Limits, Max Flow, and Shadow Prices
Explanations where appropriate
13
Weekly Reporting
•
DARUC - starting June 7
•
•
•
•
•
Number of Resources Recommended for Commitment
Number of Resources Approved for Commitment
Number of Resources Recommended for Decommitment
Constraints in DARUC that Drove Commitment
Emergency Situations in DARUC
•
•
•
Performance / Issues
IDRUC – starting June 7
•
•
Capacity Shortage / Surplus
Performance / Issues
RTBM – starting June 7
•
Number of MPs participating
•
•
Prices
•
•
•
•
RTBM Offers
LMPs (min and max per Hub)
MCPs (min and max per Reserve Zone)
Explanation for abnormally high or low prices
Major Constraints
•
•
Constraints, Intervals, Limits, Max Flow, and Shadow Prices
Missing Intervals
14
Market Trials Useful Documentation
•
Integrated Marketplace Market Trials Project Documentation Folder

•
spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test >
Integrated Marketplace Market Trials Project Documentation Folder
•
Market Trials Daily Calendar
•
Release Scorecard
•
Change Tracker
•
Market Trials Known Issues Log
•
•
Migration Report
*Note: As of 5/31/2013 the Migration Report is not yet available
Structured Market Trials Scenarios
•
Market Participant Guide
View Readiness Metrics on iDashboard on spp.org
•
spp.org > Integrated Marketplace > Readiness Center > View the Integrated Marketplace
iDashboard > Readiness Dashboard > Executive Dashboard
15
Connectivity Test Preparation
•
Connectivity Test Preparation occurs over 4 weeks from
May 6th – May 31st.
•
During this timeframe Market Participants prepare for
Connectivity Test through the following activities:
–
Complete the Connectivity Test Checklist
–
Initiate Local Security Administrator (LSA) and User/Application
Certificate Setup.
–
Exchange Notification Certificates and Market Participant Listener
URLs with SPP (if applicable)
–
Request Access to OATI WebTrans and CROW (if applicable)
16
Connectivity Test Execution Timeframe & Logistics
•
Timeframe:
–
•
Connectivity Test Execution occurs over 4 weeks from June 3rd – June 28th.
Logistics:
–
Tests executed are determined by what tests are deemed applicable by the
MP in their Connectivity Test Checklist
–
Market Participants will be assigned a week during the test execution
timeframe to perform their testing. Weekly Assignments can be found here
–
Test Execution Plans (modified checklists) will be provided via RMS.
–
Tests are performed independently during the assigned week- no
appointment needed.
–
Market Participants are to populate the execution plan as directed and
return their results by the end of their assigned week via RMS.
–
Issues with test execution will be handled via RMS. SPP Test Appointments
will be provided only on an as needed based.
17
Test Execution Week #1
MPs Scheduled to Perform Extended Connectivity Testing
June 3rd – June 7th.
–
TPS 1- 8
–
ETC ENDURE ENERGY
–
MAG ENERGY SOLUTIONS
–
MERCURIA ENERGY AMERICA, INC
–
CITY OF COFFEYVILLE, KS
18
TCR Market Trials Upcoming Activities
•
Annual 1 Round TCR Auction
–
•
•
Results made available on May 17th
July Incremental ARR Allocation
–
Nomination Window: June 10th
–
Results Posted: June 13th
July Monthly TCR Auction
–
Bid Window: June 17th & 18th
–
Results Posted: June 21st
19
TCR Market Trials Known Issues & Auction
Summary
•
Important Known Issues:
–
Known Issue 376: Binding Constraint download shows
binding constraints in opposite direction

•
This is a report only issue and is not impact the MOI or TCR
database.
Phase 2 Annual Auction Summary
–
Pre-Run Fix and Price Issue: Ty Mitchell
20
21