Market Trials Review Group. May 2, 2012

Size: px

Start display at page:

Download "Market Trials Review Group. May 2, 2012"

Sharleen Lee
5 years ago
Views:

3 Market Trials Review Group May 2, 2012

4 Section 1 WELCOME & INTRODUCTIONS 4

5 Agenda 08:00 08:30 Welcome and Introductions Review of Today s Agenda 08:30 09:00 MTRG Objectives and Process 09:00 10:00 High Level Timeline & Test Stages - Connectivity, Structured, Unstructured, Parallel Operations 10:00 12:00 Connectivity Testing 12:00 12:30 LUNCH 12:30 02:30 TCR Testing 02:30 03:30 Parking Lot and Next Steps Optional topics if time permits: Brainstorm and prioritize test scenarios Discuss planning for and handling contingencies 5

6 Section 2 MTRG OBJECTIVES AND PROCESS 6

7 Agenda Group Overview (Why, What, Who) Review/Discuss Process (How) Timeline (When) Q&A 7

8 Why? Objectives Successful Market Trials Member engagement Transparency Success of this group means Well planned Market Trials Test Phases Participant understanding support of approach Smoother execution and go-live 8

9 What? Ad hoc group reporting to the CWG Members, vendors, SPP staff coordination Provide input into planning for Market Trials Test Phases Discussion(s) focused on individual Test Phase prior to development of Approach Provide feedback on Market Trials Test Phase Approaches prior to official publishing Meeting logistics TBD Group Scope Statement 9

10 Who? Market Trials Review Group Representatives Jessica Collins, XCEL Terry Gates, AEP Jim Jacoby, AEP Dave Erickson, AEP Tony Delacluyse, PCI Tyler Wolford, TEA Kaneisha Jones, XCEL Andrea Reordan, Tenaska 10

11 How? MTRG Input to Test Phase Approach Test Phase Approach Development (SPP) SPP publishes to MTRG MTRG Review/ Comment SPP Compiles Comments Comment Review/ Reconciliation Meeting SPP Updates Approach SPP publishes to MPs via CWG 11

12 When? MTRG review approach TBD aholbert: I m not sure how to best schedule as cutting time out of development window for approach documents does not seem feasible; may have to have approach review in parallel to publication or provide pseudodraft version for review. PIRG schedule follows this pattern: publish specs to PIRG 1 week for group comment 1 week for SPP compilation and addressing of comments 1-2 weeks for updates per comments before publication of updated version 12

13 When? All dates tentative. To be confirmed in Market Trials Connectivity Approach planning. 13

14 Market Participant Milestones 14

15 Section 3 HIGH LEVEL TIMELINE & TEST STAGES 15

16 High Level Timeline Gantt format 16

17 High Level Timeline Rod Format 17

18 Market Trials Testing Objectives Confirm SPP / Participant systems and business processes are ready to support the Integrated Marketplace by: Validating the technical connectivity for each Participant Exercising each Marketplace business function through a series of controlled tests Allowing SPP and Participants the flexibility to further verify systems and business functionality through a collaborative unstructured test Establishing confidence in the Marketplace systems in what will become the Production environment Allow for cooperative feedback, discussion, and education on the operational performance of Integrated Marketplace 18

19 Market Trials Connectivity Testing Connectivity Testing will verify technical connectivity between SPP and Participants including digital certificates, XML listeners, and firewall access Connectivity Testing will exercise the programmatic interfaces between SPP and the Market Participant as part of functional operations Connectivity Testing will also verify Participant access to the external user interfaces for SPP systems. Some user interfaces may not be available until later in Connectivity Testing Successful completion of Connectivity Testing will provide a measure of both SPP and Participant readiness for Structured Market Trials 19

20 Market Trials Connectivity Testing ICCP testing is considered a separate effort from the Market Trials Connectivity Testing SPP plans to publish the Market Trials Connectivity Test Approach by July 9, 2012 SPP reviews and informational sessions with Participants will start in July 2012 Market Trials Connectivity Testing is scheduled to start on January 7, 2013 All dates tentative. To be confirmed in Market Trials Connectivity Approach planning. 20

21 Market Trials Structured Testing Market Trials Structured Testing will cover both normal business processes and exception scenarios Market Trials Structured Testing will be performed as a controlled scenario test, which means that SPP will provide the test data that is to be submitted by the Participants To ensure that the expected outcomes are achieved, SPP will execute the operational functions central to each test using the test data provided to the Participants 21

22 Market Trials Structured Testing SPP plans to publish the Market Trials Structured / Unstructured Test Approach by December 10, This will be a single Test Approach covering both test phases SPP reviews and informational sessions with Participants will start in January These reviews will include a detailed walk-through of each scenario and associated test data Market Trials Structured Testing is scheduled to start on June 3, 2013 All dates tentative. To be confirmed in Market Trials Connectivity Approach planning. 22

23 Market Trials Unstructured Testing As we validate business functionality through Structured Testing, SPP will enable Participants to further validate each function through the Market Trials Unstructured Testing phase Test data will not be provided by SPP, rather Participants will be able to submit data as desired to exercise and validate various interactions between the Participant and SPP This approach should enable a controlled approach to enabling Participants to interact with broader Marketplace systems leading into Market Trials Parallel Operations 23

24 Market Trials Unstructured Testing SPP plans to publish the Market Trials Structured / Unstructured Test Approach by December 10, This will be a single Test Approach covering both test phases SPP reviews and informational sessions with Participants will start in January 2013 Market Trials Unstructured Testing is scheduled to start on July 8, 2013 All dates tentative. To be confirmed in Market Trials Connectivity Approach planning. 24

25 Market Trials Parallel Operations Test data will not be provided by SPP, rather Participants will be able to submit data as desired to exercise and validate various interactions between the Participant and SPP It is expected that the Market Participants will be submitting production or production like data on a daily basis SPP will support Parallel Operations as if in production, and will be staffed at go-live levels Integrated Deployment Testing, a test within Parallel Operations, will be coordinated across the entire SPP CBA footprint to demonstrate the capability of the Integrated Marketplace to successfully dispatch units, manage congestion, and balance the system 25

26 Market Trials Parallel Operations SPP plans to publish the Market Trials Parallel Operations Test Approach by May 27, 2013 SPP reviews and informational sessions with Participants will start in June 2013 Market Trials Parallel Operations Testing is scheduled to start on November 11, 2013 All dates tentative. To be confirmed in Market Trials Connectivity Approach planning. 26

27 Communications Plan Test Stage Kickoff Teleconference Bi-Weekly Teleconference (frequency to vary by Test Stage) Market Trials Liaison distribution list SPP Market Trials Distribution List Spp.org CWG project folder Communication with individual Market Participants Your Customer Service Rep s and Phonecalls to Market Trials Liaison GlobalScape 27

28 Issue Management MPs will not need to access SPP s Defect Mgmt. Tool Market Participants will submit Issues using a distribution list (do we want one specifically for this purpose?) SPP will triage all Issues and determine the root cause If determined to be a defect, SPP will enter the defect in the Defect Mgmt. Tool (SilkCentral) and prioritize for resolution SPP will maintain a Known Issues spreadsheet Only issues affecting current phase of market trials will be included, the upcoming phase will be added as it approaches New and resolved issues discussed on bi-weekly teleconference 28

29 Section 4 CONNECTIVITY TESTING 29

30 Market Trials Connectivity Testing Connectivity Testing will verify technical connectivity between SPP and Participants including digital certificates, XML listeners, and firewall access Connectivity Testing will exercise the programmatic interfaces between SPP and the Market Participant as part of functional operations Connectivity Testing will also verify Participant access to the external user interfaces for SPP systems. Some user interfaces may not be available until later in Connectivity Testing Successful completion of Connectivity Testing will provide a measure of both SPP and Participant readiness for Structured Market Trials 30

31 High Level Timeline Gantt format 31

32 Connectivity Testing Basics Connectivity Testing will verify technical connectivity between SPP and Participants including digital certificates, XML listeners, and firewall access Marketplace Production environment Security Digital certificates Firewall Static Commercial Model version December 2012 model 32

33 Connectivity Testing Scope of Programmatic Interface Testing Connectivity Testing will exercise the programmatic interfaces between SPP and the Market Participant as part of functional operations All member facing applications Both Inbound and Outbound All programmatic interface types API, FTP, etc. Critical interfaces Business Rule Validation will not be tested* 33

34 Connectivity Testing User Interfaces Connectivity Testing will also verify Participant access to the external user interfaces for SPP systems. Some user interfaces may not be available until later in Connectivity Testing Access to Marketplace UIs only Simple UI Interactions 34

35 Connectivity Testing - Logistics Test Stage Kickoff Teleconference Bi-Weekly Teleconference Testing cadence By Market Participant vs. By Functional Area Programmatic vs. User Interfaces By appointment Tue Thu 8:00 5:00 Mitigation planning Known Defects, Stage Fixes 35

36 Connectivity Testing Readiness Metrics Successful completion of Connectivity Testing will provide a measure of both SPP and Participant readiness for Structured Market Trials Participation of Market Participant Scheduled appointment Executed connectivity tests Confirmation by data point/ UI 36

37 Section 5 TCR TESTING 37

38 Agenda Status update on TCR Workstream TCR Market Trial details Potential Challenges 38

39 Section 5.1 STATUS UPDATE TCR WORKSTREAM 39

40 Current TCR Activities Mock TCR auction Using offline Hedge program 40+ members participating Data interface through GlobalScape Software (i-hedge) testing Three Pre-FAT demos of i-hedge completed 4 th Demo is underway 40

Protocols 1Q 2011 Mock TCR Runs 1 Q 2012 Design/ Customization 2 Q 2012

41 TCR Activities What s Next i-hedge Testing FAT: Scheduled in June 2012 SAT: Scheduled to start in July 2012 Overall TCR Workstream Timeline Market Protocols 1Q 2011 Mock TCR Runs 1 Q 2012 Design/ Customization 2 Q 2012 FAT/SAT/ Testing 3Q -4Q 2012 Market Trial Runs 1Q Q 2013 Ready to Go Live 4 Q

42 Section 5.2 TCR MARKET TRIALS PHASE 1 & 2 42

43 Market Trial : Objective First member facing testing using i-hedge system MUI Portal Interface with Oasis Transfer Tool, CMS and CMT Mimic Production (Go-Live) Plan for first year Periods offered: Phase I : March 1 st, 2014 through May 31 st, 2014 Phase II: June 1 st, 2014 through May 31 st,

Su Mo Tu We Th Fr Sa Su Mo Tu We Th 1 2 3 4 5 1 2 3 6 7 8 9 10 11 12 6 7 8 9 10 13 14 15 16 17 18 19 13 14 15 16 17 Market Trials 20 21 2013 22 23 24 25 26 20 21 22 23 24 Phase 1 27 28 29 Phase 30

6 7 13 14 15 16 17 18 19 10 1311 1412 1513 1614 1715 1816 19 10 11 12 13 14 20 21 22 23 24 25 26 17 2018 2119 2220 2321 2422 2523 26 17 18 19 20 21 27 28 29 30 31 24 2725 2826 2927 3028 31 24 25 26

44 Su Mo Tu We Th Fr Sa Su Mo Tu We Th Market Trials Phase Phase January February January February Su Mo Tu We Th Fr Sa Su SuMoMoTu TuWeWeThThFr FrSa Sa Su Mo Tu We Th February March February March Su Mo Tu We Th Fr Sa Su SuMoMoTu TuWeWeThThFr FrSa Sa Su Mo Tu We Th March 31 March 31 Su Mo Tu We Th Fr Sa Su Mo Tu April We Th Fr Sa April 1 2 Su Mo Tu We Th Fr 1 Sa 2 Su Mo Tu We Th TCR Market Trials Phase 1 Timeline (2013)

45 Phase 1 (Interim) ARR/TCR Objective of this phase is to represent first three months of market (i.e. March 1 st 2014 through May 31 st 2014) March and Spring periods On-peak and off-peak products March and Spring ARR: 100% system capacity March TCR: 100% system capacity Spring TCR: 60% system capacity 45

46 Phase 1 Incremental ARR/Monthly TCR Conducted prior to April and May e.g. process executed in March offers April TCR s On-peak and off-peak products Incremental ARR: 100% system capacity Following Month 2-round TCR o +50% remaining system capacity o 100% system capacity 46

47 June February Su Mo Tu We Th Fr1 Sa2 Su Mo Tu We Th Fr Sa Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa July Su Mo Tu We Th Fr Sa TCR 3 4 Market Trials 9 Phase Timeline (2013) Market Trials Phase Cont April March June May April May Sa Su SuMo MoTuTuWe WeThTh Fr Fr Sa Sa Su Mo Tu Su We Su Mo Th Mo Fr Tu TuSa We We Th Th Fr Fr SaJuly Su Mo Tu We ThAugust Fr Sa Su2 4Mo3 5Tu 4We 6 Th Fr Sa Su Mo 1 Tu2 We3 Th 4Fr Sa Market Trials Phase 2 Cont. May April 30 May Sa Su SuMo Mo June Tu TuWe WeThTh Fr Fr Sa Sa July Su Mo Tu We Th Fr August Sa September 6 Su Mo Tu 1We 2Th 1 3Fr Sa 2 4 3Su 5 4Mo 6 Tu We Th Fr Sa 1 Su 2Mo 3Tu We 4 Th Fr Sa Su Mo Tu We Th Fr Sa May Sa Su Mo Tu We Th Fr Sa July August September Su Mo Tu We Th Fr Sa Su 10 Mo 11 Tu We Th Fr Sa Su Mo Tu We Th Fr Sa August Su Mo Tu We Th Fr Sa September

48 Phase 2 Annual ARR/TCR Objective of this phase is to represent 1 st calendar year for TCR process (i.e. June 1 st 2014 through May 31 st 2015) June, July, August, September, Fall, Winter, Spring 2015 periods On-peak and off-peak products All ARR: 100% system capacity June TCR: 100% System capacity July, August, September: 90% system capacity Fall, Winter, Spring: 60% system capacity 48

49 Phase 2 Incremental ARR/Monthly TCR Conducted prior to each month starting July e.g. process executed in June offers July TCR s On-peak and off-peak products Incremental ARR: 100% system capacity July, August, September TCR: 100% system capacity October TCR o +50% remaining system capacity o 100% system capacity No Monthly TCR auction beyond October

50 Section 5.3 POTENTIAL CHALLENGES 50

51 Potential Challenges: What if Scenarios External system to TCR not completely ready Market Trails begins January 14, 2013 External system expected to be ready on/before Jan 1, 2013 TCR participating members not ready to participate MUI, Portal, TCR Strategy etc. MP participate in TCR market but decides not to participate in Day Ahead Market OR TCR market goes live on October 2013 but the rest of the market delays How to undo awarded TCRs? 51

52 Mak Nagle Manager, Congestion Hedging

53 Section 6 PARKING LOT & NEXT STEPS 53

Published: December 15, 2016 Revised: December 15, 2016

Market Participant Guide: SPP 2017 Congestion Hedging Published: December 15, 2016 Revised: December 15, 2016 Revision History Chart Version Revised By Description of Modifications Revision Date 1.0 Congestion