Detailed Specifications

Transcription

1 Tender No.: PUR/UARC-04/17-18 SASTB Specifications based on 9.2 Detailed Specifications Substation Automation Test Bed (SASTB) This Tender Document shall be used only for the purpose of responding to this tender and cannot be used for any other purpose without written consent from. Page 1 of 31

2 Contents SASTB Specifications based on Introduction Abbreviations Intended uses for the SASTB Standards Conformance Testing Interoperability Testing Substation Automation System Station Level Subsystem General requirements for Station Level Devices Router Station Level Ethernet Switches (Dual Station LAN) Station Level Computer Gateway Human-Machine Interface (HMI) Time Reference Power Supply Bay Level Subsystem General requirements for Bay Level IEDs Bay Control Unit (BCU) Protection Functions to be applied to each part of the substation Specifics of each Bay and Rack Process Level Subsystem General requirements for Process Bus Level Equipment Merging Units Process Level LAN Ethernet Switch Miscellaneous and Spare Parts Signal Generation Test Tools Qualification to bid SCL Editor protocol analysis, Testing Sampled Value inspection testing: WAN Emulator Ethernet Network Taps Redundancy Box (Red Box) Page 2 of 31

3 6.7 Portable Notebook Computers 2Nos Physical Structure Communication Network Network Performance Requirements SNMP Manager Redundancy Requirements Cyber Security Requirements for Substations External Interfaces Cyber Security Requirements for Interfaces with External Systems SCADA Interface SCADA Simulator Time Synchronization Access from Simulated Corporate Network for Miscellaneous Purpose Internal Interfaces Cyber Security Requirements for Interactions with IEDs within Substations Control and Protection Fault Recording Phasor Measurements Time Synchronization Protection Relay Integration Reliability and Availability vs. Flexibility Contracting requirement Feature & Quantities Mapping Functions to Features Figures Figure 3-1 Interoperability Context-Setting Framework, aka GWAC Stack... 5 Figure 4-1: SAS Logical Architecture... 7 Figure 4-2 SAS Physical Arrangement... 7 Figure 4-3 Target circuit for SASTB Substation Design, including Remote Substation... 8 Figure 7-1 Physical 19 rack structure for mounting SASTB equipment Tables Table 2-1 Abbreviations... 5 Table 3-1 SASTB Conformance Testing... 5 Table 13-1 SASTB Features and Quantities Table 14-1 Selection options for each Feature Table 14-2 Function dependency on Features Page 3 of 31

4 Notes: 1. The Substation Automation Test Bed (SASTB) is one of eight Test Beds constituting the Smart Grid Test Bed project. 2. This specification is designed to facilitate the procurement of hardware, software, and services needed to realize the SASTB. 3. The bidder shall provide a detailed list of: i. Hardware, software, equipment, modules, subsystems, and systems; ii. Hardware, software, equipment, modules, subsystems, and system specification and function; and iii. Costs including details design, procurement, construction, and initial operation and testing of all deliverable assets (hardware, software, equipment, control center, etc., technical specifications, including a detailed list of equipment with specifications and functionality; a plan for implementation. iv. Shall design, supply, install, commission/ integrate and provide training at to the satisfaction of the buyer. 4. This facility(sastb) will be of interest to the other work streams such as Distribution Automation (DATB), Communications and Computation (CCTB), and Situational Awareness (SituTB). Thus, wherever required support for integrations with the other streams/setup shall be extended by the successful bidder. 1 Introduction The Substation Automation Test Bed (SASTB) consists of all equipment and devices associated with information flow within the test bed (A write-up on the background of Smart Grid Test Bed Project is given in Annexure 1 for information). In this respect, the SASTB includes Substation Automation System based on the IEC Reference Architecture Simulation software and signal generation needed to drive the SAS functions Instrumentation used to test and verify conformance of SAS devices to relevant standards. This document provides the SASTB specifications. Conceptual Logical and Physical architectures of the Substation Automation System are also presented. 2 Abbreviations CCTB DATB DERTB EVTB HANTB Communications and Computing Test Bed Distribution Automation Test Bed Distributed Energy Resources Test Bed Garage of the Future Test Bed Home Area Network Test Bed HSR High-availability Seamless Redundancy (IEC clause 5) PRP Parallel Redundancy Protocol (IEC clause 4) PSTB Power System Test Bed Page 4 of 31

5 SASTB Substation Automation System Test Bed SituTB Situational Awareness Test Bed SNMP Simple Network Maintenance Protocol SNTP Simple Network Time Protocol Table 2-1 Abbreviations 3 Intended uses for the SASTB 3.1 Standards Conformance Testing The SASTB will be used for the following tests as per IEC standards, performed on IEDs in a test bed setting: (Sampled Values over Ethernet) (time synch per IEEE-1588) (61850 messaging substation to substation) (61850 messaging substation to control center) (routing for GOOSE, SV, and PMU data) client verification (Station Level HMI as Client to Bay Level IEDs) Non-conventional instrument transformer (Optical CT via Merging Units) Clause 4 PRP verification Clause 5 HSR verification (Device level security) ; ; ; ; ; Table 3-1 SASTB Conformance Testing 3.2 Interoperability Testing In addition to conformance testing of the above standards, SASTB will be used to verify Interoperability of multiple vendor devices within the SAS. Interoperability is categorized by the GridWise Architecture Council Interoperability Context Stack (GWAC Stack). The GWAC Stack separates interoperability issues into basic contexts: Figure 3-1 Interoperability Context-Setting Framework, aka GWAC Stack The lower four layers of the GWAC Stack map well to laboratory testing procedures: Basic connectivity deals with connector type, media type, electrical parameters, etc. Page 5 of 31

6 Network IOP addresses the ability of signals to move correctly through the IT network. Syntactic IOP deals with syntax used to form messages and message parts. Semantic Understanding addresses the ability of different devices to make good use of the shared information e.g. understanding the difference between Current and Contact State. Interoperability Testing requires the staging of devices from different vendors and verifying that these devices interoperate in reliable and predictable ways. The SASTB will provide the multivendor IED s, structures and fixtures to facilitate this type of testing. The Substation Automation System Test Bed (SASTB) specification consists of the following four parts: (1) Substation Automation System (SAS) Section 4 - suitable for Protection and Control of the target Sample Circuit with external interfaces for SCADA and Engineering access (Fig 4.1) (2) Signal generation equipment Section 5 - with Hardware in the Loop capability to exercise the SAS with generation of analog and digital signals based on simulation of circuit events (3) Analysis tools Section 6 protocols used to communicate between station components, station-to-station, and station to control center. (4) Physical structure Section 7 - mounting SAS equipment SASTB will interact with the Situational Awareness Test Bed (SASTB), the Distributed Energy Resources Test Bed (DERTB) and the Power Systems Test Bed (PSTB) for evaluation of its performance in selected testing. 4 Substation Automation System The SAS shall be designed as a Distributed Computer-based Control System and shall consist of three interconnected functional entities in accordance with the Reference Architecture: - Station Level HMI, Station Control, SCADA Gateway, PTP Timing, Ethernet switch - Bay Level protection and control of circuit elements by operating Circuit Breakers and motorized switches (MOABs) on the Sample Circuit - Process Level compatible sensors, actuators, and merging units on an Ethernet network. All subsystems shall interoperate via redundant data communication networks to form a unique integrated control and protection system. A conceptual logical architecture is shown in Figure 4-1. Suggested physical architecture is shown in Fig 4-2. All SAS equipment shall be mounted on structurally sound, interconnected 19 relay racks. Organization of equipment shall initially adhere to the Physical Architecture as shown in Fig. 4-2, with the understanding that the SASTB Staff may add or remove components as needed for additional testing activities. A 19 by six foot tall rack on casters shall be provided for the mounting of signal generation and communication test equipment. Page 6 of 31

7 Figure 4-1: SAS Logical Architecture SCADA GOOSE+SV GOOSE GOOSE Cable Raceway GOOSE GOOSE+SV GOOSE+SV Test Equipment Test Equipment Test Equipment Test Equipment Test Equipment Switch HMI Station Computer Gateway Router BCU 1 HMI BPU1 BCU 2 HMI BPU2 BMP 3 HMI BMP 4 HMI Switch Router Gateway BPU-R Switch Process Bus Automation Control MU1 MU N Currents Voltages Relay Test Sets 24 DC NC MU1 NC MU2 Test Rack Rack1 Station Rack2 Bay 1 Rack3 Bay 2 Rack4 Bay 3&4 Rack5 Remote Rack6 Process Bus Amplifier Rack Figure 4-2 SAS Physical Arrangement Page 7 of 31

8 11kV SASTB Specifications based on 9.2 Bus PT 66kV Bus Target Circuit for SASTB MOAB CT CT R M R1 MU R1 MU R2 M R3 IED LP-Remote 21/67/87L Breaker 50BF/25/27 MOAB 29 Remote End IED LP coordinates with local LP for InterStation Protection Remote Substation Line PT 66kV Transmission Incoming 66kV Feeder MOAB Line PT M A1 CT CT A MU A1 MU A2 IED LP 21/50/51/67/87L Breaker 50BF/25/27 MOAB 29 M A3 CT 66kV Bus M B1 MU B1 Bus PT IED BP-HV 87B B CT M B3 MU B2 66/11kV M C1 IED TP 87/50HS/51HS/50LS/ 51LS/50N/51N Breakers 50BF/25/27 MOAB 29 MU C C CT M C3 11kV Bus Bus PT IED BP-MV 87B CT M D1 MU D MU E CT M E1 IED FP 21/67/87L Breaker 50BF/25/27 MOAB 29 D E Local Substation M D3 11kV M E3 11kV Feeder #1 11kV Feeder #2 Figure 4-3 Target circuit for SASTB Substation Design, including Remote Substation 4.1 Station Level Subsystem The Station Level Subsystem shall include One Router per section for connection to the SGTB WAN two compatible Ethernet switches per section providing the Dual Station LAN one substation computer to host Gateway and HMI functions per section Page 8 of 31

9 one Gateway per section bridging the station IEC network to the IEC or DNP3 SCADA interface of the SituTB. Initial testing will be with IEC one HMI workstation per section capable of serving as an Operator or Engineering workstation one GPS synchronized time reference per section for SAS time synchronization General requirements for Station Level Devices Station Level devices provide visibility and control of Bay Level devices and interface the SAS to the outside world through the SCADA Gateway and engineering interface. Station Level IEDs shall provide at least (2) Ethernet ports for redundant connection to the Dual Station LAN. Station Level devices shall act as clients to the Bay Level servers, subscribing to messages published at the Bay Level. Station Level IEDs shall support the IEC and other international standards, particularly following IEC standards: General requirements (electrical and environmental stresses) Publish and subscribe to GOOSE messaging by Ethernet Multicast Subscribe to Sampled Value Streaming by Ethernet Multicast Time synch per IEEE Inter-substation GOOSE messaging publication and subscription Station to control center GOOSE messaging publication and subscription Routing of GOOSE messages, SV streams, and synchrophasor streams outside of the Local Area Network Support for Device Level Security including user authentication, multiple user roles, user role based functional authorization, and protected firmware revision support for HSR network loops and PRP on dual station and process LAN ; ; ; ; ; Router SASTB shall support the testing of extensions to IEC that allow communication from the SAS substation to other substations for several protection and control functions ( ), and to the utility control center for supervisory actions ( ). To facilitate these tests, SASTB and SituTB will create a simulated Wide Area Network (SMGT WAN) with Control Center, SAS Substation, and a simplified Remote Substation. The SAS Station Level router enables the connection of the SAS to the simulated WAN. The WAN shall be extendable by joining additional routers and equipment in this and other Smart Grid Test Beds to the WAN. Router shall support the limiting of throughput to simulate realistic utility WAN capacity to substations. Symmetrical limited throughput shall be selectable. Router Specification: Adhere to requirements in section IEEE1613 / IEC compliant 230VAC 50 Hz power 4 Ethernet ports Intrusion Detection capability Page 9 of 31

10 Single T1/E1 interface SNMP Management version 2c and version 3 Web-based and/or CLI (SSH) management Syslog Logging IEC /IEEE 1588 PTP compliant Station Level Ethernet Switches (Dual Station LAN) The Station Level shall provide redundant Ethernet networks supporting IEC Clause 4 Parallel Redundancy Protocol (PRP) and Clause 5 High availability Seamless Recovery (HSR). Each device operating in the Station Level shall support dual Ethernet connection to the Dual Station LAN. Bay Level Devices shall likewise be redundantly connected to the Dual Station LAN, providing redundant connection of Station Level devices to Bay Level devices. See Fig 4-1 for the logical connection of Station Level and Bay Level equipment to the Dual Station LAN. Switch Specification: (2) required at Station Level (2) Required Adhere to requirements in section IEEE1613 / IEC compliant 12 Small Form Factor Pluggable (SFP) ports for connection of all Bay Level and Station Level devices 230 VAC 50 Hz powerieee 1588v2 capable Rapid Spanning Tree Protocol (RSTP) - IEEE 802.1d-2004 VLAN aware - IEEE 802.1q 2005 Multicast filtering Static and IGMP Snooping SNMP Management version 2c and version 3 Web-based and/or CLI (SSH) management Syslog Logging IEC , IEEE 1588v2 PTP time keeping Station Level Computer The Station Level Computer is a hardened rack mount computer that hosts several station level functions including: Gateway between SCADA and Station networks Human Machine Interface (HMI) providing a one-line view of the overall station and station control capabilities Station configuration creating, editing, serving the System Configuration Language (SCL) files used to configure the station IEDs. Station Level Computer Specification: Adhere to requirements in section Hardened computing platform for 19 substation rack mount Fanless operation IEC compatible Windows 7 Professional or Windows 10 Pro 64 bit operating system Page 10 of 31

11 Multicore processor 2GHz or higher 8GB RAM or higher Hot swap RAID spinning disk 1TB (4) USB 2.0 ports PCI or PCI Express expansion slots (4) Ethernet ports (2 needed for Dual Station LAN connection) (2) EIA-232 asynchronous serial ports Time synchronization to 1 microsecond using IRIB-B or IEEE1588 PTP time synchronization Battery backed Real time clock 19 Rack Mount touch-screen monitor 230 VAC 50Hz power supply Gateway The Substation Level shall include the SCADA interface consisting of a Gateway connection through the SGTB WAN to the Situational Awareness Test Bed SCADA Control Center. The Gateway shall be realized as Windows 10 software running on the Station Level Computer (section 4.1.4). Gateway will translate SCADA Protocol commands and responses to communicate with SAS devices using IEC Gateway Specification: Adhere to requirements in section Runs on Windows 7 Professional Substation Level Computer hardware (section 4.1.4) to IEC protocol conversion per IEC TS : to DNP3 protocol conversion per IEEE IEC Client File Services IEC Server capable IEC GOOSE support Human-Machine Interface (HMI) HMI shall be realized as software running on the Station Level Computer. The HMI shall provide a graphical representation (single-line diagram) of the SAS Substation equipment by acting as a Client to the various Bay Level server equipment. The HMI shall allow operator interaction with the SAS in a view-only mode. The Station Level HMI computer shall also act as a Front-end Server (the Station Controller). HMI shall be interconnected via dual port Ethernet connections to the redundant Ethernet-based Dual Station LAN (Figure 4-1, Dual Station LAN). The Station Controller shall provide a real-time Control and Monitoring capability for the entire Substation. This shall include the capability to control Circuit Breakers, Isolation MOABs, and any controllable substation devices. HMI Specification: Adhere to requirements in section Runs on Windows 7 Professional Substation Level Computer hardware (section 4.1.3) Configuration software to create the station one-line client to Bay Level server equipment Graphical display of station equipment in one-line diagram Page 11 of 31

12 Redundant Ethernet connection to Dual Station LAN control of SAS components limited by User Role (Visible/Control/Configure) Time Reference The Station Level Subsystem shall provide the time master functionality. The time master shall be a GPS-based Stratum 1 server and shall provide the time synchronisation capabilities as specified below. Time Reference Specification: GPS synchronized GPS antenna with 50ft cable 230 VAC 50 Hz power compatible compliant IEEE1588 compliant PTP support 1 PPS output IRIG-B Output +/-1 microsecond (4) 100BaseT Ethernet ports Power Supply The SGTB building will include an uninterruptible 230VAC 50Hz supply (Building UPS). All devices on the SAS shall be specified to operate from building 230VAC 50Hz power. 4.2 Bay Level Subsystem The Bay Level Subsystem shall consist of the following microprocessor-based equipment: It may be noted that all the IED s supplied shall be tested for IEC conformance from a Level A UCA accredited test lab and certificate for the same shall be provided. Also, IED s from alteast 4 different makes (OEM s) shall be used which also demonstrates interoperability. - Bay Control Unit (BCU) dedicated to operation of bay circuit breakers and isolation MOABs, with an embedded Bay HMI - 66kV Primary and Secondary protection devices (BPU) - 11kV Bay Management and Protection (BMP) devices that provide combined protection and control functions, with an embedded Bay HMI - 11kV Backup protection devices - Non-bay related I/O devices as an interface to station common services The BCUs, BPUs, BMPs, and other I/O from a functional point of view, shall operate as Servers for the Station Level Client equipment. Each BCU and BMP shall be equipped with a local HMI enabling their use as independent bay level workstations, HMI with Bay one-line, with all operational interlocks. Page 12 of 31

13 4.2.1 General requirements for Bay Level IEDs Bay Level devices connect to both the Dual Station LAN to serve to the Station Level devices, and Process Bus LAN to receive Sampled Value Streams from Process Bus Merging Units. Bay Level IEDs shall provide at least (4) Ethernet ports for redundant connection to both the Dual Station LAN and the Dual Process Bus LAN. Bay Level IEDs shall support the IEC and other international standards, particularly the following IEC Standards: General requirements (electrical and environmental stresses) Publish and subscribe to GOOSE messaging by Ethernet Multicast Subscribe to Sampled Value Streaming by Ethernet Multicast Time synch per IEEE Inter-substation GOOSE messaging publication and subscription station to control center GOOSE messaging publication and subscription Routing of GOOSE messages, SV streams, and synchrophasor streams outside of the Local Area Network Support for Device Level Security including user authentication, multiple user roles, user role based functional authorization, and protected firmware revision support PRP and HSR on dual station LAN and dual process bus LAN ; ; ; ; ; Bay Control Unit (BCU) Bay Control Units shall adhere to the requirements of section An exception to the (4) Ethernet Port requirement, accepting only (2) Ethernet Ports, may be met with suitable Redundancy appliances (Red Box) to duplicate the Ethernet connections to the Station and Process Bus LANs. Bay Control Unit shall manage the operation of the MOABs and Circuit Breakers in each high voltage bay. Interlocks shall be applied to prevent unsafe operation of any circuit switch. Bay Control Unit shall provide a smaller touch screen display and user interface buttons for display of the Bay single line diagram, and for operation of the devices under control of the BCU. Operation of switches shall be classified Protection Function Protection Functions to be applied to each part of the substation Bay Protection Units (BPU) and Bay Management and Protection (BMP) devices shall adhere to the requirements of section An exception to the (4) Ethernet Port requirement, accepting only (2) Ethernet Ports, may be met with suitable Redundancy appliances (Red Box) to duplicate the Ethernet connections to the Station and Process Bus LANs. High voltage protection applies to 66kV line and 66kV bus. Medium Voltage protection applies to the 11kV bus and 11kV Feeders. Transformer protection applies to the 66/11kV transformer. All protection device are required to be compatible; support time synch; support Sample Values input from Merging Units 66kV Line protection (Local and Remote stations) Distance (21L) Synch Check (25) Page 13 of 31

14 Undervoltage (27) Breaker Failure (50BF) Overcurrent (50L/51L) (Instantaneous/Time Overcurrent) Overvoltage (59) Directional Overcurrent (67L) Reclosing (79) Direction Comparison Blocking (test of station-to-station) 66kV Bus protection Bus differential (87B) Breaker Failure (50BF) 66/11kV transformer protection Synch Check (25) Overcurrent High Side (50HS/51HS) Overcurrent Low Side (50LS/51LS) Overcurrent Neutral (50N/51N) Breaker Failure (50BF) XFMR Differential (87T) SASTB Specifications based on kV Bus protection Using Reverse Blocking Scheme in the transformer protection device. 11kV Feeder Protection Overcurrent (50/51) Breaker Failure (50BF) Specifics of each Bay and Rack Bay 1 in Rack 2 will house: Bay Control Unit (BCU1) o Bay 1 HMI o 66kV CB o (2) 66kV isolation MOABs Bay Protection Unit (BPU1) o 66kV Line protection Bay 2 in Rack 3 will house: Bay Control Unit (BCU2) o Bay 2 HMI o 11kV MOAB Control Bay Protection Unit (BPU2) o 66/11kV Transformer Protection o 11kV Bus Protection (Reverse Blocking Scheme) Bay 3 in Rack 4 will house: Bay3 Management and Protection Unit (BMP3) o Bay 3 HMI o 11kV Feeder #1 Protection o 11kV Feeder #1 isolation MOABs Page 14 of 31

15 Bay 4 in Rack 4 will house: Bay4 Management and Protection Unit (BMP4) o Bay 4 HMI o 11kV Feeder #2 Protection o 11kV Feeder #2 MOABs SASTB Specifications based on Remote Station in Rack 5 Representing a simplified remote substation on the far end of the 66kV incoming line o Router to access SCADA WAN per sec o Station Level Layer 2/3 Ethernet Switch 8 port SFP o Process Level switch for MU to IED 8 port SFP o 61850/ SCADA Gateway per o BPU-R remote compatible transmission line protection o Remote Station Computer per Process Level Subsystem The process level subsystem consists of Merging units that serve as interfaces to the conventional and non-conventional CTs and VTs. Dual Process Level LAN Ethernet switches providing the Dual Process LAN General requirements for Process Bus Level Equipment Process Bus Level equipment provides an interface from SAS to the real world of analog voltages and currents, as well as input and output interfaces to substation switchgear. SAS design shall take full advantage of compliant Merging Units to realize those real-world interfaces. Process Bus Level equipment shall provide at least (2) Ethernet ports for redundant connection to the Dual Process Bus LAN. Process Bus Level equipment shall support IEC and other international standards, particularly the following IEC Standards: General requirements (electrical and environmental stresses) Publish and subscribe to GOOSE messaging by Ethernet Multicast Publish Sampled Value Streams by Ethernet Multicast Time synch per IEEE Inter-substation GOOSE and SV Stream publication station to control center GOOSE and SV Stream publication Routing of GOOSE messages and SV streams outside of the Local Area Network Support for Device Level Security including user authentication, multiple user roles, user role based functional authorization, and protected firmware revision support PRP and HSR on dual Process Bus LAN ; ; ; ; ; Page 15 of 31

16 4.3.2 Merging Units Merging Units digitize analog voltage and current signals at their source, at a defined conversion rate of 80 or 256 samples (per IEC LE) per power system cycle, and share those signals by steaming time synchronized Sampled Values of those signals through the SAS Process Bus Ethernet LAN, as defined in IEC Protection and Control devices at the Bay Level of the SAS subscribe to these streams, providing a single source of synchronized digitized waveform data for the several P&C devices that need that information. IEC Merging units reduce the length of runs of heavy current carrying cables, the isolation requirements of voltage cables, and eliminate the need for accurate analog conversion circuits in multiple devices in the SAS. Merging units are available in different configurations. Some offer combined (4) current AND (4) voltage input; others are limited to either (4) current OR (4) voltage inputs. Some units may have additional current or voltage inputs, or relay or transistorized digital I/O. A mix of vendor offerings is desirable for Interoperability testing in the SASTB. Non-conventional (optical) merging units are also to be integrated to SASTB. The target power system circuit (Fig 4.3) requires measurement of (9) 3-phase CTs, (3) 3-phase bus PTs, and (2) 1-phase line PTs (66kV line PT on each end of line for synchcheck). If the Remote Station is simplified to conventional analog IED measurement, that reduces to (7) CTs, (2) bus PTs, and (1) 1- phase line PT. SAS local station requires measurement of (7) CT, (2) PT, with the 1-phase 66kV line PT brought to the 4 th voltage input of the 66kV bus potential MU. Merging Unit Specifications: require (4) Combined CT+PT (66kV), (3) CT (11kV), (1) VT (66kV) Adherence to the requirements of section Sampled value Ethernet telegram per LE Sample rate: 80 samples per cycle on each input Time synchronization per IEC , or 1PPS Redundancy: per IEC PRP and HSR System frequency: 50 Hz Operating range: Hz Current input (4 channels) o Nominal CT current: 1A or 5A o Measurement range: up to 40 times nominal o Burden at nominal current: <0.1A o Error at nominal current: <0.5%, <10 arc-minute o Neutral Current: configurable Measured OR Calculated Voltage Input (4 channels) o Input range: VDC o Rated voltage: settable 24, 48, 110, 125 VAC 50 Hz o Error: <0.5% FS o Neutral Voltage: configurable Measured OR Calculated Power supply: 230VAC 50Hz (DIN rail power supply if required) Process Bus Interface: Ethernet 100Base-TX copper OR 100Base-FX Fiber optic SFP Configuration interface: USB 2.0, Ethernet, or RS232 Serial Page 16 of 31

17 Non-Conventional Instrument Transformer plus Merging Unit Specification: Flexible or Fixed optical CT 1A to 4800A dynamic range LE Sampled Value compliant merging unit SASTB Specifications based on Process Level LAN Ethernet Switch The Process Level LAN will integrate the Process Level Merging Units and the Bay Level protection and control device. There are (2) switches required, each one supporting one of the Process LANs. Specification: (2) Required o Adherence to the requirements of section o IEEE1613 / IEC compliant (electrical and environmental stresses) o 24 Small Form Factor Pluggable (SFP) ports for connection of all Bay Level and Process Level devices. o 230VAC 50Hz power supply o IEEE 1588v2 capable o Rapid Spanning Tree Protocol (RSTP) - IEEE 802.1d-2004 o VLAN aware - IEEE 802.1q 2005 o Multicast filtering capable o SNMP Management version 2c and version 3 o Web-based and/or CLI (SSH) management o Syslog Logging 4.4 Miscellaneous and Spare Parts Ethernet cabling (20) 100Base-TX (RJ45) and (50) 100Base-FX (Dual LC), 10 to 25 long Ethernet adapters (50) each SFP for FX (fiber optic) and TX (copper) network cable terminations (4) 230VAC surge protected power strips (1000) OR M6 pan head rack screws for 19 rack mounts 5 Signal Generation IEC testing requires the excitation of the devices under test, and capture of their responses using GOOSE and SV message capture and analysis. Relays can be exercised using Relay Test Sets, and the addition of simulation software to the test set permits more complex interactions to be analysed. Signal Generation requirements depend on the extent of excitation of the SAS required for the listed set of tests. (6) current and (4) voltage analog outputs can excite each individual protection bay. Additional synchronized analog or sampled value (merging units modelled in a simulator and injected into the SAS Process Bus LAN) can expose more complex interactions. The existing RTDS or Opal-RT simulators at might be used if a network configuration would allow the extension of the Process Bus LAN to the Power Systems Lab (another building on the Bangalore campus). Without that network extension, simulation tools local to the SASTB are recommended. Page 17 of 31

18 Signal generation specification: Signal Generator Programmable by connected Windows laptop computer Hardware In Loop capability COMTRADE playback Test scripting Time synchronization per (IEEE 1588 PTP) (6) current channels with 32 amp capacity, error <1% (4) voltage channels with 300 VAC phase-ground, error<1% (10) digital input (4) digital output relay 300 VAC 8 amp (4) open collector transistorized output SASTB Specifications based on 9.2 (10) analog input 300 VAC, minimum sample rate 80 samples/cycle, overload protection Transient triggering at configured threshold voltage Programmable simulation of 20 or more buses o Simulation of 50 or 60 Hz power system signals o Simulation of (3) 4-channel voltage and 4-channel current Merging Units to Ethernet per LE Sampled Values o Sampled Value streams on (2) Ethernet ports to SAS dual Process Bus LAN o Generation of (>=32) GOOSE event messages from simulation o Subscription to (>=32) GOOSE messages from Device Under Test This minimum configuration will allow the testing of each bay protection function, with the generation of device-to-device GOOSE messages, simulated LE Sampled Values at 80 samples per cycle, and the excitation of physical merging units driving sampled values. This Signal Generator will allow the protection functions related to remote and local protection functions as well as local line, bus, transformer, and 11kV feeder faults. Simulation within the Signal Generator platform will provide standard models for typical power system equipment, allowing the modelling of 20 or more buses for HIL testing of individual SAS protection functions. 6 Test Tools Qualification to bid Vendors of test tools for standards conformance testing of substation equipment shall: provide documentation of the application of their tools for the intended purpose at a minimum of One(1) commercial accredited conformance testing laboratories. quote on-site training in the use of their tools for a minimum of Five (5) staff members at the facilities in Bangalore, India. This quote shall include a reasonable number of days to absorb the information and the total cost of training, including travel and expenses for the training staff. guarantee availability of test tool maintenance and updates for a period not less than 5 years from the date of delivery as per the latest versions of the test procedures/ standards/ customer requirements/ etc. Accreditation of the test tool to any of the accreditation body/ User Group/ Alliances are to be supported by the supplier/bidder for getting the test facility accredited to the respective agencies. Page 18 of 31

19 6.1 SCL Editor Substation Configuration Language (SCL) is used to configure the devices in the substation to operate and interoperate in a well-defined way. A Substation Configuration tool will create and maintain files with information needed by the devices in the SAS, including: IED Capability Description (ICD) file System Specification Description (SSD) file Substation Configuration Description (SCD) file Configured IED Description (CID) file Instantiated IED Description (IID) file System Exchange Description (SED) file SCL Editor shall conform to the qualification to bid requirements protocol analysis, Testing testing tools shall conform to the qualification to bid requirements and provide the following features: Testing in accordance with UCA specification Scripted testing with results report Executable on Windows laptop Use available network taps as needed Conformance testing o client o server o GOOSE Publication o GOOSE Subscription o Sampled Value Stream Publication o Sampled Value Stream Subscription o Messaging from substation to substation o Messaging from substation to control center 6.3 Sampled Value inspection testing: Sampled Value testing tools shall conform to the qualification to bid requirements and provide the following features: Support observation of LE Sampled Value Streams Display multiple waveforms simultaneously Compute standard values such as RMS, Frequency, and Phase Angle of waveforms Output captured SV streams in COMTRADE format Support IEEE 1588 Precision Time Protocol 6.4 WAN Emulator Control the performance of the SCADA/SAS/Remote Network performance inject traffic, delay, jitter, and bit error rate Specifications: Page 19 of 31

20 10/100/1000 Mbps network IEEE 802.3, IP, TCP, UDP, 802.1Q Ethernet filtering IP filtering Jitter injection Traffic loss Error injection 8 concurrent traffic flow QoS SASTB Specifications based on Ethernet Network Taps Inspection of traffic during PRP and HSR testing. Ethernet Taps allow the observation of traffic flow without interrupting the flow. Recommend (2) Copper and (2) LC Fiber: (2) LC Fiber network taps (2) RJ45 Copper network taps LC/RJ45 link, or USB to Windows analysis computer 19 rack mount kit 230VAC 50Hz power input or USB powered 6.6 Redundancy Box (Red Box) converting (1) Ethernet port (SAN) to (2) redundant ports. Red Box can function as an HSR appliance and as PRP connection for SAN single-port devices. Recommended (4): IEC compliant IEC (PRP and HSR) compliant PRP and HSR coupling IEEE 1588 Precision Time Protocol (PTP) support 230VAC 50Hz power SFP ports for fiber or copper connection 6.7 Portable Notebook Computers 2Nos. Intel i7 processor or better Windows 7 professional or Windows 10 Pro 10 hour battery life 16 GB RAM 1TB SSD drive 14 or larger outdoor-readable touch display (1) HDMI output (2) USB 3.0 (2) Ethernet ports (may be via USB adapter) WiFi n Bluetooth Physical Structure SAS and Remote Station hardware shall be mounted in 19-inch two-post relay racks. The structure shall consist of six (6) 19 racks a minimum of 45 units (84, 2.133m) tall, connected side-by-side. Page 20 of 31

21 Racks will be solidly attached to the floor, and will include a 1 meter long arm from the top of the rack to a wall behind the rack for additional stability. An additional (seventh) 19 x 45U two-post rack on casters will be used to mount test equipment. The test equipment rack will be suitably stable to allow rolling movement of the rack without risk of tipping over. Rack Specification: Total (8) racks 19 2-post relay rack OR M6 threaded holes Black finish Formed steel OR Extruded aluminum construction 1000 lbs (455 kg) weight capacity Base dimension approximately 20 x14 Top cross member width 6 Outside dimension approximately 20 Threaded hole spacing (465mm) Inside clearance (452mm) Concrete floor installation kit Rack Accessories (qty 1000) compatible rack screws (qty 4) 3U 2-post shelf (qty 6) Horizontal Cable Raceway (qty 20) side-to-side rack joining hardware (qty 2) rack caster sets for mobility of (2) racks (qty 8) 20 amp rack mount AC surge suppression power strip, individually switched universal power socket Cable Raceway 84" (45U) Rack 8 Amplifiers Rack 7 Test Equip Rack1 Station Rack2 Bay 1 Rack3 Bay 2 Rack4 Bay 3&4 Rack5 Remote Rack6 Process Bus 19" x 45U Rack structure for SASTB equipment mount. NTS - Color only denotes intended use all racks are black. Attach racks 1 to 6 side-by-side. Racks 7 and 8 are on casters for mobility. Figure 7-1 Physical 19 rack structure for mounting SASTB equipment Page 21 of 31

22 8 Communication Network SASTB Specifications based on 9.2 Communications within the substation shall comply with the IEC standard. Conceptually, the network for communications can be decomposed into the following elements: - Dual Station LAN integrating Station Level and Bay Level equipment - Dual Process bus LAN to connect the bay level equipment with merging units serving as interfaces to conventional and non-conventional CTs and VTs. - Interface between the SAS and a non SCADA system. It is the responsibility of the SAS Builder to define the overall physical topology of the communication network in such a way that it fully complies with all SAS functional requirements. 8.1 Network Performance Requirements The Station LAN and the SituTB WAN connections shall be 100/1000 Mbps Ethernet. The performance of the overall network architecture shall be such that the critical clearing time requirements for various protection functions are guaranteed under all network loading conditions. The network performance shall be completely predictable for operational behaviour. For peer-topeer in-station communication (GOOSE, Sampled Value streaming), an end-to-end delay of not more than 3ms shall be guaranteed. Fiber optic cabling shall be used in the Station and Process networks. Panel Contractor (or if self-assembling) shall provide all required fiber optic cables, with a set of spare fiber optic cables sufficient to connect two additional IEDs to each Bay. 8.2 SNMP Manager All SAS network components shall include an SNMPv3 Agent for device management by an SNMP Manager. SASTB shall include an SNMPv3 management system installed on the SAS Station Computer. Additional SNMP Managers may be installed on the SASTB Portable Computers. Several SNMP Managers are available at no or low cost for a system as small as SASTB. SNMP Manager shall Automatically detect network devices Map network topology Monitor for events (faults, availability, and performance) of network devices Send event alerts via console display and Sequentially timestamp log entries Provide search capability through system logs Concurrently manage a minimum of 50 network devices Run on the Windows 7 or Windows 10 station and portable computers 8.3 Redundancy Requirements The Station LAN shall be redundant with all Station and Process Bus devices being dual-ported, and all Bay Level devices quad-ported for connection to both Dual Station LAN and Dual Process Bus LAN. The Station LAN shall be redundant to ensure that there is no single-point of failure and no loss of data. It shall also ensure reliability in 24x7 real-time applications under substation automation with zero network recovery time for all protection functions.the redundancy of the Station LAN shall be Page 22 of 31

23 based on IEC PRP or HSR as applicable to fulfill the requirements on reliability. Both methods will be subject to conformance testing. The maximum number of IEDs connected to each switch shall be limited to meet the reliability, redundancy, and performance requirements in this Specification. Devices connected to the Dual Station LAN shall have dual Ethernet connections to avoid any network single- point of failure. Ethernet ports are to be SFP to accept Fiber or Copper adapters. The Dual Station LAN as well as the Dual Process Bus LAN shall be independent. Bay level IEDs that include control capability shall be redundantly connected to Station LAN and to the Process LAN to avoid any network single-point of failure. Depending on the protection scheme requirements, protection devices at the Bay Level shall be redundantly connected to both Dual Station LAN and Dual Process Bus LAN. 8.4 Cyber Security Requirements for Substations Substations shall be designed with a secure electronic perimeter placed around all substation systems, such that no direct access is provided to external users or software applications. Access by users and by applications to all substation systems, whether within the substation or via external systems in the Control Center, shall be managed through Role-Based Access Control as defined in IEC , in conjunction with the Areas of Responsibility that are supported by the EMS/DMS systems. Two-factor authentication, such as locked doors plus password, or electronic token plus password, shall be used for access by users to critical systems. Within the substation, the role based access control can be handled globally by the station HMI where the user logs in and does not need to be handled individually by each IED. The exchange of any information between systems shall include authentication of BOTH the source and the receiver. Transport Layer communications (OSI Layers 1-4) shall include cyber security protocols such as IPsec, Transport Layer Security (TLS) per IEC , Virtual Private Networks (VPNs), or other secure transport measures. For communications within or between substations that use the IEC protocol, the IEC , IEC , and IEC requirements shall be met. For communications using IEC , the IEC standard that references IEC and IEC shall be met. Cryptographic key management shall be provided based on IEC requirements. Alternatively, Public Key Infrastructure (PKI) may be used for key management. Compliance with the cyber security recommendations in IEEE 1686 is required, including user ID and password control, testing for adequate password strength, provision of audit capabilities for alarms and events, monitoring of security-related activities, appropriate cryptographic technologies, and IED configuration management. 9 External Interfaces The following external interfaces to the SAS shall be available: - SCADA interface - Time synchronization interface Page 23 of 31

24 - Access interface (from simulated corporate network for miscellaneous purposes) - Protection signaling interface - Process interface SASTB Specifications based on 9.2 The following clauses highlight some of the requirements associated with these interfaces. 9.1 Cyber Security Requirements for Interfaces with External Systems For an overview on security requirements, see section 8.3. The connection to the external telecommunications network for SCADA shall be a VPN connection through a router and firewall. No direct access from the external telecommunications network to the local communications networks of the SAS shall be possible. All telecommunications networks will have their health and status monitored and controlled through Simple Network Management Protocol (SNMP). 9.2 SCADA Interface Dedicated communication interface from SAS to the Situational Awareness Test Bed SCADA/EMS/DMS system shall be provided by the SAS Station Level SCADA Gateway. The communication protocol between the SASTB Station Level Gateway and SituTB SCADA Control Center shall be based on the latest IEC standard. The IEC interoperability specification of the provided SASTB Gateway shall comply with the implementation at the SituTB SCADA System. The SAS Panel Contractor (or if self-assembly of the SAS) shall take full responsibility for ensuring such compliance and, as necessary, shall work in close co-ordination with the SituTB SCADA system supplier regarding all required interoperability and redundancy handling issues to the satisfaction of. The SAS Panel Contractor (or ) shall take full responsibility for all protocol licensing required. All real-time information as per the approved SAS and SCADA I/O signal list (part of the required tele-information plan) shall be acquired by the SAS Gateways from the SAS Bay Control Units, protection relays, and other IEDs and transmitted to the SituTB SCADA System. Similarly, all output data (control signals) received from the SituTB SACADA System via the Gateway shall be transferred to the relevant SAS Bay Control Units using IEC translation. The Gateway mapping between IEC and IEC shall be according to IEC SCADA Simulator In order to exercise the SAS when the SituTB SCADA system is unavailable, SASTB shall include a software test set capable of simulating the SCADA Interface. The SCADA Simulator shall: Run on an SAS portable Windows computer Simulate the SCADA system as IEC Master to the SAS -104 SCADA port over the SituTB WAN Support periodic polling of and unsolicited messaging from SAS Support SCADA commands to SAS Display SCADA values Log activity between SCADA and SAS. Page 24 of 31

25 9.3 Time Synchronization Time synchronization shall be provided to the SAS using one Stratum 1 server with GPS receiver as described in section above. 9.4 Access from Simulated Corporate Network for Miscellaneous Purpose The access from the simulated corporate network for miscellaneous purposes shall follow the cyber security requirements stated in section 8.3. For TCP/IP based communication, IEC shall be applied. Additionally, all servers with access from external networks shall be located in a separate part of the SAS LAN known as the De-Militarized Zone (DMZ). The DMZ servers shall be redundantly connected to the SAS Station network via Firewalls. Dedicated authentication servers shall be located within the DMZ LAN for access from simulated engineering networks in order to facilitate SAS monitoring (view only mode), file transfers, configuration of the SAS and IEDs, and system diagnostic procedures. The functionality of the remote access facility including its security features shall be validated to s full satisfaction. The following systems may require access from the corporate network other than through the SCADA gateway: - Protection Relay Integration (PRI) system allowing remote access to all relays from a dedicated PC located in the simulated corporate network in the SituTB. - Maintenance access to the individual devices - Remote monitoring of individual information available in the SAS Station Level HMI - Remote engineering (e.g., parameter change) - File transfer (e.g., SOE archives, alarm archives) 10 Internal Interfaces The following internal interfaces shall be provided: - Control and protection interface - Fault recording interface - Protection signaling interface - Time synchronization interface - Protection Relay Integration(PRI) interface - Engineering interface Some associated requirements are presented in the following sub-clauses. Also refer to the Protection System specifications Cyber Security Requirements for Interactions with IEDs within Substations For an overview on security requirements, see Clause 8.4. All telecommunications networks shall have their health and status monitored and controlled through network management systems. These shall use the Simple Network Management Protocol (SNMP). Additional monitoring of the health and status of IEDs shall meet the applicable requirements in IEC (currently being updated to include mapping to SNMP). Page 25 of 31

26 10.2 Control and Protection All communication related to control and protection shall support the latest edition and revisions of IEC with the mapping defined in IEC The devices of the Bay Level Subsystem are IEC servers; the devices of the Station Level Subsystem are IEC clients. Real-time data transmission from bay units to the station controller and gateway shall be event driven, using IEC buffered reporting. For analogue signals, both cyclic as well as dead-band calculation based event driven trigger options shall be supported. For controls from station HMI as well from remote SCADA, select before operate with enhanced security according to IEC shall be applied. Communication between devices of the Bay Level Subsystem shall be by IEC GOOSE messages. Priority tagging shall be supported by all communication equipment. The priorities to be used shall be the default priorities as proposed in IEC : - Priority 4 for GOOSE messages - Priority 0 for all the other messages IEC communication requires several parameters for the different protocol layers (e.g., AE Qualifier, Presentation Selector, etc.). If an IED acting as an IEC server has any optional parameters predefined and fixed but is still conforming to IEC 61850, the client IED must provide the flexibility to guarantee that the communication can be established. Communication of digitized voltage and current waveform data to Bay Level IEDs shall be per IEC compliant Merging Units on the Dual Process Bus LAN Fault Recording A dedicated Fault collecting PC will NOT be implemented in the initial SASTB. Storage of oscillography and sequence of events will be within the IEDs Phasor Measurements The Smart Grid Test Beds will not implement synchrophasor measurements or collection. However, also supports routed GOOSE messaging and SV streams. While synchrophasor is out of scope, for R-GOOSE will be viable testing at SASTB Time Synchronization One time master shall be provided with the SAS. It shall be synchronized by a GPS receiver (refer to Clause 9.3). The distribution of accurate time within the substation shall use the following protocols: - IEDs implementing IEC process bus applications requiring synchronization shall have an accuracy equal to or better than 1 µs and shall be synchronized according to Precision time protocol profile for power utility automation - For all other IEDs, an accuracy of ±1ms shall be achieved at the IED using SNTP as described in IEC Page 26 of 31