Chanan Singh Texas A&M University PSERC Webinar November 22, 2016

Similar documents
Reliability Assessment and Modeling of Cyber Enabled Power Systems with Renewable Sources and Energy Storage

Reliability Considerations in Cyber-Power Dependent Systems

An Integrative Approach to Reliability Analysis of an IEC Digital Substation

COMPOSITE SYSTEM BASED MULTI-AREA RELIABILITY EVALUATIO

Upgrading From a Successful Emergency Control System to a Complete WAMPAC System for Georgian State Energy System

Influence of Route Choice Behavior on Vulnerability to Cascading Failure in Transportation Networks

Requests for Clarifications And Responses Order No. 754 Data Request The Study of Single Point of Failure

Distributed Detection in Sensor Networks: Connectivity Graph and Small World Networks

Dmitry Ishchenko/Reynaldo Nuqui/Steve Kunsman, September 21, 2016 Collaborative Defense of Transmission and Distribution Protection & Control Devices

Similar Polygons Date: Per:

Data Exchange Design and A Textured State Estimation Algorithm For Distributed Multi-Utility Operations In Electric Power Market.

Call for Papers GCC POWER 2011 GCC Cigre s Leading Electric Power Conference & Exhibition In the Gulf Region

Chapter 2 State Estimation and Visualization

False Analog Data Injection Attack Towards Topology Errors: Formulation and Feasibility Analysis

PRC Coordination of Protection Systems for Performance During Faults

An adaptive limited wide area differential protection for power grid with microsources

POWER SYSTEM RELIABILITY ASSESSMENT CONSIDERING NON-EXPONENTIAL DISTRIBUTIONS AND RESTORATIVE ACTIONS. Gwang Won Kim a and Kwang Y.

Standard Development Timeline

Cyber Security of Power Grids

Standard Development Timeline

Minnesota Hosting Capacity Analysis

Semantic Security Analysis of SCADA Networks to Detect Malicious Control Commands in Power Grids

Automated Analysis of Digital Relay Data Based on Expert System

MODELING OF SMART GRID TRAFFICS USING NON- PREEMPTIVE PRIORITY QUEUES

Ali Abur Northeastern University Department of Electrical and Computer Engineering Boston, MA 02115

SDG&E s EPIC Demonstration Projects on Emerging Communication Standards. IEC Europe 2017 Conference. Frank Goodman, SDG&E EPIC Program Manager

FERC Reliability Technical Conference -- Panel I State of Reliability and Emerging Issues

IEEE PES Swiss Chapter Workshop: Microgrids Evolution and Integration in Modern Power Systems

EPRI Research Overview IT/Security Focus. Power Delivery & Energy Utilization Sector From Generator Bus Bar to End Use

Reviewed by CeemanB. Vellaithurai WSU ID:

Network Configuration Document Selection for New Substations Framework

An Improved Measurement Placement Algorithm for Network Observability

THE ANATOMY OF A CENTRALIZED REMEDIAL ACTION SYSTEM: WHAT CAN BE DONE IN 50 MILLISECONDS?

Microgrids: Building Blocks of the Smart Grid Adaptive Protection Schemes for Microgrids

Application of QNA to analyze the Queueing Network Mobility Model of MANET

Real Time Monitoring of

Smart grid control based on heterogeneous communications and adaptive layers

Lesson 12: Angles Associated with Parallel Lines

Spectrum Collaboration Challenge

Electrical Integration with Smart Communication

Development trends in Substation Design

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 7, Issue 1, July 2017

Title. Author(s)Nguyen, Thi Xuan My; Saivichit, Chaiyachet; Miyanaga. Issue Date Doc URL. Type. Note. File Information

Mechanism Synthesis. Introduction: Design of a slider-crank mechanism

POWER GRIDS. We are bridging the gap. Enabling Digital Substations.

9 th Electricity Conference at CMU

OPTIMAL DESIGN OF A STEPPER-DRIVEN PLANAR LINKAGE USING ENTROPY METHODS

Interconnection and Transmission

PMU Communication Network Analysis

Micropolis Interdependency Modeling using Open Hybrid Automata

IEEE PES Initiatives and Industry Role in Standards

HPC: N x Contingency Analysis

RELAY CO-ORDINATION IN A 11KV SUBSTATION USING ETAP

ELECTRICITY SUPPLY SYSTEMS OF THE FUTURE

Load Flow Analysis. I Objectives

POWER FLOW ANALYSIS AND PROTECTION COORDINATION OF REAL TIME SYSTEM

Analysis of End-to-End Delay Characteristics among Various Packet Sizes in Modern Substation Communication Systems based on IEC 61850

Digital Substation Unrestricted Siemens AG 2017 siemens.com/digital-substation

A Novel Method for Power-Flow Solution of Radial Distribution Networks

Experience with a Digital Substation Pilot in North Ame rica

Calculus Limits Images in this handout were obtained from the My Math Lab Briggs online e-book.

ACASCADING failure of the transmission network of a

IEC in Digital Substation and Cyber security

REALISATION OF AN INTELLIGENT AND CONTINUOUS PROCESS CONNECTION IN SUBSTATIONS

Future Grid Initiative Technology Challenges in Designing the Future Grid to Enable Sustainable Energy Systems

SDG&E EPIC Program Overview

T&D Challenges and Opportunities

Data and Forecasting Summary

NERC Event Analysis Update Webinar. Hassan Hamdar Chair, Event Analysis Subcommittee October 20, 2016

University of Strathclyde

HIL POWER SYSTEM RESEARCH FROM SIMULATION TO FIELD DEMONSTRATION Center for Electromechanics University of Texas at Austin

Karl Iliev, San Diego Gas & Electric Company

The current state of the electrical grid And the technologies that will enable its transformation

A Novel Digital Relay Model Based on SIMULINK and Its Validation Based on Expert System

Real-Time Hardware-in-the- Loop Co-Simulation Platform for Microgrid Analysis

Powering Progress: Smarter, Sustainable, More Secure, and Resilient Energy Infrastructure

Power System Resilience & Reliability. Robert W. Cummings Senior Director of Engineering and Reliability Initiatives i-pcgrid March 28, 2017

XXXX. Bear Creek Hydro Generation Project. Interconnection Facilities Study

KRUSKAL AIDED FLOYD WARSHALL ALGORITHM FOR SHORTEST PATH IDENTIFICATION IN MICROGRIDS

Incorporating PMUs in Power System State Estimation for Smart Grid EMS

Chapter 2 Communication for Control in Heterogeneous Power Supply

Sacramen Sacr t amen o t Municipal Utility Dis t Dis rict t SMUD May Ma 10,

Use of Ethernet Control Word RECOMMENDED. draft-ietf-pals-ethernet-cw-00 Stewart Bryant, Andy Malis & Ingas Bagdonas IETF 100 November 2017

LOAD SHEDDING AN EFFICIENT USE OF LTC TRANSFORMERS

AUTOMATED ANALYSIS OF PROTECTIVE RELAY DATA

INTERCONNECTION FACILITIES STUDY REPORT

Building Resilient IEC Communication Networks with Next Generation Redundancy Technologies

Reliability Comparison of Five 220 KV Substations in Pakistan Power System

A Fault Tolerant Approach for WSN Chain Based Routing Protocols

Lecture 5 Substation Automation Systems. Course map

Transient Stability Improvement of Long Transmission Line System by Using SVC

Cyber Security Analysis of State Estimators in Electric Power Systems

November 25, Mr. Paul Kaspar, PE City Engineer City of Bryan Post Office Box 1000 Bryan, Texas 77802

Energy Security: A Global Challenge

Modeling and Simulation in XENDEE

Revised Generation Interconnection Impact Study Report. For. Queue Position 31 ( Interconnection Customer )

CMSC 2833 Lecture Memory Organization and Addressing

Entergy Development and Deployment of IEC Protection and Control Including Process Bus

A RELIABILITY AND COST ASSESSMENT METHODOLOGY OF MEDIUM VOLTAGE FEEDERS

Smart and Adaptive Over Current Protection for Distribution System with Distributed Generation

Transcription:

Chanan Singh Texas A&M University (singh@ece.tamu.edu) PSERC Webinar November 22, 2016 1

Modern power systems: integration of current carrying components (for power delivery), monitoring, computing, communication and protection systems. Human interface - power systems are not fully automated Complexity is increasing with more monitoring, control and communications Sources of failure: physical components ( power/current carrying), failures in cyber network hard and soft, human failures Contemporary power system reliability methods focused almost entirely on the failure of physical components 2

Analytical methods: mostly used in single, multiarea and distribution system models. Monte Carlo simulation; mostly used in multi-area and composite system models. Intelligent search techniques: still in development stage for either increasing the efficiency of analytical or simulation or providing an alternative to Monte Carlo simulation. Hybrid: mixing for increased strength. An assumption running through the developed models and methods is that of independence of components and that cyber part is perfectly reliable. 3

Power systems of the future are emerging to be different. Two major factors contributing to this change: Large penetration of renewable energy sources Increasing complexity of cyber part. Installation of hardware for interactive relationship between the supplier and consumer will add to complexity and interdependency between the cyber and physical parts. Complexity and interdependency will introduce more sources of problems and make reliability analysis more challenging but also more essential. 4

Cyber-Physical Security and Reliability Cyber Security: Studies deliberate cyber attack scenarios, consequences, and prevention or mitigation strategies. Cyber Reliability: Studies intrinsic failure modes of cyber related components and their impact on power system reliability. Ultimately both impact the reliability of power supply but the two may require different modeling and methodology. 5

The concepts and approaches will be explained using an example of a substation. The problems, however, extend across the entire grid. 6

A 230 KV Bus C 1 1 4 E 6 4 6 G 9 9 I Physical Components (Power-Carrying Components): Transmission Lines 3 3 8 8 Power Transformers B 2 D 5 F 7 69 KV Bus H Circuit Breakers 2 5 7 10 J Process Bus 10 Cyber Components: ES ES ES ES CTs/PTs Line Transformer Bus Brkr. IED Brkr. IED Brkr. IED Brkr. IED Breaker Control Merging Units Process Bus An IEC 61850 based protection system for a 230-69 kv substation Ethernet Switches IEDs 7

230 KV Bus 9 I B A 1 1 2 2 C 4 E 6 4 3 3 8 8 D ES Line 5 F 7 5 ES Transformer Process Bus ES Bus 6 7 ES Brkr. IED Brkr. IED Brkr. IED Brkr. IED Breaker Control G H 9 69 KV Bus 10 10 J Type Fault Locations Associated Circuit Breakers Line A Breaker 1 B Breaker 2 I Breaker 9 J Breaker 10 Transformer E Breakers 4, 6 F Breakers 5, 7 Bus C Breakers 1, 3, 4 D Breakers 2, 3, 5 G Breakers 6, 8, 9 H Breakers 7, 8, 10 8

230 KV Bus 9 I A 1 1 C 4 E 6 4 6 G 9 Analysis: Primary fault on Line A 3 3 8 8 B 2 D 69 KV Bus 5 F 7 H 2 5 7 10 J ES Line ES Transformer Process Bus ES Bus ES Brkr. IED Brkr. IED Brkr. IED Brkr. IED Breaker Control 10 *Other : One or more components of 1, Line Panel, CB1 fail to operate. Or Process Bus is in delay state Failure Modes Physical Components Affected Probability all good Only Line A 0.996957511 Process bus failed Entire Substation 0.000009132 Other* Line A and Bus C 0.003033357 9

Analysis: Primary fault on Line B Physical Components Affected Probability Only Line B 0.996957511 Entire Substation 0.000009132 Line B and Bus D 0.003033357 Analysis: Primary fault on Line I Physical Components Affected Probability Only Line I 0.996957511 Entire Substation 0.000009132 Line I and Bus G 0.003033357 Analysis: Primary fault on Line J Physical Components Affected Probability Only Line J 0.996957511 Entire Substation 0.000009132 Line J and Bus H 0.003033357 10

A 1 230 KV Bus C 4 E 6 4 6 G 9 9 I Analysis: Primary fault on Transformer E B 1 2 3 3 8 8 D 5 F 7 H 69 KV Bus Physical Components Affected Probability Only E 0.996942336 2 ES Line 5 ES Transformer Process Bus ES Bus 7 ES Brkr. IED Brkr. IED Brkr. IED Brkr. IED Breaker Control 10 10 J Entire Substation 0.000009132 E and C 0.000015174 E and G 0.000015174 E, C, and G 0.003018182 11

A 230 KV Bus C 4 E 6 G 1 4 6 1 3 3 8 8 9 9 I Analysis: Primary fault on Bus C Physical Components Affected Probability B 2 D 5 F 7 69 KV Bus H Only C 0.996927163 2 5 7 10 10 J Entire Substation 0.000009132 Process Bus A and C 0.000015174 ES ES ES ES Brkr. IED Brkr. IED Brkr. IED Brkr. IED C and D 0.000015174 C and E 0.000015174 Line Transformer Bus Breaker Control A, C, and D 2.31*10-10 A, C, and E 2.31*10-10 C, D, and E 2.31*10-10 A, C, D, and E 0.003018182 12

Representing interdependency for Reliability Analysis Cyber-Physical Interface Matrix (CPIM) Line A 0.9969575 0.0000091 0.0030334 0 Line B 0.9969575 0.0000091 0.0030334 0 Line I 0.9969575 0.0000091 0.0030334 0 Bus H 0.9969272 0.0000091 0.0000152 0.0000152 Consequent Events Matrix (CEM) Line A Event-1 Event-2 Event-3 Event-4 Line B Line I Bus H 13

Composite system reliability evaluation with the use of cyber-physical interface matrix 230 KV Bus G1 G2 M N Q A C E G I K G3 G4 O P R B D F H J L 69 KV Bus 230 KV Bus 9 I A 1 C 4 E 6 4 6 G 9 1 3 3 8 8 B 2 D 5 F 7 H 69 KV Bus 2 5 7 10 J 10 Process Bus ES ES ES ES Brkr. IED Brkr. IED Brkr. IED Brkr. IED Line Transformer Bus Breaker Control 14

Composite system reliability evaluation with the use of cyber-physical interface matrix 230 KV Bus G1 G2 M N Q A C E G I K G3 G4 O P R B D F H J L 69 KV Bus Step 1: Set the initial state of all components as UP and set the simulation time t = 0. Step 2: For each individual component, draw a random decimal number z i between 0 and 1 to compute the time to the next event. TT ii = llnn(zz ii) ρρ ii Depending on whether the i th component is UP or DOWN, λ i or µ i is used in place of ρ i 15

Composite system reliability evaluation with the use of cyber-physical interface matrix 230 KV Bus G1 G2 M N Q A C E G I K G3 G4 O P R B D F H J L 69 KV Bus Step 3: Find the minimum time, change the state of the corresponding component, and update the total time. T q = min TT ii, 1 ii NN The next transition takes place by change of state of the q th component. The total simulation time t is increased by T q. t = t + T q 16

Composite system reliability evaluation with the use of cyber-physical interface matrix 230 KV Bus G1 G2 M N Q A C E G I K G3 G4 O P R B D F H J L 69 KV Bus Step 4: Change the q th component s state accordingly. For each component i TT ii = TT ii T q 17

Composite system reliability evaluation with the use of cyber-physical interface matrix 230 KV Bus G1 G2 M N Q A C E G I K G3 G4 O P R B D F H J L 69 KV Bus Step 5: If the state of the q th component transits from UP to DOWN, which means a primary fault occurs on this component, then the cyber-physical interface matrix is used to determine if there are some subsequent failures causing more components out of service due to the cyber part s malfunction. 18

Composite system reliability evaluation with the use of cyber-physical interface matrix 230 KV Bus G1 G2 M N Q A C E G I K G3 G4 O P R B D F H J L 69 KV Bus Draw another random decimal number y (0 < y 1) Line A 0.9969575 0.0000091 0.0030334 0 Transformer E 0.9969423 0.0000091 0.0000152 0.0000152 Bus H 0.9969272 0.0000091 0.0000152 0.0000152 19

Composite system reliability evaluation with the use of cyber-physical interface matrix 230 KV Bus G1 G2 M N Q A C E G I K G3 G4 O P R B D F H J L 69 KV Bus How to determine the next transition time of Transformer E and Bus C? TT ii = llnn(zz ii) ρρ ii For Transformer E, use µ i in place of ρ i For Bus C, use µ i,exp in place of ρ i µ i,exp is an expedited repair rate, called switching rate 20

Composite system reliability evaluation with the use of cyber-physical interface matrix 230 KV Bus G1 G2 M N Q A C E G I K G3 G4 O P R B D F H J L 69 KV Bus Step 6: Perform a network power flow analysis to assess system operation states. Update system-wide reliability indices. Repeat steps 3 6 until convergence is achieved. 21

Composite system reliability evaluation with the use of cyber-physical interface matrix When the simulation finishes, system-wide reliability indices can be obtained. G1 G2 M N Q A 230 KV Bus C E G I K NN ss HH ii tt ii LLLLLLLL = ii=1 tt tttttttttt G3 G4 O P R B D F H J L NN ss RR ii tt ii 8760 EEEEEEEE = ii=1 tt tttttttttt (With the unit of MWh/year ) 69 KV Bus LLLLLLLL = LLLLLLLL 8760 (With the unit of hours/year ) N s H i t i t total R i Total number of iterations simulated; Equals 1 if load curtailment occurs in the i th iteration; otherwise it equals 0; Simulated time in the i th iteration, with the unit of year; Total simulated time, with the unit of year. curtailment during the i th iteration, with the unit of MW; 22

Illustrating the overall methodology on a standard test system RBTS Test System G1 G5 G6 6 G3 Bus 3 Generating Station 1 G2 3 G4 1 2 4 G7 G8 G9 Generating Station 2 Bus 4 7 20 MW G10 G11 The size of this system is small to permit reasonable time for extension of cyber part and development of interface matrices. But the configuration of this system is sufficiently detailed to reflect the actual features of a practical system 5 8 85 MW 20 MW Bus 5 40 MW Buses 3 5 are extended with cyber configurations 9 Bus 6 20 MW 23

G1 Generating Station 1 G5 3 G8 G9 Generating Station 2 G6 20 MW G10 G11 Extend bus 3 of the RBTS Test System with substation protection configurations. G3 G4 Line 6 Line 5 Line 4 Line 1 6 G2 1 2 4 G7 7 3-6 3-7 3-8 3-9 Bus 3 Bus 4 3-1 3-1 3-2 3-3 3-2 3-3 5 8 85 MW 40 MW 20 MW Bus 5 3-4 3-5 3-4 3-5 9 3 Bus 6 Process Bus 20 MW Line 1 Panel Line 4 Panel Line 5 Panel Line 6 Panel Physical part of the RBTS Extension with cyber part in Bus 3 24

6 G3 G2 G1 Generating Station 1 G5 3 G4 1 2 4 G7 G8 G9 Generating Station 2 7 G6 20 MW G10 G11 Extend bus 4 of the RBTS with substation protection configurations. Line 2 Line 8 Line 4 Line 7 4-6 4-7 4-8 4-9 4-1 4-2 4-3 Bus 3 Bus 4 4-1 4-2 4-3 5 8 85 MW 20 MW Bus 5 40 MW 4-4 4-5 4-4 4-5 9 4 Bus 6 Process Bus 20 MW Line 2 Panel Line 4 Panel Line 7 Panel Line 8 Panel Physical part of the RBTS Extension with cyber part in Bus 4 25

6 G3 G2 G1 Generating Station 1 G5 3 G4 1 2 4 G7 G8 G9 Generating Station 2 7 G6 20 MW G10 G11 Extend bus 5 of the RBTS with substation protection configurations. Line 5 Line 8 5 5-5 5-6 5-1 5-2 Bus 3 Bus 4 5-1 5-2 5 8 85 MW 20 MW Bus 5 40 MW 5-3 5-4 5-3 5-7 5-4 9 Line 9 Bus 6 Process Bus 20 MW Line 5 Panel Line 8 Panel Line 9 Panel Physical part of the RBTS Extension with cyber part in Bus 5 26

G1 G5 G6 Generation Variation 6 G3 Bus 3 Generating Station 1 G2 85 MW 3 G4 1 2 4 5 8 G7 40 MW G8 G9 Generating Station 2 Bus 4 7 20 MW G10 G11 Unit Bu Rating Failure Rate MRT (hours) No. s (MW) ( /year) 1 1 40 6.0 45 2 1 40 6.0 45 3 1 10 4.0 45 4 1 20 5.0 45 5 2 5 2.0 45 6 2 5 2.0 45 7 2 40 3.0 60 8 2 20 2.4 55 9 2 20 2.4 55 10 2 20 2.4 55 11 2 20 2.4 55 20 MW 9 20 MW Bus 6 Bus 5 Physical part of the RBTS Variation The hourly load profile is created based on the information in Tables 1, 2, and 3 of the IEEE Reliability Test System*. *IEEE Committee Report, IEEE reliability test system, IEEE Trans. Power App. and Syst., vol. PAS-98, no. 6, pp. 2047 2054, Nov./Dec. 1979. 27

Line 6 Line 5 Line 4 Line 1 3-6 3-7 3-8 3-9 3-1 3-1 3-2 3-3 3-2 3-4 3-5 3-3 pp 1,1 pp 1,2 pp 2,1 pp 2,2 pp 1,nn pp 2,nn pp mm,1 pp mm,2 pp mm,nn 3-4 3-5 3 Process Bus Line 1 Panel Line 4 Panel Line 5 Panel Line 6 Panel Analyze the cyber failure modes and consequent events and obtain the Cyber-Physical Interface Matrices (CPIM) for Buses 3-5. 28

Results: The CPIM and CEM of Bus 3 The Cyber-Physical Interface Matrix (CPIM) of Bus 3 Fault Location Probabilities Line 1 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 Line 4 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 Line 5 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 Line 6 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 The Consequent Event Matrix (CEM) of Bus 3 Fault Location Events Line 1 100000000000 100111000000 100100000000 100000000100 100100000100 Line 4 000100000000 100111000000 000110000000 100100000000 100110000000 Line 5 000010000000 100111000000 000011000000 000110000000 000111000000 Line 6 000001000000 100111000000 000001000100 000011000000 000011000100 29

Results: The CPIM and CEM of Bus 4 The Cyber-Physical Interface Matrix (CPIM) of Bus 4 Fault Location Probabilities Line 2 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 Line 4 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 Line 7 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 Line 8 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 The Consequent Event Matrix (CEM) of Bus 4 Fault Location Events Line 2 010000000000 010100110000 010000000010 010000010000 010000010010 Line 4 000100000000 010100110000 000100010000 000100100000 000100110000 Line 7 000000100000 010100110000 000100100000 000000100010 000100100010 Line 8 000000010000 010100110000 010000010000 000100010000 010100010000 30

Results: The CPIM and CEM of Bus 5 The Cyber-Physical Interface Matrix (CPIM) of Bus 5 Fault Location Probabilities Line 5 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 Line 8 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 Line 9 0.996899850569 0.000009132337 0.000027312491 0.000027312491 0.003036392112 The Consequent Event Matrix (CEM) of Bus 5 Fault Location Events Line 5 000010000000 000010011000 000010001000 000010000001 000010001001 Line 8 000000010000 000010011000 000000010001 000000011000 000000011001 Line 9 000000001000 000010011000 000000011000 000010001000 000010011000 31

G1 G5 G6 G8 6 G3 Bus 3 Generating Station 1 G2 85 MW 20 MW G4 3 1 2 4 5 8 Bus 5 G7 40 MW G9 Generating Station 2 Bus 4 7 20 MW G10 G11 Utilize the results of the interface matrices, perform a Monte-Carlo simulation for the composite system, and obtain numerical results of system-wide reliability indices. 9 Bus 6 20 MW 32

6 G3 Bus 3 G2 85 MW 20 MW G1 Generating Station 1 G4 G5 3 1 2 4 5 8 9 20 MW Bus 6 Bus 5 40 MW G8 G9 Generating Station 2 G7 Bus 4 7 G6 20 MW G10 G11 NN Objective: yy = MMMMMM bb ii=1 subject to: Variables: θ, G, and C CC ii BBθθ + GG + CC = LL GG GG mmmmmm CC LL DDDDDD FF mmmmmm DDDDDD FF mmmmmm GG, CC 0 θθ 1 = 0 θθ 2 NNbb unrestricted Total number of variables: 3N b N b C C i BB G G max L D A θ F max Number of buses NN bb 1 vector of bus load curtailments curtailment at bus i NN bb NN bb augmented node susceptance matrix NN bb 1 vector of bus actual generating power NN bb 1 vector of bus maximum generating availability NN bb 1 vector of bus loads NN tt NN tt diagonal matrix of transmission line susceptances, with N t the number of transmission lines NN tt NN bb line-bus incidence matrix NN bb 1 vector of bus voltage angles NN tt 1 vector of transmission line power flow capacities 33

Brief Results Impact on Expected Energy Not Served (EENS) EENS (MWh/year) Δ If protection systems are perfectly reliable Considering protection malfunctions Bus 1 0 0 N/A Bus 2 1.862 2.655 42.59% Bus 3 2.828 8.597 204.00% Bus 4 1.950 10.095 417.69% Bus 5 2.145 3.729 73.85% Bus 6 103.947 116.104 11.70% Overall System 112.732 141.180 25.24% 34

G1 Line 5 Line 6 1-1 ES 1-1 ES 1-2 2-1 ES 2-1 ES 2-2 Bus 1 Bus 2 ES 1-3 ES 2-3 1-2 1-3 2-2 2-3 S1-L5 S1-L1 S1-L2 S2-L6 S2-L3 S2-L1 Line 1 Line 2 Line 3 Line 4 3-2 3-1 ES 3-1 ES 3-2 4-2 4-1 ES 4-1 ES 4-2 ES 3-3 Bus 3 Bus 4 ES 4-3 3-3 4-3 S3-L4 S3-L7 S3-L2 S4-L3 S4-L8 S4-L4 Line 7 G4 Line 8 35

Two types of cyber link failures: (a) A link is unavailable due to packet delay resulting from traffic congestion or queue failure; (b) A link is physically damaged. Failure type (b) is relatively rare and thus only failure type (a) is considered in this research 36

G1 Line 5 1-1 ES 1-1 ES 1-2 Line 6 2-1 ES 2-1 ES 2-2 11 10 18 19 Bus 1 ES 1-3 Bus 2 1-2 1-3 2-2 2-3 ES 2-3 12 1-1 1 7 ES 1-1 ES 1-2 6 1-2 20 Line 2 3-2 3-1 S1-L5 S1-L1 S1-L2 S2-L6 S2-L3 S2-L1 Line 1 Line 4 Bus 3 Bus 4 3-3 ES 3-1 ES 3-2 ES 3-3 4-2 Line 3 4-3 4-1 ES 4-1 ES 4-2 ES 4-3 13 14 15 16 1-3 3 8 9 2 ES 1-3 5 4 S1-L5 S1-L1 S1-L2 21 Line 7 S3-L4 S3-L7 S3-L2 G4 Line 8 S4-L3 S4-L8 S4-L4 17 Reliability Data for Components Component Failure Rate Mean Repair Time (/year) (h) Circuit Breaker 0.01 8 Merging Unit 0.02 8 Ethernet Switch 0.01 8 Line Panel 0.02 8 Cyber Component Names and Meanings Component Name Meaning 1-1 Merging Unit 1 at Substation 1 1-2 Merging Unit 2 at Substation 1 1-3 Merging Unit 3 at Substation 1 ES 1-1 Ethernet Switch 1 at Substation 1 ES 1-2 Ethernet Switch 2 at Substation 1 ES 1-3 Ethernet Switch 3 at Substation 1 S1-L5 Line 5 Panel at Substation 1 S1-L1 Line 1 Panel at Substation 1 S1-L2 Line 2 Panel at Substation 1 37

Cyber Component Names and Meanings Component Name Meaning 1-1 Merging Unit 1 at Substation 1 1-2 Merging Unit 2 at Substation 1 1-3 Merging Unit 3 at Substation 1 ES 1-1 Ethernet Switch 1 at Substation 1 ES 1-2 Ethernet Switch 2 at Substation 1 ES 1-3 Ethernet Switch 3 at Substation 1 S1-L5 Line 5 Panel at Substation 1 S1-L1 Line 1 Panel at Substation 1 S1-L2 Line 2 Panel at Substation 1 10 11 12 13 14 15 16 1-1 1-3 1 3 7 ES 1-1 ES 1-2 8 9 2 ES 1-3 5 4 S1-L5 S1-L1 S1-L2 6 18 1-2 19 20 21 17 For the link i, the time it takes for a packet to travel in the forward direction is a random variable denoted by t i.1 For the reverse direction, the random time is denoted by t i.2 For example: Consider Link 7, the time it takes for a packet to travel from ES 1-1 to ES 1-2 is denoted by t 7.1 From ES 1-2 to ES 1-1, the time is denoted by t 7.2 38

Cyber Component Names and Meanings Component Name Meaning 1-1 Merging Unit 1 at Substation 1 1-2 Merging Unit 2 at Substation 1 1-3 Merging Unit 3 at Substation 1 ES 1-1 Ethernet Switch 1 at Substation 1 ES 1-2 Ethernet Switch 2 at Substation 1 ES 1-3 Ethernet Switch 3 at Substation 1 S1-L5 Line 5 Panel at Substation 1 S1-L1 Line 1 Panel at Substation 1 S1-L2 Line 2 Panel at Substation 1 11 12 13 14 15 16 10 1-1 1-3 1 3 7 ES 1-1 ES 1-2 8 9 2 ES 1-3 5 4 S1-L5 S1-L1 S1-L2 6 18 1-2 19 20 21 17 Consider the communication from 1-1 to S1-L1. There are two possible paths: 1-8-4 and 1-7-9-4. pp ffffffff = Pr[ tt 1.1 + tt 8.1 + tt 4.1 > TT tttttt aaaaaa (tt 1.1 + tt 7.1 + tt 9.1 + tt 4.1 > TT tttttt )] where T tsd is a predefined threshold delay value for the two paths. 39

11 10 18 19 12 13 14 15 16 1-1 1-3 1 3 7 ES 1-1 ES 1-2 8 9 2 ES 1-3 5 4 S1-L5 S1-L1 S1-L2 6 1-2 20 From 1-1 to S1-L1 21 pp ffffffff = Pr[ tt 1.1 + tt 8.1 + tt 4.1 > TT tttttt aaaaaa (tt 1.1 + tt 7.1 + tt 9.1 + tt 4.1 > TT tttttt )] 17 Similarly, with any two components specified as the two ends of a communication path, the path failure probability can be computed from the cyber link level parameters 40

11 10 18 19 12 13 14 15 16 1-1 1-3 1 3 7 ES 1-1 ES 1-2 8 9 2 ES 1-3 5 4 S1-L5 S1-L1 S1-L2 6 1-2 20 21 The detailed procedures are based on queueing theory and are beyond the scope of this research. These probabilities can be assumed directly at the path level. 17 From To Forward Path Failure Probability Reverse Path Failure Probability 1-1 S1-L5 0.002 0.002 1-1 S1-L1 0.001 0.001 1-1 S1-L2 0.001 0.001 1-2 S1-L5 0.001 0.001 1-2 S1-L1 0.001 0.001 1-2 S1-L2 0.002 0.002 1-3 S1-L5 0.001 0.001 1-3 S1-L1 0.002 0.002 1-3 S1-L2 0.001 0.001 41

G1 1-2 Line 5 1-1 1-3 ES 1-1 ES 1-2 Bus 1 ES 1-3 Bus 2 Line 2 3-2 3-1 S1-L5 2-2 2-1 2-3 ES 2-1 ES 2-2 ES 2-3 S1-L1 S1-L2 S2-L6 S2-L3 S2-L1 Line 1 Line 4 ES 3-1 ES 3-2 Line 6 4-2 Line 3 4-1 ES 4-1 ES 4-2 Results The Cyber-Physical Interface Matrix Primary Fault Probabilities of Consequent Events Location Line 1 0.9919152 0.0040342 0.0040342 0.0000164 Line 2 0.9919152 0.0040342 0.0040342 0.0000164 Line 3 0.9919152 0.0040342 0.0040342 0.0000164 Line 4 0.9919152 0.0040342 0.0040342 0.0000164 Line 5 0.9959494 0.0040506 0 0 Line 6 0.9959494 0.0040506 0 0 Line 7 0.9959494 0.0040506 0 0 Line 8 0.9959494 0.0040506 0 0 Bus 3 Bus 4 3-3 ES 3-3 4-3 ES 4-3 The Consequent Event Matrix Line 7 S3-L4 S3-L7 S3-L2 G4 Line 8 S4-L3 S4-L8 S4-L4 Primary Fault Consequent Events Location Line 1 10000000 11001000 10100100 11101100 Line 2 01000000 11001000 01010010 11011010 Line 3 00100000 10100100 00110001 10110101 Line 4 00010000 01010010 00110001 01110011 Line 5 00001000 11001000 00000000 00000000 Line 6 00000100 10100100 00000000 00000000 Line 7 00000010 01010010 00000000 00000000 Line 8 00000001 00110001 00000000 00000000 42

Stage 1: Substation Level Analysis Analysis at this stage can be performed locally at each substation and the computations can be performed offline. Stage 2: Composite System Level Analysis The results of CPIMs and CEMs can be directly utilized. Monte-Carlo simulation performed in this stage is generic and applicable for large power systems. The CPIM decouples the 2 stages of analysis, making the overall analysis more tractable. 43

Cyber-Physical Interactions Modeling This is only starting point More detailed models need to be developed. We need to consider inter-substation interactions Consider the interaction of physical on the cyber as well More automated analysis at the substation level. 44

Computational Methods Development Generally non-sequential Monte Carlo Simulation is preferred as a more efficient method of for reliability evaluation. Several variance reduction techniques like importance sampling have been developed to make it even faster, especially those incorporating the concept of cross-entropy. The efficiency of non-sequential MCS is based on the assumption of independence between the components, although limited dependence can be accommodated. 45

Because of interdependence introduced by cyber part it becomes difficult to use nonsequential MC and the associated variance reduction techniques. So we have used sequential MCS. We have also proposed a non-sequential MCS technique to solve this problem but more work is needed in this direction. 46

IEEE RTS Reliability Test System has served as a resource for the researchers and developers to test their algorithms and compare their results with others. Additional information about distribution has since been added. This test system does not have information on the related cyber part. A taskforce under the Reliability, Risk and Probability Applications Subcommittee (RRPA) is investigating adding configurations and data on the cyber part. 47

1. C. Singh, A. Sprintson, Reliability Assurance of Cyber- Physical Power Systems, IEEE PES General Meeting, July 2010. 2. Yan Zhang, Alex Sprintson, and Chanan Singh, An Integrative Approach to Reliability Analysis of an IEC 61850 Digital Substation, IEEE PES General Meeting, July 2012. 3. H. Lei, C. Singh, and A. Sprintson, Reliability modeling and analysis of IEC 61850 based substation protection systems, IEEE Transactions on Smart Grid, vol. 5, no. 5, pp. 2194 2202, September 2014. 4. H. Lei and C. Singh, Power system reliability evaluation considering cyber-malfunctions in substations, Electric Power Systems Research, vol. 129, pp. 160-169, December 2015. 5. H. Lei and C. Singh, Non-Sequential Monte Carlo Simulation for Cyber-Induced Dependent Failures in Composite Power System Reliability Evaluation, IEEE Transactions on Power Systems, (accepted for publication: DOI: 10.1109/TPWRS.2016.2572159) 48

This presentation is based on the work of my students Yan Zhang and Hangtian Lei. The work reported here was supported in part by PSERC Project T-53. 49

Chanan Singh (singh@ece.tamu.edu) 50