CIGRE Green Books

Series editor

Cigré, International Council on Large Electric Systems, Paris, France

CIGRE presents their expertise in compact professional books on electrical powernetworks. These books are of a self-contained concise character, covering the entireknowledge of the subject within power engineering. The books are created byCIGRE experts within their study committees and are recognized by theengineering community as the top reference books in their fields.

More information about this series at http://www.springer.com/series/15383

Carlos SamitierEditor

Utility CommunicationNetworks and ServicesSpecification, Deploymentand Operation

123

EditorCarlos SamitierPullnet TechnologyParc Technològic BC NordBarcelonaSpain

Co-editorMehrdad MesbahGE Energy ConnectionsParisFrance

ISSN 2367-2625 ISSN 2367-2633 (electronic)CIGRE Green BooksISSN 2509-2812 ISSN 2509-2820 (electronic)Compact StudiesISBN 978-3-319-40282-6 ISBN 978-3-319-40283-3 (eBook)DOI 10.1007/978-3-319-40283-3

Library of Congress Control Number: 2016942499

© Springer International Publishing Switzerland 2017This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or partof the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations,recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmissionor information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilarmethodology now known or hereafter developed.The use of general descriptive names, registered names, trademarks, service marks, etc. in thispublication does not imply, even in the absence of a specific statement, that such names are exempt fromthe relevant protective laws and regulations and therefore free for general use.The publisher, the authors and the editors are safe to assume that the advice and information in thisbook are believed to be true and accurate at the date of publication. Neither the publisher nor theauthors or the editors give a warranty, express or implied, with respect to the material contained herein orfor any errors or omissions that may have been made.

Printed on acid-free paper

This Springer imprint is published by Springer NatureThe registered company is Springer International Publishing AG Switzerland

Message from the Secretary General

All CIGRE members have access to the publications produced by the WorkingGroups of our Association, in the form of “Technical Brochures” when their workis completed.

Between 40 and 50 new Technical Brochures are published yearly, and thesebrochures are announced in Electra, CIGRE’s bimonthly journal, and are availablefor downloading from “e-cigre”. This online library of CIGRE (http://www.e-cigre.org), is one of the most comprehensive accessible databases of relevant technicalworks on power engineering.

During 1931 to 1974 the technical reports of Working Groups were published inElectra only. As some reports were becoming voluminous it was decided to publishthe largest ones separately, as Technical Brochures.

In 2000, Electra was redesigned, and as a result, it no longer published the finalreports of Working Groups. Today only summaries of Technical Brochures areprovided in Electra, in both English and French.

The idea to value the collective work of the Study Committees accumulated overmore than twenty years, by putting together all the Technical Brochures of a givenfield, in a single book, which was first proposed by Dr. Konstantin Papailiou to theTechnical Committee in 2011.

As a result, the first two Green Books were published by CIGRE at the timeof the last 2014 session in Paris. It is planned that the series will grow progressivelyat a pace of about one Green Book per year.

In 2015, the Technical Committee decided to associate CIGRE with a renownedpublisher of scientific books in order to benefit from its know-how and of itsvisibility worldwide. An agreement was signed with Springer at the end of this yearto co-publish the future CIGRE Green Books.

This new Green Book is the first result of this new collaboration, and it isinteresting to note, that given its size, not as big as the first two books, together withour partner we decided to have an alternative format, the CIGRE Compact Studies,to satisfy the need of some Study Committees for a more concise book formatcovering a specific subject from the scope of a Study Committee.

v

Before closing this foreword, I want to thank and congratulate the editor, theco-editor and all the authors, contributors and reviewers of this specific issue thatgives the reader a clear and comprehensive vision of the past and recent devel-opments of the information and telecommunication technologies applied to thepower systems.

Paris, June 2016 Philippe AdamCIGRE Secretary General

vi Message from the Secretary General

Foreword

Since the beginning of Power System deployment, telecommunication serviceshave been a very important component to operate the grid. Their role has evolveddriven by two factors, the need to implement new grid operation capabilities, andthe evolution of Information and Telecommunication technologies.

At the beginning of twentieth century, power utilities required reliable voicecommunications to operate the grid. Power line carrier, called in those times “wavetelephony”, was the first technology that contributed to the operation of the powergrid.

When CIGRE was founded, in 1921, there were around 40 PLC voice links inservice in USA and Europe. The deployment of this technology grew very fast andin 1929 it was reported that more than 1000 links were in operation in Europe andUSA.

CIGRE identified the need for support for improving and developing commu-nication services and a specific study committee was founded to identify issues ofconcern, to propose the development of new international standards and to produceguidelines on the application of new telecom and information technologies.

Many new technologies have been introduced since those early times. StudyCommittee D2 has actively contributed to a smooth introduction of new tech-nologies and new ways to implement and operate these networks. These techno-logical developments pave the way to a better control and operation of the grid,driving to an improvement of the global efficiency of the power system.

The use of fiber optics cables on overhead lines introduced a turning point in thecapabilities of power utilities to develop powerful telecommunication infrastruc-tures. Digital networks with very high transmission capacity were deployed creatinga synergy between technology improvements and new operational service imple-mentation and paving the way to the development of new operational services thatoffer new opportunities to implement new ways of operation and protection of thegrid.

The deployment of digital networks over fiber optic infrastructure provides analmost unlimited capacity introducing the false idea that increased network band-width which could compensate any other issue and that a reliable operationalservice could be provided without any other considerations.

vii

Study Committee D2 recognizes many other issues that should be consideredwhen implementing reliable operational services. In the past years, several technicalbrochures were produced to develop these new topics. These technical brochuresdescribe different aspects relevant to mission-critical operational service imple-mentation including new opportunities brought about by new technologies as wellas their corresponding constraints in such a way to present a complete picture ofmodern service provision architecture.

When CIGRE Green Books series were launched, study committee D2 identifiedthis as a great opportunity to spread our findings and bring together several works inorder to provide a comprehensive view of operational service provision in the scopeof present power utilities scenario and considering the incoming Smart Gridsdeployments. Consequently, it was decided to initiate the production of a GreenBook. This task gave us the opportunity to compile and update existing material topresent it in a smooth and didactic manner.

This book is a compact study focused on describing key and specific consid-erations that should be taken into account to implement operational services as wellas the architecture alternatives that better suit the fast evolving scenario of modernpower grid and the future Smart Grid deployment. With the objective of producinga compact and focused work, technologies and international standards are notdescribed in detail, since those details can be found in many other publications.

I am confident that, by reading the book, you will discover every relevant aspectof operational services provision in the scope of power utilities. Specific require-ments and key working principles of every operational service type as well asdifferentiated implementation aspects are developed through the text providing acomprehensive view of different functionalities and their interactions.

This book is the result of the contribution of many specialists from StudyCommittee D2 and specially of Mr. Mehrdad Mesbah, Convenor of the D2Advisory Group on Telecom, who did a great job compiling, sorting and updatinginformation to get the text you are about to read.

It is important to point out that this is the first CIGRE Compact Studies book, anew format and idea that has seen the light thanks to the support and help of myfriend Dr. Konstantin Papailiou who very cleverly saw the need and advantages ofthis new type of CIGRE books. I would also like to thank Mr. Mark Waldron, theChairman of the Technical Committee of CIGRE and Mr. Philippe Adam theSecretary General of CIGRE for their support to this new format. I am sure moreCIGRE Compact Studies books will follow but meanwhile enjoy this one!

Barcelona, June 2016 Carlos SamitierCIGRE Study Committee D2 Chairman

viii Foreword

Preface

Electrical power delivery systems are undergoing tremendous change under theimpact of economic, environmental, organizational, and technological factors. Thischange spreads across the whole landscape of power generation, transmission, dis-tribution, supply and consumption, bringing together these previously distinctdomains into closely related processes requiring substantial exchange of information.

At the same time, energy deregulation is breaking the unique government-ownedmonopolistic “Vertically Integrated Utility” into separate organizations, many ofwhich are privately controlled and operating in a competitive electricity market.This competitive environment implies a permanent quest for cost optimizationthrough optimal usage of assets, new service provisioning processes and enhancedvalue proposition. It also creates the need for new coordination and control of thesystem operation and new regulating authorities controlling the reliability and thesecurity of the power supply and its underlying infrastructure.

Information exchange is no longer limited to the collect of information in aunique control center and dispatch of commands to the field, but a complexinter-exchange of information between all actors of the power generation, delivery,supply, and consumption process. These actors include transmission and distribu-tion control centers, regional and national system operators, market platforms andregulating authorities, electrical substations, bulk power plants and energy farms,distributed energy generation and storage plants, service providers, and energyconsumers.

Such a complex multi-actor environment assures that the produced energymatches the consumed energy, the electrical power is transported and distributed inan optimal manner, the power system assets are used in a secure manner andmaintained correctly, that energy producing entities are compensated accordingly,and that the power consumer adapts its power consumption to the realities of thegeneration capability at any time.

Information exchange also enables the system to adapt to any faults or anomaliesin the power system in order to avoid grid instabilities and consequent poweroutages, assuring hence the continuity of power supply. Protection relaying ofelectrical transmission lines is increasingly interacting across the grid, exchanginginformation for higher dependability, security and selectiveness, while evolving to amore adaptive and more “grid-aware” behavior. Restoring power system assets still

ix

requires the intervention of field workers who have to detect anomalies and reactrapidly to restore the system with more limited workforce and often to solve a muchwider range of technical issues implying remote technical support.

A common denominator to all the mentioned changes in the power systemlandscape is abundant communications: between field devices, information andcontrol platforms and utility staff, in field sites, in operational centers, or in engi-neering and technical support offices.

This present book is prepared with the ambition of describing the operationaltelecommunication networks and services of electrical power utility, the present andnear-future applications for which they must assure the interconnections, theircommunication constraints and requirements, as well as the way they could beplanned, designed, deployed and operated in a rapidly changing environment. It isbased on the works of several CIGRE D2 working groups in which I have beeninvolved in recent years and have had as a common thread the same question “howcan the operational telecom network adapt to new power system communicationrequirements, the change of scale of the network, new communication technologies,and new organizational realities?” It is therefore the result of many contributions,discussions and experiences of a large number of utility and industry experts frommany countries to whom I am particularly indebted and who are acknowledged.

It should be noted that the present book is not a textbook on telecommunicationsand networking technologies, for which excellent books exist already. The objec-tive has rather been to produce in a same volume a coherent compilation of tech-nical material, practical guidelines, process modeling and organizational principlesnecessary for an understanding of the communication issues in the new powerutility context and orientations that have been taken or are being examined by thepower system communication community worldwide.

Paris, June 2016 Mehrdad Mesbah

x Preface

Acknowledgments

This book is the result of active participation of a large number of experts, listed inthe appendix, who contributed through their discussions to the preparation of fourCIGRE Technical Brochures, the main source of the present volume. Weacknowledge their decisive role in providing the material.

We acknowledge also other CIGRE D2 Working groups in telecommunicationswhose work has inspired many subjects presented in this book.

We are particularly indebted to the members of CIGRE D2 Advisory GroupAGD2.03 for their feedback and in particular to Mr. Hermann Spiess, a majorcontributor of CIGRE D2 and a long date operational telecom expert who read thedraft and brought many precious suggestions and corrections to the content.

Carlos SamitierMehrdad Mesbah

xi

Contents

Part I Operational Applications and Requirements

1 Operational Applications in the Power Delivery System . . . . . . . . 3

2 IEC 61850 Communication Model . . . . . . . . . . . . . . . . . . . . . . . . 7

3 Substation-to-Substation Applications . . . . . . . . . . . . . . . . . . . . . 113.1 Line Protection Applications. . . . . . . . . . . . . . . . . . . . . . . . 11

3.1.1 State Comparison Protection Schemes . . . . . . . . . . . 143.1.2 Analogue Comparison Protection Schemes. . . . . . . . 183.1.3 Protection Relay Communication

in the IEC 61850 . . . . . . . . . . . . . . . . . . . . . . . . . 213.2 System Protection Schemes . . . . . . . . . . . . . . . . . . . . . . . . 22

3.2.1 SPS Applications . . . . . . . . . . . . . . . . . . . . . . . . . 233.2.2 SPS Architecture . . . . . . . . . . . . . . . . . . . . . . . . . 243.2.3 Wide Area Protection & Control (WAP&C). . . . . . . 25

4 Field Device to Central Platform Applications . . . . . . . . . . . . . . . 294.1 Power System SCADA . . . . . . . . . . . . . . . . . . . . . . . . . . . 304.2 Synchrophasor-Based Wide Area Monitoring System. . . . . . . 314.3 Other IP-Based Monitoring Applications in the Substation . . . 34

5 Inter-platform Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37

6 Office-to-Field Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 396.1 Remote Access from Office to Grid Device

and Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 416.2 Field Worker Access to Central Platforms

and Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

7 Smart Distribution Applications . . . . . . . . . . . . . . . . . . . . . . . . . 45

Part II Provisioning of Utility-Grade Communication Services

8 Service Provisioning, Quality of Service, and SLA . . . . . . . . . . . . 49

xiii

9 Service Specification Attributes . . . . . . . . . . . . . . . . . . . . . . . . . . 539.1 Operational Coverage and Topology . . . . . . . . . . . . . . . . . . 539.2 Throughput . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 549.3 Time Constraints. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 559.4 Service Integrity and Data Loss . . . . . . . . . . . . . . . . . . . . . 599.5 Availability and Dependability . . . . . . . . . . . . . . . . . . . . . . 629.6 Communication Security . . . . . . . . . . . . . . . . . . . . . . . . . . 649.7 Future Proofing, Legacy Support, Vendor Independence . . . . 659.8 Electromagnetic and Environmental Constraints . . . . . . . . . . 669.9 Service Survivability, Resilience and Disaster Readiness . . . . 679.10 Cost Considerations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68

10 Building and Adjusting Service Level Agreements . . . . . . . . . . . . 75

11 Service Provisioning Models—Impact on the Delivery Process . . . 81

Part III Delivery of Communication Services in the UtilityEnvironment

12 Introduction on Service Delivery . . . . . . . . . . . . . . . . . . . . . . . . . 89

13 Communication Service Delivery Architecture . . . . . . . . . . . . . . . 91

14 Service Interfacing at the Access Point. . . . . . . . . . . . . . . . . . . . . 9514.1 Legacy Interfacing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9514.2 Ethernet Access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96

15 Synchronization at User-to-Network Interface . . . . . . . . . . . . . . . 99

16 Circuit and Packet Conversions at the Service Access Point . . . . . 10316.1 Packet Over TDM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10316.2 Circuit Emulation Over Packet . . . . . . . . . . . . . . . . . . . . . . 104

17 Modeling the Service Delivery Process . . . . . . . . . . . . . . . . . . . . . 109

18 Managing the Delivered Communication Service . . . . . . . . . . . . . 115

19 Meeting Service Quality at a Packet-Switched Access Point . . . . . 119

20 Integrating Service Delivery for IT and OT Communications . . . . 129

Part IV Deploying Reliable and Secure Network Infrastructures

21 Deploying Reliable and Secure Network Infrastructures . . . . . . . . 137

22 An Overview on Network Technologies . . . . . . . . . . . . . . . . . . . . 13922.1 Multiplexing and Switching Fundamentals . . . . . . . . . . . . . . 13922.2 Optical Communication . . . . . . . . . . . . . . . . . . . . . . . . . . . 14022.3 Wavelength Division Multiplexing (C- and D-WDM) . . . . . . 14122.4 Time Division Multiplexing (PDH and SDH) . . . . . . . . . . . . 14222.5 Optical Transport Networks (OTN) . . . . . . . . . . . . . . . . . . . 145

xiv Contents

22.6 Ethernet Transport. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14622.7 Multi-protocol Label Switching (MPLS) . . . . . . . . . . . . . . . 14722.8 MPLS-TP or IP-MPLS in Operational Context . . . . . . . . . . . 15022.9 Radio Communication . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15122.10 Power Line Carrier . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153

23 Hierarchical and Overlay Architectures . . . . . . . . . . . . . . . . . . . . 155

24 Revisiting the Process Model—Upstream Management . . . . . . . . . 16124.1 Policy Definition and Business Planning . . . . . . . . . . . . . . . 16324.2 Strategic Deployment and Tactical Adjustments . . . . . . . . . . 16524.3 Business Development, Service Offer, and Service

Migrations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169

25 Telecom Network Asset Ownership . . . . . . . . . . . . . . . . . . . . . . . 17125.1 Fiber and RF Infrastructure . . . . . . . . . . . . . . . . . . . . . . . . 17225.2 Transport Network Assets . . . . . . . . . . . . . . . . . . . . . . . . . 17525.3 Application Service Networks and Platforms . . . . . . . . . . . . 176

26 Planning Network Transformations and Migrations . . . . . . . . . . . 177

27 Cyber-Secure and Disaster-Resistant Communications . . . . . . . . . 18327.1 Risk and Impact Assessment . . . . . . . . . . . . . . . . . . . . . . . 18427.2 Designing for Cyber-Security . . . . . . . . . . . . . . . . . . . . . . . 18527.3 Designing for Disaster-Resistance . . . . . . . . . . . . . . . . . . . . 190

Part V Maintaining Network Operation

28 Maintaining Network Operation—Introduction . . . . . . . . . . . . . . 195

29 Reasons for a Formal Approach to O&M . . . . . . . . . . . . . . . . . . 197

30 O&M Scope, Process, and Organization . . . . . . . . . . . . . . . . . . . 20130.1 User-Provider Relationship . . . . . . . . . . . . . . . . . . . . . . . . . 20230.2 Network Perimeter for O&M . . . . . . . . . . . . . . . . . . . . . . . 20330.3 Scope of O&M Activities. . . . . . . . . . . . . . . . . . . . . . . . . . 20430.4 Evolution of O&M Scopes and Processes. . . . . . . . . . . . . . . 20530.5 Transforming the O&M . . . . . . . . . . . . . . . . . . . . . . . . . . . 20630.6 Operation and Maintenance Organization . . . . . . . . . . . . . . . 20830.7 Network Operation Center Activities . . . . . . . . . . . . . . . . . . 210

31 Managing Faults and Anomalies . . . . . . . . . . . . . . . . . . . . . . . . . 21331.1 Fault Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21331.2 Fault Localization and Problem Management . . . . . . . . . . . . 21731.3 Fault Notification and Reporting . . . . . . . . . . . . . . . . . . . . . 21731.4 Fault Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21831.5 Fault Recovery and Reporting. . . . . . . . . . . . . . . . . . . . . . . 218

Contents xv

32 Incident Management and Work Assignment . . . . . . . . . . . . . . . . 219

33 Configuration and Change Management . . . . . . . . . . . . . . . . . . . 22133.1 Configuration Database—Network and Service Inventory. . . . 22133.2 User Order Handling and Service Activation . . . . . . . . . . . . 22433.3 Configuration and Change Management, Capacity

Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22433.4 O&M Tools and IT Platform Management . . . . . . . . . . . . . . 22633.5 Asset Lifecycle and Spare Management . . . . . . . . . . . . . . . . 226

34 Quality and Performance Monitoring . . . . . . . . . . . . . . . . . . . . . 22934.1 TDM Transmission Performance Monitoring . . . . . . . . . . . . 23034.2 Packet-Switched Network Performance Monitoring . . . . . . . . 230

35 Telecom O&M Communications and Field Worker Support . . . . . 23335.1 Telecom O&M Communications . . . . . . . . . . . . . . . . . . . . . 23335.2 Connecting to Field Device and Management Platforms. . . . . 23435.3 Human-to-Human O&M Communications . . . . . . . . . . . . . . 23535.4 External O&M Interventions. . . . . . . . . . . . . . . . . . . . . . . . 23635.5 Field Worker Access to Operational Sites and Assets. . . . . . . 23735.6 Disaster-Mode Operation . . . . . . . . . . . . . . . . . . . . . . . . . . 240

Appendix 1: Termination Networks and Service Access. . . . . . . . . . . . 243

Appendix 2: ITIL Management Framework . . . . . . . . . . . . . . . . . . . . 253

Appendix 3: Some Relevant Standards . . . . . . . . . . . . . . . . . . . . . . . . 259

Appendix 4: CIGRE Technical Brochure Contributors . . . . . . . . . . . . 263

Bibliography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265

Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267

xvi Contents

About the Editors

Editor

Mr. Carlos Samitier holds a degree in Telecommunication and an MBA from theUniversity of Madrid. He has been working for more than 35 years in the field ofPower Utility Control Networks. He is the founder and CEO of Pullnet a companyproviding solutions in the field of networking and automation for Power Utilities aswell as IEC 61850 tools.

He spent his professional career working in the field of Telecom for OperationalApplications developing different Telecom solutions for Protection and Controlapplications and he has also been playing an active role in different standardisationbodies being the co-author of several standards.

He is strongly involved with CIGRE. He serves as the Chairman of StudyCommittee D2 on Information Systems and Telecommunication. Since 1997, hehas been the member and convenor of different working groups. He has contributedactively within CIGRE publishing for more than 40 papers in international con-ferences and symposia. He received the Technical Committee Award in 2003 andwas appointed Distinguished Member and Honorary member of CIGRE in 2012and 2016 respectively.

Co-Editor

Mr. Mehrdad Mesbah is a senior telecom expert in charge of innovation andtechnical strategies in Utilities Communications for GE Energy Connections in Paris,France. He has been involved for over thirty years in telecom network design andimplementation, network transformation plans, telecom architectures and technolo-gies for numerous power utilities across the world. He has contributed to CIGRE D2Study Committee on different aspects of operational telecoms in electrical powerutilities for over a decade. In particular, he has been in charge of internationalworking groups on operational telecom service provisioning and delivery, on utilitytelecom operation & maintenance and on protection relay communications. Atpresent he leads the CIGRE D2 Advisory Group on telecommunications.

xvii

He graduated in electronic engineering from Southampton University, UK in1982 and in telecom engineering from Ecole Nationale Superieure des Telecom-munications (Telecom Paristech), Paris, France in 1984. Mehrdad Mesbah hasauthored many technical papers and received the CIGRE technical award forTelecommunications and Information Systems in 2008.

xviii About the Editors

Abbreviations

ACL Access Control List (Cyber-security)ACSI Abstract Communication Service InterfaceADSL Asymmetric Digital Subscriber LineADSS All Dielectric Self Supporting optical cableAGC Automatic Generation ControlAMI Advanced Metering InfrastructureAN Application NetworkBCP Business Continuity PlanningBE Best Effort (IP)BER Bit Error RateBO Blocking Overreach ProtectionBPL Broadband Power Line CommunicationBWM Broadband Wireless MeshCAPEX Capital ExpenditureCB Circuit BreakerCD Collision DetectionCDMA Code Division Multiple AccessCDP/CDR Current Differential Protection/RelayCIR Committed Information RateCMDB Configuration Management DataBaseCOS Class of ServiceCRC Cyclic Redundancy CheckCSMA Carrier Sense Multiple AccessCWDM Coarse Wavelength Division MultiplexingDA Distribution AutomationDCUB Directional Comparison UnBlocking ProtectionDiffserv Differentiated services (QoS)DM Degraded MinutesDMS Distribution Management SystemDMZ De-militarized ZoneDNS Domain Name ServerDoS Denial of ServiceDR Demand ResponseDR Disaster Recovery

xix

DSL Digital Subscriber LineDSM Demand Side ManagementDSSS Direct Sequence Spread SpectrumDTT Direct Transfer TrippingDWDM Dense Wavelength Division MultiplexingE1 2048 kbps G.703 interfaceECMP Equal Cost Multipath Routing (MPLS)EDFA Erbium-doped Fiber AmplifierEF Expedited Forwarding (IP)EFM Ethernet in the First MileEHV Extra-High VoltageEIA Electronic Industries Alliance (USA)EIRP Equivalent Isotropic Radiated PowerE-LAN Multipoint Carrier Ethernet ServiceE-Line Point-to-point Carrier Ethernet ServiceEMC Electromagnetic CompatibilityEMS Energy Management SystemEoS Ethernet over SDH/SONETEPL Ethernet Private LineEPLAN Ethernet Private LANEPON Ethernet Passive Optical NetworkEPR Earth Potential RiseEPU Electrical Power UtilityERP Ethernet Ring ProtectionES Errored SecondsEVC Electrical Vehicle ChargerEVPL Ethernet Virtual Private LineEVPLAN Ethernet Virtual Private LANFACTS Flexible Alternating Current Transmission SystemFAN Field Area NetworkFCAPS Fault, Configuration, Accounting, Performance, and SecurityFDIR Fault Detect, Isolate, and Service RestoreFDM Frequency Division MultiplexingFEC Forward Error CorrectionFEC Forwarding Equivalence ClassFHSS Frequency Hopping Spread SpectrumFRR Fast Re-route Restoration (MPLS)FTTX Fiber to the Home, Curb, etc.GbE Gigabit EthernetGFP Generic Framing Protocol (Ethernet over SDH)GIS Geospatial Information SystemGOOSE Generic Object Oriented Substation EventGPRS General Packet Radio ServiceGPS Geostationary Positioning SatelliteGSE Generic Substation Event

xx Abbreviations

GSM Global System for Mobile CommunicationsGSM-R GSM for RailwaysHAN Home Area NetworkHDSL High-speed Digital Subscriber LineHMI Human Machine InterfaceHRP Hypothetical Reference Path (ITU-T Y.1541)HSDPA High-Speed Downlink Packet AccessHTTP (-S) HyperText Transfer Protocol (-Secure)HVAC Heating, Ventilation, Air-ConditioningHVDC High Voltage Direct CurrentICCP Inter-Control Center ProtocolICMP Internet Control Message ProtocolICT Information and Communication TechnologyIDS Intrusion Detection SystemIDU Indoor UnitIEC International Electrotechnical CommissionIED Intelligent Electronic DeviceIEEE Institute of Electrical and Electronic EngineeringIETF Internet Engineering Task ForceIGMP Internet Group Management ProtocolIP Internetworking ProtocolIPG Inter-Packet GapIPS Intrusion Protection SystemIT Information TechnologyITIL Information Technology Infrastructure LibraryITU-T International Telecommunication UnionJBD Jitter Buffer DelayL2TP Layer 2 Tunneling ProtocolLAN Local Area NetworkLCAP Link Aggregation Control ProtocolLCAS Link Capacity Adjustment SchemeLDP Label Distribution Protocol (MPLS)LMR Land Mobile RadioLN Logical NodeLOS Line-of-Sight wireless linkLSP Label Switched PathLSR Label Switch RouterLTE Long-Term Evolution Cellular Mobile Network (4G)MAC Medium Access ControlMAN Metropolitan Area NetworkMEF Metro Ethernet ForumMIB Management Information BaseMM Multimode FiberMMS Manufacturing Message ServiceMPLS Multi-Protocol Label Switching

Abbreviations xxi

MPLS-TP Multi-Protocol Label Switching - Transport ProfileMSP Multiplex Section ProtectionMSTP Multiple Spanning Tree ProtocolNBI North-Bound Interface (Network Management)ND Network DelayNERC North American Electric Reliability CorporationNERC-CIP NERC Critical Infrastructure ProtectionNGOSS Next Generation Operation Support SystemNLOS Non-Line-of-Sight wireless linkNMS Network management systemNNI Network to Network InterfaceNOC Network Operation CenterNTP Network Time ProtocolO&M Operation and MaintenanceOAM Operation Administration and MaintenanceODF Optical Distribution FrameODU Outdoor UnitOFDM Orthogonal Frequency Division MultiplexingOMS Outage Management SystemOPEX Operation ExpenditureOPGW Optical Ground WireOSPF Open Shortest Path FirstOSS Operation Support SystemOT Operational TechnologyOTN Optical Transport Network (ITU-T)PD Packetization DelayPDC Phasor Data ConcentratorPDH Plesiochronous Digital HierarchyPDV Packet Delay VariationPED Packet Encapsulation DelayPER Packet Error RatioPHB Per Hop BehaviorPHEV Pluggable Hybrid Electrical VehiclePHP Penultimate Hop Popping (MPLS)PING Packet Internet Groper (ICMP echo request)PIR Peak Information RatePLC Power Line CarrierPLR Packet Loss RatioPMR Private Mobile RadioPMU Phasor Measurement UnitPOE Power over EthernetPON Passive Optical NetworkPOS Packet over SONET (similar to EoS)POTT Permissive Overreach Transfer TrippingPPP Point-to-Point Protocol

xxii Abbreviations

PRC Packet Route ControlPRP Parallel Redundancy ProtocolPRR Packet Route Restore TimePSTN Plain Switched Telephone NetworkPTD Packet Transfer DelayPTP Precision Time Protocol (IEEE 1588)PUTT Permissive Underreach Transfer TrippingPW PseudoWirePWE PseudoWire EmulationPWE3 Pseudowire Emulation Edge-to-EdgeQAM Quadrature Amplitude ModulationQD Queuing DelayQoS Quality of ServiceRADIUS Remote Authentication Dial-In User ServiceRAS Remedial Action SchemeRCA Root Cause Analysis (Fault Management)RF Radio FrequencyRFC Request for Comments (IETF)RMON Remote MonitoringRSTP Rapid Spanning Tree ProtocolRSVP Resource Reservation ProtocolRTU Remote Terminal UnitSAN Storage Area NetworkSAP Service Access PointSAS Substation Automation SystemSAToP Structure-Agnostic Time Division Multiplexing over PacketSCADA Supervisory Control And Data Acquisition (system)SDH Synchronous Digital HierarchySES Severely Errored SecondsSFD Store-and-Forward DelaySHDSL Single-pair High-Speed Digital Subscriber LineSIPS System Integrity Protection SchemeSLA Service Level AgreementSM Single Mode FiberSNCP Sub-Network Connection ProtocolSNMP Simple Network Management ProtocolSNR Signal-to-Noise RatioSNTP/NTP (Simple) Network Timing ProtocolSOC Security Operation CenterSONET Synchronous Optical NetworkSPS System Protection SchemeSSDSL Synchronized Symmetric Digital Subscriber LineSSH Secure ShellSSL Secure Socket LayerSTP Shielded Twisted Pair

Abbreviations xxiii

STP Spanning Tree ProtocolSV Sampled ValueSyncE Synchronous EthernetTACACS Terminal Access Controller Access control System

(Cyber-security)TASE-2 Telecontrol Application Service ElementTCP Transmission Control ProtocolTDD Time Domain Duplexing (Ping-Pong)TDM Time Division MultiplexingTDMA Time Division Multiple AccessTE Traffic EngineeringTETRA Terrestrial Trunked Radio (previously Trans-European Trunked

Radio)TI Time IntervalTLS Transport Layer SecurityTMF Telemanagement ForumTN Transport NetworkTP Teleprotection SignalingTPC Twisted Pair CableTS Time SlotTSP Telecom Service ProviderUA User ApplicationUDP User Datagram ProtocolUHF Ultra-High Frequency RadioUMTS Universal Mobile Telecommunication SystemUNI User to Network InterfaceUTC Utilities Telecom CouncilU-Telco Utility Telecom Commercial Service Operator CompanyuTOM Utilities Telecom Operation MapUTP Unshielded Twisted PairVC Virtual ContainerVCAT Virtual ConcatenationVDSL Very High bitrate Digital Subscriber LineVID VLAN IdentifierVLAN Virtual Local Area NetworkVoIP Voice over IPVPLS Virtual Private LAN ServiceVPN Virtual Private NetworkVSAT Very Small Aperture satellite TerminalVVC/VVO Volt-VAR Control/OptimizationWAMS Wide Area Monitoring SystemWAN Wide Area NetworkWAP&C Wide Area Protection and ControlWDM Wavelength Division MultiplexingWiFi Wireless Fidelity

xxiv Abbreviations

WiMAX Worldwide Interoperability for Microwave AccessWLAN Wireless Local Area NetworkWMAN Wireless Metropolitan Area NetworkWPA/WPA2 WiFi Protected AccessWPAN Wireless Personal Area NetworkWSN Wireless Sensor Network

Abbreviations xxv

Introduction

Electrical Power Utilities (EPUs) are increasingly dependent upon the existence offast, secure and reliable communications services. These services interconnect theactors, platforms, and devices constituting the technical, commercial, and corporateprocesses of the utility across its different industrial and corporate sites. Thecommunication services are provisioned, managed, and maintained in differentways depending upon different quality constraints, cost and regulatory imperativesand company policy considerations. The services can be integrated together into acommon network or provisioned through completely separate networks. Theassociated telecommunication organization of the utility varies correspondinglyamong power utilities.

This green book is about the specification and provisioning of communicationservices for the electrical power utility operational applications, the consequentdeployment or transformation of networks to deliver these specific communicationservices, and finally the way the network and its services can be monitored,operated, and maintained to assure that the high quality of service necessary for theoperation of the power system is achieved. It is composed of 5 parts as presented inFig. 1.

Implementing telecom networks in the power utility is neither a top-down nor abottom-up process: we cannot dimension the network from the sum of requirementsand we cannot build the network and see which application requirements arefulfilled. There is a circular relationship between requirements and capabilities!

The network is planned and deployed without full and precise knowledge of allapplications that it shall be serving over its useful life-time. The communicationrequirements of existing applications are growing with the new data transmissioncapabilities of the telecom network. An operational department cannot thereforegive a very reliable projection of its application’s exchange requirements. Similarly,“distributed intelligence” applications are designed according to data throughput,time delay and dependability levels that the network can assure.

At the same time, the power system telecom network and its potential userapplications are much more intimately coupled than in the case of a commercialmulti-purpose telecommunication infrastructure and must be designed to cover allrequirements. As an example, power system protection relaying represents aninsignificant proportion of the network’s traffic but cannot be discarded in the

xxvii

Electrical Utility telecom network design! By comparison, a telecom operator’sservice catalog covers only the requirements of an economically viable portionof the total potential demand.

Another important issue in this respect is the relative time-scales of applicationsdeployment and network deployment. Considering the extremely rapid pace ofevolution in communication technologies an early network deployment for farfuture applications results in unused capabilities and therefore investments and maystill result in costly and yet unsuitable services when the applications are finallydeployed as cost and capabilities of telecom technology evolves in the meantime.On the other hand, a network cannot be planned, designed and deployed overnightto provide the necessary services adapted to new applications, new regulatoryconstraints, or new organizational requirements.

The same arguments may be applied to the processes, organizational changes,and tools for the management of the telecom network and service. These need to beadapted to size, type, and scope of the telecommunication services and infrastruc-tures. One cannot undertake major modifications in view of far future networkexpansions but a change of scale cannot be produced spontaneously.

As a conclusion, network planning, communication requirements assessment,and management process design are continuous and iterative processes performedconcurrently as shown in Fig. 1.1. These tasks necessitate continuous examining oftime-scales, technological and economical surveys, and organizational and

Utility Applications

Communication Services

Services Attributes & Requirements

Service catalog

Network Resources

Transport Network

ArchitectureResource-sharing

Network Technologies

Assuring Peer-to-peer performance

Service Access & Aggregation

Provisioning Mode

Network Management

Network Planning

Service Monitoring & Management

Communication Service Telecommunication Network

PART 1

PART 2

PART 3

PART 5

PART 4

Fig. 1 Implementation process for utility telecom services and infrastructures

xxviii Introduction

regulatory evolutions. An appropriate network development plan must comprisesteps and scenarios to allow gradual migration of a network to fulfil new require-ments. The architecture must be designed in such a way to accept predictablechange and capable to adapt to unpredicted accelerations or change of direction.

The present book is dedicated to operational communications as defined in thefollowing sections. Not only the scope and mission of CIGRE is limited to thesecommunications, but also the general-purpose enterprise network specification,design and deployment issues are abundantly covered in existing telecomnetworking literature.

Corporate enterprise communications covering the administrative applicationsof the utility organization as well as business and market communications betweenutility’s IT platforms and external power delivery stake holders are thereforeexcluded from our analysis.

The integration of IT and OT (Operational Technology) data traffic over a uniquenetwork is subject of debate across the power community. The economy of scale interms of infrastructure and management effort, sought through convergence, is to bereconciled with the requirement for cyber-security in the operational environment,difference in applications life cycles, as well as resilience to change and serviceoutage. An assessment of opportunities and risks for the integrated transport ofEnterprise and Operational networks (IT and OT networks) is given in Chap. 20.

One should however note that new applications at the frontier of Enterprise andOperational networks, Technical Office-to-Field Process applications, constituteone of the main paradigms of the new utility communications. These IT/OTapplications are described and taken into account as part of the general servicerequirements. Their secure deployment is discussed in the respective sections of theentire book.

The book being largely the synthesis of several works performed in CIGRE D2working groups over the recent years, very large extracts of the correspondingCIGRE Technical Brochures have been reproduced without major change, althoughre-organized, updated, and completed as necessary to fill detected gaps, to eliminateredundancies and finally to make it comprehensive and fluid. References used bythe Technical Brochures have not been cascaded in the present volume and can befound for further reading in the original documents. I hereby acknowledge theusage of this great number of publications. The list of CIGRE Technical Brochuresused as source to the book is produced in the appendix.

Introduction xxix