Table 2-1: SWOT matrix for current Agent Applications to power systems [15]. ..... platform will serve as an automatic fault locator and reconfiguration entity for the ...... Creating and Managing the Global Agent Descriptor Table (GADT), which is ...
Agent Based Modeling of Power Distribution Systems by Sridhar Chouhan
Thesis submitted to the College of Engineering and Mineral Resources at West Virginia University in partial fulfillment of the requirements for the degree of
Master of Science in Electrical Engineering
Prof. Ali Feliachi, Ph.D., Chair Prof. Daryl S Reynolds, Ph.D. Prof. Muhammad A. Choudhry, Ph.D.
Lane Department of Computer Science and Electrical Engineering
Morgantown, West Virginia 2009
Keywords: Multi-Agent System, Fault Detection, Reconfiguration, DEW©, JADE, Power World Simulator.
Copyright 2009 Sridhar Chouhan
ABSTRACT Agent Based Modeling of Power Distribution Systems by Sridhar Chouhan Master of Science in Electrical Engineering West Virginia University Professor Ali Feliachi, Ph.D., Chair The electric power system is a very vast network and becoming more complex each day. The traditional vertically monopolistic structure has been deregulated and replaced by gencos, transcos and, discos; increasing the power system intricacy. During the past few decades there has been remarkable development in software and hardware technologies for the analysis and design activities in power system planning, operation, and control. However, much still depends on the judgment of human experts. A single fault in power system can lead to multiple faults and can collapse the whole system. Power System needs a more decentralized control mechanism for solving these problems. One novel solution would be Multi-agent Systems. A Multi-agent system is a collection of agents, which perceives the system changes and acts on the system in order to achieve its goals. Recent technology developments in the area of Multi-agent systems making it a viable solution for today’s complicated power network. A Multi-agent system model is developed for fault detection and reconfiguration in this thesis work. These models are developed based on graph theory tree models and mathematical models. A set of objective functions are specified in the mathematical model for the restoration of the network. The agent platform for the fault detection is developed by Java Agent Development Framework. The restoration algorithm is programmed in MATLAB and applied to the distribution system modeled in the commercial software, Distributed Engineering Workstation and Power World Simulator. The test system in this thesis is, a distribution system developed by Southern California Edison called Circuit of the Future. The Multi-agent system can detect the fault precisely and reconfigures the circuit using the reconfiguration algorithm. The reconfiguration will happen in a way that it always try to supply all the critical loads in the network. When there are multiple solutions available for reconfiguration, the one with good voltage profile and less power loss is selected as the solution. The algorithm makes use of shunt compensation and priority based load shedding in order to control the voltage across the network. Agents make use of learning to speed up the reconfiguration process.
DEDICATION
I would like to dedicate this thesis to my parents, who carved me to whatever little I am today, & My adorable cousin, Koneri Srinivas, who helped me in each mode of my life.
***
Grand pa, you are deeply missed!
iii
The only living gods on earth are, ‘Parents’
iv
ACKNOWLEDGEMENTS After two years of my degree, I have learned one thing – I could never have completed my research work and the thesis dissertation, without the support and encouragement of many people around me. First of all, I would like to thank my esteemed mentor and advisor, Dr. Ali Feliachi. I owe him so much. He has given me a chance to continue my work in the field of power systems, which is actually my passion. He taught me much of what I know today and guided me throughout my research work. I would also like to thank rest of my thesis committee, Dr. Muhammad A Choudhry and Dr. Daryl S Reynolds, for their support and advice. I would like to thank Dr. Hong-Jian Lai for helping me out with the mathematical modeling used in this thesis work.
I extend the appreciation to Professor Hui Wan, all other faculty members in APERC and the staff in LDCSEE for their encouragement and support. I would also like to express my thanks to my friends in APERC for the healthy discussions regarding my research work. A special thanks to Ms. Koushaly Nareshkumar for helping me in understanding Multi-agent concepts related to power distribution systems. For assistance in JADE programming, my thanks are extended to Ms. Summiya Moheuddin. I’ve been fortunate enough to have a great group of friends at WVU. I would like to thank all of them for making my master’s life joyful and memorable. Specially, I would like to thank my best friends Usha, Navya, and all my roommates, who were always there for me when I needed moral support.
I would like to thank my family for their unending support and love from childhood to now. Without their support I couldn’t have made it through this process or any of the tough times in my life. My sincere gratitude goes to my cousin for helping and motivating me throughout my life. My humble pranam goes to the almighty god for being with me as a guiding light throughout my life.
This work was supported in part by grants from the US DEPSCoR/ONR grant No. N00014-03-1-0660 and the US DoE grant No. DE-FC26-06NT42793.
v
CONTENTS ABSTRACT ..........................................................................................................................ii Dedication ...........................................................................................................................iii Acknowledgements ............................................................................................................. v Contents ..............................................................................................................................vi List of Figures...................................................................................................................... x List of Tables ..................................................................................................................... xiii Nomenclature ....................................................................................................................xiv Chapter 1 ............................................................................................................................ 1 INTRODUCTION................................................................................................................. 1 1.1
Background ......................................................................................................... 1
1.2
Multi-Agent Systems............................................................................................ 3
1.3
Agent Communication ......................................................................................... 7
1.3.1 FIPA-ACL ........................................................................................................... 8 1.3.2 Knowledge Query and Manipulation Language (KQML) .................................. 10 1.4
Problem Statement............................................................................................ 11
1.5
Approach ........................................................................................................... 12
1.6
Outline ............................................................................................................... 13
Chapter 2 .......................................................................................................................... 14
vi
Literature Review .............................................................................................................. 14 2.1
Multi-agent systems........................................................................................... 14
2.2
MAS in Automatic Fault Detection and Reconfiguration.................................... 16
2.3
MAS in Distribution System with DER ............................................................... 20
2.4
MAS in protection coordination.......................................................................... 21
2.5
MAS in Voltage Control ..................................................................................... 24
2.6
MAS in Power Markets ...................................................................................... 25
2.7
MAS in other engineering disciplines ................................................................ 26
2.8
Limitations and Technical challenges of MAS ................................................... 27
Chapter 3 .......................................................................................................................... 30 Simulation Software .......................................................................................................... 30 3.1
MATLAB ®......................................................................................................... 31
3.2
MATPOWER ..................................................................................................... 32
3.3
Java Agent Development Framework ............................................................... 32
3.3.1 JADE Architecture ............................................................................................ 33 3.3.2 JADE Programming.......................................................................................... 37 3.4
Distributed Engineering Workstation© (DEW)................................................... 37
3.5
Power World Simulator...................................................................................... 39
Chapter 4 .......................................................................................................................... 42 Mathematical Model and Algorithms for MAS ................................................................... 42 4.1
Mathematical Model .......................................................................................... 42
vii
4.1.1 Graph Theory ................................................................................................... 42 4.1.2 Graph Theory representation of Power System ............................................... 43 4.2
Fault Detection Algorithm .................................................................................. 45
4.3
Fault Reconfiguration & Restoration Algorithm ................................................. 45
4.3.1 Reconfiguration algorithm for single fault ......................................................... 46 4.3.2 Reconfiguration algorithm for two faults ........................................................... 46 4.3.3 Reconfiguration algorithm for three faults ........................................................ 46 4.3.4 Objective functions and Constraints ................................................................. 48 4.4
Illustration .......................................................................................................... 49
Chapter 5 .......................................................................................................................... 51 Simulation and Results...................................................................................................... 51 5.1
Proposed MAS Architecture .............................................................................. 51
5.2
Circuit of the Future (CoF)................................................................................. 54
5.3
Fault Detection and Reconfiguration Algorithm ................................................. 57
5.3.1 Test Case 1: For a Single Fault........................................................................ 59 5.3.2 Test Case 2: For Multiple Faults ...................................................................... 63 5.4
MATLAB Reconfiguration .................................................................................. 65
5.4.1 Test Case 3: For a Line Fault........................................................................... 68 5.4.2 Test Case 4: For two Line Faults ..................................................................... 73 5.4.3 Test Case 5: For three Line Faults ................................................................... 76 5.4.4 Test Case 6: Special Scenario ......................................................................... 78
viii
5.4.5 Test Case 7: Special Scenario ......................................................................... 80 5.5
Algorithm Execution Duration ............................................................................ 82
Chapter 6 .......................................................................................................................... 84 Conclusion and Future Work............................................................................................. 84 6.1
Conclusion......................................................................................................... 84
6.2
Future Work....................................................................................................... 86
References ........................................................................................................................ 88
ix
LIST OF FIGURES Figure 1-1: A Multi-agent System for Power System. ......................................................... 4 Figure 1-2: FIPA ACL message [14]. .................................................................................. 9 Figure 1-3: KQML communication protocol [6]................................................................. 11 Figure 3-1: Architecture of the Simulation Model. ............................................................. 31 Figure 3-2: Relationship between main architectural elements [67].................................. 34 Figure 3-3: JADE Graphical User Interface (GUI). ............................................................ 36 Figure 3-4: JADE run-time environment............................................................................ 36 Figure 3-5: Organizational structure of DEW [69]. ............................................................ 38 Figure 3-6: Distributed Engineering Workstation’s Working Environment......................... 39 Figure 3-7: Snapshot of Circuit of the Future one line diagram......................................... 40 Figure 3-8: Snapshot of Model Explorer of Power World Simulator [70]........................... 41 Figure 4-1: Graph model of power distribution system...................................................... 44 Figure 4-2: Flow Chart for Fault Reconfiguration .............................................................. 47 Figure 4-3: Representation of Simplified CoF. .................................................................. 50 Figure 5-1: Proposed Multi-agent system architecture...................................................... 52 Figure 5-2: Global Agent (GAG) functionalities. ................................................................ 53 Figure 5-3: The Circuit of the Future modeled in DEW [2]. ............................................... 55 Figure 5-4: The Simplified CoF modeled in Power World Simulator. ................................ 56 Figure 5-5: Flow chart for Fault Detection and Reconfiguration........................................ 58 Figure 5-6: Simplified CoF with fault in line 2-3................................................................. 59 Figure 5-7: Power World Simulator’s Load flow report for line fault at line 2-3. ................ 60 Figure 5-8: JADE message passing between agents for line fault at line 2-3. .................. 60 x
Figure 5-9: Java output console showing results of Test Case 1...................................... 61 Figure 5-10: MATLAB plot depicting reconfiguration network for fault at line 2-3. ............ 62 Figure 5-11: JADE message passing between agents for line faults at line 1-2 and 1-5. . 63 Figure 5-12: Java output console showing results of Test Case 2.................................... 63 Figure 5-13: MATLAB plot depicting reconfiguration network for fault at line 1-2 and 1-5.64 Figure 5-14: MATLAB GUI for Fault Reconfiguration........................................................ 65 Figure 5-15: MATLAB plot depicting basic Simplified CoF................................................ 67 Figure 5-16: MATLAB plot depicting voltage profile with S1 closed for line fault at 1-2..... 68 Figure 5-17: MATLAB plot depicting voltage profile with S2 closed for line fault at 1-2..... 69 Figure 5-18: MATLAB plot depicting voltage profile with S3 closed for line fault at 1-2..... 69 Figure 5-19: MATLAB plot depicting voltage profile with S1&S5 closed for line fault at 1-2. .......................................................................................................................................... 70 Figure 5-20: MATLAB plot depicting voltage profile with S2&S5 closed for line fault at 1-2. .......................................................................................................................................... 71 Figure 5-21: MATLAB plot depicting reconfiguration network for fault at line 1-2. ............ 72 Figure 5-22: Plot depicting voltage profile with S1, S5 & S7 closed for line faults at 1-2 & 14-15, without voltage control. .......................................................................................... 73 Figure 5-23: Plot depicting voltage profile with S1, S5 & S7 closed for line faults at 1-2 & 14-15 with shunt compensation......................................................................................... 74 Figure 5-24: MATLAB plot depicting reconfiguration network for fault at lines 1-2 and 1415. ..................................................................................................................................... 75 Figure 5-25: Plot depicting voltage profile with S1, S5 & S7 closed for line faults at 1-2, 1415 ...................................................................................................................................... 76 Figure 5-26: MATLAB plot depicting reconfiguration network for fault at lines 1-2, 14-15 and 11-12. ......................................................................................................................... 77 Figure 5-27: MATLAB output command window showing solution of Test Case 5........... 78 xi
Figure 5-28: MATLAB plot depicting reconfiguration network for fault at lines 9-10 and 1011. ..................................................................................................................................... 79 Figure 5-29: MATLAB plot depicting reconfiguration network for fault at line 1-2……… 81 Figure 5-30: Plot of Execution Time for Fault Detection Algorithm [2]. ............................. 82 Figure 5-31: Plot of Execution Time for Fault Reconfiguration Algorithm. ........................ 82 Figure 5-32: Plot of Execution Time for Fault Reconfiguration Algorithm accessing data base. ................................................................................................................................. 83
xii
LIST OF TABLES Table 1-1: FIPA ACL Message Parameters [14]. .............................................................. 10 Table 2-1: SWOT matrix for current Agent Applications to power systems [15]. .............. 15 Table 4-1: Description of the notations used in Mathematical model................................ 43
xiii
NOMENCLATURE
ACL
Agent Communication Language
CoF
Circuit of the Future
DER
Distributed Energy Resources
DEW
Distributed Engineering Workstation
DG
Distributed Generators
FIPA
Foundation for Intelligent Physical Agents
GUI
Graphical User Interface
JADE
Java Agent Development Framework
KQML
Knowledge Query and Manipulation Language
LAG
Load Agent
GAG
Global Agent
MAS
Multi-agent System
OOP
Object Oriented Programming
SAG
Switch Agent
SCE
Southern California Edison
WVU
West Virginia University
xiv
Chapter 1 INTRODUCTION
1.1
Background
The Electrical Power System is the most capital intensive and most complex system ever developed by man. The main era of electrical power system was started by the invention of electric bulb by Thomas Alva Edison in 1879. He also started generating the electricity by building small generating stations. Edison’s method of generating and transmitting electricity was called Direct Current (DC) or Low Voltage. The main problem of DC power was that it cannot be transmitted to long distances and cannot be transformed from one voltage level to another. During this time all the loads were supplied at the same voltage level [1].
In 1888, Nikola Tesla invented the alternating current generation. In an Alternating Current (AC) system, transformers were used to step up the voltage levels and enabled the electricity to transfer over long distances. Starting from then many forms of generating the electricity came in to existence like, Thermal Power Generation, Hydro Power Generation, Diesel Power Generation and Gas Power Generations. Development in Nuclear Physics started the nuclear power generation in the recent years and made it a cheaper way of generating power. Because of the technology development even renewable energy sources are making their mark on the power generation.
1
Chapter 1: Introduction
Today Distributed Energy Resources (DERs), some times called Distributed Generators (DGs) are provided at the distribution level for serving some important local loads such as, hospital loads. The main reason for providing DER is that it serves as a local generation when there is a shortage of power supply through the grid. Power system is suffering from congestion issues because of deregulation. These issues can be solved by installing DERs near the load centers. However, Interconnection of these DERs is making the system more complicated. After inserting the DERs in to the system, we need to make sure that the system stability and voltage profile are within the safe limits. Even we need to come up with new protection coordination schemes to incorporate these DERs in to the system [2].
The Electric Power System is growing rapidly and becoming more complex each day because of its continuously increasing power demand. Besides the increasing demand deregulation in the power industry is another fact, which is making today’s electric power system to be more intrinsic. In the past, the electric power industry has been vertically integrated i.e., a central authority monitored and controlled all the activities in generation, transmission, and distribution. For the last decade or so, the electric power industry has been undergoing a process of restructuring, especially separation of transmission from generation activities. Deregulation is intended to encourage competition among utilities and power marketers to reduce energy prices. There is a need of a power system operator, to coordinate the dispatch of generating units to meet the expected demand of the system across the transmission grid. However this deregulation brought so much of complexity in the electric power system which is needed to be handled carefully [3].
Electric power system is such a vast and sensitive network that even a single fault can cause the whole system to be down. A single fault normally causes another fault in the system and this process keeps on going until the whole system collapses. This particular phenomenon in power system is said to be Cascading Effect. A power system operator, who generally monitors and controls the whole system, has to be very careful regarding this cascading phenomenon. A small human mistake can cause a massive black out in the power network leading to billions of dollar loss. A great example for this type of black out is the 2003 Northeast Blackout [4]. The major reason for the Northeast Blackout was a sudden power fluctuation in a particular area of Ohio. The outage of Ohio generating station triggered the cascading effect, causing several high voltage transmission lines to 2
Chapter 1: Introduction
go over their thermal limit. These sagged transmission lines then touched the overgrown trees in Ohio area and caused several ground faults. These things cascaded together and brought down approximately 100 generating stations. This was one of the major blackouts in the power history which caused nearly 50 million people to live in dark and 6 billion dollars of financial losses [4].
The one reason behind this massive havoc was lack of controlling on power grid using EMS (Energy Management Systems) and Restoration techniques available at that time. The power quality and reliability can be improved by having better fault detection and reconfiguration techniques. These can be achieved by a novel technique called Multiagent systems. Multi-agent systems monitor and control the power systems in an autonomous and decentralized manner. They use their communication capability to communicate and negotiate on a particular task. Recent technology developments and drastic reduction of cost are making this Multi-agent system a most viable solution.
1.2
Multi-Agent Systems
Agent based technologies have been the subject of extensive research and investigation for several years, but it is recently that these have been seen any significant degree of exploitation in commercial applications. Multi-agent systems have been used in vivid applications, ranging from small systems to most intrinsic systems. Some of the fields where these Multi-agent systems have been fruitfully employed include process control, system diagnostics, manufacturing, transportation logistics and network management [5].
Before understanding the Multi-agent systems one has to understand the concepts behind the single agent. Many people have defined the word ‘agent’ in their own ways since the starting of agent technologies. Out of many definitions available a couple of relevant definitions are given below
“An agent is an autonomous computational entity such as a software program that can be viewed as perceiving its environment through sensors and acting upon this environment through its effectors” – Weiss [6]. 3
Chapter 1: Introduction
“An agent is a computer system that is situated in some environment, and that is capable of autonomous action in this environment in order to meet its design objectives” – Wooldridge and Jennings (1995) [7].
The above two definitions are much suitable for this thesis project. Multi-agent systems received greater attention in the recent past in many intelligent, distributed systems to model the theories of interactivity in human societies. Humans interact in various ways and at different levels. For instance, humans observe and model one another, they request and provide information, they negotiate and discuss, they develop shared views of their environment, they detect and resolve conflicts, and they form organizational structures such as teams, committees, and economies [8].
In this thesis the term agent means, a software entity which perceives its environmental changes and acts on it diligently to achieve its organizational objectives. A Multi-agent system means the collection of such agents which communicate and coordinate to solve a particular problem according to their objectives. The Multi-agent system approach for power system is shown as below,
Power System
Senses
Act
Agent
Figure 1-1: A Multi-agent System for Power System.
4
Chapter 1: Introduction
The main problem facing by an agent is deciding which of its actions it should perform in order to best satisfy its organizational objectives. The type of decision selected always depends upon the type of environment. Russell and Norvig [9] proposed following classification of environment properties, •
Accessible vs Inaccessible. An accessible environment is one in which all the states of the environment are easily accessible. But most of the today’s complex networks, such as every day physical world and Internet, are inaccessible.
•
Deterministic vs Non-deterministic In deterministic environment the actions will have certain effects on the environment. In non-deterministic environments it is difficult to anticipate the effects of particular action on the environment. Non-deterministic environments will have greater difficulty in designing.
•
Episodic vs Non-episodic In an episodic environment, the performance of an agent is dependent on a number of episodes, such as mail sorting system.
•
Static vs Dynamic A static environment is one that can be assumed to be unchanged except for the actions by agent. In contrast to the static environment the real world is most dynamic one which changes time to time hence, difficult to control.
•
Discrete vs Continuous An environment is said to be discrete, if it has discrete number of actions and percepts in it. The best example for a discrete environment is chess game and for a continuous environment is car driving.
Comparing the agents to the present world computer systems, every action a computer performs is anticipated, planned for, and coded by a programmer. When a computer encounters a new sort of problem, which is not anticipated, then the system will crash. This is because the computer systems don’t have intelligence embedded in it. Unlike the computer systems the agents are intelligent enough to take up the flexible autonomous actions to satisfy their objectives [7]. Here the flexibility means three things 5
Chapter 1: Introduction
•
Reactivity: Agents are able to perceive their environment, and respond in a timely fashion to changes that occur in it, in order satisfy their objectives.
•
Pro-activeness: Intelligent agents are able to exhibit goal oriented behavior by taking the initiative in order to satisfy their objectives.
•
Social-ability: Intelligent agents are able to communicate and cooperate with other agents available in Multi-agent systems in order to satisfy their objectives.
Out of the above three characteristics the social-ability is more complex one. In the real world daily millions of computers exchange the information with both humans and other computers. But the ability to exchange the bit stream is not really the social ability. Consider the human world, humans achieve their goals by negotiation and cooperation [6]. The same way intelligent agents cooperate and negotiate with each other to achieve the common goal of the Multi-agent system. The communication between the agents in MAS has certain standards defined by FIPA (Foundation for Intelligent Physical Agents).
There is always been a great amount confusion between agents and objects, expert systems. The main distinctions between traditional view of an object and our view of an agent is listed below [6], •
Agent embody a strong notion of autonomy than objects, they decide on themselves whether or not to perform an action on request from other agents.
•
Agents are capable of flexible (reactive, pro-active, social) behavior. Where objects have nothing to do with these behaviors.
•
A MAS is inherently multi-threaded, each agent has at least one thread of control.
Expert systems are most important AI (Artificial Intelligence) technology of 1980s [10]. An Expert system is one that is capable of solving problems or giving advice in some knowledge rich domain [6] [11]. The main difference between Expert systems and Agent technologies is that, an Expert system cannot sense its environment directly. Instead, it
6
Chapter 1: Introduction
needs a middle man to input the data. In the same way an Expert system cannot act directly on its environment. It just gives certain instructions to the operator.
1.3
Agent Communication
It has been seen in the earlier section that agents will communicate to coordinate and negotiate on particular task to achieve its organizational objectives. The communication ability of agents is part perception (the receiving of messages) and part action (the sending of messages). There are generally two message types in Agent Communication they are, Assertion and Queries. Every agent, whether active or passive, must have the capability to accept the information. In order to assume a passive role in a dialogue, an agent must be able to 1) accept a query from an external source and 2) send a reply to the source by making an assertion. In order to assume an active role in a dialogue, an agent must have the capability to send queries and make assertions [6].
Communication protocols are very important in any communication systems. The Multiagent communication is specified by a data structure with the following five fields,
1. Sender. 2. Receiver(s). 3. Language in protocol. 4. Encoding and Decoding functions. 5. Action to be taken by the receiver(s).
Speech Act Theory helps in defining the message send by sender. So, that the receiver has no doubts regarding the received message [12]. In order to understand and to be understood communication messages precisely, all the agents in MAS has to follow the same ontology. Two agents following the same ontology means, those two agents will know the meaning of messages during the communication. Hence, ontology results in perfect operation of communication. In technical terms the name ontology is defined as follows,
7
Chapter 1: Introduction
“Ontology is a formal definition of a body of knowledge. The most typical type of ontology used in building agents involves a structural component. Essentially a taxonomy of class and subclass relations coupled with definitions of the relationships between these things” – Jim Hendler [6]
The main languages which are followed for the agent communication are, •
Agent Communication Language (ACL) by the Foundation for Intelligent Physical Agents (FIPA)
•
1.3.1
Knowledge Query and Manipulation Language (KQML)
FIPA-ACL
Foundation for Intelligent Physical Agents (FIPA) is an IEEE Computer Society Standards organization that promotes agent-based technology and the interoperability of its standards with other technologies. FIPA was originally formed as a Swiss based organization in 1996 to produce software standards specifications for heterogeneous and interacting agents and agent based systems [13].
FIPA has developed a certain number of standards for heterogeneous agent communications.
FIPA
Agent
Communication
specifications
deal
with
Agent
Communication Language (ACL) messages, message exchange interaction protocols, speech act theory based communicative acts, and content language representations. Agent Communication Language (ACL) developed by FIPA is based on speech act theory. Here the messages are actions, or communicative acts, as they are intended to perform some action by virtue of being sent. The FIPA ACL specifications consist of a set of message types and the description of their pragmatics, which is the effect on the mental attitudes of sender and receiver agents. A sample FIPA ACL message is as shown below,
8
Chapter 1: Introduction
Figure 1-2: FIPA ACL message [14].
As noted above, the message contains many parameters. These parameters can occur in any order in the message. The only parameter which is mandatory for the agent communication is :receiver parameter. However, for a meaningful message there should be other parameters required depending upon the situation. The full set of pre-defined message parameters is shown in the following table.
Message
Meaning:
Parameter :sender
Denotes the identity of the sender of the message. i.e., the name of the agent.
:receiver
Denotes the identity of the intended recipient of the message.
:content
Denotes content of the message; equivalently denotes the object of the action.
:reply-with
An expression which will be used by the agent responding to this message to identify the original message. Can be used to follow a Conversation thread in a situation where multiple dialogues occur simultaneously.
:in-reply-to
Denotes an expression that references an earlier action to which this message is a reply.
:envelope
Denotes an expression that provides useful information about the
9
Chapter 1: Introduction
message as seen by the message transport service. The content of this parameter is not defined in the specification, but may include time sent, time received, route, etc. :language
Denotes the encoding scheme of the content of the action.
:ontology
Denotes the ontology which is used to give a meaning to the symbols in the content expression.
:reply-by
Denotes a time and/or date expression which indicates a guideline on the latest time by which the sending agent would like a reply.
:protocol
Introduces an identifier which denotes the protocol which the sending agent is employing. The protocol serves to give additional context for the interpretation of the message.
:conversation-
Introduces an expression which is used to identify an ongoing
id
sequence of communicative acts which together form a conversation. A Conversation may be used by an agent to manage its communication strategies and activities.
Table 1-1: FIPA ACL Message Parameters [14].
The ACL language has been used in JADE, a Java agent based platform developed by Telecom-Italia.
1.3.2
Knowledge Query and Manipulation Language (KQML)
Knowledge Query and Manipulation Language (KQML) is older than the FIPA ACL language. The Knowledge Query and Manipulation Language (KQML) is a protocol for exchanging information and knowledge. The beauty of KQML language is that, all information for understanding the content of the message is included in the message pattern itself [6]. The basic protocol for the KQML language is defined by the following structure,
10
Chapter 1: Introduction
(KQML-performative : sender
: receiver
: language
: ontology
: content
…)
The KQML protocol for communications among both agents and application program is illustrated in the following figure,
Figure 1-3: KQML communication protocol [6].
Most of the today’s agent based platforms are migrating to FIPA ACL language for the agent communications.
1.4
Problem Statement
In this thesis an agent based platform is developed for a distribution system. This Agent platform will serve as an automatic fault locator and reconfiguration entity for the distribution system. The study is based on a proto-type circuit, the Circuit of the Future (CoF) developed by Southern California Edison (SCE).
11
Chapter 1: Introduction
An agent is located at each node, load, source and switch in the distribution system. When a fault occurs in the network, agents will start communicating to each other and come up with the fault location. Once the fault is detected depending upon the fault, the reconfiguration algorithm comes up with reconfigured network in which all the loads will get supplied. The final step in the reconfiguration is to do the voltage control by using shunt compensation and priority based load shedding.
A few assumptions made in this thesis work are listed below, •
The substation bus is modeled as an infinite bus. Assuming it is connected to the power-grid, where it can pull up the required power.
•
DG is modeled as a backup source.
•
When a fault is identified, the protection is applied first and isolates the faulty lines, before reconfiguration
1.5
Approach
The original CoF, is simplified by lumping certain loads without affecting the switch locations and maintaining the original topology of the system. The circuit is modeled using Distributed Engineering Workstation (DEW), power distribution software developed by Electrical Distribution Design Inc. Power World Simulator is used for single phase simulation of circuit of the future network. The software used to design the MAS is Java Agent Development (JADE) framework and MATLAB. Fault detection algorithm is developed by JADE and reconfiguration algorithm is implemented in MATLAB. This software will be presented in detail in Chapter 3.
The agent frame work in JADE will first detect the fault location and the global agent, which has the capability of performing load flow analysis on the circuit, will use the MATLAB reconfiguration algorithm to reconfigure the circuit. The one solution with less power losses and good voltage profile will be chosen as the final solution, when multiple solutions are available for the reconfiguration. In the Reconfiguration algorithm the voltage control is achieved by shunt compensation and priority based load shedding. 12
Chapter 1: Introduction
1.6
Outline
The outline of the remaining chapters is given in this section.
Chapter 2 will describe the literature overview of different multi-agent applications in power distribution systems. It also covers a few other applications of multi-agents outside the power engineering field.
A detailed description of the software packages used in this thesis is given in Chapter 3. The advantages of this software and the suitability to the relevant applications are also discussed.
A mathematical model, based on graph theory, for fault detection and reconfiguration algorithms will be presented in Chapter 4. This chapter will include the modeling of the system and the Circuit of the Future that is used in this work to perform the simulations.
Chapter 5 will present the simulations and results of the model. Finally, conclusion of this study and the future work is detailed in Chapter 6.
13
Chapter 2
LITERATURE REVIEW This chapter deals with comprehensive overview of the Multi-agent applications in power system field and many other engineering disciplines. The chapter starts with the explanation of Multi-agent system technology and its overview. Applications of Multi-agent systems in power systems, such as in automatic fault detection, reconfiguration, protection coordination, voltage control, reactive power control and power markets are presented in detail manner in the later section of the chapter. Finally the chapter concludes with explaining the Multi-agent system advantages over the traditional schemes available and technical difficulties of Multi-agent systems.
2.1
Multi-agent systems
A Multi-agent system is a computational system in which several agents cooperate and coordinate with each other to achieve some objectives. Multi-agent systems have the capability to solve problems which are difficult or sometimes impossible to solve by an individual agent. Multi-agents systems are a branch of Distribute Artificial Intelligence (DAI). As a social community the agents are able to evolve, self produce, learn, cooperate, and adapt. According to [6] the Multi-agent system environment has the following characteristics,
14
Chapter 2: Literature Review
•
Multi-agent environment provide an infrastructure specifying communication and interaction protocols.
•
Multi-agent environments are highly decentralized structures.
•
Multi-agent environments contain agents that are autonomous and distributed, and may be self-interested and cooperative.
Research on Multi-agent systems is still an ongoing process. Although Multi-agent systems have shown good results, these technologies are yet to make a significant impact in the power system area. The authors in [15] have analyzed agent based technologies under the Strengths Weaknesses Opportunities Threat (SWOT) framework. Based on the SWOT analysis they have envisaged the future application of agents in the power system area. The following table shows the SWOT matrix developed by them
•
Strengths No single point of failure
•
Opportunities Technological advances
•
Decentralized data processing
•
Collaboration/cooperation
-Fast operation
•
Develop generic agents/MAS
-Task distribution
•
Existing hardware or software
•
Ease of tackling complex problems
•
Natural solution
•
Leads to scalable, modular and
infrastructure. •
Learn
from
other
distributed
technologies.
flexible solutions •
Weaknesses Can lead to unstable operation
•
Threats Unimagined problems
•
Complexity
•
Acceptability
•
Lack of understanding
•
Lack of experts
•
Centralized schemes
•
Still its in infancy
•
Security issues
•
Lack of practical application in power
are
not
taken
seriously
area
Table 2-1: SWOT matrix for current Agent Applications to power systems [15].
15
Chapter 2: Literature Review
Z. Zhang et al. in [16] identified and described three major problems of today’s power system industry. They are distributed computing, communications, and data integration. They have suggested that the Multi-agent system technology would be a best solution for the above problems in power systems because of the power system’s distributed nature. They illustrated that the MAS can offer modular, flexible, and integrated approach for many problems in the power system area. They have proposed a four stage (Analysis, Design, Implementation, and Deployment) problem solving mechanism using Multi-agent system.
2.2
MAS in Automatic Fault Detection and Reconfiguration
Fault detection is a very important thing in providing survivability, reliability, availability, and efficiency of the power system. Many authors have contributed in the field of automatic fault reconfiguration and restoration of the power system.
Authors L. Liu et al. in [17] have proposed a new agent paradigm for fault detection and prognosis in an electric war ship. They have described the inability of traditional diagnosis schemes over the new software agent technologies for fault detection. Prognosis is the important thing in their work, where they can predict the future conditions in a time ahead and can plan for the future actions to avoid them. The proposed agent architecture has two types of agents named diagnosis agents and prognosis agents. A test case on permanent magnet synchronous motor (PMSM) has been demonstrated and the results were promising.
In [18] and [19], the authors have described the automatic fault detection and fault diagnosis (FDD) mechanism using model based methods. These methods are based, e.g., on parameter estimation, parity equations or state observers. The main aim of their work is to create several symptoms to identify the difference between normal and faulty systems. The fault in the system is detected by the use of classification or interference methods. Authors in [20] and [21] proposed the fault diagnosis and detection mechanism using analytical redundancy. In [22] K. Huang et al. had given a brief survey about the agent technologies available for fault detection and restoration in Ship board Power 16
Chapter 2: Literature Review
System (SPS). They presented a decentralized scheme of agent technology for automatic fault detection. Several test cases have been demonstrated to prove the proposed work. In [23], the authors presented different online techniques for fault detection.
Several authors have presented new methods of fault reconfiguration schemes since a decade. New technologies like Agent technologies are getting more emphasis in the field of fault detection and restoration of power systems. Many authors described the advantages of decentralized schemes over the centralized schemes.
In, [24] the authors proposed MAS for power distribution system. Unlike the traditional centralized reconfiguration schemes, they proposed a completely new decentralized reconfiguration scheme. In their Multi-agent systems each agent represents a major component in the power system such as generators, breakers, and loads. Each agent will communicate to its neighboring agent only, which makes the whole agent system more decentralized. The agent platform is created in Java Agent Development Framework (JADE), and the real power system is implemented in a real time digital simulator. The agents are implemented in iPAQs, iPAQ is a Pocket PC (PPC) developed by Hewlett Packard. Power system is modeled in Real Time Digital Simulator (RTDS). The series ports available in RTDS are used for the communication between RTDS and iPAQs. However, an interface named Field Programmable Array Gate (FPGA) is developed for the communication because of the voltage difference between RTDS and iPAQs.
In [25], the authors proposed a Multi-agent system approach for reconfiguration and restoration of Electric warship. The proposed scheme is a decentralized one, which has advantage of avoiding the single point failure as of in centralized reconfiguration scheme. In their work they have introduced three kinds of agents, named Switch Agents (SAs), Substation Breaker Agents (SBAs) and Tie Breaker Agents (TBAs). Fault detection in the system is based on monitoring the fault currents of neighboring agents. The ship board power system is modeled using three phase unbalanced PQ load models. Ship board system is developed in Virtual Test Bed (VTB) and the agent platform is developed in Matlab.
In [26], the same authors came up with a better agent model for the power system reconfiguration and restoration problem. The Multi-agent platform is developed in Java 17
Chapter 2: Literature Review
Agent Development Framework (JADE) and the power system test case is developed in Virtual Test Bed (VTB). In their work they proposed three new agents named Switch Agents (SAs), Load Agents (LAs), and Generator Agents (GAs). Here the agents communicate only to their neighboring agents and act locally, making the restoration decentralized. The restoration algorithm has certain objectives and constraints like, limit on generation, priority of loads, and transfer capacity of lines.
The three phase
unbalanced load flow is carried out by forward and backward propagation.
Takeshi Nagata et al. [27] have greatly contributed in the area of MAS for the restoration of distribution systems. They have proposed a restoration method by joint usage of Expert Systems (ES) and a Mathematical Programming (MP) approach. The main purpose of their work is to determine the optimal target system for restoration using Mathematical Programming (MP). They introduced a new topic called ‘’restorative operation cost’’, which has decreased the number of rules in the knowledge based Expert Systems (ESs). The Expert systems available at that time were inefficient in finding the optimal target configuration. The authors took up the same knowledge based Expert Systems and used Mathematical Programming methods to improve their capability of finding the optimal target configuration. Several test scenarios are presented in their work to demonstrate the combined technology of Expert Systems and Mathematical Programming.
The same authors in [28], [29] have proposed a Multi-agent architecture for power system restoration problem. This architecture was fully decentralized one, in which the agents communicate and negotiate only with their neighboring agents. In this work authors have used two types of agents named Bus Agents (BAGs) and Facilitator Agent (FAG). BAG is a bus agent situated at each and every bus in the network whereas, FAG is a Facilitator Agent situated on top of all BAGs for the decision making purpose. BAGs communicate with their neighboring agents to find out the suboptimal target configurations where as, FAG acts as a manager for decision process. Knowledge Query and Manipulation Language (KQML) has been used as an agent communication language.
In [30], authors Takeshi Nagata et al. proposed new agent architecture for power distribution system. In this publication the proposed method has a new agent called Junction Agent (JAG). JAG is a Junction Agent situated at each and every multi terminal transmission line to monitor and control it. The authors have used Foundation for 18
Chapter 2: Literature Review
Intelligent Physical Agents (FIPA) compliant XML/ACL, which is ACL (Agent Communication Language), mounted on XML (Extensible Markup Language) for communication between the agents. Several test scenarios are presented in their work demonstrate the proposed algorithm for the reconfiguration and they sound promising for the large scale power system restoration.
Later the same authors in [31] have proposed a decentralized Multi-agent architecture for the bulk power system restoration. In this work they have introduced hierarchy among the agents. They classified the agents into upper and lower level agents. The proposed system consists of several Local-area Management Agents (LMAs) and Remote-area Management Agents (RMAs). LMAs and RMAs are located in the upper level for monitoring and control purposes. Several Load Agents (LAGs) and Generator agents (GAGs) are situated in the lower level of physical power system network. LMAs are responsible for the local area restoration by means of communicating and negotiating with the neighboring LMAs. RMAs facilitate the restoration of loads within the remote area. LAGs and GAGs correspond to load management system and generator management system which store their respective loads and generators local information. In addition to their local communication, they also interact with the upper level agents.
In [32], authors have proposed a more complicated four layered agent architecture for the bulk power system restoration. A single Independent System Operator Agent (ISOAG) which controls the timing of the simulation process forms the higher level in the agent architecture. The second level consist several Local Area Management Agents (LAMs) for the local area management for the restoration. Third level of architecture has several Load Facilitator Agents (LFAGs), Generator Facilitator Agents (GFAGs), and Remote Facilitator Agents (RFAGs). These agents will facilitate with the agents situated in the fourth layer of architecture which are, Load Agents (LAGs) and Generator agents (GAGs). The authors have applied the proposed MAS to bulk power system and the simulation results are very promising.
Authors in [33] have also contributed in the field of Multi-agent system for bulk power system restoration. The method employed in this work makes use of both centralized and decentralized schemes to obtain the restoration solution. The agent architecture has two hierarchical agents called, Management Agents (MGAGs) and Agents representing 19
Chapter 2: Literature Review
practical power system components (PCAGs). Each PCAG monitors several agents related to a subsystem named Generator Agents (GAGs), Substation Agent (SAGs), and Load Agents (LAGs). One MGAG is generated to in charge of the subsystem and provides negotiations and communications between PCAGs and with other subsystems.
2.3
MAS in Distribution System with DER
The power grid has been changing its physical infrastructure, control and communication infrastructures because of the deregulation in the power industry. Many distributed generation firms with less pollution and cheap operating costs came into the field of generation, making the energy market competitive. Distributed Energy Resources (DERs) can improve the reliability, stability, and quality of the electric grid. However, distributed energy resources bring several problems related to connection to the electric grid and the protection issues.
In [34], authors have proposed a hybrid Multi-agent system to achieve scalability for control of a large network of power generation, transmission, load, and compensation sources. Several ancillary agents are developed for system stability and harmonic and reactive current compensation in the paper. Scalability is the greatest issue present in huge networks such as power network, where the power network has thousands to tens of thousands nodes. In decentralized architecture agents makes use of local information to achieve their goals. The information could be values of voltages, currents sometimes may be the power values. Authors have presented a hybrid agent architecture where agents can connect not only to their parents and children but also to their siblings. Peer agents can communicate and negotiate with each other. Peer agents will dynamically select a leader to establish the real connection with their parents. In the proposed agent architecture, authors have developed several compensator agents to take care of power electronic compensators in the power system. The power electronic compensator has several responsibilities such as reactive power generation, power flow control, harmonic compensation, voltage regulation or dynamic control over the frequency and voltage. A large set of decision criteria is necessary for the agents such that they can make control decisions that will ultimately improve the power quality and reliability of the electric grid. 20
Chapter 2: Literature Review
T. Hiyama et al. in [35] presented a Multi-agent based operation and control of distribution system with dispersed power sources such as a photo-voltaic unit, a wind generation unit, a diesel generation unit, and an Energy Capacitor System (ECS). Several simulation studies have been performed to prove that the proposed methods have increased the control performance even in the existence of communication delays.
In [36] the same authors proposed a reconfiguration technique using the Multi-agent technology for the distribution system which has several kinds of distributed generation. The distributed generation includes Diesel Generator (DG), wing generator, photo-voltaic and ECS. ECS is an energy storage device and plays a main role in load following operation. Computer networks are used as communication channels for communicating the information about DGs and ECSs. Authors have introduced a coordination scheme between diesel unit and ECS with the help of multi agents. Reconfiguration has been done both for radial and mesh networks.
2.4
MAS in protection coordination
Many in the research community have conducted research concerning to the MAS application for the protection coordination in power system. It is very important task for agents in the protection coordination in order to ensure power system safety and reliability. Selectivity, Celerity, Sensitivity, Reliability in relaying protection have already been improved, but the system is lack of cooperation and coordination to solve the problems. Relays play a vital role in power system operations with very low tolerance for failure. Hence, MAS technology can be a promising solution for all of these protection coordination problems in power network.
In [37], the authors have proposed Multi-agent system approach for the post-fault disturbance diagnostics. Protection engineers use data from different monitoring devices to perform the post-fault disturbance diagnostics. In the past, several heterogeneous intelligent systems have been developed to interpret the data received and to assist the engineers in post-fault disturbance diagnostics. Majority of the system were standalone
21
Chapter 2: Literature Review
because of the system integration issues. In this paper a novel MAS architecture has been developed named protection engineering diagnostic agents (PEDAs). The new proposed method delivers flexibility and scalability features. These agents will integrate Supervisory Control and Data Acquisition (SCADA) systems with new systems for Digital Fault Recorder (DFR) for enhancing the fault record retrieval from remote DFRs. The paper elaborates the benefits of a MAS approach and design and implementation of PEDA.
Jinai Zhang et al. in [38] came up with new Multi-agent system architecture for relaying protection in power system. The proposed scheme has a coordination layer where all the agents, which are monitoring the protection in the power network, are coordinating for protection and control of power grid independently and collectively. Authors have used the PEDA technology, discussed in [37], to remove failures correctly and quickly. They have mentioned several advantages of MAS over traditional methods, such as enhancing intelligence, flexibility, reliability of the power system. In [39], the authors have proposed an agent based methodology for current differential relay to use with a utility intranet. Agents, as proposed in this paper are software pieces capable of searching for information in the networks, interacting with pieces of equipment and performing tasks on behalf of their owners (relays). Results have illustrated that the proposed scheme was very promising agent-based differential method acting within a communication structure i.e., intranet.
In [40] the authors have presented an agent based power protection system using supervisors. In this paper the framework of supervisory control of discrete event system (DESs) is applied for agent-based power protection system for achieving high reliability and selectivity. Reliability is a measure of the degree that the protection system will perform correctly when required, and the selectivity is an ability to recognize the fault and to trip the circuit breaker to isolate that fault. The proposed system uses the feedback information of events to achieve its objective goals. A detailed design procedure of a supervisor that coordinates the behavior of relay agents to isolate fault areas through the minimum operations of circuit breakers is presented in this paper.
A Multi-agent architecture is developed in [41] for the protection coordination of power system having distributed generation in it. Protection of power system, which includes 22
Chapter 2: Literature Review
DGs is going to be more complicated than simple radial network protection. The proposed scheme is capable of such type of protection, High Impedance Fault (HIF) detection, fault location and load shedding for the DG system. The complete design and implementation of relay agents is presented in this paper. The relay agents will coordinate and communicate with other relay agents for performing tasks of protection with autonomy. EMTP simulation results prove that the proposed scheme is very promising MAS for distributed generation.
The authors of [42] have presented a Multi-agent approach for protection coordination with distributed generation in industrial power distribution system. In the proposed system communication will play a major role besides relay settings. The agent architecture is developed using Java Agent Development Framework (JADE). In this work the author proposed three types of agents named relay agent, equipment agent and distributed generation agent. The relay agent is responsible for searching the relevant information by communication, detecting malfunctions of relay, breaker failures and DG connection status. The equipment agent collects the local power system information and acts on the local power system. The distributed agent will communicate with the relay agent to provide the connection status of its own for protection coordination. In [43], the same authors have proposed MAS architecture for substation protection with distributed generation. In this architecture each substation is viewed as one JDE container. Each JADE container again has number of agents in it. In this work author introduced new agent called Substation Management Agent (SMAG). The results presented in the paper are very promising.
The same work on protection coordination is investigated in [44], [45] and [46]. Finally, MAS proves to be a prominent solution for today’s protection coordination issues in power system.
23
Chapter 2: Literature Review
2.5
MAS in Voltage Control
Many authors have contributed in the field of voltage control and reactive power control of power system. In this section some of their work is illustrated. Power quality refers to two quantities which are voltage and frequency. Frequency is the measure of balance between the generation and load, and maintained always at nominal value for the power system reliability. Voltage is second quantity which is always kept under certain limits and is the major concern in the power distribution system. MAS technology is a very promising solution for reactive power management and voltage control in power distribution system because of agents supreme attributes such as autonomy, cooperation, Intelligence, adaptation and social behavior.
In [47], the authors have proposed a decentralized agent mechanism for the secondary voltage control in power-system contingencies. The secondary voltage control mainly applied for the generator Automatic Voltage Regulators (AVRs) to improve the power system voltage stability. In this paper, different types of voltage controllers, such as an Automatic Voltage Regulator (AVR), a Static Var Compensator (SVC) or Static Synchronous Compensator (STATCOM), is treated as an agent. The agents which are electrically close are responsible for their own area voltage control. When an agent senses voltage violation it activates its reactive power reserve. If the voltage violation is not cleared by its own reactive power reserve then the agent starts asking reactive power from its neighbor agents. The agents with sufficient reactive power will respond to the respective agent for voltage support. The agents share their common goal and achieve goal by communication and coordination. The proposed scheme is applied on simple power system and the results are promising.
The authors in [48] have presented optimal coordination work for Multi-agent based secondary voltage control in power system. The agent architecture has a set of execution agents and a coordination agent. Individual voltage controllers, such as an AVR, a SVC and a STATCOM represent an execution agent. Under normal conditions, Multi-agent system based voltage co-ordination works as a conventional secondary voltage control and supports Var/Voltage control. When system runs in to contingencies, the Multi-agent system uses contract net protocol to realize coordination and cooperation among voltage control agents for eliminating voltage violation. During the contingency situations the 24
Chapter 2: Literature Review
execution agents (EA) will act independently and try to restore the voltage in their areas. If the execution agents fail in restoring the voltage within limits, they send message to coordination agent (CA). The coordination agent then will coordinate with its execution agents to restore the voltage profile. Authors have used New England 39-bus system as a test system to demonstrate the proposed agent architecture and the results were up to the mark.
2.6
MAS in Power Markets
Power Market is the other major area in the power system, where Multi-agent systems are exploited to a wide range. In [49], the authors have proposed a Multi-agent system for power markets, which makes use of game theory principles. They have developed specialized intelligent software agents that perform negotiations on behalf of their human counterparts, and then suggest the market strategies that the human can adopt. The game theory principles are used for negotiation protocol. The agent model required not to exchange any sort of trustworthy important information between coalition partners. This is the fact where game theory differs from the proposed work in this paper. In [50], the same authors applied this work to a three player market model. This particular model has three generation companies where each individual company wants to maximize its profits.
Hyungna Oh et al. in [51] have investigated about, why price spikes occur in deregulated wholesale market and how efficiently they can be mitigated. The authors have presented MAS architecture to replicate a spot market. The proposed agent architecture has six autonomous adaptive agents representing six generating stations and one Independent System Operator agent representing an Independent System Operator (ISO). The firm learns about the market and its competitor’s behavior by comparing actual market outcomes with predicted outcomes based on an estimate of their own residual demand curve. The estimated residual demand curve is updated each interval using a kalman filter. In [52], the same authors presented a agent based work to test how spot prices affected by forward contracts.
25
Chapter 2: Literature Review
Leigh Testfation et al. in [53] developed a Java agent based whole sale power market simulator. The simulator is referred as Agent-based Modeling of Electricity Systems (AMES) and is designed in accordance with core Federal Energy Regulatory Commission’s (FERC)’s recommended design features and operating over a realistically rendered transmission grid. This framework has several learning mechanisms through which generation companies can maximize their profits and utilization factors. Authors have taken a 5-bus test case to illustrate the simulator features.
Several other papers such as [54], [55], and [56] also contributed for Multi-agent system application in power markets.
2.7
MAS in other engineering disciplines
Distributed Artificial Intelligence (DAI) is very promising and developing technology in many fields of engineering. Many engineering applications which needs monitor and control aspects are opting for Multi-agent system technology, which is the part of DAI. Several firms in engineering today are exploiting the Multi-agent technology to harness its strengths towards technical problem solving. A few of them are discussed in brief below.
Highway Traffic Management is one area where researchers are using agent based technologies for making them effective and reliable. The traffic congestion in peak hours results in loss of productivity by conveyors, waste of valuable time, increase in accidents, and a risk of public health with the increasing pollution from the vehicles. In [57], the authors have proposed a multi agent system for traffic management which can mitigate the traffic congestion in Automated Highway System (AHS). Autonomous agents cooperate and coordinate with each other to solve problem, such as conflicts, incidents and synchronization. The behavior of agent is described by colored petri nets.
Due to ever increasing intensity of air traffic and its safety issues, MAS proves to be promising solution for Air Traffic Control (ATC). In [58] authors have proposed a agent architecture for ATC which employs several agents playing roles of assistant aircraft crews and assistant air traffic control operator of approach zone. ATC operator agent 26
Chapter 2: Literature Review
(ATCO) is responsible for coordination of airliner’s entries in to the ATC zone. Its knowledge base (KB) consists of rule set representing temporal constraints on concurrent usage of approach schemes. Airliner agent is responsible for control over airline trajectory along assigned arrival scheme. The authors developed a software prototype intended for validation of the Multi-agent model of ATC.
Mine detection is the other specific area where distributed artificial Intelligence techniques such as MAS are widely used. In [59], the authors have studied and implemented hybrid architecture to implement mine detection, obstacle avoidance and route planning by using MAS. There are different techniques to design the mine exploration. The authors have followed frontier based exploration. In this type of exploration the agent builds its own map and starts searching on it.
After the coordination mechanism post exploration route
planning is carried out. This will enable the agent to generate safe route plans for the given target destinations.
There are several other fields in which MAS technologies have been used for variety of reasons. For example, computer games, logistics, robotics, graphics and e-commerce are some of the fields where extensive research is going on for embedding the Multi-agent systems.
2.8
Limitations and Technical challenges of MAS
It is recently that Multi-agent technologies are shifting from laboratory to utility areas to harness its potential features. As stated earlier in the chapter, Multi-agent systems are used in many power systems and many other engineering areas.
Despite the advantages of Multi-agent systems and its growing awareness, some basic questions often arise from the researchers and industrialists, in particular, industrial partners when discussing Multi-agent systems and their role in power engineering. The basic questions are as follows,
27
Chapter 2: Literature Review
•
What are the benefits offered by MAS over traditional technologies?
•
What are the major differences between MAS and traditional technologies?
•
To which sort of problems MAS can be applied?
These are the key questions regarding to the Multi-agent systems and often confusing. Many researchers have struggled answering these questions. D. J. McArthur et al. in [60] were able to answer the above questions. MAS can encapsulate a particular task or set of functionalities, and acts in a similar way to object oriented programming. In fact MAS is adding another level of abstraction to object oriented programming, not only the internal data structures are hidden but also action of agents (methods) can be hidden. This particular fact makes MAS pioneer in energy markets, where certain things need to be kept in secret between agents. According to [60], the main advantages of MAS are as follows, •
Agent autonomy and agent encapsulation
•
Open Multi-agent system architecture.
•
Can be used as a platform for distributed systems
•
Fault tolerance
The key difference between MAS and its counterparts such as AI techniques, Expert systems, Model based reasoning (MBR) systems, and Artificial Neural Networks (ANNs) is the notion of autonomy and interaction protocols available in MAS. MAS offer a great amount of autonomy feature to its agents, where agents can independently decide on actions to achieve their goals. Another great feature of MAS is that, it has a richer set of interaction protocols which supports negotiations. The authors in [60] have explained clearly that, this MAS technology can be applied to any engineering discipline which requires a decentralized problem solving mechanism. In spite of many advantages of MAS, there are certain technical challenges that are yet to be overcome to allow most effective implementation of multi-agent systems in the power engineering community. The technical challenges are listed below
28
Chapter 2: Literature Review
•
Platforms Today in the market several Multi-agent platforms are available. A judicious selection of agent platform is required to ensure the long-term compatibility and required robustness for online applications.
•
Toolkits Reuse of existing agent behaviors and capabilities is an important task. Thus, selection of toolkits to perform these activities is a major thing for the benefit of the whole community.
•
Intelligent agent design Standardized agent design architecture is needed for educating the new researchers and industrial implementers about MAS.
•
Agent communication languages and ontologies
•
Specific data standards
•
Security issues
•
Mobile agents Many researchers are interested in moving or mobile agents. These agents actually move from one point to another point in the network. As of now no credible reason for using this approach is apparent.
These above listed things are few technical challenges which have to be overcome such that MAS technologies are widely used in power engineering area. Beyond above technical challenges and implementation issues, the lack of experience in the use of multiagent system technology in the industry is an obvious concern of both utilities and manufacturers. In [61], the same authors stressed on design and implementation issues of Multi-agent systems.
The other main challenge would be interfacing the power system software with the agent platform. Normally the agent platforms are created in some Java based systems, where as power system models are created using traditional power system software. Many times there exists a big difficulty in interfacing these two platforms. In [62], the authors proposed a methodology to interface the MAS application, JADE to the power system application, which is developed in Virtual Test Bed (VTB). The authors have realized this interface through a communication mechanism called Common Object Request Broker Architecture (CORBA). 29
Chapter 3
SIMULATION SOFTWARE This chapter briefly describes about various software packages used in this thesis work for modeling the agent-based power distribution system. It is clear from the previous chapter that MAS greatly depend on software simulations and it is very important to choose suitable software packages for the agent based simulations.
Among several technical challenges listed in the previous chapter, selecting a appropriate software package for simulating MAS is the major technical challenge. Several options are analyzed for simulating both power distribution system and Multi Agent System. Finally, MATLAB, MATPOWER, Power World Simulator, Distributed Engineering Workstation (DEW), and Java Agent Development Framework (JADE) are chosen to simulate the power distribution system and agent model in this thesis work.
The whole Multi-agent system model interfaced to power distribution system is depicted in the following figure. The bottom layer in the figure represents physical network of power distribution system. Agents are situated at all components of power system such as, buses, loads, distributed generators, etc. These agents form upper layer in the architecture. There is a great need of an interfacing tool for interfacing the distribution system model to the agent architecture.
30
Chapter 3: Simulation Software
Agent Layer
Interface
Power System Layer
Figure 3-1: Architecture of the Simulation Model.
3.1
MATLAB ®
MATLAB ®, Matrix Laboratory, is a high level technical language and numerical computing environment for algorithm development, data visualization, data analysis, and numeric computation. MATLAB solves technical oriented tasks faster than traditional languages such as C, C++, and FORTRAN [49]. MATLAB was first adopted by control design engineers, later it is been used in many other scientific applications including image processing, communications, etc. Some of the key features of MATLAB are listed as followed [63], •
Developing environment for managing code, files, and data
•
High level language for technical computing.
•
Tools for creating custom graphical user interfaces.
•
Functions for integrating MATLAB based methods to external applications, such as C, C++, FORTRAN, Java, and Microsoft Excel.
•
2-D and 3-D graphics functions for visualizing data. 31
Chapter 3: Simulation Software
MATLAB is more suitable for engineering applications because of its operations based on matrix and vectors. MATLAB is faster in engineering tasks, because of the basic tasks like variable declaration, memory allocation, and data type specifications are default. MATLAB uses Object Oriented Programming (OOP) thus, adds the object oriented features to it. This feature enables to develop complex technical computing applications easily. When using well defined classes, object-oriented programming can significantly increase the code reuse and, make program easier to maintain and extend. Besides the OOP attributes, MATLAB has Graphical User Interface (GUI) tool to create and visualize customized interfaces.
In this thesis work MATLAB object-oriented programming is used to create the reconfiguration algorithms and the plotting functions. In addition to that, a graphical user interface for the reconfiguration has been developed using MTALAB GUI.
3.2
MATPOWER
MATPOWER is a MATLAB based power system simulation package. It is a collection of MATLAB m-files to solve the load flow and optimal power flow problems of power system [64]. It is indeed a simulation package for researchers and educators, where one can easily make modifications to the original code according to one’s application. Ray D. Zimmerman is the main contributor for this power simulation software. The need for MATLAB based power flow and optimal power flow born out of the computational requirements of the PowerWeb project at Cornell University [65]. MATPOWER is an open source software and freely downloadable at [64]. MATPOWER is used for load flow calculations of Circuit of the Future (CoF) distribution network in this thesis work.
3.3
Java Agent Development Framework
JADE (Java Agent Development Framework) is a software package for developing agentbased applications in compliance with Foundation for Intelligent Physical Agents (FIPA) specifications for interoperable and intelligent multi-agent systems [66]. JADE is a middleware application completely developed using Java language. JADE has extensive 32
Chapter 3: Simulation Software
graphical tools for the debugging and deployment phases. The key advantage offered by JADE is its Graphical User Interface (GUI), through which one can visualize the development phases and agent communications.
Today, JADE is the most popular agent middle-ware that implements an agent platform and a development framework. JADE was developed in 1998 by the Research and Development department of Telecom Italia, in 2000. JADE is released as open source software under the license of Lesser General Public License (LGPL). JADE software is freely downloadable from [66] with source code, documentation, and some wealthy information.
3.3.1 JADE Architecture JADE architecture has several agent containers that can be distributed over the network. Agents live in the containers are the Java processes which provide the JADE run-time and, all the services needed for instantiating and executing the agents [67]. In every JADE framework, there is a special container, called the main container. It is the first container to be launched and all other possible containers must join to a main container by registering with it. By default main container is named ‘Main Container’ and the remaining containers are named ‘Container-1’, ‘Container-2’, etc. The main duties of main container are listed below [67], •
Creating and Managing the container table (CT), which is the registry of the object references and transport addresses.
•
Creating and Managing the Global Agent Descriptor Table (GADT), which is the registry of all agents present in the JADE platform including their current status and location.
•
Hosting the AMS agent, which provides agent management and white page service.
•
Hosting the DF agent, this provides default yellow page service.
33
Chapter 3: Simulation Software
Figure 3-2: Relationship between main architectural elements [67].
The two main agents named Agent Management System (AMS) and Directory Facilitator (DF) are instantiated when the main container is launched. •
The Agent Management System (AMS) Agent Management System is the special agent which supervises and monitors the whole platform. It is the main hub for all agents present in the container in order to access the white pages of the platform and to get Agent Identifier (AID). All agents life cycle are managed by AMS. The registering process of all agents with AMS is done automatically by JADE at start-up.
•
The Directory Facilitator (DF) Directory Facilitator (DF) agent implements the yellow age service. These services are used by any agent wishing register its services or search for other available services. Multiple DFs can start concurrently in order to distribute the yellow page services across several domains.
34
Chapter 3: Simulation Software
Besides AMS and DF agents, the one more important service according to FIPA is a Message Transport Service (MTS). An MTS manages all message exchanges within and between platforms. It supports several Message Transport Protocols (MTPs) to promote interoperability between different non-JADE platforms [67]. There are several other agent tools such as, Dummy Agent, Sniffer Agent, and Introspector Agent to facilitate the developing and debugging of agent platforms. •
The Dummy Agent The dummy agent is a very simple agent which is used to simulate other agent’s behavior by sending the custom Agent Communication Language (ACL) messages. When an application agent has been launched, a Dummy agent can be used to stimulate it by sending user-specified messages and analyzing its reaction in terms of received messages.
•
The Sniffer Agent This is a very useful agent tool in terms of debugging the project. This agent tool enables to visualize conversations between agents. The conversations between agents are shown by arrows; each arrow contains the message content. In the Sniffer agent GUI, different agent communications can be marked with different colors.
•
The Introspector Agent The Introspector agent is useful to debug the behavior of a single agent. This agent will control and monitors the agent sent and received messages, scheduled behaviors of agent, and the agent life cycle. In simple words, this agent is responsible for introspection of agent execution.
The following figure shows a typical JADE GUI for the remote management, monitoring and controlling of the agents present in platform.
35
Chapter 3: Simulation Software
Figure 3-3: JADE Graphical User Interface (GUI).
The following figure shows the output of JADE run-time environment, when JADE is launched.
Figure 3-4: JADE run-time environment.
36
Chapter 3: Simulation Software
3.3.2 JADE Programming JADE programming is similar to the standard JAVA programming. The creation of an agent is done by a simple class jade.core.Agent and implementing the setup() method. The setup() method intended to include agent initializations. The actual job performed by the agent is defined within the ‘behaviors’ of agent. The ‘behavior’ property tells the agent about its typical operations. The typical operations, an agent performs in its setup() method are: showing a GUI, opening the connection to database, registering the services to provide the yellow pages, and starting the initial behavior [67].
According to FIPA specifications each agent is identified by a unique ‘agent identifier’ in Java Agent Development Framework. In JADE, the getAID() method is used to retrieve the local agent identifier. The AID object includes a globally unique name (GUID) and a number of addresses. These AIDs are very important entities in agent communication.
As discussed earlier agent communication is the most important feature of Multi-agent systems. Each agent that is created has a mailbox where the messages are passed in a queue when it receives messages from other agents. The messages are compliant with FIPA standards. The ACL messages are sent to one agent from another agent by using send() method. The receiving agents can receive the message by calling receive() method. Agent will be alive even after completing all its responsibilities. doDelete() method is used in order to terminate it.
JADE has been used in this thesis work for developing the agent platform for the Circuit of the Future (CoF) distribution system.
3.4
Distributed Engineering Workstation© (DEW)
Distributed Engineering Workstation is a distribution system software and an open architecture environment with integrated data and applications, analysis, design, and operation modules access database data and exchange data through common functions. The distribution engineering tool is designed to meet the analysis, planning, design, and operation needs of today’s distribution systems. DEW offers myriad tools such as, power 37
Chapter 3: Simulation Software
flow, load estimation, line impedance calculations, fault analysis, capacitor placement, phase balancing and many more [68]. Some of the add-ons of this software can be bought separately from the vendor. The open architecture allows external application modules to be added to the workstation.
Executive, Database, Graphical User Interface (GUI), Application Programmer Interface (API), and Application modules are the major components of the Distributed Engineering Workstation (DEW) [69]. These major functional parts of the DEW are depicted in the following figure.
DEW DAIS SCADA
DAIS Distribution Database
DEW Executive
API Data Access
Corporate Data
GUI
User
Application Modules
Figure 3-5: Organizational structure of DEW [69].
The main operations of the workstation are managed by Executive. It provides interface between API, GUI, and database modules. The key feature of API is to integrate the application modules into the framework without disturbing other parts of the workstation. All the applications utilize the GUI functions for user interaction and display. The standard data schema available in DEW makes data accessible and shareable by all applications. The data from Supervisory Control and Data Acquisition System (SCADA) such as, financial, statistical, geographical, operations data are utilized for the application through an interface called, Database Access Integration Service (DAIS).
38
Chapter 3: Simulation Software
The following figure shows the Graphical User Interface (GUI) of DEW. The right side pane of the DEW main page has different power system entities. These entities can be dragged into the DEW workspace to build the one-line model of the distribution system. In this thesis work DEW has been used to model the Circuit of the Future (CoF) distribution network.
Figure 3-6: Distributed Engineering Workstation’s Working Environment.
3.5
Power World Simulator
Power World simulator is an interactive power system simulation package designed to simulate high voltage power system operation. The software contains a highly effective power flow analysis package capable of efficiently solving systems with up to 100,000 buses [70]. Some of the key tools offered by Power World Simulator are listed below,
39
Chapter 3: Simulation Software
•
Load Flow Analysis
•
Optimal Power Flow (Linear programming method)
•
Security Constrained Optimal Power Flow (SCOPF)
•
Available Transfer Capabilities (ATC)
•
PVQV curve tool
•
Transmission line Parameter Calculator
•
Contingency Analysis
•
Fault Analysis
This software is a very good tool for modeling the power system. The key feature of this software is its graphical user interface (GUI), where one needs to drag and drop the power system elements to build up one’s own case. Different tools available in Power World Simulator are listed above. The following figure shows the snapshot of one line diagram of Circuit of the Future (CoF) created in Power World Simulator.
Figure 3-7: Snapshot of Circuit of the Future one line diagram
40
Chapter 3: Simulation Software
Power World Simulator has a very good facility of visualizing the load flow results. Every time we run the load flow all the results will be stored and viewed through a GUI entity called Model Explorer. The model explorer has a explore pane, which contains a list of the objects contained in the power system model. The entries in the explore pain which are grayed out indicates that the elements are not defined in the model. The explore pain again divided into
eight sub folders named, Recent, Network, Aggregation, Solution
Details, Case Information and Auxiliary, Contingency Analysis, Optimal Power Flow, and Transient Stability. The following figure shows a snapshot of Power World Simulator’s Model Explorer.
Figure 3-8: Snapshot of Model Explorer of Power World Simulator [70].
41
Chapter 4
MATHEMATICAL MODEL AND ALGORITHMS FOR MAS This chapter mainly explains the mathematical model used behind the Multi-agent framework in this thesis. Multi-agent architecture has its own mathematical model to serve as its foot-print. Once the mathematical model is build then it can be translated into software packages for simulation purpose. This chapter presents a set of new algorithms for fault detection and reconfiguration. The fault detection algorithm is based on Graph theory, and the reconfiguration algorithm is based on load-flows.
4.1
Mathematical Model
4.1.1 Graph Theory
Graph theory is the study of graphs used extensively in the fields of mathematics and computer science. A ‘graph’ is defined as, collection of vertices or ‘nodes’ and collection of edges that connects pairs of vertices [71]. The graphs are primarily categorized as either directed graphs or undirected graphs. The major difference between above two graphs is, the direction between two vertices. Graph theory has several applications such as network
42
Chapter 4: Mathematical Model and Algorithms for MAS
analysis, study of molecules in physics and chemistry, and social network analysis in sociology. The main application of graph theory lies in modeling and analyzing traffic networks. Power system is a vast network consisting tens of thousands of vertices, can be modeled using graph theory.
4.1.2
Graph Theory representation of Power System
The power system network is modeled as a graph G as shown in the Figure 4-1. It has a single parent node. The power distribution feeders form the spanning tree T. Each node in graph G represents power system elements such as loads, sources and buses. These nodes are connected by edges. The edges in spanning tree T represent transmission lines connecting every pair of buses. The edges in G, but not in T represent switches. These switches are used for restoration purposes during the fault and left open during normal healthy conditions of power grid. In the proposed MAS, agents are place at each and every node and switch of the power distribution network. The following table describes some of the key notations used in the mathematical model.
Notation
Description
G
Graph, represents the power network.
T
Spanning tree, represents radial feeders.
N
Set of nodes in the graph.
E
Set of directed edges in the graph, represent power lines.
s
Power source, represents substation or a distributed generator.
S(G)
Set of edges in G, but not in T, represents set of switches in the system
Table 4-1: Description of the notations used in Mathematical model.
43
Chapter 4: Mathematical Model and Algorithms for MAS
s
n1
n2
n3
S1
S2
S3
n4
n5
n6
S4
S5
S6
n7
n8
n9
Figure 4-1: Graph model of power distribution system.
In the above graph model s represents the substation. Each branch s → n1 → n2 → n3 ,
s → n4 → n5 → n6 , s → n7 → n8 → n9 forms the spanning tree. The edges in the graph, but not in the trees are switches, S1-S6. In the spanning tree every node except the root node has in-degree1 1. That is, each node n in T can be reached by a directed path in T form the source s to n. For each edge e ∈ E (T ) , let
S (e) = { X : X ⊆ S , such that (T − e) U X is a connected graph}
1
In-degree of a vertex in a graph is defined as the number of edges coming into the vertex.
44
Chapter 4: Mathematical Model and Algorithms for MAS
4.2
Fault Detection Algorithm
The following section describes about the Fault Detection algorithm used in this thesis work. Fault detection is the first thing in restoring the faulty power network. Major input to this algorithm is power flowing into each load.
Let us assume that the fault location detected by the node agents is at n f . Suppose a node agent n identifies that the power flowing into its node is zero, then on the unique directed path from s to n , say s → n1 → n2 → n3 → ...... → nk , where n = nk ,
nk will
request nk −1 , whether it has power. Subsequently, nk −1 will request nk − 2 for its power. When for some i , ni does not have power, but ni −1 has power, the fault edge can be identified as, e f = (ni −1 , ni ) [2].
Once the fault location is identified, the edge e f is isolated and agents that are controlling each switch X ∈ S (e f ) will communicate and coordinate with each other to decide on the particular switch or switches that have to be switched on, so that
(T − e f ) U X will
continue to be a fully supplied network [2].
4.3
Fault Reconfiguration & Restoration Algorithm
The reconfiguration algorithm employed in this thesis work is completely based on loadflows. This algorithm is embedded inside the Global agent for reconfiguration of the faulty network. Depending on the number of faults in the system, there are three different algorithms to reconfigure the power distribution network. They are,
•
Reconfiguration algorithm for single fault.
•
Reconfiguration algorithm for double fault.
•
Reconfiguration algorithm for three faults.
45
Chapter 4: Mathematical Model and Algorithms for MAS
4.3.1 Reconfiguration algorithm for single fault
The fault location, e f , has been found from the previous algorithm and possible switches are explored through this algorithm for reconfiguration. This algorithm searches for all the possible combinations of switches, which has to operate in order to reconfigure the circuit. If there is voltage violation in the circuit, the algorithm employs shunt compensation and load shedding methods to improve the voltage profile. When there are multiple solutions available for reconfiguration, the best solution is chosen in regards of voltage profile and less power losses. Each time the algorithm executes a scenario, the solution is stored in a database. Next time when the same scenario happens the reconfiguration would run from the database rather than running through the algorithm. The algorithm is described through the flowchart in the Figure 4-2.
4.3.2 Reconfiguration algorithm for two faults
The solution from single fault reconfiguration algorithm is used in this algorithm. When we use solution form above algorithm, some times the load flow will not converge. In this case this algorithm itself searches for additional switches to reconfigure the faulty circuit. If the reconfigured circuit has voltage violations, then the algorithm employs shunt compensation and priority based load shedding for voltage profile improvement. Similar to above algorithm this algorithm also has a database to store the solutions of the scenarios. When there are multiple solutions, the best solution in regards to voltage profile and less power losses is chosen.
4.3.3 Reconfiguration algorithm for three faults
This algorithm is also similar to the above two fault reconfiguration algorithm. The solution from the single fault reconfiguration algorithm is used in this algorithm. The voltage control is done in the same manner using shunt compensation and priority load shedding.
46
Chapter 4: Mathematical Model and Algorithms for MAS
Start
Isolate the faulty line.
Yes
If scenario exists in database
No
Switch on each switch at a time. Si i=1 to 7.
Run the load flow
No
If load flow converging Yes
0.9