a systematic mapping study on runtime monitoring of services

The Iraqi Journal For Mechanical And Material Engineering, Special Volume for Babylon First International Engineering Conference , Issue (A)

A SYSTEMATIC MAPPING STUDY ON RUNTIME MONITORING OF SERVICES Saad Qassim Fleh Kemerburgas University Istanbul, Turkey [email protected]

Ahmed Khudhair Abbas Kemerburgas University Istanbul , Turkey [email protected]

Khalid Mohammed Saffer Kemerburgas University Istanbul, Turkey [email protected]

ABSTRACT The number of the services and service oriented systems is continuously increasing. Many applications depend on them. Therefore, the quality attributes of the employed services are critical. To be able to select services that can support the required quality attributes, runtime monitoringof services techniques and tools have been introduced. These tools monitor a set of services regarding a set of different aspects such as reliability, performance, availability and security. In this paper, we present a systematic mapping study on runtime monitoring of services.We collected 967 papers in total. We selected 52 papers as primary studies and classified them with respect to several facets. Our results provide an overview of the existing relevant studies in reported in the literature, highlight focus areas and research gaps. Keywords: Service , Web Service , Monitoring , Runtime , Quality , Quality of Service , Quality Attributes , Performance , Reliability , Evaluate , Evolve , Technology

121

S. Q. Fleh, A. K. Abbas, K. M. Saffer

The Iraqi Journal For Mechanical And Material Engineering, Special Volume for Babylon First International Engineering Conference , Issue (A)

INTRODUCTION Recent years the services provided with the Internet are very wide. Has become one of the daily requirements. Because it related to people's lives. This services contained communications, financial dealings, education, military applications…etc. . The Web services represent the most important types of services . They are Internet based software application .Where providing electronic services for all types of users. Whether the user is human or one of other software applications. These applications make the services very important. So their qualities are also important and critical issues. Because the natural dynamic of web service. The behavioral or characteristics of services provided by system may be also change .This leads to the service become inefficient or unavailable.In some cases, cause big problems.To achieve high quality criteria of service must monitor continuously. In addition, the monitoring are responsible for verifying performance and integration of various components such as hardware resources and software ‎[6],‎[9].At runtime the monitoring of services considered as substantial issues .Where the monitoring gathering the information about service characteristics and its behavioral. Checking this information to determine the quality and efficiency of services. The run-time monitoring of services has strong motivations. Indeed at run-time, requirements and properties complete and reinforced at design time. Can be violated before execution. This is the case of web service, service oriented system , service oriented architecture,real time system and middleware application. Which are most often developed by composing services that are made available violated by some kind of problems. That can be detected and may be solved only at run-time. Therefore we can maintain a system that provides this service without problems‎[31],‎[45]. There are a lot of techniques developed but nobody summarized these before.This paper provides a good summary of researcher who wants a future research on the runtime monitoring of services. Inaddition it's may be providing some answers that will help them answer some questions related to this topics. A systematic mapping study provides a structure of the type of research reports and results what have been published by categorizing them. It often gives a visual summary, the map, of its results, it requires less effort while providing a more coarse-grained overview. The remainder of this paper is organized as follows: Section II, it’s literature review protocol. Section III, describes the screening of the papers. Section IV, explain how building different viewpoints using a variety of schemes . Section V, is explained classification schemes and Section VI, is a conclusion. LITERATURE REVIEW PROTOCOL Research Questions The purpose of a systematic mapping study is to provide a clear vision of the selected area.To obtain on this vision we must determine some research questions (RQs). The questions we should definitioncarefully. Usually driven from research title and the relevant studies. Then analysis and determine the results are available within this area. The result help the researchers in this field access to the information want as quickly as possible.Often one wants to map the frequencies of publication of time to see trends. Another one can be to identify the forums in which research in the area has been published. Each one can use the result obtains

122

A SYSTEMATIC MAPPING STUDY ON RUNTIME MONITORING OF SERVICES

S. Q. Fleh, A. K. Abbas, K. M. Saffer

as he/she wants.The number and formula for research questions of each systemattic mapping is varying fromone area to another. The research questions for runtime monitoring of services shown in Table I . Search String The formula and relevant keyword used in search string effect on the papers result from searching.The primary studies are identified with using to search strings of scientific databases or browsing manually through relevant conference proceedings , journal and work shop publications. A good way to create the search string is to structure them in terms of population, intervention, comparison, and outcome . The structure of research string should of course be driven by the research questions and keywords. Therefore the search string can be writing as shown in Table II . Search strategy We used the search string of different database to collect the relevant studies.There are a lot of database provide data onto world. We must try to collect the largest possible numberof relevant studies.We can classification its according to methods search. There are two main methods search automatics and manual search. For example , we can search out ACM digital library , IEEE explorer , springer link , international symposium on leveraging and computer science technology. As we search using journals, conferences and workshops they have extensive information. .After three filter we get on results from publiccation venues that show to bellow in TableIII. SCREENING OF THE SELECTED PAPERS In this step we depend on (Inclusion & Exclusion ) criteria to eliminate the papers that irrelevant to answer the research questions .We apply set of inclusion and exclusion criteria to each study to decide if its eliminated or not .The process of screening may be passing through numbers of stages. Each stage isstricter than previous one. Figure (1) explains the steps that implemented to complete systematic mapping. Inclusion Criteria We kept all papers,such as journals , coferences, work shop and technical report. That satisfied the inclusion conditions. For our study (runtime monitoring of services) we included all relevant papers. This means approaches, types , behavioral, modelling driven and all aspects of monitoring of( services or web services) . While reading the titles should check the answer to everything related to the subject. Because all classifications applied for this paper. Exclusion Criteria We eliminated all Papers , books , reports that unreal outputs for runtime monitoring of services .Titles don’t write in English .Papers duplicated .Papers that exit such as journal and conference. Papers incomplete . Literature just available in form of abstract .Power point 123

S. Q. Fleh, A. K. Abbas, K. M. Saffer

The Iraqi Journal For Mechanical And Material Engineering, Special Volume for Babylon First International Engineering Conference , Issue (A)

presentation. Posters and advertising . Short papers less < 2 pages .Sometimes the researcher determines the period of time for studies that wants to be included and the cancel all studies outside this period. BUILDING DIFFERENT VIEWPOINTS USING A VARIETY OF SCHEMES We can explain any scheme or description to any subject through build schemes. Defining Comprehensive vision of articles in any subject and deal with it through some of the schemes. Figures(2&3) show the distribution of primary studies according to venue chart that explain the numbers of papers per (coference , journal and work shop) and distribution of the papers per yearsrespectively. CLASSIFICATION SCHEME In this paper there are four facets of classification data onto this facet. The first facet is (research type facet), it showed criteria according to validation research ,evaluation research ,solution research,philosophical papers ,opinion papers andexperiences papers as shown in Figure(4). Second a facet is (domain facet) it shows criteria according to web service, middleware, cloud application, service oriented system and real time system as shown in Figure(5).Third facet (monitoring facet) it shows criteria according to performance, behavioral, availability ,security and data flow as shown in Figure(6). Fourth facet is (model driven language facet) it show criteria according to Unified Modeling Language(UML),Web service-Business Process Execution Language(BPEL), Service Level Agreement (SLA),Web Service Description Language (WSDL) and other as shown in Figure(7). Finally Figure (8) explained the bubble chart classification mapping between (Monitoring facet and Domain facet) of runtime monitoring of services for 52 papers. CONCLUSION To perform a systematic mapping for any scientific research . Firstly we must determine number of research questions. That helped the researcher to arrive for relevant studies. The number of research questions sets by researcher. Effect him to determine the research direction .which ensures to him reachs to require information quickly he was seeking for it. This questions have selected depend on research field. The aim at some question is determining the target for analysis and tools. While the aim at some questions used to determine the activities and properties performed by this research . Whereas some searcher use standard ways, criteria and mechanisms to search for it. Some time the researchers need to know the researches applicable or does reach it’s target .The empirical studies used for this subject. The questions used to search for different opinions about studies and scientfic analysis,represent the most important type of questions. Therefor to determine the questions give us results in particular trend. The all details and related things must be taken in consideration.This paper presented a systematic mapping study providing an overview of existing research on( runtime monitoring of services). After initial iteration we collected 967papers in primary research. Contain various classifications (papers, book, report 124

A SYSTEMATIC MAPPING STUDY ON RUNTIME MONITORING OF SERVICES

S. Q. Fleh, A. K. Abbas, K. M. Saffer

workshop, presentation, lecture, and others etc ..) ,published from 2000 to 2014. We apply screening for all papers by three filters.From three stage filtering through the first stage reduced it in to 568 papers. After that in second stage eliminated all papers in filters in to 124papers .Finaly filter gets on 52 papers that are holding it . The classification of these scientific works helped us to identify how the scientific production is distributed over the years. Also to recognize what is the most used publication venues. From different bar charts explained we conclude the most papers published through (2009&2010) .We distribut the papers to several facet such as research type , monitoring , domain and model driven language facets.The research type facet show themost papers are solution proposal and philosoph papers.The monitoring facet show the purpose most papers is performance and behavioral.The domain facet explain the domain of most papers are web services ane service oriented system.While the modal driven language facets explained the serchers used some language.However the majority of papers used (SLA and WS-BPEL) language.Finally, the systematic map bubble plot is more useful. Bubble plots allow to combine categories with each other. Thus the relative emphasis on research on categories is visible from the plot itself.In this paper the bubble chart plot against monitoring facets and domain facet. The bubble plots of result explain in Table IV .

TABLE I.Research quesions for runtime monitoring of service RQ1-Which methods are used to evaluate the runtime monitoring of service? RQ2-What is the effect of runtime monitoring of service on performance, reliability and quality? RQ3-Which quality attributes are monitored?

TABLE II. Search string (“service ” OR “web service”) AND (“runtime” OR “ monitoring ”) AND (“quality” OR “quality of service” OR “quality attribute ” OR “performance” OR “reliability” OR “evaluation” OR “evolve” OR “technology”)

125

S. Q. Fleh, A. K. Abbas, K. M. Saffer

The Iraqi Journal For Mechanical And Material Engineering, Special Volume for Babylon First International Engineering Conference , Issue (A)

TABLE III. Publication venues Journal Title

Number of Papers 27

IEEE explorer

6

ACM Didital Library

8

Springer Ling International Symposium On Leveraging ISOL

4 11

Computer Science Technoloogy Institute of Engineering and Technology IET Internatial Journal of CyberSecurity and Digital Fornsics IJCSDF

1 1 1

Multi Media Automated Software Engineering ASE Service Oriented Computing and Application SOCA

1 2

Performance

[‎ 16] ‎[31]

‎[3] ‎[42]

Behavioral

[‎ 7] ‎[9] ‎[18] ‎[29] ‎[39] ‎[44] ‎[45] ‎[49] ‎[6] ‎[14] ‎[35]

‎[8]

‎[50]

Avalibility

126

Real Time system

Service oriented system

Cloud application

Middle ware

Web service

TABLE IV. Primary Studies Categorized According to Quality Attributes and Different Facets

‎[4] [‎ 10]‎[12] ‎[21]‎[25]‎[ 28]‎[48]

[‎ 26] ‎[41]

‎[27]

‎[17]‎[23]‎[ 33]‎[37]‎[3 8]‎[46]

‎[52]

‎[40]

‎[2]

A SYSTEMATIC MAPPING STUDY ON RUNTIME MONITORING OF SERVICES [‎ 30] ‎[36] ‎[43] ‎[1] ‎[11] ‎[24] ‎[47]‎[51]

Security

Data flow

S. Q. Fleh, A. K. Abbas, K. M. Saffer

‎[34]

‎[19]‎[22]

‎[5]‎[15]‎[2 0]‎[32]

Using Keywords and Abstract

Research Question

Conduct Research

Screening Papers

Keyword and Search String

Papers Relevant to Research Question

Eliminate irrelevant Papers

Classific. Scheme

Data Extraction

Set of studies evaluated

Fig. 1. Main steps of systematic mapping study

30

51.92%

25 Number of Papers

38.46% 20 15 10

27 20 9.62%

5 5 0 % # of papers

Conference

Journal

Workshop

38.46%

51.92%

9.62%

20

27

5

Fig. 2.Distribution of papers per venue

127

S. Q. Fleh, A. K. Abbas, K. M. Saffer

The Iraqi Journal For Mechanical And Material Engineering, Special Volume for Babylon First International Engineering Conference , Issue (A)

16 26.92% 14

Number of Papers

12

10

8

13.46%

13.46%

13.46%

14 6 7.69% 7.69% 4

2

0 %

7.69%

7

7

3.85% 1.92%

4

4

7 4

1.92% 0.00% 0.00% 0.00% 1 1 1 0.00% 0 0 0 0 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 1.92%

2

1.92% 0.00% 1.92% 0.00% 3.85% 0.00% 13.46 7.69% 7.69% 26.92 13.46 7.69% 13.46 0.00% 1.92%

# of papers

1

0

1

0

2

0

7

4

4

14

7

4

7

0

1

Fig. 3. Distribution the papers per years 16

26.92%

14 Number of Papers

23.08%

21.15%

12 10

17.31%

8 6

11

9.62%

14

12 9

4 5

2 0 % # of papers

1.92% 1

Validation Research

Evaluation Research

Solution Proposal

Philosoph Paper

Opinion Paper

Experience Paper

21.15%

9.62%

26.92%

23.08%

1.92%

17.31%

11

5

14

12

1

9

Fig. 4. Distribution of studies based on research type

128

A SYSTEMATIC MAPPING STUDY ON RUNTIME MONITORING OF SERVICES

S. Q. Fleh, A. K. Abbas, K. M. Saffer

34.62%

20 18 16 25.00%

Number of papers

14 12

17.31%

10 18

8 13

6

11.54%

11.54%

6

6

9

4 2 0 %

Performace

Behavioral

Avaibility

Security

Data Flow

25.00%

34.62%

11.54%

11.54%

17.31%

13

18

6

6

9

#of Papers

Fig. 5. Distribution of studies based on monitoring facet 25 40.38% 38.46%

Number of Papers

20

15

10

21

20 9.62% 7.69%

5 3.85% 5

4 2

0 % # of Papers

Web Service

Middleware

Cloud Application

Service Oriented System

Real Time System

40.38%

9.62%

3.85%

38.46%

7.69%

21

5

2

20

4

Fig. 6. Distribution of studies based on domain facet

129

S. Q. Fleh, A. K. Abbas, K. M. Saffer

The Iraqi Journal For Mechanical And Material Engineering, Special Volume for Babylon First International Engineering Conference , Issue (A)

16

Number of papers

14 12 26.92% 10 8 17.31%

14 6

11.54%

9

4

9.62%

7.69%

5.77% 2 0 # of papers %

11.54%

9.62%

5

6

5

6

4

3 UML

WS-BPEL

SLA

WSDL

XML

Spec. Lang.

Query Lang.

3

14

9

5

5

4

6

Others 6

5.77%

26.92%

17.31%

9.62%

9.62%

7.69%

11.54%

11.54%

Fig. 7.Distribution of studies based on model driven language facet

Performance

2

2

Behavior

8

1

Avalibility

3

1

2

Security

3

1

2

Dataflow

5 Web Service

1

7

2

6

2

4 Middle Ware

Cloud Application

Service Oriented system

Real tim system

Fig. 8. Distribution of studies based on target domain and focus of monitoring

130

A SYSTEMATIC MAPPING STUDY ON RUNTIME MONITORING OF SERVICES

S. Q. Fleh, A. K. Abbas, K. M. Saffer

REFERENCES : [1]

Roblee, C., Implementing Large-Scale Autonomic Server Monitoring Using ProcessQuery Systems, 2000 [2] Chen, C.; Zaidman, A. & Gross, H.-G., A framework-based runtime monitoring approach for service-oriented software systems, Proceedings of the International Workshop on Quality Assurance for Service-Based Applications - QASBA '11, ACM Press, 2011, 17 [3] Li, B.; Xu, D. & Nahrstedt, K., An integrated runtime QoS-aware middleware framework for distributed multimedia applications, Multimedia Systems, 2002, 8, 420-430 [4] Baresi, L. & Plebani, P., WS-Policy for Service Monitoring, 2006, 72-83 [5] Compositions, W. S.; Barbon, F.; Traverso, P.; Sommarive, V.; Pistore, M. & Trainotti, M., Run-Time Monitoring of Instances and Classes of web service compostions, 2006 [6] Wang, Q.; Liu, Y.; Li, M. & Mei, H., An Online Monitoring Approach for Web services 31st Annual International Computer Software and Applications Conference - Vol. 1(COMPSAC 2007), Ieee, 2007, 335-342 [7] Roth, H.; Schiefer, J. & Schatten, a., Probing and Monitoring of WSBPEL Processes with Web Services, The 8th IEEE International Conference on E-Commerce Technology and The 3rd IEEE International Conference on Enterprise Computing, E-Commerce, and EServices (CEC/EEE'06), Ieee, 2006, 30 [8] Wohlstadter, E.; Tai, S.; Mikalsen, T.; Diament, J. & Rouvellou, I., A Service-oriented Middleware for Runtime Web Services Interoperability, 2006 IEEE International Conference on Web Services (ICWS'06), Ieee, 2006, 393-400 [9] Gan, Y.; Chechik, M.; Nejati, S.; Bennett, J.; O'Farrell, B. & Waterhouse, J., Runtime monitoring of web service conversations, Proceedings of the 2007 conference of the center for advanced studies on Collaborative research - CASCON '07, ACM Press, 2007, 42 [10] Baresi, L.; Bianculli, D. & Milano, P., Validation of Web Service Compositions, 2008, 1-26 [11] Gounaris, A.; Yfoulis, C.; Sakellariou, R. & Dikaiakos, M. D., Robust Runtime Optimization of Data Transfer in Queries over Web Services, 2008 IEEE 24th International Conference on Data Engineering, Ieee, 2008, 596-605 [12] Vaculn, R. & Sycara, K., Semantic Web Services Monitoring : An OWL-S based Approach, 2008, 1-10 [13] Zhu, J.; Guo, C.; Yin, Q.; Bo, J. & Wu, Q., A Runtime-Monitoring-Based Dependable Software Construction Method, 2008 The 9th International Conference for Young Computer Scientists, Ieee, 2008, 1093-1100 [14] Comuzzi, M.; Kotsokalis, C.; Spanoudakis, G. & Yahyapour, R., Establishing and Monitoring SLAs in Complex Service Based Systems, 2009 IEEE International Conference on Web Services, Ieee, 2009, 783-790 [15] Halima, R. B.; Drira, K.; Karim, M. & Guennoun, M. K., A framework for monitoring and runtime recovery of web service-based applications To cite this version : A FRAMEWORK FOR MONITORING AND RUNTIME RECOVERY OF WEB SERVICEBASED APPLICATIONS, 2009 [16] Hall, S. & Villemaire, R., Runtime Monitoring of Web Service Choreographies Using Streaming XML, 2009

131

S. Q. Fleh, A. K. Abbas, K. M. Saffer

The Iraqi Journal For Mechanical And Material Engineering, Special Volume for Babylon First International Engineering Conference , Issue (A)

[17] Huang, T., Runtime Monitoring Composite Web Services Through Stateful Aspect Extension, 2009, 24, 294-308 [18] Lomuscio, A.; Solanki, M.; Penczek, W. & Szreter, M.,Runtime monitoring of contract regulated web services, 2009, 1001-1017 [19] Michlmayr, A.; Rosenberg, F.; Leitner, P. & Dustdar, S., Comprehensive QoS monitoring of Web services and event-based SLA violation detection, Proceedings of the 4th International Workshop on Middleware for Service Oriented Computing - MWSOC '09, ACM Press, 2009, 1-6 [20] Michlmayr, A.; Rosenberg, F.; Leitner, P. & Dustdar, S., Service Provenance in QoSAware Web Service Runtimes, 2009 IEEE International Conference on Web Services, Ieee, 2009, 115-122 [21] Momm, C.; Gebhart, M. & Abeck, S., A Model-Driven Approach for Monitoring Business Performance in Web Service Compositions, 2009 Fourth International Conference on Internet and Web Applications and Services, Ieee, 2009, 343-350 [22] Mulo, E.; Zdun, U. & Dustdar, S., Monitoring web service event trails for business compliance, 2009 IEEE International Conference on Service-Oriented Computing and Applications (SOCA), Ieee, 2009, 1-8 [23] Simmonds, J.; Gan, Y.; Chechik, M.; Nejati, S.; O'Farrell, B.; Litani, E. & Waterhouse, J. Runtime Monitoring of Web Service Conversations, IEEE Transactions on Services Computing, 2009, 2, 223-244 [24] Spillner, J. & Schill, A., Dynamic SLA Template Adjustments Based on Service Property Monitoring, 2009 IEEE International Conference on Cloud Computing, Ieee, 2009, 183-189 [25] Spillner, J.; Winkler, M.; Reichert, S. & Cardoso, J., Distributed Contracting and Monitoring in the Internet of Services, 2009, 129-142 [26] Wetzstein, B.; Leitner, P.; Rosenberg, F.; Brandic, I.; Dustdar, S. & Leymann, F., Monitoring and Analyzing Influential Factors of Business Process Performance,2009 IEEE International Enterprise Distributed Object Computing Conference, Ieee, 2009, 141-150 [27] Clayman, S.; Galis, A.; Chapman, C. & Toffetti, G.,Monitoring Service Clouds in the Future Internet, 2010, 115-126 [28] Heward, G.; Müller, I.; Han, J.; Schneider, J.-G. & Versteeg, S., Assessing the Performance Impact of Service Monitoring, 2010 21st Australian Software Engineering Conference, Ieee, 2010, 192-201 [29] Hosein Zadeh, M. & Seyyedi, M. A., Qos monitoring for web services by Time Series Forecasting, 2010 3rd International Conference on Computer Science and Information Technology, Ieee, 2010, 659-663 [30] Leitner, P.; Michlmayr, A.; Rosenberg, F. & Dustdar, S., Monitoring, Prediction and Prevention of SLA Violations in Composite Services, 2010 IEEE International Conference on Web Services, Ieee, 2010, 369-376 [31] Mahbub, K.; Spanoudakis, G. & Zisman, a., A monitoring approach for runtime service discovery, Automated Software Engineering, 2010, 18, 117-161 [32] Moser, O.; Rosenberg, F. & Dustdar, S., Event Driven Monitoring for Service Composition Infrastructures, 2010, 38-51 [33] Psaier, H.; Juszczyk, L.; Skopik, F.; Schall, D. & Dustdar, S. Runtime Behavior Monitoring and Self-Adaptation in Service-OrientedSystems 2010 Fourth 132

A SYSTEMATIC MAPPING STUDY ON RUNTIME MONITORING OF SERVICES

S. Q. Fleh, A. K. Abbas, K. M. Saffer

IEEE International Conference on Self-Adaptive and Self-Organizing Systems, Ieee, 2010, 164-173 [34] Bertolino, A.; Calabr, A.; Lonetti, F.; Marco, A. D. & Sa, A., Towards a ModelDriven Infrastructure for Runtime Monitoring To cite this version : 2011 [35] Foster, H. & Spanoudakis, G., Advanced service monitoring configurations with SLA decomposition and selection, Proceedings of the 2011 ACM Symposium on Applied Computing - SAC '11, ACM Press, 2011, 1582 [36] Dharam, R. & Shiva, S. G., Runtime Monitoring Technique to handle Tautology based SQL Injection Attacks, 2012, 1, 189-203 [37] Espinha, T.; Zaidman, A. & Gross, H.-G., Understanding the Runtime Topology of Service-Oriented Systems, 2012 19th Working Conference on Reverse Engineering, Ieee, 2012, 187-196 [38] Holmes, T.; Zdun, U. & Dustdar, S., Automating the Management and Versioning of Service Models at Runtime to Support Service Monitoring, 2012 IEEE 16th International Enterprise Distributed Object Computing Conference, Ieee, 2012, 211-218 [39] Khaxar, M. & Jalili, S., WSCMon: runtime monitoring of web service orchestration based on refinement checking, Service Oriented Computing and Applications, 2012, 6, 33-49 [40] Klems, M.; Bermbach, D. & Weinert, R., A Runtime Quality Measurement Framework for Cloud Database Service Systems, 2012 Eighth International Conference on the Quality of Information and Communications Technology, Ieee, 2012, 38-46 [41] Noureddine, A.; Rouvoy, R.; Seinturier, L.; Moni, L. S. R.; Energy, S.; Ase, H.; Ieee, T.; International, A. C. M. & Bourdon, A., Runtime Monitoring of Software Energy Hotspots To cite this version : Runtime Monitoring of Software Energy Hotspots 2012 [42] Othman, O.; Balasubramanian, J. & Schmidt, D. C., The Design of an Adaptive Middleware Load Balancing and Monitoring Service, 2015 [43] a.M. Fiskiran & Lee, R. B., Runtime execution monitoring (REM) to detect and prevent malicious code execution, IEEE International Conference on Computer Design: VLSI in Computers and Processors, 2004. ICCD 2004. Proceedings., Ieee, , 452-457 [44] Barbon, F.; Traverso, P.; Pistore, M. & Trainotti, M.,Run-Time Monitoring of the Execution of Plans for Web Service Composition , 346-349 [45] Bianculli, D.; Ghezzi, C. & Milano, P., Monitoring Conversational Web Services [46] Franch, X.; Grünbacher, P.; Oriol, M.; Burgstaller, B.; Dhungana, D.; López, L.; Marco, J. & Pimentel, J. a., Goal-driven Adaptation of Service-Based Systems from Runtime Monitoring Data [47] Hall, S., Cooperative Runtime Monitoring of LTL Interface Contracts [48] Mos, A.; Pedrinaci, C.; Rey, G. A.; Gomez, J. M.; Vaudaux-ruth, G. & Quaireau, S. Multi-Level Monitoring and Analysis of Web-Scale Service Based Applications, , 1-15 [49] Pistore, M.; Barbon, F.; Bertoli, P.; Shaparau, D. & Traverso, P., Planning and Monitoring Web Service Composition [50] Pohlack, M. & Lackorzy, A., Towards Runtime Monitoring in Real-Time Systems [51] Vaculn, R. & Sycara, K., Specifying and Monitoring Composite Events for Semantic Web Services [52] Pohlack, M. & Lackorzy, A., Towards Runtime Monitoring in Real-Time Systems [53] Petersen, K.; Feldt, R.; Mujtaba, S. & Mattsson, M., Systematic Mapping Studies in Software Engineering, 2007, 1-10 133

S. Q. Fleh, A. K. Abbas, K. M. Saffer

The Iraqi Journal For Mechanical And Material Engineering, Special Volume for Babylon First International Engineering Conference , Issue (A)

[54] Shahin, M.; Liang, P. & Babar, M. A., A systematic review of software architecture visualization techniques, Journal of Systems and Software, Elsevier Inc., 2014, 94, 161-185 [55] Novais, R. L.; Torres, A.; Mendes, T. S.; Mendonça, M. & Zazworka, N., Software evolution visualization: A systematic mapping study, Information and Software Technology, Elsevier B.V., 2013, 55, 1860-1883 [56] Barreiros, E.; Almeida, A.; Saraiva, J. & Soares, S., A Systematic Mapping Study on Software Engineering Testbeds, 2011 International Symposium on Empirical Software Engineering and Measurement, IEEE, 2011, 107-116 [57] Neto, C. B. L.; Filho, P. B. D. C. & Duarte, A. N., A Systematic Mapping Study on Fault Management in Cloud Computing, 2013 International Conference on Parallel and Distributed Computing, Applications and Technologies, Ieee, 2013, 332-337

134