Key Performance Indicators for Integrated Water ...

SUST Journal of Engineering and Computer Science (JECS), Vol. 16, No. 2, 2015

Key Performance Indicators for Integrated Water Resources Management in Some African Countries Osama Mohamed Ahmed Adam1 and Isam Mohammed Abdel-Magid2 1

Hydraulics Department, Sudan University of Science & Technology (SUST), Khartoum, Sudan Environmental Engineering Department, College of Engineering, University of Dammam, Saudi Arabia [email protected], [email protected]

2

Received: 24.07.2014 Accepted: 02.09.2014 ABSTRACT-The research undertaken herein focused mainly on the quality and content of key performance indicatorsets in Integrated Water Resources Management (IWRM).The concept of IWRM was introduced in its modern interpretation. Review of IWRM literature from Eastern African countries indicated that the regional WRM sector is at various stages of implementing IWRM. The study of Key Performance Indicators (KPIs) in IWRM-oriented interventions recommended essential steps for an assessment of water-related projects. Appropriate KPIs were formulated, selected and tested for certain African countries. A computer program model was developed to help in decision making in implementing IWRM projects. Selected KPIs helped in evaluating the progress towards IWRM implementation to certain countries that include: Burundi, Comoros, Djibouti, Eritrea, Ethiopia, Kenya, Rwanda, Seychelles, Somali, Sudan, Tanzania and Uganda based on a well phrased questionnaire. Keywords: Integrated Water Resources Management (IWRM), Key Performance Indicators (KPI’s) ‫ وقدم مفهوم اإلدارة المتكاملة‬.‫ هذا البحث ير ّكز بشكل عام على نوعية مجموعات مؤشرات األداء الرئيسة لإلدارة المتكاملة لمصادر المياه‬- ‫المستخلّص‬ ‫ لقد أشارت المراجعة المختارة ألدبيات اإلدارة المتكاملة لموارد المياه من بلدان شرق أفريقياإلى أن قطاع اإلدارة‬.‫لموارد المياه في اطاره الحديث‬ ‫ أوصت‬.‫غير أن هنالك عناصر مشتركة في ُك ّل النظرات‬،‫اإلقليميةلمصادر المياه في مراحل ُمختلفة فيها من حيث تطبيق اإلدارة المتكاملة لمصادر المياه‬ ‫ ومن ثم فقد‬.‫الدراسة الموجهة لمؤشرات األداء الرئيسة في تد ّخالت اإلدارة المتكاملة لمصادر المياه للخطوات الضرورية لتقييم المشاريع المتعلقة بالمياه‬ ‫ وصمم نموذج لبرنامج حاسوبي وطُ ّور لل ُمساعدة في إتّخاذ قرارات تطبيق‬.‫ضعت مؤشرات األداء الرئيسة المالئمةوإختيرت وإختبرت لبلدان أفريقية منتقاة‬ ‫ ساعدت مؤشرات األداء المختارة في تقويّم التق ّدم نحو تطبيق اإلدارة المتكاملة لمصادر المياه لبلدان معينة‬.‫مشاريع اإلدارة المتكاملة لمصادر المياه‬ .‫بوروندي والكومورون وجيبوتي وأرتيريا وإثيوبيا وكينيا ورواندا وسيشيل والصومال والسودان وتانزانيا وأوغندا مستندة على إستبانة محكمة‬:‫ضمت‬

when properly developed should provide all staff with clear goals and objectives, coupled with an understanding of how they relate to the overall success of the organization, strengthen shared values and create common goals. (See Figure 1).

INTRODUCTION Integrated Water Resources Management (IWRM) is being regarded as a vital component of government’s sustainable development agenda. This research work is designed to address the importance of IWRM, its goals and needs in order to spread its application and reap associated benefits. The research is aimed at policy makers, water managers, trainers and educators linked with implementation of IWRM principles. It provides the case for IWRM and the arguments against those who may oppose it on institutional or sectoral grounds and for those who will be directly involved in practical implementation of IWRM. The work undertaken provides the opportunity to look at specific implications of IWRM in a sectoral field or to recognize the key issues in other sectors (environment, agriculture, domestic/municipal water supply and wastewater treatment). It provides a series of measures against which internal managers and external investors can judge the business and how it is likely to perform over medium and long terms. KPIs

Competitive advantage Business development

Monitor performance

KPIs

Organization success Goals & objectives

Management

Investment

Empowers employees

Answers to questions

Share value

Figure 1: KPI’s added value

Key Performance Indicators, KPIs, have become one of the most used terms in business development and management. KPIs and Benchmarks are management tools for monitoring and improving performance of people, systems, processes and organizations. 05


An understanding of benchmarks is essential to make KPIs useful and specific to an organization. This is because KPIs put the level of current performance in context – both for startups and established enterprises – though they are more important for the latter. Benchmarks also help in checking what other successful organizations see as crucial in building and maintaining competitive advantage. The provision of water is crucial to all communities. Water service authorities or providers are generally not subject to market competition. Therefore, it is important that water provision is independently monitored to ensure that the performance of service providers is at an acceptable standard. In Sudan, the water service sector has significant financial constraints. Thus it is imperative that supply is effective and efficient if it is to be sustainable. This is formally supported in Sudan through Water Services which requires annual performance reporting to the governing authority. Indicators that vary significantly with time cannot be interpreted meaningfully when viewed at an isolated point in time. Such indicators have to be monitored regularly for the trend in the indicator to be established [1,2]. Statement of Research Problem and Hypothesis Integrated water resources management and water supply in different countries lack key issues for its effective introduction and implementation. Selection of appropriate Key Performance Indicators, KPIs, would help formulating appropriate action plans, milestones and effective implementation and governance for appropriate IWRM format. Grouping of selected KPIs through a computer program facilities selection, monitoring and sound decision making. Importance of the Research Problem The research aims to propose KPIs in integrated water resources management for countries and districts alike. In this respect, the study focused on investigation of KPIs in IWRM and tested their use and effect in selected countries in the developing world where IWRM is introduced. It is also anticipated that the research will explore areas of concern about indicators usefulness and applicability.

Research Objectives: The goals and objectives of this research work may be summarized as follows: 1. To set suitable performance indicators to IWRM with special emphasis on indicators sustainability and implementation in some countries. 2. To formulate and test a computer modelling program which can be used to evaluate the state progress towards IWRM implementation in some African countries based on a preset questionnaire. Selection of appropriate key performance indicators to IWRM will help countries, districts and catchment basins for appropriate management of their resources. Literature review Integrated Water Resources Management (IWRM) is a holistic approach that considers economic, environmental, technical, social as well as cultural issues. It is aiming to follow the three overriding criteria of economic efficiency in water resources use, equity in the access to water resources in adequate quantity and quality and environmental sustainability). The key concept of the IWRM approach and the basis of its success are integration and balancing of different goals and views in an informed manner. This essential element separates IWRM from other management practices (see Figure 2).

Figure 2: General Framework of IWRM Concept [4]

However, due to context specific conditions derived from the integration principle, IWRM is not a concept applicable in all circumstances in the same way. It has to be understood as a framework that considers local, regional or basin-scale conditions to be successful interventions. 05


The three complementary elements of an effective water resources management have to be developed and strengthened concurrently to a successful implementation of the IWRM framework[3] i.e. an enabling environment, institutional role and management instruments. An enabling environment addresses general framework of national policies, legislation, regulations and information for water resources management stakeholders. The institutional roles and functions of various administrative levels cover local, national and international levels. Improved performance of water resources management will depend on institutional reforms rather than on additional technologies or more infrastructures [5]. Thus, the main challenge will be to establish correct policies, viable political institutions, as well as self-governing and self-supporting of local systems [6]. The management instruments that enable decision-makers to make informed choices between alternative actions include: operational instruments for effective regulation, monitoring and enforcement. These instruments need to be based on agreed policies, available resources and consideration of environmental impacts and socio-economic consequences. The central feature of IWRM success is to

recognize available tools and instruments for water management and selecting, adjusting and applying this mix of tools appropriate to the given circumstances. Since IWRM framework is a process, the concept of a “project cycle management” should be used in its implementation. This offers opportunities and necessity for adjustment and improvement of management measures and decision-making procedures. The process starts with a planning process and continues into an implementation of the framework and action plans, followed by monitoring of this process which leads into an adjustment of the planning and implementation (see Figure 3). At any point in this cycle feedback is necessary on which part decisions can be monitored and evaluated. Consequently, IWRM implies a holistic view of the water resources situation and its interaction with societal use in a spatial entity and give a tentative assessment of the water requirements for the assumed development. This incorporates also an effective water demand management in contrast to traditional water resources management approach which focuses merely on water supply management.

Figure 3: The IWRM Cycle [4].

05


The success and effectiveness of the IWRM processes also highly depends on adaptive skills of the ability of institutionalized communication and decision-making processes to cope with constantly changing complex socio-economic and ecological framework conditions, and to develop adequate, effective, problem-solving oriented and managing strategies Consequently, IWRM does not only deal with management of physical domain, but also has to manage the management process itself [7]. Adequate and effective monitoring and evaluation, M&E, procedures becomes an essential feature of an integrated and adaptive water resources management process. This is because information is needed to adapt management actions to a changing environment and assess to adequacy the actions that incorporate [1]: adaptive management and adequate M&E, M&E to initiate learning processes and needed resources that are frequently neglected in favor of more tangible assets. Monitoring, evaluation and establishing benchmarks are key activities in all successful management strategies. M&E main objectives are to [8]: 1. assess whether the implementation process is on track against the process objectives 2. measure the impacts of the process, both in the short and long run 3. evaluate whether actions and impacts indeed contribute to a larger strategy and sustainable development 4. Requirements for M&E in IWRM overview: assessing resource domain and process level, initiating learning processes, integrating assessment, having to be adaptive as well necessary in all process phases , broad integration of participation, development of management objectives, development of indicators and establishing assessments Water management depends highly on participation of affected stakeholders and will not be successful if they will not follow the management actions, incorporating local knowledge and resources and coping with complexity and uncertainties. Indicators in M&E cannot provide a complete and entire picture of the reality and come with information loss and uncertainties [9].

Nonetheless, indicators are considered important instruments to provide insights to the system. The selection process of indicators is very important to ensure adequacy of provided information. Participatory development of indicators will increase their significance and effectiveness. The process of indicator development enables participants to recognize shared goals and visions, as well as the limitations of existing measures of well-being. Development process provides meaning and credibility to information and participatory developments of indicators contribute significantly to IWRM. KPIs should be clearly linked to the strategy Once strategy have been agreed upon, defined and mapped KPIs can be designed to track progress and gain relevant insights to help manage and improve performance. KPIs have to provide answers to the most important questions. KPIs should be primarily designed to empower employees and provide them with the relevant information to learn. This in turn should improve the decision making and lead to improved performance (see Figure 4).

Figure 4: Business Performance Measurement

A good starting point is therefore to come up with the questions that need to have an answer before starting designing KPIs. One or two socalled Key Performance Questions (KPQs) are identified for each strategic objective. KPQs will help articulating the information needs which in turn allow designing the right performance indicators to help answering KPQs. 05


taken in consideration. Provisions allowed an indicative list of main elements of water resources management policies, strategies regardless of their being the outcomes of a “proper” IWRM plan that has been labeled as such or of other planning processes. Countries (See figure 5) provided some indication of their status of implementation by checking in the relevant box. Information about implementation and monitoring instruments pertaining to sought water resources management reforms calls for information about their impact in addressing problems for which these instruments were designed and implemented. Finally, suggestions were sought about key issues and their possible solutions.

METHODOLOGY AND CASE STUDY GENERAL CONSIDERATIONS Eastern African countries are in different stages of planning and implementing the water resources management reforms. For example, some countries have gone through multi-year IWRM planning processes resulting in new national policies, strategies and laws for the development and management of their water resources. Others have embarked on similar processes, but without actually calling it an IWRM process or having developed a specific “IWRM plan”. Experience has shown that there is no “one way” for planning and implementing the integration in the water sector. Specific water resources problems and conditions will determine priorities in an individual country and the final choice of management solutions will depend on local culture, tradition and capacity. Therefore, measuring progress towards integrated water resources management must seek to capture and take into account the wide range of efforts made by the countries to improve water resources management in order to balance economic, social and environmental requirements rather than “counting plans”. IWRM Case Study IWRM/Water Efficiency Plan target is sought through a questionnaire. It has been developed to accommodate different interpretations and modalities for water resources management reforms by not focusing only on the “IWRM plans”, but also on other elements of the enabling environment and on actual implementation of the reform processes. It provides opportunities for narrative explanations, where necessary, and it is open ended for any additional or alternative description of what is being implemented in a certain country in terms of water resources management strategies and reforms. The questionnaire sought information on the enabling conditions for water resources management reforms i.e. the strategies and plans as well as policies and legislation. It is to be noted that even if there is no IWRM plan that has been labeled as such, other strategic water resources management policy or planning documents which could be considered as “equivalents or proxy” are also included and

Figure 5: Eastern African countries of study area

Developed IWRM KPIs Within the scope of the research undertaken herein an IWRM KPIs must be 1: 1. Efficient (i.e. easily measured and analysed using existing data) 2. Effective (i.e. sensitive to change and clearly linked to causative factors) 3. Economically and logistically feasible (e.g. already being measured) and 4. Reliable (i.e. accurate and continuous). 5. Meaningful and should focus to a clear purpose and reflect norms and values of a community. An issue in the development and application of indicators is the feasibility, technical, financial and environmental aspect of gathering the information required. While an indicator may 05


have great potential for monitoring policyrelevant trends, the logistical, technical, and economic realities of collecting and analysing the information required for its determination will dictate its use. While some indicators may have great utility, technical and financial constraints may preclude their use. Sound KPIs were developed and tested in this research work. They include the following vital compounds [1]: mean annual rainfall, data collection effort, annual surface runoff and pollution of ground water.

Clarification of the state of water resources management of countries Clarification of state of water resources management of selected countries

Indicator evaluating survey

Evaluation of state of progress toward IWRM

Figure 6: The research study flow charts. Table 1: Method of Referring to Concept of IWRM in the Water Action Follow-up Survey Method of referring to IWRM concept Basic information about water resources Country Information management for each country Country’s effort (can not be applied toward the portfolio usefully) of water action Management systems State of progress of system of IWRM resources to achieve IWRM

Model Development KPIs related closely to water resources development from among the indicators applied to monitor the Millennium Development Goals (MDGs), were selected for this survey and applied to clarify the degree of progress towards IWRM in Eastern African countries forming the GWP regional water partnership. The state of progress towards IWRM around selected countries is clarified at the same time when determining degree of progress of system related to water resources management of countries based on the indicator evaluation survey. Specifically, each item clarified by portfolio of water action (PWA) flow up survey and by indicator evaluation survey quantitatively evaluated by scoring condition in each country. Finally, the degree of progress towards IWRM is evaluated based on the scoring in tested country. The degree of progress towards IWRM, evaluated by the method above, has been based on the questionnaire based in reply of each national country, and together with the indicator evaluation that is based on the objective data. As such, high credibility is achieved. Figure 6 summaries study flow charts. Table 1 presents the structure of the questions in the portfolio of water action follow-up survey. Although it is basically intended to monitor portfolio of water action, many of the questions concern the integrated development and management of water resources, or in other words, the IWRM concept. Specific method of clarifying the state of WRM of countries is study based on the results of the PWA followup survey.

Water resources management system in the PWA follow-up survey presents questions about the states of provision of the legal frameworks, state of provision plans, and state of continuous allocation of government expenditures concerning the management of water that include surface water (rivers, lakes), groundwater, and costal water. Within a single related framework there are questions such as, existence of IWRM-compliant law, IWRMcompliant water policy, special budget allocation for IWRM, etc. (see Table 2). If this legal framework of plan government expenditure is grasped in terms of IWRM concept, they can be resulted as degree of sharing of the concept, its degree of specification, and degree of implementation. This relation can be represented schematically as shown in Figure 7. Figure 8 shows portfolio of water action follow-up survey outline of the structure of the questions. Legal framework

Share of the concept

Plan

Specification of the concept

Continuous allocated government expenditures

Implementation of the concept

Figure 7: Method of Referring to the Questions in the PWA Follow-up Survey

00


Table 2: Progress Markers of Questionnaire Questions Answer Yes/No

Questions 1 2 3 4 5 6 7 8 9 10 11 12 13 14

Perspectives in IWRM Concept

Existence of IWRM-compliant law IWRM-compliant Water Policy Special budget allocation for IWRM Existence of stakeholder platform Environmental water requirement studies carried out Percentage of the budget for running water management institutions generated from users Establishment of legislation for water quality standards Whether water allocation to users considers economic value Average decreasing level of unaccounted for water Percentage increase of women in decision-making levels Existence of outreach programme for IWRM Decentralised water management institutions operational Existence of updated and accessible IWRM database Information on IWRM shared widely with decision makers and end users

Figure 8: Portfolio of Water Action Follow-up Survey Outline of the Structure of the Questions

05


that the progress towards the development of an IWRM is at an initial stage (Figure 10). Ethiopia High level of Government commitment is envisaged to facilitate IWRM implementation process in Ethiopia. The county is establishing river basin organization which is believed to significantly contribute towards creating efficient and stable mechanisms for the implementation of the Ethiopian Water Resources Management Policy. Implementation will be sought through river basin plans and effective and sustainable joint management by relevant stakeholders of water resources of basins (Figure 11). The Abay (Blue Nile River Basin Organization has already been established by regulation while other two (the Awash River Basin and Rift Valley Lakes Basins) are under development. The fact that seven of twelve major river basins in Ethiopian have master plan is facilitating the implementation of IWRM at basin scale. In addition to IWRM implementation at big river basin scale, the ongoing program on piloting IWRM at small watershed level is to be scaled up at country level. The IWRM planning and implementation exercise is being carried out in some watersheds thus generating practical experiences.

RESULTS AND DISCUSSIONS Obtained data is rechecked by using summary status reports in Eastern Africa GWP country partnerships that is supported by the African Development Bank under the auspices of a multi Donor Water Partnership Program for different years. Burundi In Burundi there are significant problems in the planning and utilization of water resources due to poor coordination of activities between the various actors in the government as well as the challenges posed by physical factors (steep relief, dispersed pattern of settlement, high spatial and temporal variability of the resource). Planning and management of water resources in Burundi aims to address the multi-sectoral use of resources, taking account of environmental aspects and allowing for the costs of operation, maintenance, and upgrading of infrastructure . One of the main issues for the future is the improvement of access to potable drinking water. Problems include drought and desertification in peripheral regions, progressive decline in water quality due to demographic pressure, deforestation and soil erosion, bacterial pollution from untreated sewage discharge which affects drinking water supplies, and high sediment loads which impair hydropower generation. Data and information on water resources are scattered across several ministries. Analysis of the data is difficult because they are not standardized, collection is not systematic or regular, and there is no central database (Figure 9). Comoros There is no documentation available that could be considered towards an IWRM plan development in Comoros. However, there are number of reports that document the current water resources status in the country. Currently, Comoros is among countries suffering from water scarcity and severe water quality problems. The Ministry of Rural Development, Fishing, Handicraft and Environment govern the water sector in Comoros. There is no information on Comoros progress towards development of an IWRM plan. However, the unavailable documentation of taken steps towards water resources management, in addition to the economic conditions in the country suggests

Figure 9: Grades of Burundi IWRM States –Some State

05


management. The role being played by such local networks in raising awareness, building capacity and establishing framework for broader stakeholder participation and networking is high. Somalia There is no available documentation that could be considered towards an IWRM plan development in Somalia. The water resources in Somalia are dominated by surface water. Groundwater potential is limited because of the limited natural recharge to aquifers. Somalia needs support in assessing its groundwater resources in addition to expanding of other nonconventional water resources to meet national demand. Ministry of Mineral and Water Resources and its National Water Centre govern the water sector in Somalia. There are no reported activities towards development of an IWRM plan. Considering the level of economic status of Somalia and the lack of sufficient water policies documentation, the progress of an IWRM plan development by now is unlikely to be taking place. Sudan Barriers and constraints to adopting IWRM approach in Sudan (See figure 12) can be attributed to the level of priority attached to water management in general and to the water governance system in particular. The situation is aggravated by the lack of awareness and capacity building programs and absence of support from the international community advocating/supporting IWRM and sustainable water management. Major factors constraining the water resources management institutions include; 1. Sector governance particularly participation and coordination beside transparency, accountability, integration and communication, 2. Institutional framework to address key water resources management issues(e.g. mix of regulatory and service provider functions; also mixing federal and states responsibilities and lack of basin level coordination structure) 3. Responsibility poorly described for departments/sections, which greatly affects budget approval. 4. Budget is a very severe constraint to all water management functions. The greater

Figure 10: Grades of Comoros IWRM States –Initial State

Figure 11: Grades of Ethiopia IWRM States –Good Progress

Ethiopia Country Water Partnership (ECWP), under the auspices of the GWP Network, now becoming an important forum for bringing together various stakeholders and sectors for sustainable management of water resources in Ethiopia. It is also playing an important role in promoting participation networking and coordination. Such forums are also laying the foundations for all stakeholders to jointly plan and implement sustainable water resources 05


proportion of MIWR budget is allocated to tasks outside its mandate such as irrigation operations. Low political will to develop and implement relevant laws that are required to effectively coordinate water uses within the various sectors and to manage resources in an integrated manner.

this data using a suitable method. Nonetheless in order to compare the degree of IWRM progress between countries it is based on indicators that are finally selected and it is important that the reliability of the supplementary data not to fall. CONCLUSIONS AND RECOMMENDATIONS The research work undertaken herein revealed the following significant results and recommendations: 1. IWRM proved to be an important and vital process towards improving the standard of water resources planning and management in Eastern African countries. 2. Key performance indicators aid selection and implementation of IWRM programs and projects. Sound KPIs developed and tested in this research work included:  Mean annual rainfall  Data collection effort  Annual surface runoff and  Pollution of ground water 3. A new network of website developed modeling program was established, to follow up the portfolio of water action that will publicize actions planned and taken on water-related issues by countries and international organizations in order to share information and promote cooperation. 4. Evaluation of the state progress towards IWRM implementation to each selected country (Burundi, Comoros, Djibouti, Eritrea, Ethiopia, Kenya, Rwanda, Seychelles, Somali, Sudan, Tanzania and Uganda) based on a sound questionnaire 5. Specific recommendations as outlined by the conducted Survey in case study may include the following: a. Countries, particularly those that are lagging behind in implementing IWRM concept, need to prioritize the development of IWRM and water efficiency measures, with the help of supporting national & international agencies; b. Countries need to prioritize the implementation of developed and set policies and plans; c. Countries ought to establish roadmaps and finance strategies for the implementation of

Figure 12: Grade of Sudan IWRM States – Some step

SUMMARY RESULTS According to the overall structure, results of the investigation of IWRM are however at various levels of planning and implementation in the region as shown in Table 3. 1. Four countries advanced with Water Plans that can qualify for IWRM Plans (Good progress) 33%. 2. Five countries with IWRM Plans in progress or with Water Plans that need evaluation for IWRM qualification (Some steps) 42%. 3. One country without information available but with likely progress in developing IWRM Plans (Initial stages) 8%. 4. Two countries without available information and unlikely progress in developing IWRM Plans 17% There are some countries lacking any data for the same item selected such as IWRM evaluating indicator. In order to perform evaluations by comparing data from the different countries, it is essential to supplement 05


plans with External Support Agencies (including UN, donors, CBO’s and NGOs) providing support based on demand; d. The GWP, UN, World Water Assessment Program and its associated World Water Development Reports should continue to provide an up-to-date global overview of progress on implementing the IWRM approach. e. Experiences in implementing IWRM should be evaluated, monitored and shared through global coordination mechanisms. This will require more work on indicators and follow-up processes that do not add an undue reporting burden on beneficiaries. 6. Case study undertaken for selected Eastern African countries showed the following vital results and information: a. Most often IWRM is implemented without a substantial shift in the underlying management paradigm. b. Approaches of IWRM are surely suitable concepts to be implemented for a sustainable water resources management strategy and to deal with the complex nature of water resources systems and schemes in each domain. c. Further evident observation showed that most of the IWRM processes have spent neither much time nor substantial resources on monitoring and evaluation procedures. d. Challenges worth consideration in engaging non-technical and technical communities in advocated dialogue with each other. e. Stakeholders were neither involved in the monitoring and evaluation, nor in the development of criteria and indicators for the monitoring. f. Lack of planning and forethought together with little or no experience of the process have its negative impact in planning and implementation

g. Selection of certain stakeholder (groups) to be included in the dialogue, and exclusion of others can lead to a refusal of the latter to accept the outcome. Consequently, jeopardizing the success of the process. REFERENCES [1] Adam, O.M.A., (2011), Key performance indicators for integrated water resource management, Ph.D. thesis, Graduate College, Sudan University for Science and Technology, Khartoum. [2] Bell, S. and Morse, S. (2004). Experiences with Sustainability Indicators and Stakeholder Participation: A Case Study Relating to a Blue Plan Project in Malta. Sustainable Development J., Vol. 12, No. 1, PP. 1-14. [3] Global Water Partnership (2000). Integrated Water Resources Management. TAC Background Papers Series, No 4, pp. 66. www.gwpforum.org/gwp/library/Tacno4.pdf [4] GWP (2004). Integrated Water Resources Management (IWRM) and Water Efficiency Plans by 2005. Why, What and How? GWPTAC Background Paper Series No. 10. Stockholm. [5] Koudstaal, R. and Rijsberman, F. R. (1992). Water and Sustainable Development, Natural Resources Forum J., Vol. 16, No. 4, PP. 277290. [6] Grigg, N. S. (1999). Integrated Water Resources Management: Who Should Lead, Who Should Pay, Journal of the American Water Resources Association, Vol. 35, No. 3, PP. 527-534. [7] Medema, W. and Jeffrey, P. (2005). IWRM and Adaptive Management: Synergy or Conflict? NeWater Working Paper, No. 7. [8] Pahl-Wostl, C. and Sendzimir, J. (2005). The Relationship between IWRM and Adaptive Managment. NeWater Working Papers No. 3, NeWater Project. [9] Freebairn, D. M. and King, C. A. (2003). Reflections on Collectively Working toward Sustainability: Indicators for Indicators, Australian Journal of Experimental Agriculture, Vol. 43, No. 3, PP. 223 – 238.

55