Final Evaluation of the “Participatory Utilization and Resource Efficiency of Water (PURE Water)” Project
The Urban Foundation for Sustainable Development (the Urban Foundation) solicits applications from Consultants (individual or organization) for fulfilling an Assignment described below in the framework of the PURE Water Project funded by USAID.
The goal of the PURE Water Activity is to contribute to the increase of water productivity, efficiency, and quality, as well as foster behavioral change, to reduce the rate of groundwater extraction in the Ararat Valley.
The goal was planned to achieve through the following objectives:
Objective 1: Support the development of and advocacy for an enabling policy and regulatory framework for improved participatory use of water;
Objective 2: Facilitate participation and oversight of integrated water management practices in about 12 target communities to increase water resource efficiency;
Objective 3: Raise public awareness and foster water-related behavioral change among affected stakeholders;
Objective 4: Identify small-scale infrastructure pilot projects to complement local water needs.
The duration of the project:
3 years, March 2017 - February 2020.
Expected results :
- Policy and regulatory improvements to foster participatory use of water are in place;
- Participation in and oversight of water resources ensured to improve efficiency;
- Public Awareness raised and behavioral change fostered among water users; and
- Small-Scale infrastructure pilots to complement local water needs identified and implemented.
Beneficiaries:
The local population of the following selected rural communities: Vedi, Aygavan, Poqr Vedi, Burastan, Berqanush and Khachpar in Ararat marz, and Aknalich, Aratashen, Yeraskhahun, Yeghegnut, Guy and Griboyedov in Armavir marz.
- Description of the Assignment
Overall objective
The evaluation should contribute to accountability by providing an assessment of the results achieved. Furthermore, it should contribute to learning by understanding what have been the factors that made possible or created obstacles to the achievement of results (the focus is therefore on why, not only on what); and by identifying any key lessons that would lead to improved future actions in the country and sector. The evaluation will also evaluate the impact and sustainability in order to draw conclusions that may inform further actions. It shall not only describe what has been achieved but particularly why and upon what conditions results have been (or have not been) achieved.
Specific objectives
The final evaluation will analyze the relevance, efficiency, effectiveness of the Project and assess whether the Project’s expected outputs have been achieved during the implementation period of the Project (effectiveness), and if this was done in an efficient manner (efficiency). It will also assess the extent to which the Project has contributed to the achievement of the stated specific and overall objectives (outcome and impact, if any) and whether the results of the Project (at all levels) are likely to be sustainable (sustainability). Finally, it will draw conclusions on whether the Project provided the best avenue to address the actual needs and priorities (relevance) as well as the indicator relevance to the project and provide concrete recommendations for the Project.
The focus of evaluation is on the assessment of achievements, the quality and the results of actions in the context of an increasing emphasis on result-oriented approaches and the contribution towards the implementation of the SDGs. From this perspective, the evaluation should look for evidence of why, whether or how these results are linked to the USAID interventions in Armenia and seek to identify the factors driving or hindering progress. Evaluation should provide an understanding of the cause and effect links between: inputs and activities, and outputs, outcomes and impacts and should serve accountability, decision making, learning and management purposes.
The main objectives of this evaluation are to provide the relevant services with:
an overall independent assessment of the past performance of the Project, paying particular attention to its results measured against its expected objectives; and the reasons underpinning such results; key lessons learned, conclusions and related recommendations in order to improve current and future actions.
Indicative Evaluation Questions
The specific Evaluation Questions as formulated below are indicative. Based on the latter and following initial consultations and document analysis, the evaluator(s) will discuss them with the Project Team and propose in their Inception Report a complete and finalised set of Evaluation Questions with indication of specific Judgement Criteria and Indicators, as well as the relevant data collection sources and tools.
Once agreed through the approval of the Inception Report, the Evaluation Questions will become contractually binding.
The below evaluation questions are reflective of the evaluation objectives and selected specific aspects, covering all the evaluation criteria.
1. Relevance
1.1 - How well do the original objectives still correspond to the current and expected needs and priorities of the target groups?
1.2 - How does the project address the needs of the beneficiaries and other stakeholders?
2. Effectiveness
2.1 - What have been and what are the expected (quantitative and qualitative) effects of the intervention?
3. Efficiency
3.1 - To what extent are the costs proportionate to the benefits achieved, considering the full costs and benefits to the society?
4. Sustainability
4.1 - How likely the effects, specifically in terms of results, are to last after the intervention ends, also in terms of the institutional arrangements and capacities, and how they can be effectively transitioned from piloting to mainstreaming? Please identify the relevance per each contract.
5. Impact
5.1 - Which of the changes produced by the Project among the target groups, both intended and unintended, are long-term?
5.2 - How can the progress achieved under the Project be tracked?
5.3 - Assess the visibility of the Project intervention for the USAID. How do the final beneficiaries associate the Project intervention with the USAID?
These evaluation questions must be fully addressed by the Evaluator(s) in the proposed methodology.
Additional questions can be added if considered related and bringing important insights.
The results will be used:
- by the USAID and other stakeholders, as well as, partners to replicate and/or review and redesign the approaches for future participatory projects, particularly in the water sector.
Methodology
The Successful Consultant should suggest a methodology for the implementation of the assignments which, inter alia, may include:
- Designing the evaluation;
- Preparing the questionnaire;
- Conducting desk research, and in-depth interviews with experts, policymakers and practitioners in the water sector at the national and local levels;
- Designing and facilitating a focus group session(s);
- Designing and carrying out a stakeholder analysis and prepare a comparison chart comparing with the same type of analysis carried out at the beginning of the project. The methodology of the current evaluation should consider previously done assessments.
Deliverables
Deliverables should include the following:
- Evaluation questionnaire;
- Evaluation Timetable;
- Comparative stakeholder analysis (with a chart and table) - (Armenian and English);
- Final Evaluation Report in (Armenian and English) with recommendations;
- Powerpoint presentation (Armenian and English);
- Audio recordings and transcripts of expert interviews.
- Duration of the assignment
The successful organization/individual should suggest a timeline for the assignment which should cover the period from mid-December 2019 to the end of February 2020 not to exceed a two and half month period. Preference will be given to the organization/individual who would be able to allocate resources to implement several tasks in parallel.
Interested organization/individuals are requested to submit Technical and Financial applications.
Maximum 70% of the total score will go to the Technical application, which will include the following documents:
- Brief methodology (max. 1 page) – 30%
- Description of human resource capacities of the applicant to fulfill the described tasks within limited timelines (max. 1 page) – 40%
- The past experience about the accomplishment of similar tasks (max. 1 page) – 20%
- The CV of the lead social scientist – 30%.
Maximum 30% of the total score will go to the financial application, which will include budget estimate with per task breakdown.
- Required experience and qualification
The Lead social scientist/consultant shall have the following expertise and qualifications:
- Master’s degree in Public Policy, Sociology, International Development, Development Studies/Planning, Economics, Statistics or any other relevant university degree;
- At least 3 years of experience in the project evaluation. Experience in conducting an evaluation of in water-sector will be considered as an advantage;
- At least 3 years of experience in working with international organizations and donors,
- Excellent written and verbal communication skills in English and Armenian.
- Cost of the Assignment
The maximum price offered for this assignment should not exceed 2,300,000 AMD.
- Application procedures
Interested organizations/individuals should submit the requested documents electronically to the following address: [email protected] by COB December 06, 2019.