Terms of Reference to Conduct an Endline Evaluation for Green Energy-Solar (GIZ)-Project in West Nile At ZOA

Terms of Reference to Conduct an Endline Evaluation for Green Energy-Solar (GIZ)-Project in West Nile

1. Background information

1.1 Introduction

ZOA with funding from GIZ has implemented a fourteen-month Green Energy-Solar project ending in July 2023 in West Nile in the districts of Madi-Okollo and Terego. This project sought to improve economic, social, health and environmental well-being by providing sustainable approaches to increase the uptake and use of solar products by refugees and host communities in Terego and Madi-Okollo districts. The project adopted various strategies to increase Awareness, Availability, and Affordability of solar products.

ZOA seeks a consultant to complete an endline survey to report on final indicators as well as to conduct an evaluation of the project assessing the effectiveness and sustainability of strategies adopted by the project.

• Project deliverables

Overall: The well-being of refugees and host communities improved (economic, social, and health-improved)

• Outcome: Increased uptake of solar products among refugees and host communities of Terego and Madi-Okollo districts in West Nile.
  • Outputs:
    • Awareness of solar products among refugees and host communities increased
    • The availability of solar products improved
    • The affordability of solar products improved

2. Purpose of the endline Evaluation

Overall, the purpose of this evaluation is to assess the extent to which the solar green energy project has attained its objectives and identify key learnings to inform similar interventions in the future.

Specifically, the evaluation aims to:

• Assess the extent/level to which the project has improved the economic, social, health, and environmental well-being of refugees and host communities.
• Determine the extent/level of solar product uptake and adoption in homes, businesses, and agriculture.
• Evaluate the effectiveness of the project in terms of achieving project results – outputs/activities and its sustainability
• Assess the effectiveness of the supply-side interventions, including the utilization of Saving Groups (SGs) as an outreach platform and the involvement of small shop owners and retailers.
• Evaluate the impact of demand-side interventions, such as awareness campaigns and efforts to improve the affordability of solar products.
• Assess to what extent the project has responded to the needs of the beneficiaries in both Terego and Madi Okello districts and how efficient was the project in the utilization of the budget
• Assess the contribution of partnerships with solar companies and the utilization of their expertise in project implementation.
• Evaluation questions
  • Impact and Effectiveness questions:
• To what extent has the Green Energy-solar project improved the economic, social, health, and environmental well-being of targeted refugees and host communities in Terego and Madi Okollo districts?
• To what extent has the project caused additional time spent at work, additional study time for children, increased income earned, and savings made on kerosene and other energy-related expenditures?
  • Solar Product Uptake and Adoption:
• What is the level of solar product uptake and utilization in households, businesses, and agriculture among targeted refugees and host communities in Terego and Madi Okollo districts?
• Are there any variations in solar product uptake and adoption between different target groups (refugees vs. host communities, male vs. female)?
  • Supply Side Interventions:
• How effective has the engagement of Saving Groups (SGs) as an outreach platform been in promoting the distribution and availability of solar products?
• How effective has the involvement of small shop owners and retailers been in strengthening the supply chain and increasing the accessibility of solar products? Is the strengthened supply chain sustainable?
  • Demand Side Interventions:
• To what extent has the awareness campaign increased knowledge and awareness of solar products among refugees and host communities? Which strategies were most effective at targeting different groups?
• How effective have the affordability initiatives, such as flexible payment options and access to financial credit, been in improving the affordability of solar products for refugees and host communities? Which strategies were the most effective and sustainable within the context?
  • Partnerships and Solar Company Engagement:
• What is the impact of partnerships with solar companies on the implementation of the Green Energy project?
• How has the utilization of solar companies’ expertise contributed to the project’s outcomes and effectiveness?

Cross-cutting:

• Propose recommendations for future similar programming.
• Document lessons learned to inform stakeholders and policymakers.
• Cost efficiency in budget use.

3. Methodological approach to the end-line evaluation

The consultant will develop a comprehensive evaluation methodology based on the OECD DAC evaluation criteria, and this will be confirmed and refined by the ZOA team during the inception phase. Triangulation of techniques is preferred with focus on;

Desk Review and Context Analysis: Carefully analyse existing data and information from secondary sources including policy documents, programme documents, activity reports, periodic project reports, past reviews, and evaluations.

Quantitative Primary Data Collection: adopting and adapting existing baseline survey tools.

Qualitative Primary Data Collection: through interviews, focus group discussions, key informant interviews, and other participatory methods (triangulation of techniques is encouraged). This should cover both direct and indirect beneficiaries of the Green Energy-solar project in the two districts.

Costs Analysis: to answer the questions related to efficiency, the consultant is required to provide a detailed analysis of the cost drivers associated with the project.

4. Timeframe and deliverables

The consultant will summarize the endline evaluation work plan according to the table below. The final report of the endline evaluation report shall tentatively be submitted to the ZOA Uganda Country office not later than 28th July-2023.

Main Activity Start date End date Responsibility of

ToR advert June 2nd June 16th ZOA HR dept.

Selection and Contracting June 19th June 21st ZOA HR dept.

Document review & Inception report submitted June 22nd June 27th Consultant

Inception Meeting & discussion June 29th Consultant

Incorporate feedback into the inception and re-submit June 30th Consultant

Training of research assistants and field data collection July 3rd July 12th Consultant & ZOA

Report writing & Submission of 1st draft report July 13th July 20th Consultant

Review 1st draft report & shared it back with the Consultant July 24th ZOA Project team

Consultant responds to comments in 1st draft report July 25th July 26th Consultant

Validation meeting July 27th Consultant & ZOA

Submission of final evaluation report July 28th Consultant

5. Budget

All costs related to the endline evaluation will be submitted to ZOA by the consultant in form of financial proposal in response to these ToR. Payment will be issued in installments and final payment to the consultant will be made after the final evaluation report has been approved by ZOA Uganda. The budget should cover costs for: professional fees, costs related to field operations, transportation among other

6. Division of Responsibilities

• Roles and Responsibilities of the Consultant/consulting firm
• Submit the technical and financial proposal with clear proposed study methodologies
• Review documents and submit Inception report with detailed survey methodology and design and separate data collection tools (Interview, FGD, KII, and Observation)
• Develop a fieldwork schedule
• Develop Quantitative data collection on Kobo toolbox and use own mobile apparatus as required
• Hire, train, and manage enumerators (to be recommended by ZOA) for quantitative data collection
• Administer and supervise data collection, data entry, and analysis of quantitative surveys
• Conduct qualitative data collection with experienced facilitators
• Analyze both qualitative and quantitative data and report in a clear and accessible format
• Provide regular progress updates to the ZOA project team (including the MEAL team and sector advisor)
• Provide all deliverables and final report to ZOA Uganda as per the agreed timeframe
• The consultant will be required to adhere to ZOA policies and Code of Conduct.
• Roles and Responsibilities of ZOA Uganda
• To ensure that the consultant facilitates field data collectors
• Guidance and technical support as required throughout the survey process
• Coordinates all phases/stages of the survey
• Effect payments of the services as per the contract agreement
• Review and approve inception reports, tools, and other relevant documents/requirements.
• Review the draft report and provide feedback to the consultant
• Approve all final deliverables and disbursement of payment to the services as per the contract agreement.

7. Resources

The evaluation will make reference to all other project documents including but not limited to proposal, workplan, budget, activity report, periodic reports, survey reports and other literature from similar interventions

8. Expected Outputs/Deliverables

The Consultant should deliver the following:

1. Inception Report: This should include: a detailed evaluation methodology, data collection tools and techniques, work plan, team composition, proposed timeline, and a preliminary table of contents that outlines the structure of the final report.
2. Draft Report: A draft report of the endline evaluation should highlight results from the data collected. The report should include a list of stakeholders interviewed, and graphical map showing data collection points (e.g., referenced to Kobo)
3. Dissemination meeting of findings: The consultant will present to project team and potentially other stakeholders on the survey findings and will address the feedback from the internal validation meeting.
4. Sumamry of findings as: PowerPoint presentation of draft findings.
5. Final Report: Covers all key aspects of the evaluationand shall be submitted to ZOA Uganda. The body of the final report is expect to be on not more than 30 pages and contents of the draft and final report are assumed to be the same.
6. Raw Data and Study Resources: The consultant shall annex all-relevant documents related to the assessment. He/she will also submit; 1) raw data and 2) cleaned data used for the analysis, 3) a 10-page summary report, 4) a 15-slide PowerPoint (PPT), and a detailed assessment report not exceeding 30 pages (Excluding preliminary pages).

The consultant is accountable for the property rights of all primary data/information generated as a result of this evaluation.

All written documents will be submitted in English in Microsoft word/excel and pdf in soft copy.

1. Consultancy Requirement

The lead consultant must be a senior expert in conducting and facilitating evaluations, studies &/or surveys on large and complex programs, holding a minimum of a master’s degree in social science, Development studies, Economics, Rural Development or a related subject and practical knowledge in conducting evaluations, surveys.

The consultant/consulting firm needs to have the following key competencies, experiences, and skills:

• A minimum of 10+ years’ experience in designing, implementing & managing baseline surveys on development programs. Experience in inclusive programming is an added value
• Proven track record in leading survey teams and producing high-quality survey reports.
• Proven knowledge and experience in MEAL.
• Experience in quantitative research and data analysis using statistical software (SPSS, Stata, and others).
• Experience in conducting qualitative surveys
• Proven ability to work with community and different stakeholders
• Work experience with multinational NGOs and their working environment
• Excellent writing and presentation skills
• English and local languages are required
• Experience in sign language is a plus

1. Application Process and Requirement

Interested applicants of the consultancy services should adhere to the following application process and requirements:

• The proposal should not be more than ten pages, excluding the supporting documents, and will have the following contents:
• The capacity statement describing how they meet required qualifications and competencies including summary of similar studies previously conducted
• Expression of interest describing how they understood the consultancy assignment
• Description of methodology, sampling strategy, approach to primary data collection, and plan for data analysis
• Mid-term review work plan
• Financial proposal that includes professional fees and all logistics expenses
• Team composition with their qualifications and roles in the survey (Annex the CVs of key team members)
• Minimum two samples of reports on surveys conducted that have been produced by the applicant, in soft copies (this will be treated as confidential and only used for the purposes of quality assurance)

The consultant/consulting firm must submit both technical and detailed financial proposals to ZOA Uganda via CV Selection online.