Endline and Final Evaluation Assessment for GAC funded project At Oxfam

Leave a Comment / Jordan / By

Oxfam is a global movement of people who are fighting inequality to end poverty and injustice. Across regions, from the local to the global, we work with people to bring change that lasts.

Click Here to view the post overview

BACKGROUND AND CONTEXT

The purpose of this Terms of Reference (ToR) is to outline the scope, responsibilities, and deliverables for a consultant (individual or firm) who will be responsible for conducting an endline assessment and final evaluation for the Global Affairs Canada (GAC)-funded project “Reducing GBV and Inequality through Lifesaving WASH and Protection: An Integrated Response to Crisis-affected Communities in Yemen, Lebanon and Syria” (2024–2026). The project aims to reduce suffering and improve the protection environment for crisis-affected communities, especially women and girls, including GBV survivors and persons with specific needs, through improved, equitable and gender-responsive access to protection and WASH services. The consultant will be expected to conduct a final evaluation and endline assessment of the project to measure its progress toward achieving the desired outcomes, including both originally planned and adaptive interventions introduced in response to emerged challenges. The two products are commissioned as a single combined assignment, delivered as one consolidated report with a distinct Endline Findings section and a distinct Final Evaluation section, so that the same data collection tools, samples and fieldwork can serve both purposes. As detailed below, the consultant’s role differs by country: in Lebanon and Syria the consultant leads data collection, analysis and reporting directly; in Yemen, data collection will be carried out by Oxfam’s Yemen office team, with the consultant responsible for the analysis and reporting of that data.

PROJECT BACKGROUND

The project is funded by Global Affairs Canada (GAC) over a duration of 24 months. Its Performance Measurement Framework (Annex 8) sets out 53 indicators across the ultimate, intermediate, immediate outcome and output levels, disaggregated across Yemen, Lebanon and Syria.

The project seeks to reduce gender-based violence (GBV) and inequality and improve access to lifesaving assistance for crisis-affected communities in Yemen, Lebanon and Syria, through two integrated components:

  • Protection: Strengthening safe, confidential and informed use of lifesaving, gender-responsive protection services, including GBV services, legal assistance, and cash for protection, and building the self-protection capacity of communities and frontline actors.
  • WASH: Enhancing equitable use of lifesaving, gender-responsive WASH services — including drinking water, sanitation, and hygiene — while reducing the risk of GBV associated with WASH service delivery.
  • Women Leadership in humanitarian action: Including training and support mechanisms provided to enhance local women’s leadership in and influence over humanitarian response.

The project is implemented through local partners in each country: in Yemen, the Field Medical Foundation (FMF, WASH activities in Al-Qubaytah, Lahj governorate) and the Coalition of Humanitarian Relief (CHR, WASH and protection activities in Maqbanah, Taiz governorate); in Syria, the Syrian Society for Social Development (SSSD) and the Greek Orthodox Patriarchate of Antioch and the East’s Development Department (GOPA-DERD); and in Lebanon, the Association NABAD for Development (NABAD), KAFA (Enough) Violence & Exploitation, and the Lebanese Center for Human Rights (CLDH).

The results chain below summarizes the results levels the project is working toward:

Click here to view the results level

PURPOSE, OBJECTIVES AND SCOPE OF THE ASSIGNMENT

The purpose of this assignment is to conduct an endline study and a final evaluation of the GAC-funded project “Reducing GBV and Inequality through Lifesaving WASH and Protection: An Integrated Response to Crisis-affected Communities in Yemen, Lebanon and Syria.”

The final evaluation

The final evaluation aims to assess the project’s overall impact, effectiveness, efficiency, relevance, coherence, and sustainability at the end of its implementation period. The evaluation will examine how the intervention contributed to more systematic, safe and confidential access to protection and GBV services, and to enhanced, equitable and gender-responsive use of WASH services, across Yemen, Lebanon and Syria. It will also analyze the project’s adaptability in response to evolving crises and access constraints, and how such adjustments enhanced the relevance, flexibility, and responsiveness of the intervention. The evaluation will apply the OECD-DAC criteria and review achievements against project targets and outcome indicators, identify enabling and limiting factors, explore unintended effects (including protection and safeguarding risks), and assess the quality of stakeholder engagement, GBV survivor-centred programming, and the project’s contribution to localization. The evaluation will provide an independent, evidence-based analysis that ensures accountability to GAC and affected communities while generating actionable recommendations for future humanitarian programming.

The Endline Study:

The endline study will collect the final values for the project’s key indicators, as set out in the Performance Measurement Framework (Annex 8), to assess overall project performance and progress toward intended results. The endline will primarily measure achievement against end of project targets and, where routine monitoring data exists, changes over the life of the project. Beyond indicator tracking, the endline should also explore the project’s contribution to intended and unintended outcomes, an area of particular interest to both GAC and Oxfam — drawing on qualitative evidence (KIIs, FGDs, and the outcome harvesting exercise described under Methodology) to complement the quantitative indicator results. The methodology should be applied consistently across Yemen, Lebanon and Syria to allow for aggregation and comparison, while remaining sensitive to the distinct context, access, and security conditions of each country, including the country-differentiated data collection modality described in the Methodology and Roles and Responsibilities sections below.

The scope of this assignment

The scope of this assignment covers all three project countries (Yemen, Lebanon and Syria), all outputs and their related outcomes (see results chain and outputs table above), and the full 24-month implementation period. It includes both a quantitative component (household/beneficiary survey against PMF indicators) and a qualitative component (KIIs, FGDs, case studies and an outcome harvesting exercise), covering both the endline indicator results and the analytical final evaluation against the OECD-DAC criteria. It excludes a full financial/value-for-money audit, which falls outside this assignment. The specific evaluation and research questions that define this scope in more detail are set out in the Key Evaluation Questions table below and will be finalized with Oxfam during the inception phase.

METHODOLOGY

The key steps to be followed, though not exhaustive, and the detailed modality and work plan will be agreed during the consultation meeting, and include:

3.1 Endline Study Methodology

The endline study will focus on measuring changes in key project indicators and will provide quantitative and qualitative evidence of progress toward the achievement of the project’s intended outcomes.

For Syria and Lebanon, the endline methodology should, to the extent possible, maintain consistency with the methodology and data collection tools used during the baseline study. This will allow for more meaningful comparison between baseline and endline findings and support the assessment of changes over the course of the project. Any necessary adaptations to the baseline methodology or tools should be clearly justified and agreed during the inception phase.

3.2 Final Evaluation Methodology

The final evaluation will assess the overall performance and strategic value of the project, using a mixed-methods approach grounded in the OECD DAC evaluation criteria: relevance, effectiveness, efficiency, impact, sustainability, and coherence. The purpose is to generate evidence-based insights on how well the project achieved its intended objectives, the quality and durability of outcomes, and the lessons learned — especially in the context of protracted crisis, active conflict, and GBV risk.

Evaluation Design

The evaluation will triangulate findings from the endline data with additional qualitative and contextual analysis. This will ensure a comprehensive and balanced understanding of project achievements, limitations, and adaptations.

Key Evaluation Questions

Click here to view the key evaluation questions part one and part two

Data Collection Methods

  • Document Review: Review of all relevant project documents, including the Logic Model, PMF, monitoring data, progress reports, financial records, and conflict/access impact assessments.
  • Household/Beneficiary Survey: A structured quantitative survey administered to a representative sample of project participants/beneficiaries in each country, to measure progress against the PMF’s outcome and output indicators (e.g., access to protection and GBV services, equitable use of WASH services, self-protection capacity). The survey should collect sex, age and disability disaggregated data consistent with the project’s M&E approach. The survey will be conducted using a digital data collection platform (SurveyCTO). In Lebanon and Syria, the survey will be built and hosted on Oxfam’s SurveyCTO domain, with access granted to the consultant. Data collection will be administered directly by the consultant’s field teams. In Yemen, the survey will be administered by Oxfam’s Yemen office team. The consultant will be responsible for data cleaning and analysis across all three countries. and quality assurance.
  • Key Informant Interviews (KIIs): Interviews with Oxfam staff, implementing partners, community leaders, local authorities, and, where feasible and coordinated with Oxfam, a representative of the donor (GAC), to gather insight on implementation, coordination, and crisis response. In Lebanon and Syria, the consultant will conduct KIIs directly (in-person or remotely). In Yemen, KIIs will be conducted by Oxfam’s Yemen office team using guides developed jointly with the consultant, with recordings/transcripts shared with the consultant for analysis.
  • Focus Group Discussions (FGDs): FGDs with representative groups of project participants (e.g., women, youth, persons with disabilities) to capture their experiences and perceptions of project impact. As with KIIs, FGDs in Lebanon and Syria will be led directly by the consultant, while FGDs in Yemen will be facilitated by Oxfam’s Yemen office team following consultant-designed guides, with the consultant leading transcription review and analysis. Any engagement with GBV survivors must follow a survivor-centred, do-no-harm approach with safe referral pathways in place.
  • Outcome Harvesting: A mini outcome harvesting exercise, conducted with Oxfam and partner staff (and, where relevant, community stakeholders) in each country, to identify and verify significant changes including unintended outcomes that the project contributed to, and to substantiate the “how” and “why” behind observed results. This complements the indicator-based endline and strengthens the evidence base for the Impact criterion under the final evaluation.
  • Case Studies: Where feasible, the consultant may prepare illustrative case studies showcasing successful interventions, adaptation strategies, or stories of impact and resilience, drawing on interviews conducted directly (Lebanon, Syria) or facilitated by Oxfam’s Yemen team (Yemen).

Analysis and Reporting

Analysis and reporting will be conducted separately for the quantitative and qualitative data collected, then triangulated to produce integrated findings:

  • Quantitative analysis: Survey data will be cleaned and analyzed using descriptive statistics (frequencies, means, cross-tabulations) to measure achievement against each PMF indicator’s end-of-project target, and, where routine monitoring/baseline data exists, to assess change over the life of the project.
  • Qualitative analysis: KII, FGD, case study and outcome harvesting data will be analyzed thematically, coded against the OECD-DAC criteria and the key evaluation questions, to explain and contextualize the quantitative findings and capture intended and unintended outcomes.

All findings (quantitative and qualitative) should be disaggregated by gender, age, location, disability, and nationality/displacement status (e.g., host community, IDP, refugee, returnee), given the significant presence of displaced and refugee populations across the three countries. The consultant is expected to provide a clear evaluative judgment under each OECD DAC criterion and a synthesis of key learnings and recommendations for future programming. The consultant retains full responsibility for data analysis and reporting across all three countries, including for the Yemen dataset collected by Oxfam’s Yemen office team, and is responsible for the overall cross-country synthesis, comparison, and the single consolidated endline and final evaluation report.

Ethical Standards

The evaluation must follow ethical principles of do-no-harm, informed consent, data confidentiality, and conflict sensitivity. Given the prevalence of GBV, displacement, and conflict-related trauma across Yemen, Lebanon and Syria, special care must be taken when engaging with affected populations, particularly GBV survivors and other individuals with specific needs. This applies equally to data collection conducted directly by the consultant (Lebanon, Syria) and to data collection conducted by Oxfam’s Yemen office team (Yemen), for which the consultant must provide clear ethical guidance, consent protocols, and referral pathway instructions as part of the tools handed over to the Yemen team. The consultant must comply with Oxfam’s safeguarding, protection, PSEA (Protection from Sexual Exploitation and Abuse) and ethical data-use standards, and must ensure that tools and protocols follow a survivor-centred approach with safe referral pathways for any disclosure of abuse or protection concerns.

DELIVERABLES

This assignment produces the following deliverables, covering both the endline study and the final evaluation as a single combined product:

  • Inception report (draft), including the consultant’s understanding of the assignment, refined evaluation matrix/questions, detailed sampling approach and unit of analysis, data collection tools (survey, KII/FGD/outcome harvesting guides), and a detailed work plan and risk analysis.
  • Final inception report, incorporating Oxfam’s feedback, together with finalized data collection tools and, for Yemen, training/orientation materials for Oxfam’s Yemen office team.
  • Cleaned datasets (quantitative and qualitative) for all three countries, including the Yemen dataset transferred by Oxfam’s Yemen team.
  • Draft consolidated Endline and Final Evaluation Report, with separate Endline Findings and Final Evaluation sections, including case studies and outcome harvesting results.
  • Validation workshop with Oxfam and partners to present and discuss draft findings and recommendations.
  • Final consolidated Endline and Final Evaluation Report, incorporating feedback from the validation workshop, comprehensive against the PMF (Annex 8) indicators and the Key Evaluation Questions.
  • A short PowerPoint presentation summarizing key findings and recommendations.

The working language for all deliverables is English.

Planned Timeline

Click Here to view the planned timeline

EXPERIENCE OR PROFILE REQUIREMENTS

Upon the conclusion of an open and competitive bidding process, Oxfam will commission a technically qualified independent consultant (an individual consultant or a consultancy firm/team) with a capable team covering Lebanon and Syria for direct fieldwork, and with strong remote analytical capacity for Yemen. The core team must demonstrate strong expertise in research, baseline and endline assessments, monitoring and evaluation methodologies, statistics, and Protection (including GBV) and WASH sectors. For Lebanon and Syria, the team should include experienced enumerators and data entry personnel, fluent in Arabic and familiar with local dialects, with clear logistical capacity to operate under the current security and access constraints in each country.

Preference will be given to individual consultants or firms with proven experience delivering assignments of similar scale and complexity, and who meet the following qualifications:

  • 7–10 years of relevant experience in development research and evaluation
  • Proven experience in evaluating Protection (including GBV response) and WASH humanitarian programming.
  • Demonstrated capacity in designing and implementing quantitative and qualitative assessments, particularly in the relevant sectors.
  • Strong understanding of GBV case management, safeguarding, and PSEA standards, given the sensitivity of protection-related data.
  • Strong understanding of research methodologies, data collection processes, and ethical research standards.
  • Experience conducting field research with communities in Lebanon and/or Syria, including participatory approaches.
  • Strong understanding of gender and protection mainstreaming, and localization approaches.
  • Experience working in the MENA region, particularly Yemen, Lebanon and Syria; existing operational presence (registered office, field presence, or established local associates/enumerator network) in Lebanon and/or Syria is a preferred criterion.
  • Fluency in Arabic and English, with strong capacity to write high-quality reports in English.
  • Ability to propose and manage an efficient, context-appropriate team composition across Lebanon and Syria (direct fieldwork) and Yemen (remote coordination, training and analysis), considering social, cultural, environmental, and security sensitivities.
  • Proven ability to work with diverse teams and under pressure to meet tight deadlines while maintaining high-quality deliverables.

How to apply

APPLICATION PROCESS

Submission Instructions

Quotations and applications must reach Oxfam no later than: 8th of October 2025

Responses must be submitted in English, electronically to: AmmanProcurement@oxfam.org.uk

The subject of the email should be: (RFQ-MENRP-26-0017– GAC Final Evaluation Endline + Name of bidder).

Any questions, remarks or requests for clarification can be sent up to (5 days) before the submission deadline in writing. Anonymized questions will be answered for all applicants.

Administrative Requirements

To be shortlisted for evaluation against award criteria, Click Here to view the documents that must be submitted with this application. Add or delete documents as needed, depending on local context or other requirements.

Evaluation and Award Criteria

Click Here to view the evaluation and award criteria

[Only quotations with combined scores of at least 60 points for the technical award criteria (approach paper and CV) qualify for the financial evaluation.]

Oxfam withholds the right to conduct interviews with one or more potential suppliers before an award decision is made. The purpose of the interview is to seek further clarification on the submitted quotations and learn more about the background and previous experience of the potential suppliers and their teams.

OTHER CONDITIONS

Conditions for participating in the procurement process are detailed in the Terms & Conditions of Bidding.

CODE OF CONDUCT

Oxfam is committed to integrity in its operations and supply chains and ensuring high ethical standards. Complying with all laws and regulations and ensuring fair competition are fundamental to this commitment. We actively promote these principles and standards, and expect all Oxfam suppliers to demonstrate commitment towards them.

All consultants/applicants are required to agree and adhere to the Oxfam Supplier Code of Conduct, whereas individuals (including consultants) must sign the Oxfam Non-Staff Code of Conduct. These Codes of Conduct set out the specific standards and principles in the areas of human and labour rights, environmental impact and anti-corruption that suppliers must follow.

ANNEXES