Project Evaluation for “Providing Built Shelters for Vulnerable Displaced Families in Idleb, Northwest Syria”, Ref. Consult 24MAY24-4428 At Islamic Relief

OBJECTIVES OF THE EVALUATION

İslamic Relief Türkiye has commissioned this evaluation in line with agreed internal policies (IR MEAL framework). The purpose of this evaluation is to assess the overall performance of the project with reference to the outcomes and outputs, focusing on the effectiveness of the intervention and suitability of the shelter in terms of design, inclusivity, cultural norms and other related aspects. Also draw lessons for future programmes. This evaluation should take into consideration the OECD/DAC Evaluation Criteria to assess the performance of the project, as well as use the Core Humanitarian Standard (CHS) to evaluate the quality of the interventions and the aspects of accountability.

The focus is on:

1. Assessing the extent to which planned outputs and outcomes have been achieved using the OECD DAC criteria for evaluating humanitarian responses: relevance, coherence, effectiveness, efficiency, impact and sustainability.
2. Evaluating the appropriateness and extent of application of quality standards, with a particular focus on the CHS.
3. Identifying lessons and good practices from the project to inform IR Syria’s future regarding the shelter and housing sector. This report will be externally published.
4. To what extent the intervention considers the shelter various guidelines, standards and codes that align with the Syrian context including but not limited to Shelter and NFI cluster, construction codes northwest, inclusivity guidelines in Syria, etc.

The scope of the evaluation

The scope of the evaluation should cover the intervention outputs and various related activities funded through Islamic relief Canada office. The geographical scope of the evaluation includes areas of implementation Great Idleb and northern Aleppo (NWS).

The technical scope of the evaluation is to:

• Examine the response’s relevance and appropriateness, with specific reference to the design of the project and the progress in achieving the planned objectives (i.e. the outcomes and outputs).
• Uncover the gaps in provision or unintended positive or negative impacts and provide commentary on the primary and secondary effects of the intervention, along with any direct and indirect contributions.
• Analyze the coherence with other actors and the extent of engagement and collaboration with stakeholders, and the strategic linkages made.
• Review the effectiveness (financial and programmatic) and efficiency of the mode of operation.
• Examine the strategic value addition and distinctive contribution of IRW and İslamic Relief Türkiye.
• Identifying lessons learned and good practices, improving current operations and marking the way forward for future programming.

In addition, İslamic Relief Türkiye is a certified CHS agency and therefore uses the CHS standard as the foundational approach to undertake evaluations, which ensures that we focus on communities. We believe this can be integrated with the OECD/DAC (relevance, coherence, effectiveness, efficiency, impact, and sustainability) where the CHS standards can be embedded in the OECD/DAC criteria in the following way:

Relevance

• CHS Commitment 1: Humanitarian response is appropriate and relevant.
• CHS Commitment 4: Humanitarian response is based upon communication, participation, and feedback.

Effectiveness

• CHS Commitment 2: Humanitarian response is effective and timely.
• CHS Commitment 3: Humanitarian response strengthens local capacities and avoids negative effects.
• CHS Commitment 5: Complaints are welcomed and addressed.
• CHS Commitment 8: Staff is supported to do their job effectively and are treated fairly and equitably.

Efficiency

• CHS Commitment 6: Humanitarian responses are coordinated and complementary.
• CHS Commitment 7: Humanitarian actors continuously learn and improve.
• CHS Commitment 9: Resources are managed and used responsibly for their intended purpose.

Methodology and approach

We are looking for an evaluation team to meet the above objectives and scope through a mixed method (quantitative and qualitative) approach of:

• Desk review of secondary data and İslamic Relief Türkiye project documentation.
• Household surveys of a statistically representative sample with a minimum 95% confidence level and 5% margin of error.
• FGDs with communities – with proportionate sampling.
• Key informant interviews with IR staff, peer agencies, technical staff, UN, and government authorities (local and national).
• Case Studies to see the most significant change in the rightsholder’s life and livelihood.

We would like the evaluators to outline their proposed methodology and requirements for this particular consultancy.

Required competencies

The successful team will have the following competencies:

• Demonstrate evidence of experience in evaluating humanitarian action/ early recovery and development projects and programmes.
• Possess sectoral experience and knowledge in evaluating shelter/ housing and other related technical sub-subjects including but not limited to architecture, construction, relevant technical guidelines for such humanitarian context etc.
• Possess deep knowledge and practical experience in using quality standards such as CHS and Sphere.
• Possess deep and strong statistical/quantitative and qualitative research skills.
• Have excellent written skills in English.
• Have the legal right to travel to the Northwest of Syria (NWS) in accessible areas in Idleb and Aleppo governorates and/or have national counterpart consultants appointed in Syria.
• Be able to communicate fluently in English and the local languages (Arabic). If local translators are required, this should be budgeted.
• Deep Working experience and knowledge about the context in Syria/ Northwest of Syria (NWS) a presence/representation in Northwest of Syria (NWS).

The chosen evaluation team will be supported by İslamic Relief Türkiye’s’ country and if required IRW Regional team and IRW Programme Quality (PQ) team.