END OF PROJECT EVALUATION LIFESAVING WASH, HEALTH AND PROTECTION EMERGENCY RESPONSE IN BAIDOA, SOMALIA 2021-2023 At World Vision

TERMS OF REFERNCE FOR

END OF PROJECT EVALUATION

Lifesaving WASH, health and protection emergency response in Baidoa, Somalia 2021-2023

JANUARY 2023.

GLOSSARY

AWD Acute Watery Diarrhea

CBO Community Based Organization

CMR comprehensive medication review

CWB Child Wellbeing

DME Design Monitoring & Evaluation

EARO East African Regional Office

FGD Focus Group Discussion

GAC Global Affairs Canada

GBV Gender Based Violence

H/Hs Households

IDP Internally Displaced Persons

ITT Indicator Tracking Table

KIs Key Informants

MCHCs Maternal Child Health Centers

MoE Ministry of Environment

MoH Ministry of Health

NFI Non Food Items

NGO Non-Governmental Organization

NO National Office

ODK Open Data Kit

PDU Programme Development Unit

QA&S Quality Assurance & Strategy

SLT Senior Leadership Team

SO Support Office

SPSS Statistical Package for Social Sciences

SWS South West State

ToR Term of Reference

UASC Unaccompanied and Separated Children

UN United Nations

WASH Water Sanitation and Hygiene

WVC World Vision Canada

WVI World Vision International

WVSOM World Vision Somalia

INTRODUCTION

Description of the project to be evaluated

The protracted humanitarian crisis in Somalia, brought about by conflict and political instability for close to 3 decades, is among the most complicated around the globe. Ongoing armed conflict and climate shocks have affected the lives and livelihoods of children and their families in Somalia. A UNOCHA report from September 2020 indicates that more than 1.3 million people face food insecurity, 849,000 of which are children at risk of acute malnutrition. The 2020 Post-Gu Seasonal Food Security and Nutrition Analysis report from October1 warns that even with humanitarian assistance, 1.7 million women, girls, boys and men are in danger of an acute food security crisis (IPC Phase 3 or higher) through May 2021. The proposed project area has been affected by cumulative shocks of drought, insecurity and displacement. The humanitarian situation is expected to deteriorate due to the triple crisis in Somalia concerning desert locust infestations, COVID-19 pandemic and cyclical flooding. Since July 2020, seasonal Hagaa flooding has resulted in the displacement of nearly 342,000 people, impacting 294 villages, destroyed property and approximately 20,000 hectares of assorted crops mainly in rural areas along the Juba and Shabelle river valleys.2

Natural Disasters: Humanitarian needs will further increase in 2021 due to the influence of La Nina. Potential drought conditions are expected as a result of a below average 2020 Deyr rainy season (Oct-Dec), an anticipated harsh 2021 dry Jilaal season (Jan-Mar), and a probable delayed or poor performance of the 2021 Gu (Apr-Jun) rainy season. The impact of drought is evident with an estimated 79,000 IDPs and 74,000 rural populations in Bay Region at risk of food insecurity (IPC Phase 3) with about 27,000 of the IDPs classified as emergency IPC 4. Consequently, the GAM nutritional status of IDPs is critical at 15-29.9%. In contrast, Somalia experiences annual flooding during the April to June and September to November rainy seasons. Since 2010, on average more than 70,000 people have been displaced by annual floods3. Recent floods from the ongoing Deyr seasonal rains (October-December) in Bay region have affected 66,000 people in Baidoa town and displaced 6,000 households4.

Insecurity: Conflict remains at the center of the crisis with chronic levels of insecurity and violence taking a heavy toll on civilians for decades, damaging livelihoods, and hampering economic progress and development. Conflict in Somalia largely stems from the activities of non-state armed actors who attack civilians and civilian infrastructure, impose illegal taxation and forcefully recruit children into armed groups.

Displacement: The cyclical nature of droughts, coupled with insecurity, has led to massive displacement of people, with an estimated 2.6 million people living in 2,000 displaced persons camps across Somalia5. In South West State, the majority of IDPs fled their areas of origin mainly Bay, Bakool and Lower Shabelle regions due to drought and conflict, choosing Baidoa town as a hub for safety, access to humanitarian assistance and livelihood opportunities. According to an EU Delegation to Somalia report, the city of Baidoa hosts the second largest number of IDPs in Somalia, after Mogadishu. A joint site verification exercise of August 2020 indicates that Baidoa district hosts 517 IDP sites, with 392,274 individuals (64% women and girls) from 59,921 households. Compared to the last site verification conducted in March 2020, there was an increase of 34 new IDP sites and 4,916 households6. The majority of IDPs create new temporary shelters in the outskirts of the city while others have joined the existing informal camps. 85% of IDP sites in Somalia are informal with inconsistent service provision or exclusion from accessing humanitarian support7. While there is good coordination between humanitarian agencies responding to need in Baidoa; efforts are limited in relation to the continually growing need to provide durable solutions and emergency support to more IDPs.

1.1 Project Goal

Reduced vulnerability, increased and maintained human dignity (especially for women and girls), and vulnerable lives saved of displaced populations affected by the protracted crisis in Baidoa, Somalia

Table1: Project Outcome and Outputs

Narrative

Outcome

Indicator(s)

Project outcomes

1100: Increased use of gender-responsive, culturally appropriate and environmentally friendly WASH services for W, G, B and M

% of people using improved water service

% of individuals who last defecated in a toilet or safe manner

% of households that are properly managing solid waste

1200: Increased use of life-saving gender-responsive, quality health care and nutrition services for women, girls, boys and men

# of pregnant women who have attended at least two comprehensive antenatal clinics

# of communicable disease consultations

% infants 0–5 months of age who are fed exclusively with breast milk

1300: Improved enabling, safe environment to prevent, mitigate SGBV risk and respond to the protection needs of women, girl and boys affected by abuse, neglect, exploitation and violence

% of children enjoying safe environments

% of individuals accessing SGBV response services satisfied with support received

1110: Increased access to gender responsive and culturally appropriate sanitation facilities and safe water sources

% of households that are collecting water for drinking, cooking and hygiene from improved water sources

# of litres/person/day collected from all sources for drinking, cooking and hygiene

# of households whose latrines are completed and clean

% of people who know at least 3 of the 5 critical times to wash hands

1120: Increased knowledge of gender-responsive and contextually appropriate hygiene practices including MHM

# of women and girls who have properly utilized and disposed of MHM kits

# of households reached with hygiene kits, menstrual hygiene management kits, and emergency shelter kits

1210: Increased access to lifesaving gender-responsive primary health care services for women, U5 girls and boys and men

# of children U5 who received community-based treatment for common childhood illnesses

1220: Increased access to emergency nutrition services for pregnant and lactating women and children U5 girls and boys

# of PLW and children U5 receiving micronutrient supplement (Vitamin A, Iron and Folic Acid)

1230: Improved knowledge and skills for women and men on optimal child feeding practices during emergency

% of children U5 months of age who receive foods from 4 or more food groups

1310: Strengthened National and community-based protection mechanisms for women, girls and boys at risk of child protection and SGBV violations

% of women and girls who feel that community and family behaviour create a protective environment for women and children

% of women and girls, men and boys, demonstrating positive attitudes towards ending SGBV because of project interventions (GAC SRHR KPI)

1320: Increased access to gender-responsive and age and culturally appropriate services for women, girls and boys who are survivors of child protection and SGBV violations

# of individuals who have experienced or are at risk of any form of SGBV that have received related services in the previous 12 months through project interventions (GAC SRHR KPI)

Project outputs

1111: Gender responsive context-specific sanitation facilities constructed and/or rehabilitated including installation of sustainable lighting

1112: Gender responsive context-specific community water points constructed, rehabilitated and/or extended

1113: Water points and sanitation infrastructure are effectively managed by gender inclusive community councils to improve sustainability and prevent negative environmental impacts

1121: Gender responsive awareness raising on safe health and hygiene practices in households and communities conducted

1122: IEC material on safe health and hygiene practices and preventive measures for water, sanitation and hygiene related diseases including COVID-19 updated and installed at IDP sites and villages

1211: Health systems and clinical support for PHC services provided

1212: Access to SRHR, maternal and new-born healthcare services increased

1213: Immunization services provided for children under-1 and women of child-bearing age

1221: Treatment of acute malnutrition, in alignment with national protocols and minimum standards, provided to children under 5 and PLW

1231: Culturally relevant and gender-sensitive health and nutrition Social and Behavioral Change Communications provided for families and communities

1232: Timely and targeted counseling services provided

1233: IYCF promotion and dissemination of IEC materials on IYCF conducted.

1311: Formal and informal community-based protection structures capacitated to prevent SGBV and other protection risks affecting women, girls, boys and men

1312: Communities and families understand protection risks and actively prevent boys, girls, and vulnerable women and men from being exposed to abuse and violence

1321: Reporting and referral system for protection cases strengthened among service providers and community actors

1322: Timely SGBV and other child protection services provided through case management

1323: Child-friendly and inclusive safe-spaces and community support groups established to address CP risks

Primary Sector/s

Health & Nutrition
WASH
Protection (including GBV)

Project Duration

1st April 2021 – 31st March 2023

EVALUATION OBJECTIVE

Objective: The evaluation is intended to establish the extent to which the project’s objectives (Outcomes and outputs) were achieved, understand the project’s contribution to child wellbeing, facilitate analysis of lessons learnt (what went well and what did not go well), and make recommendations that will influence future interventions in Baidoa and similar contexts. Largely the evaluation will help in informing all project stakeholders on the extent to which the intended outcome and output objectives were achieved as well as highlight the relevance, appropriateness, effectiveness, sustainability, impact and lessons learnt from the interventions.

This will be an external assessment which will necessitate, undertaking a complete review and analysis of the program design document (Narrative Proposal) and its annexes including: Budget, Log frame, M&E plan and ITT together with progress reports (financial, narrative & monitoring) and available strategies (Somalia NDP & WVS NO Strategy).

Scope

Geographic area and target population

Since the project has been implemented in selected areas within Baidoa district, the evaluation will take place in these primary project areas.

Depth of investigation

Since this is the summative evaluation, it will assess the progress of the project towards the project goal and outcome starting April 2021 to March 2023 and delve into the details in table 3.

Community level partners

The evaluation will involve all stakeholders that were involved in the project design and implementation including:

Community groups and committees involved in project implementation (WASH, H&N and Protection
Implementing partners (Ministry of Health, Ministry of Gender, Ministry of Water and Mineral Resources)
Local Administration offices involved in the project implementation – District Commissioner’s office

METHODOLOGY
1. Study design

This will be a cross sectional and will employ a mixed method approach in data collection, triangulation and analysis drawing on quantitative and qualitative data. Both primary and secondary data will be collected, reviewed and analyzed. Household questionnaire survey (HS), focus group discussions (FGDs) and key informant interviews (KIIs) will be used to gather primary data involving both direct beneficiaries & indirect beneficiaries. The study will have three phases intertwined in the evaluation process:

Phase one: – will involve a comprehensive review of secondary information based on the existing project information from the proposal, detailed implementation plans, quarterly & annual reports, monitoring reports, and any other relevant reports.
Phase two:- quantitative household survey using structured questionnaire
Phase three: – qualitative information gathering using observations, FGDs and KIIs

In order to further ensure the quality of evidence, the evaluation will be designed with reference to the Bond Evidence Principles Checklist. Specific reference will be made to the 5 key dimensions of voice and inclusion, appropriateness, triangulation, contribution and transparency.

1. Sampling Design

Quantitative Data: While designing the survey tool, the consultant will consider various factors. For this evaluation, quantitative approach will only be employed in gathering information at household level with focus on mothers with under five children and/or household care takers. The sources of indicator vary for different indicators. Items covered in the questionnaire will be framed from project outputs, outcomes and goal. Further in this approach, the evaluation team will adopt probability proportional to size (PPS) sampling technique designed by Taro Yamane (1967) with taking into consideration sample size used at baseline. This should be well elaborated in the inception report. With the help of local administration, the household numbers for the target villages will be obtained before commencement of study to facilitate scientific determination of the sample size. This will be based on the household numbers from each village falling within the project scope. Probabilistic methods will then be used to sample the key respondents at household level.

Scientific sampling will guarantee randomness in selection of respondents, validity and reliability of data collected. To generate the sample size from the population, the team will use the online sample calculator (generator) to arrive at the total households to be targeted for the evaluation.

Qualitative Data: Physical observations, Focus Group Discussions (FGDs) and Key Informant Interviews (KIIs) will be carried out with beneficiaries and stakeholders to understand the extent to which the project achieved the intended objectives and addressed community needs. The FGD guides will contain a checklist of questions generated from the main project objectives and activities. The evaluation team working together with project staff will select the participants of the FGDs based on the focus of the study. Mothers with children under five will be purposively included for the FGD.

The focus groups will target key stakeholders including beneficiaries, comprising; Pregnant and lactating Women (PLW), CHWs, WASH Committees, Protection Committees, facility staff, camp leaders, youth clubs and children’s clubs among others. Every FGD will have standard 6-12 participants within the project areas. For purposes of plural investigation, the exercise will be conducted with a broad range of representation within the community to enable triangulation of findings and incorporate wide-ranging perspectives.

Key Informant Interviews (KIIs) will be conducted with a wide range of stakeholders including; WV Project staff, Government officials from MOH, MoEWR & Min of Gender, Health facility in-charges and other implementing partners working within the project area.

Note: The evaluation team will also consider gathering information on the impacts of COVID-19 as a cross cutting theme by deliberately incorporating key questionnaires related to the pandemic. Key questions will be developed by the evaluation team or provided by WV QA&S team.

1. Documents review

The evaluation team will undertake a thorough review of all available project documents as deemed necessary to gather vital information on the project design, implementation and monitoring processes as well as capture significant lessons registered over the lifetime of the project. Of necessity, the evaluation team will review the following literature:

Project proposal including logic model, M&E Plan, ITT, DIP & Budget
World Vision Somalia National Office Strategy 2016-2020/25
Field Level Agreements signed between WVSOM and GAC.
MOUs signed with line ministries
Project progress reports
Activity Reports
Any other relevant documents by FSNAU, UNICEF, UNOCHA, INGOs etc.

Additionally the team will look at government strategic documents and reports, SDG targets and WVI child wellbeing outcomes to enable comparisons (where applicable) and validation of the findings.

1. Field Processes

Selection and training of enumerators: Enumerators with previous research experience and the ability to speak Somali language will be recruited. Key government official from Ministry of health and Water resources and social affairs will be engaged in order to support the process. Depending on sample size, a total of [xxx male, xxx female] enumerators will be engaged for evaluation and these will work hand-in-hand with M&E Officers during data collection. The field team (enumerators & M&E Officers) will be trained in data collection techniques using KOBO platform and mastery of the data collection tools before field data collection exercise. During the training, the field team will also be briefed on the objectives of the evaluation, how to identify the appropriate respondents at various levels and how to fill in the questionnaire appropriately. Emphasis will be put on research ethics, accuracy, and completeness among others

Data collections tools and methods: As indicated, the evaluation will use both quantitative and qualitative tools and methods for data collection, analysis and presentation. Information triangulation (using different methods) will be used to guarantee that the evidence supporting any conclusion drawn is representative of the situation. The evaluation will employ the following data collection methods during the evaluation;

Household interviews will be conducted using structured questionnaires
Key Informant interview will be conducted using KII Guide
Focus group discussions will be conducted using Focus Group Discussion Guide

Research ethical code will be applied throughout the study design, data collection and analysis phases. This will be reinforced during the survey team training.

Field data collection: The team will use mobile phones configured with KOBO mobile application for data collection (Uses WV server). The interviews and discussions will be conducted mainly in Somali language. Focus group discussions will be conducted by a key researcher using a predetermined focus group guide with relevant themes and sub-themes, while Key informant interviews will be conducted using a predetermined guide with open ended questions for specific informants.

Analytical framework: The evaluation team will use the project logic model and the evaluation criteria set out below to address the evaluation objectives as attached below. The tools and data collection will be aligned to this framework with emphasis on gender and social inclusion, and other cross cutting issues such as COVID-19 and locust invasion.

Table 2: Evaluation criteria and questions[1]

Evaluation Objectives

Suggested Key Questions

Rationale for asking Key Questions

Suggested Approach (To explore key question)

Assess the Relevance and appropriateness of the project design to the community needs

Was the project in line with local needs and priorities, targeting the right areas, people with the right interventions?
Was the project sensitive to the culture, gender and social inclusion of women, girls, boys and men?
Were the interventions in line with government National plans/strategies?
Was the intervention aligned to the child wellbeing outcomes and WVS Strategy (FY2016-2020/25)?
Was the selection criteria appropriate for identifying and reaching target communities and households?
What measures were put in place to ensure that the project stakeholders were adequately informed of the project interventions and their roles in it?
To what extent did the key stakeholder groups (desegregated by age/sex and other level of vulnerability) participate in the management and implementation of the food aid project?
Did the activities contribute to the outcome and the objective of the project? Were there gaps in any sector, if yes, what are they and what more or different could WV Somalia, WVC, GAC and other stakeholders do to address the problem?

A thorough elaboration on these questions, will enable world Vision and stakeholders;

Clearly understand whether the project design was based on community priority needs.
Understand whether the design and implementation took care of cultural sensitivities given that the fragile context.
Clearly document whether the project was aligned to government plans, CWB targets and WVS strategy for purposes of compliance.
Understand the beneficiary selection criteria used and whether it conformed to the set standards.
Establish and properly document the contribution of the project to intended changes in the communities
Establish and document whether the project management were responsive to community needs

Thorough document review should be conducted to establish the set strategies and how they were addressed by the design.
A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing

Assess the efficiency of the project in delivering and achieving project outputs and outcomes.

Were the outputs and activities appropriate for achieving project outcomes?
Did the project adopt the most efficient approach in implementation?
How well did the management structure support/facilitate program implementation? Was project management responsive to changing conditions on the ground?
Was the project implementation in line with the planned objectives?
How successful was the project in integrating with other sectors (beyond WASH, Health and Protection)?
How the project was efficient in terms of budget spent compared to the number of people who benefited from the project. How efficient is this project compared to other similar interventions either by WV or local partners?

The key questions will enable WV and partners to:

Clearly understand and document the extent to which outputs were adequate for achievement of outcomes.
Assess the approaches adopted during implementation, and their appropriateness in delivering results.
Clearly understand the management structure and its contribution to the success implementation of the project.

A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing;
Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.
Thorough document review should be conducted to establish the set strategies and how they were addressed by the design

Assess project effectiveness (progress of implementation and key outcomes achieved including the contribution onwellbeing of children)

Did the project achieve the objectives and the targets?
Were project activities implemented effectively to achieve maximum benefit within the context; including community engagement, trainings, community sensitisation etc.?
What are the factors that hindered/assisted the effectiveness of the project?
How did beneficiaries perceive the value of the project compared with other alternatives?
Have there been any un-intended benefits or negative consequences? How did the project mitigate these consequences?
How did the project relate with other partners or stakeholder? What were the challenges in working with other partners or stakeholders? How did the project try to address these challenges
Did WVS put in place adequate and effective systems for ensuring accountability and transparency in the management and implementation of the project? Were these systems adhered to? Why or Why not?

These questions will enable WV and partners to:

Clearly document the impact of IHA interventions to the communities
Identify and document any un-intended consequences of interventions (both positive and negative)
Assess the extent to which any observed impact(s) could be attributed to WV or other partners?
Analyse the performance of the projects against set targets (projects, critical activities, outputs) and document factors that contributed to meeting/not meeting/exceeding targets

A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing;
Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.
Thorough document review should be conducted to establish the set strategies and how they were addressed by the design.
Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.

Assessing sustainability of key activities, outputs and outcomes that have been initiated by project

What mechanisms have been put in place in order to sustain the key activities, outputs and outcomes that were initiated by the project activities?
Who are the key partners WV has worked with? What roles did they play? What motivations /mechanisms exist for partners to continue playing these roles?
What key behavioural changes have the project facilitated? What is the likelihood of continuity of these changes
What, if any are the risks facing sustainability of key activities, outputs and outcomes? What can be done to strengthen sustainability during the next phase of the program?

Under this objective, WV and partners will be able to:

Identify key enablers of sustainability that can be strengthened during the next phase
Identify key risks of sustainability that need to be addressed in order to achieve broader impact and sustainability.

Key informant interviews and focus group discussions will explore strengths and weaknesses related to sustainability;
Through household survey, document reviews and observation, the survey team will assess the likelihood of continuity of key project outputs (e.g., infrastructure constructed, community groups’ set-up, etc.)

To establish and document key lessons learned during the project implementation

What key lessons were learnt by staff, management and stakeholders throughout the implementation of the program
What key challenges were experienced/witnessed by staff and management in the implementation of the program? How were they able to address the challenges
What possible recommendations do staff and stakeholders put forward for any related future interventions
What best practices emerged from the project implementation across the different sectors? To what extent can they be scaled up?
What innovations were integrated in delivering humanitarian response across the different sectors during COVID-19?
Have COVID-19 preventive and control measures implemented by the targeted communities?
What specific impacts COVID-19 brought out to the targeted community?

This will help WV and Partners;

Clearly understand the key lessons that were learnt during the program implementation. This would be able to inform future designs.
Document best practices and innovations for possible scale them up in future projects.
Assess if the COVID-19 preventive and control measures were well implemented in the project area
Assess negative impacts of COVID-19 to the targeted community

Key informant interviews and focus group discussions will explore strengths and weaknesses related to sustainability.

TIMEFRAME

The assessment is expected to take …15… working days including preparation, data collection, and analysis and reporting. The Consultant should be able to undertake some of the tasks concurrently to fit within the planned time-frame, without compromising the standards of the assessment. The assignment is expected to commence on the 1st of February 2023

EVALUATION PLAN

To be shared by consultant

EVALUATION STUDY LIMITATIONS

Security in Baidoa is volatile with likelihood of disruptions that may restrict staff from accessing some field locations hence affecting the quality of the evaluation. This will be mitigated by working together with our local line ministry staff right from the inception to the end, as this will empower them to adequately supervise the evaluation and update lead evaluators on a daily basis.

RESPONSIBILITY AND AUTHORITY

Support from WV Somalia

World Vision will be responsible for the following:

Recruit the external Consultant and finalize the consultancy agreement
Share all necessary documents to the Consultant to finalize the evaluation design, protocols and tools for data collection tools. This includes provision of previous baseline report to be considered while revising the tools.
Provide inputs in the evaluation survey methodology, data collection tools and report
Ensure that input from WVS is coordinated and shared with the Consultant. Approves survey protocols/ inception reports.
Flight expenses for the Consultant to Baidoa (as per the agreement in the contract)
Vehicle hire to support the evaluation process
Working space for the Consultant while in the field
Recruitment and payment of enumerators (or depend up on agreement with the consultant)
Stationery for data collection
Overall accountability of the evaluation process
Guidance and coordination throughout all the phases of evaluation keeping communication with the Consultant throughout all phases
Provide support to the Consultant during field visit processes
Closely supervise the data collection process, ensuring quality control, daily debriefing, meeting the timelines set for assignment;
Inform the evaluation audience including MoH for their involvement and validation of the findings.
Approves final report

The Consultant will be responsible for the following:

The Consultant will be required to provide a detailed description of the technical and budget for undertaking this assignment.
Develop the inception report and have the protocol to be presented to sector Clusters for their approval.
Review all the relevant documents for the evaluation
Develop evaluation design including the methodology and the data collection tools as appropriate including a field manual for training in consultation with WVS sector team.
Develop the field work schedule in consultation with WVS team
Facilitate the training of enumerators and supervisors on the tools and data collection processes.
Supervise the data collection process, give advice and ensure the quality of the data
Data analysis and report writing. It is expected that at least 2 drafts be provided to WVS and nutrition cluster with feedback addressed in each round before submission of the final report
Provide the required raw data that is complete and labelled in English (variables and values)
Provide final versions of data collection tools.
Add key questionnaires into the household questionnaires in order to assess the impacts of COVID-19 on projects outcomes.
Provide daily field briefing to the DME and Project Manager on progress and any challenges from the field.

6.1 EVALUATION CRITERIA

6.1.1 Mandatory documents

Provide a certified copy of a certificate of business registration, Certificate of incorporation, business licence or similar document (Companies/Organizations)
Provide a certified copy of tax registration, tax clearance certificates or similar documents (Companies/Organization)
Provide information on ownership structure (Name of directors of the company / Owner) (Companies/Organization)
Provide references from previous clients for similar works.

Note – Applicant who will not meet the above mandatory requirement will not be considered for Technical Evaluation.

6.1.2 Technical Evaluation by a Technical Team

Applicants will need to have the following experiences and qualifications (as detailed in their CVs that are submitted as part of the application):
Strong academic background (Masters degree preferred in Water Resources, Nutrition, Public Health, Epidemiology, Biostatistics, Social Sciences, Monitoring & Evaluation .)
Strong understanding and experience in technical Survey Methodology, Research Methods
Strong experience (7-10 years) in coordinating and managing SMART nutrition surveys is mandatory,
Experience in team leadership and management .
Experience working with conflict-affected populations and managing surveys in fragile contexts
Strong background in statistics and data analysis. Must know EPI info and Emergency Nutrition Assessment (ENA) and all relevant computer applications in general.
Excellent reporting and presentation skills.
Excellent knowledge of Somalia and other fragile context
Excellent knowledge of and experience with humanitarian guidelines and principles.
Fluency in English and local languages spoken in the working area is an advantage.
Strong experience in Computer literacy and working with ENA Software, Epi Info or alternate statistical package, MS Word, MS Excel and PowerPoint
Located in the East Africa Time zone for easy coordination.

6.1.3 Financial Evaluation

All bidders are advised to submit the following Financial Proposal:

Total cost to deliver on project (Quote in US dollars)
Payment Terms
Credit Period

LOGISTICS

Organizing workspace for the evaluation team throughout the fieldwork period
Putting together documents for review, availing them to members through the evaluation exercise.
Getting the enumerators on board and sign agreements with them for the assignment
Draw a schedule for community visits, data collection and focus groups discussions
Arrange logistics in terms transport for planned trips
Organize for meals for evaluation team members
Purchase materials and other required supplies for trainings and data collection
Ensure printing/copying materials are readily available for the evaluation team

EVALUATION DELIVERABLES

As part of this Evaluation survey the evaluation team will perform the following tasks:

Inception report
Conduct a comprehensive documentation review.
Develop appropriate data collection tools fieldwork.
Refine key research questions.
Present a draft report for comments within the stipulated time.

The deliverables resulting from this evaluation will be:

A comprehensive draft report not exceeding 25 pages- excluding annexes.
Clean quantitative and qualitative data set and/or summaries

DOCUMENTS

During the planning process (and throughout the evaluation process), the Evaluation team will review/use the following key program and other documents.

World Vision Somalia National Office Strategy 2016-2020/25
Project Proposal (inclusive of log frame, M&E Plan, ITT, budget, etc.)
Field Level Agreements signed between WVSOM and GAC.
Project narrative reports
Detailed implementation plans
Activity Reports
Partner reports
Somalia NDP
Monitoring reports

EVALUATION REPORT TEMPLATE

Final Evaluation report will be structured as below:

Table of Contents
Glossary/Acronyms and Abbreviations
Introduction

1. Executive Summary

2. Survey Introduction/Background

3. Methodology

4. Limitations

5. Findings

6. Conclusions and Recommendations

7. Lessons Learned from the evaluation Process

8. Appendices

APPLICATION PROCESS AND REQUIREMENTS

Qualified and interested parties are asked to submit the following;

Letter of interest in submission of a proposal
A detailed technical proposal clearly demonstrating a thorough understanding of this ToR and including but not limited to the following;
- Consultant/Company Profile
- Description of the Methodology
- Demonstrated previous and excellent experience in evaluation is required and qualifications outlined in this ToR (with submission of at least TWO most recent evaluation reports as evidence).
- Proposed data management plan (collection, processing and analysis).
- Proposed timeframe detailing activities and a work plan.
- Team composition and level of effort of each proposed team member (include CVs of each team member).
A financial proposal with a detailed breakdown of costs for the study quoted in United States dollars

Note:

As part of the Consultant selection process, the best five candidates will be required to make a presentation of the technical proposal to the Supply Chain and Core Project Technical team to inform the final decision on the award of the contract.

Payment Process

Payment upon submission and acceptance of the Inception Report to World Vision Somalia

40%

Payment upon submission of first draft of the assessment report to World Vision Somalia

30%

Payment upon submission and acceptance of Final assessment report to World Vision Somalia

30%

16 Provision of Taxation

1. The payment shall be subjected to withholding tax as required by the Law at the time of payment.

2. Payment will be made by cheque or bank transfer unless otherwise specified.

3. The consultancy quotation will only include professional fees and related travel costs.

HOW TO APPLY

All interested bidders/consultants are requested to submit their Technical Proposals and Financial Proposals in Separate documents as attachments (Bidders who will combine both technical and financial proposals shall be disqualified) via email somo_supplychain@wvi.org on or before 9th February 2023 Bids received after deadline shall not be considered.

Email Subject line: END OF PROJECT EVALUATION Lifesaving WASH, health and protection emergency response in Baidoa, Somalia 2021-2023

[1] All data collection tools should be designed by aligning the research questions with a gender and social inclusion emphasis.