Endline Evaluation of RACIDA’s Integrated Nutrition-CVA Project in Wajir County, Kenya

Terms of Reference

1. Background and Rationale

In Wajir County – as in most Arid and Semi-Arid Land (ASAL) counties – malnutrition, food insecurity, and deleterious health outcomes remain unacceptably high. High rates of food insecurity and poor nutrition outcomes are closely related and chronic and serious food security considerations exacerbate dynamics that drive negative nutrition outcomes. A number of concerning developments have occurred in Wajir County recently. Depressed rains have raised the risks of drought, household animal milk production is far below long-term averages and wet year prices, and an estimated 550,000 people in Wajir County were food insecure (IPC Phase 2 or worse) in the final months of 2020.

Poor health outcomes in the county are reaching high levels. According to the 2019 SMART Survey, rates of malaria like symptoms (42.7%), Acute Respiratory Infections (56.7%) and watery diarrhea (30.5%) remain the most prevalent morbidities found among respondents who reported symptoms within the two weeks prior to being interviewed. Additional major contributing factors identified by the Kenyan Ministry of Health include inadequate dietary diversity and insufficient medical facilities and services. Major contributors identified by the Ministry of Health (MoH) include inadequate infant and young child feeding (IYCF) practices supporting other findings that have reported low rates of efficacious IYCF practices in Wajir County.

In response to the above-mentioned needs, RACIDA and Diakonie Katastrophenhilfe implemented an integrated food security and nutrition project to address the needs of communities in Eldas Sub-county (Basir, Masalale), Tarbaj sub-county ( Wargadud ), and Wajir West sub-county (Lanqoot and Bulla Hagar in Wajir County. RACIDA worked through existing ministry of health structures and utilized community health structures.

2. Endline Survey Objectives

I. To establish Endline information for measuring progress of project log frame indicators at community level after project implementation.

II. Produce an Endline report that will show the impact, lesson learnt and recommendation for future similar projects including other pressing needs if identified.

2.1. Questions to be addressed by the Survey.

ü What is the current status of malnutrition rates in the target communities among children aged 6-59 months compared to the baseline.

ü Did the project address the factors that limited increased access to health and nutrition services in the target communities?

ü Did the intervention improve proper child rearing and feeding practices in target communities?

ü Did the intervention improve food security among target communities?

ü How many target households have access to acceptable household Dietary Diversity Score during and after the project intervention?

ü How many target households currently are able to access at least 2/3 meals per day after the project intervention?

ü Have recommendations of baseline been translated into action

ü Gaps identified in this intervention

ü Has the response been relevant to the humanitarian needs of the drought affected communities of Wajir

ü To what extent was the project aligned with the county nutrition plan priorities?

ü To assess and report on the performance and results achieved (intended or unintended, positive and negative) of the project against the OECD DAC

criteria

ü Identify best practice and lessons learnt, with particular focus on the modality,

transfer mechanism, as well as accountability to beneficiaries

How well did the project integrate participatory approaches, gender equality and disability?

ü To what extent did the project meet its objective?

ü Assess if cash transfer beneficiaries received all their entitlements

ü Assess if the transfer value met the beneficiary household needs

ü

The Specific Project Indicators, which the consultant will be expected assess progress are detailed below:

DESCRIPTION

INDICATORS

Overall Objective

Contribute to improved nutrition status and food security among 1000 HHs in Wajir county in Kenya

Project Objective

Ensure Moderate and Severe malnutrition levels are reduced as immediate food and nutrition needs among Target HHs in Wajir County are met and community initiatives to monitor and take care of individuals affected by malnutrition are promoted”

Result 1

Improved access to food among 1000 targeted HH

At least 90% of HH supported with cash transfers of KES 4,701 per month for 5 months are able to get 2/3 meals per day during the 5 months support period.

Result 2

Improved management of acute malnutrition in Eldas Sub-county (Basir, Masalale), Tarbaj sub-county ( Wargadud ), and Wajir West sub-county (Lanqoot and Bulla Hagar Communities.

At least 25 medical health workers (out of 30) are trained in the prevention and management of acute malnutrition and are applying knowledge learnt by the end of the project

Percentage increase in detection and reduction of malnutrition cases from supported sites with outreach services and HH MUAC measurements

% of wasted children admitted at the outreach sites.

Number of children under 5 screened for malnutrition by caregivers using MUAC with Moderate Acute Malnutrition (MAM) and Severely Acute Malnutrition having reduced from MUAC (Mid-Upper Arm Circumference) of <11-12.5cm to > 13.5 cm among target HHs by end of project period

Number of children referred for further treatment from outreach services who are responding positively to various recommended prescription and intervention

Number of infants 0-6 months of age who are fed exclusively with breast milk after baby friendly community initiatives for protection, promotion and support for breastfeeding

At least 75%, both men and women who received behavior change interventions training reported to be supporting improved infant and young child feeding practices

Total Beneficiaries

7,110 persons

3. Methodology

The consultant is expected to utilize a mixed-methods approach with both quantitative and qualitative data from five villages of ELDAS Sub-county (BASIR, MASALALE), TARBAJ sub-county ( WARGADUD ), and WAJIR WEST sub-county (LANQOOT AND BULLA HAGAR in three sub-counties of Wajir County.

3.1. Quantitative Data Collection

The core of the assessment will consist of a randomized quantitative survey. The survey will collect data on food security, nutrition, and health sectors. All data will be disaggregated by sex, age, and disability. The Endline study will sample beneficiary community members and other stakeholders from the project locations. The consultant is expected to propose quantitative methodology that is scientific, culturally appropriate, and will leverage both qualitative and quantitative data.

3.1.1. Household Questionnaire

Quantitative survey tools will be developed by the Consultant. However, RACIDA will provide all the required information to enable swift development of the tools. Both RACIDA and the consultant will work together to ensure the tools are up to standard.

3.1.2. Sampling Framework

A sample of beneficiary respondents, stratified by gender, will be randomly selected in each target area for the quantitative survey. The sample will be statistically representative of the populations living in each target area based on the acceptable statistical sampling techniques. This should be in line with various contextual factors and proposed project site.

3.1.3. Sampling Methodology**

To identify survey respondents, the survey will use a targeted random sampling approach. RACIDA suggests that the consultant propose a sampling methodology that they deem to be most appropriate. Any proposed methodology should ensure gender, age and disability representation.

Participants will be classified as either male or female, according to the sampling framework above. In each classification, data collectors will seek respondents of that gender. If there is more than one adult within the household of that specific gender, the data collectors will introduce the assessment and ask household members who they think among them can provide information given the nature of the assessment.

3.1.4. Consent**

The consultant must ensure that all participants in the household survey have given consent to participate in the study.

3.2. Qualitative Data Collection

Qualitative data collection methods will include Focus Group Discussions (FGDs) and Key Informant Interviews with community members, community health workers, community leaders, Community Health workers, RACIDA staff, ministry officials, and other relevant partners deemed appropriate. Example FGD participants include members of target communities, including women, youth, men, elders, and persons with disability, and KIIs may include Ministry of Health Officials in Wajir County. The consultant team is expected to propose KII and FGD participants on the basis of their knowledge.

Qualitative data collection tools will be determined on the basis of Consultant expertise, RACIDA priorities and knowledge, and Consultant-RACIDA engagement, and the tools will be finalized by RACIDA.

3.2.1. Focus Group Discussions**

The FGDs will have the following goals:

• Gather qualitative data to triangulate, explain, and expand upon the quantitative data gathered.
• Explore in more detail if the intervention was able to solve the challenges faced by the community members and the perceived gaps in food security, health, and nutrition.
• Identify specific barriers faced by different groups, i.e. women, youth, people living with disabilities (PLWD), children, and IDPs in each target area in terms of accessing services, participating in the development of the local community, and understanding how these barriers can be overcome for these specific groups.
• Other goals as determined by RACIDA and the Consultant.

Participants will be selected by data collectors in the field based on selection criteria for each sample group. Each focus group with consist of 8 – 10 participants. To account for the sensitive nature of information which might be discussed during the FGDs, female facilitators will be involved in conducting the female FGDs and male facilitators involved in male FGDs.

All participants must give written consent to participate in the FGD.

3.2.2. Key Informant Interviews

KIIs will also be conducted as part of the qualitative data collection. Interviews in each target area will be expected and will be expected to include PLWDs. KII should be conducted using both closed questionnaires and open-ended questionnaires, depending on the Key Informant.

The interviews will have the following goals:

• Understand whether the inventions were able to improve the trends for food security, nutrition, and health compared to the baseline.
• Understand the current management, planning, and implementation practices of mitigation mechanisms for food security, nutrition, and health.
• Other goals as determined by RACIDA and the Consultant.

3.2.3. Survey Administration

The survey will be administered using ODK/Kobo Tool Box. A number of checks will be put in place to ensure the quality and accuracy of the data collected. These will include but are not limited to:

• A thorough testing process for the data collection tool in line with standard operating procedures for tool development and testing, involving multiple layers of testing to ensure that the tool functions fully.
• A pilot phase in the field during which the tool is thoroughly checked and tested prior to final use.
• Daily checks of data collected to ensure that it is comprehensive and does not contain any mistakes.
• Daily debriefs with data collection team to ensure that any problems encountered during data collection are identified and resolved.
• Regular spot checks on the field during data collection to ensure data collectors are properly administering survey questionnaire.
• A final, thorough, data cleaning process which will include verification of any potentially inaccurate data and revisits to the field if necessary. A log of data cleaning will be kept by the consultant and shared with RACIDA to ensure that all steps in the process can be replicated.

3.2.4. Survey Quality and Ethical Standards

The consultant shall take all reasonable steps to ensure that the survey is designed and conducted to respect and protect the rights and welfare of the people and communities involved and to ensure that the survey is technically accurate and reliable, is conducted in a transparent and impartial manner, and contributes to organizational learning and accountability. Therefore, the survey team shall be required to adhere to the survey standards and applicable practices as recommended by IFRC.

Utility – Surveys must be realistic, diplomatic, and managed in a sensible, cost-effective manner.

Ethics & Legality – Surveys must be conducted in an ethical and legal manner, with particular regard for the welfare of those involved in and affected by the survey.

Transparency – Survey activities should reflect an attitude of openness and transparency.

Accuracy – Survey should be technically accurate, providing sufficient information about the data collection, analysis, and interpretation methods so that its worth or merit can be determined.

Participation – Stakeholders should be consulted and meaningfully involved in the survey process when feasible and appropriate.

Collaboration – Collaboration between key operating partners in the survey process improves the legitimacy and utility of the survey.

It is also expected that the survey will respect the seven fundamental principles of the Red Cross Red Crescent: 1) Humanity, 2) Impartiality, 3) Neutrality, 4) Independence, 5) Voluntary Service, 6) Unity, and 7) Universality.

3.3. Obligations

3.3.1. Obligations of the Consultant

• Give leadership to the technical team throughout the assessment
• Inform the Program Manager, M&E Officer in a timely manner of the progress made and any challenges encountered.
• Conduct the consultancy as per agreements in TOR, and contract, and if modifications are necessary, bring to the attention of the Program Manager before making any changes.
• Report on a timely basis as per the ToR and the contract agreement
• Declare any possible conflict of interest before signing the contract.
• Participatory share draft report and discuss the feedback and general findings with RACIDA team.
• Take care for all enumeration cost for this assignment
• Cater for his/her transport to the site or within his/her bid can indicate RACIDA to provide i.e. transport to the communities and exclude costing on the same within the bid.
• Organize for his/her own accommodation and cater for other expenses they may likely to incur during the assignment.

3.3.2. Obligations of RACIDA

• Make sure the Consultant is provided with the necessary and required resources i.e. the project documents- proposal, reports and any other that the consultant may need.
• Give logistical information and attend to any concerns that may arise during the endline exercise
• Facilitate the work of the consultant in accessing beneficiaries and other local stakeholders
• Monitor the daily work of the consultant and bring to the attention of the consultant /RACIDA any concerns that may arise
• Provide technical oversight in the review of all deliverables
• Provide timely comments on the draft report

4. Consultancy Requirements

4.1. Duration of the Consultancy: 12 days **

4.2. Deliverables

The evaluators’ will be required of the following but not limited to;

1. Provide inception report, detailing the Endline survey design, sampling methodology and framework, survey tools, and agreed upon budget and work plan.
2. Provide inputs regarding evaluation design; bring refinement and specificity to the evaluation objective
3. Guide reflection of expected outcome to facilitate a presentation of findings in a workshop setting
4. Undertake site visits; conduct interviews
5. Provide regular progress/briefing report to RACIDA
6. Analyze and synthesize information; interpreted findings, develop and discuss conclusion and recommendations; draw lessons learnt from similar projects
7. Draft Endline report that will contain the following elements:

a. Table of contents

b. Executive Summary

c. Introduction-Objectives of the Endline Survey, Methodology, and any challenges encountered in the field.

d. A presentation of the findings and the analysis including lessons learnt and best practices.

e. Conclusions

f. Detailed recommendations with clear guidelines on how they can be implemented including recommendations for stakeholders.

g. At least 1 Case study

h. Report Annexes

1. Copies of original and cleaned data sets with a codebook for both quantitative and qualitative data including original field notes for KIIs and FGDs, as well as recorded audio material, if available, should be submitted with the draft report.
2. Hard and Digital Copies of Signed Consent provided by respondents.
3. A power point presentation highlighting key findings from the Endline, presented at a feedback meeting to be held after completing the draft report and rectify any factual errors or misinterpretation.
4. Final Endline Survey Report – submitted as one digital copy and least 2 bounded, signed hard copies submitted to RACIDA by the agreed submission deadline.

5. Qualifications and Evaluation Criteria of the Consultant

5.1. Key Selection Criteria

The independent consultant/consultancy firm must demonstrate experience and expertise as follows:

• Master’s degree in Public Health, Nutrition, or related field.
• Demonstrated experience in conducting high quality Endlines for related project in the past five years (sample reports are required ruing the bid analysis).
• Extensive hands-on experience in the sectors of Health, Nutrition, and Food Security.
• Experience of working in a resource poor environment.
• Experience working in Kenya is an asset.
• Fluency in English is mandatory.
• Knowledge and experience of emergency response and humanitarian response in East Africa is an asset.
• Sectoral experience and contextual knowledge of Wajir County, Kenya, as well as demonstrable experience conducting field assessments or working in the Northern Counties of Kenya.
• Experience with Emergency Response and Recovery programming with a broad understanding of Nutrition, Food Security, and Public Health in the context of emergencies.
• High level of professionalism and the ability to work independently under tight deadlines.
• Strong interpersonal and communication skills.
• The team must have a statistician able to analyse quantitative and qualitative data.
• Firm must have experience in using mobile phone technology (ODK/KOBO collect) for data collection.
• The lead consultant must have strong analytical skills and ability to clearly synthesize and present findings, draw practical conclusions, make recommendations and to prepare well-written reports.

5.2. Application Evaluation Criteria

The below evaluation criteria will be used to select the consultant:

Evaluation Criteria

Consultant Academic and Professional Qualification – 20%

• Master’s degree in Public Health, Nutrition, or related field.

Consultant Prior Work Experience – 35%

Detailed and specific experience in undertaking similar roles highlighting;

1. Proven consultancy experience with Endline assessments for emergency response programming**
2. Demonstrated experience in conducting high quality Endlines for related project in the past three years (sample reports are required ruing the bid analysis).
3. Extensive hands-on experience in the sectors of Health, Nutrition, and Food Security.
4. Sectoral experience and contextual knowledge of Wajir County, Kenya, as well as demonstrable experience conducting field assessments or working in the Northern Counties of Kenya.
5. Experience of working in a resource poor environment.
6. Experience working in Kenya in ASAL areas of Kenya .
7. Knowledge and experience of emergency response and humanitarian response in East Africa is an asset.
8. Experience with Emergency Response and Recovery programming with a broad understanding of Nutrition, Food Security, and Public Health in the context of emergencies.

Bidder must attach detailed CV

Methodology/Approach – 35%

Understanding of the terms of reference that includes:

1. Outline of methodology and approach of implementing this assignment.
2. Proposed assignment plan that includes clear timelines for the assignment that demonstrates the understanding of the assignment expectation.
3. Firm Experience Sample work done either in Nutrition, health or cash transfer programming
4. Detailed budget breakdown based on expected daily rates and initial work plan.

Language and analytical skills – 10%

Demonstrated capacity for high-level analysis and report writing, includes:

• Strong analytical and information presentation skills

· Organizing and facilitating the conduct of capacity building activities.

· Excellent interpersonal and communication skills, including the ability to communicate and work with a wide range of stakeholders in a participatory, respectful, collaborative manner, and to enhance effective work relationships.

TO SEE COMPLETE TERMS OF REFERENCE AND RELEVANT ANNEXES, PLEASE CONSULT RACIDA’S WEBSITE UNDER THE ANNOUNCEMENTS PAGE

[HERE](**https://racida.org/index.php/announcements/).**