Post Distribution Monitoring of WASH NFIs in Mandera County, Kenya at Rural Agency for Community Development and Assistance

1. Background and Rationale

RACIDA in partnership with USAID’s BHA is implementing an integrated humanitarian response that leverages interventions in the sectors of WASH, Nutrition, and Agriculture to respond to the high humanitarian needs strumming the triple crisis of drought, COVID-19, and desert locusts in Mandera County. The project, entitled Integrated emergency response to the triple crisis of drought, COVID-19, and desert locusts in Mandera County, Kenya (IETC), is built upon both an independent assessment conducted by RACIDA in Mandera County in February 2021 as well as RACIDA’s close collaboration with stakeholders in government (including the Mandera County Steering Group, the Mandera County Department of Nutrition, local community leaders, and others).

IETC is designed to support communities experiencing high rates of food insecurity and malnutrition, poor access to water quality for household and livestock, as well as poor livestock health outcomes.

The project seeks to alleviate the impact of humanitarian disasters by increasing access to nutrition services in hard-to-reach areas in Mandera County (including improving the coverage of integrated management of acute malnutrition (IMAM) services), improving Infant and Young Child Feeding (IYCF) practices, enabling improved household nutrition and hygiene practices, reducing the burden of livestock diseases, and improving access to emergency treated and protected water supply for human and livestock consumption.

Under Agriculture sector, apart from addressing issues of livestock diseases through vaccination and disease surveillance campaigns, the project also supported livestock owners with hay and cash transfers for watering the livestock at key strategic water points at the peak of the drought.

To ensure that the project is well implemented, targeted, and measured, RACIDA has issued this Terms of Reference (ToR) to solicit proposals for a post distribution monitoring of the Hay and cash transfers for livestock watering in the IETC project.

2. Overall Post Distribution survey objective:

The overall objective of the Post Distribution Monitoring (PDM) is to assess the relevance and utility of the WASH NFIs and handwashing facilities distributed and also to assess the effectiveness and efficiency of the assistance provided to the beneficiaries.

2.1. Specific Post Distribution Survey Objectives

i. Determine effectiveness of the activity and its process in relation to address needs of the community.

ii. Identify shortcomings in implementation process.

iii. Identify achievements and highlight them (acknowledge and celebrate success).

iv. Enabling project implementers and managers to review progress made.

2.2. Indicators to be Assessed;

Indicator 1: Percent of people who received WASH NFIs (Jerry cans, Bar Soaps, Sanitary Pads) assistance from RACIDA (BHA).

Indicator 2: Percent of households reporting satisfaction with the quality of WASH NFIs received through direct distribution.

Indicator 3: Percent of people utilizing (Putting them in good use) the WASH NFIs.

Indicator 4: Number/percentage of people utilizing handwashing facilities

Indicator 5: Number of institutional settings gaining access to basic sanitation through the provision of handwashing facilities.

Indicator 6: Percent of handwashing facilities that remain functional.

Indicator7: Average liters/person/day collected from all sources for drinking, cooking, and hygiene(water tucking) for 90 days)

3. Key Survey Questions

i. Did the project address the needs of the community under WASH sector?

ii. Did the project improve the hygiene of women of reproductive age?

iii. Has the response been relevant to the humanitarian needs of the drought affected communities of Mandera?

iv. What were the best practices and lessons learnt, with particular focus on distribution mechanism, as well as accountability to beneficiaries?

v. How well did the project integrate participatory approaches, gender equality and disability?

vi. Did beneficiaries receive their entitlement on a timely manner?

vii. Did the intervention meet the beneficiary needs?

viii. How does the community feel about the relevance of the interventions?

ix. How does the community feel about the quality of items distributed?

x. What is the appropriateness of WASH NFIs and water trucking interventions among target beneficiaries.

xi. How many institutional settings are remaining with functional handwashing facilities provided by RACIDA/BHA assistance?

xii. How many people are accessing handwashing facilities at mobile outreach sites and in institutional settings?

xiii. What are the channels that communities prefer for communication and feedback?

3.1. PDM Target Groups

The populations of interest for this PDM are people living within the areas targeted under this project, with special focus on beneficiaries who were supported with Water Trucking, WASH Non-Food Items (Jerry Cans, Bar Soaps & Sanitary Pads), as well as link health facilities supported with handwashing stations.

4. Methodology

4.1. Methods Overview

Methodology: The consultant is expected to utilize a mixed-methods approach using quantitative data from the targeted villages, and qualitative data from relevant stakeholders in Mandera County. The methods are summarized below:

1. Households Surveys
2. Focus Group Discussions
3. Key Informant Interviews
4. Observational data collection.

Data Sources: Household surveys, key informant interviews, focus group discussions, observations, program records, observational data collection, and other sources as deemed relevant by RACIDA. **

Location: The consultant will gather data from the field at household level, community level, and at county level.**

4.2. Quantitative Data Collection

The core of the assessment will consist of a randomized quantitative survey. The survey will collect data from the WASH NFI beneficiaries from project target sites in Mandera. Observational surveys will be administered in link health facilities to assess the functionality of handwashing stations.

All data will be disaggregated by sex, age, and disability. The PDM study will sample community members and other stakeholders from the project locations. The consultant is expected to propose a methodology that is scientific, culturally appropriate, and will leverage both qualitative and quantitative data.

4.2.1. Household Questionnaire

The consultant will administer a household survey tool, the content and scope of the household survey tools will be determined on the basis of Consultant expertise, RACIDA priorities and knowledge, will be finalized through consultation between RACIDA and the consultant.

4.2.2. Sampling Framework

A sample of respondents, stratified by gender, will be randomly selected in each target area for the quantitative survey. The sample will be statistically representative of the populations living in each target area based on the acceptable statistical sampling techniques. This should be in line with various contextual factors and proposed project site.

4.2.3. Sampling Approach

RACIDA expects the consultant to employ a sampling framework that utilizes a two-stage cluster sampling with probability proportionate to size (PPS) design.

4.2.4. Survey Administration

The survey will be administered using ODK/Kobo Tool Box. A number of checks will be put in place to ensure the quality and accuracy of the data collected. These will include but are not limited to:

• A thorough testing process for the data collection tool in line with standard operating procedures for tool development and testing, involving multiple layers of testing to ensure that the tool functions fully.
• A pilot phase in the field during which the tool is thoroughly checked and tested prior to final use.
• Daily checks of data collected to ensure that it is comprehensive and does not contain any mistakes.
• Daily debriefs with data collection team to ensure that any problems encountered during data collection are identified and resolved.
• Regular spot checks on the field during data collection to ensure data collectors are properly administering survey questionnaire.
• A final, thorough, data cleaning process which will include verification of any potentially inaccurate data and revisits to the field if necessary. A log of data cleaning will be kept by the consultant and shared with RACIDA to ensure that all steps in the process can be replicated. .

4.3. Qualitative Data Collection

Qualitative data collection methods will include Focus Group Discussions (FGDs) and Key Informant Interviews (KIIs) with community members, leaders, RACIDA staff, ministry officials, and other relevant partners deemed appropriate. Example FGD participants include members of target communities, including women, youth, men, elders, and the like, and KIIs may include Mandera Ministry of Agriculture, Livestock and Fisheries (especially livestock veterinary department) and National Drought management Authority. The consultant team is expected to propose KII and FGD participants on the basis of their knowledge and on guidance from RACIDA.

4.3.1. Focus Group Discussions

The FGDs will have the following goals:

• Gather qualitative data to triangulate, explain, and expand upon the quantitative data gathered.
• Explore in more detail the challenges facing community members and the perceived gaps in intervention.

All participants must give written consent to participate in the FGD.

4.3.2. Key Informant Interview

KIIs will also be conducted as part of the qualitative data collection. Interviews in each target area will be expected and will be expected to include PLWDs. KII should be conducted using both closed questionnaires and open-ended questionnaires, depending on the Key Informant.

5. Survey Quality and Ethical Standards

5.1. Ethical Standards

The consultant shall take all reasonable steps to ensure that the survey is designed and conducted to respect and protect the rights and welfare of the people and communities involved and to ensure that the survey is technically accurate and reliable, is conducted in a transparent and impartial manner, and contributes to organizational learning and accountability. Therefore, the survey team shall be required to adhere to the survey standards and applicable practices as recommended by IFRC.

• Utility – Surveys must be realistic, diplomatic, and managed in a sensible, cost-effective manner.
• Ethics & Legality – Surveys must be conducted in an ethical and legal manner, with particular regard for the welfare of those involved in and affected by the survey.
• Transparency – Survey activities should reflect an attitude of openness and transparency.
• Accuracy – Survey should be technically accurate, providing sufficient information about the data collection, analysis, and interpretation methods so that its worth or merit can be determined.
• Participation – Stakeholders should be consulted and meaningfully involved in the survey process when feasible and appropriate.
• Collaboration – Collaboration between key operating partners in the survey process improves the legitimacy and utility of the survey.

It is also expected that the survey will respect the seven fundamental principles of the Red Cross Red Crescent: 1) Humanity, 2) Impartiality, 3) Neutrality, 4) Independence, 5) Voluntary Service, 6) Unity, and 7) Universality

5.2. Future Use of the Data

All data collected will be sole property of RACIDA & USAID BHA. The consultant must not use the data for their own research purposes, nor license the data to be used by others, without the written consent of RACIDA and USAID BHA.

6. Obligations

6.1. Obligations of the Consultant

• Give leadership to the technical team throughout the assessment.
• Inform the Program Manager, M&E Officer in a timely manner of the progress made and any challenges encountered.
• Conduct the consultancy as per agreements in TOR, and contract, and if modifications are necessary, bring to the attention of the Program Manager before making any changes.
• Report on a timely basis as per the ToR and the contract agreement
• Declare any possible conflict of interest before signing the contract.
• Participatory share draft report and discuss the feedback and general findings with RACIDA team.
• Cater for his/her transport to the site or within his/her bid can indicate RACIDA to provide i.e. transport to the communities and exclude costing on the same within the bid.
• Organize for his/her own accommodation and cater for other expenses they may likely to incur during the assignment.

6.2. Obligations of RACIDA

• Make sure the Consultant is provided with the necessary and required resources i.e. the project documents- proposal, reports and any other that the consultant may need.
• Give logistical information and attend to any concerns that may arise during the PDM exercise Facilitate the work of the consultant in accessing beneficiaries and other local stakeholders
• Monitor the daily work of the consultant and bring to the attention of the consultant /RACIDA any concerns that may arise
• Provide technical oversight in the review of all deliverables
• Provide timely comments on the draft report

7. Qualifications and Experience of Consultant

The lead consultant must have a background and experience in economics, DRR, community development, M&E or any other related field. Past experience in conducting similar assignments as well as in Emergency Response and Recovery programming, with a broad understanding of Agriculture, Food Security, and livestock will be an added advantage.

7.1. Key Selection Criteria

The independent consultant/consultancy firm must demonstrate experience and expertise as follows:

• Master’s Degree in Economics, Statistics, social sciences, community development, Public Policy, agriculture, livestock or any other related field.
• Demonstrated experience in conducting PDMs or related projects in the past three years (sample reports are required during the bid analysis).
• Experience in Monitoring and Evaluation with more than 5 years proven experience of undertaking project evaluations, monitoring, and assessments in the WASH sector.
• Experience working in Mandera Kenya is preferred.
• Fluency in English is Mandatory.
• Knowledge and experience of emergency response and humanitarian response in East Africa is preferred.
• Understanding of political, social and cultural context in ASAL counties in Kenya is essential
• Strong interpersonal and communication skills.
• The consultancy team must have a statistician able to analysis quantitative and qualitative data. It is preferred that this person have both professional and academic background in statistics and econometrics.
• Ability to write clear and useful reports (please provide examples of previous work). – Attention to details is essential

7.2. Application Evaluation Criteria

Evaluation Criteria

Consultant Academic and Professional Qualification – 20%

Master’s Degree in Economics, statistics, social sciences, community development, Public Policy, agriculture/livestock, M&E or another related field.

Consultant Prior Work Experience – 35%

Detailed and specific experience in undertaking similar roles highlighting;

1. Demonstrated experience in conducting Post-Distribution Monitoring or related projects in the past three years (sample reports are required during the bid analysis).
2. Experience in Monitoring and Evaluation with more than 5 years proven experience of undertaking project evaluations, monitoring and assessments in the WASH sectors.
3. Experience working in Mandera Kenya is preferred.
4. Fluency in English is Mandatory.
5. Knowledge and experience of emergency response and humanitarian response in East Africa is preferred.
6. Understanding of political, social and cultural context in ASAL counties in Kenya is essential
7. Strong interpersonal and communication skills.
8. The consultancy team must have a statistician able to analysis quantitative and qualitative data. It is preferred that this person have both professional and academic background in statistics and econometrics.
9. Ability to write clear and useful reports (please provide examples of previous work). – Attention to details is essential

Bidder must attach detailed CV

Methodology/Approach 35%

Understanding of the terms of reference that includes:

1. Outline of methodology and approach of implementing this assignment.
2. Proposed assignment plan that includes clear timelines for the assignment that demonstrates the understanding of the assignment expectation.
3. Firm/individual Experience Sample work done: Citation (web link) of at least of 3 knowledge products developed and disseminated
4. Detailed budget breakdown based on expected daily rates and initial work plan.

Language and analytical skills 10%

Demonstrated capacity for high-level analysis and report writing, includes:

• Strong analytical and information presentation skills

· Fluency in English is mandatory.

· Organizing and facilitating capacity-building activities.

· Mentoring and coaching colleagues at work.

· Writing/reviewing strategic documents, monitoring and evaluation reports, systems and tools, and action plans.

· Networking and partnership building.

· Developed analytical skills.**

· Excellent interpersonal and communication skills, including the ability to communicate and work with a wide range of stakeholders in a participatory, respectful, collaborative manner, and to enhance effective work relationships.

· Commitment to team building and a consensus-led approach to work.

7.3. Duration of the Consultancy

The PDM will be conducted over 16 billable days from contract signing to delivery of the final report.

7.4. Deliverables

The following deliverables are expected from the consultant:

Inception report, detailing the PDM survey design, sampling methodology and framework, survey tools, and agreed upon budget and workplan.

Draft PDM report that will contain the following elements:

1. Table of contents
2. Executive Summary
3. Objectives of the PDM, Methodology, and any challenges encountered in the field.
4. A presentation of the findings and the analysis.
5. Conclusions
6. Recommendations with clear guidelines on how they can be implemented.
7. Report Annexes:
8. Copies of original and cleaned data sets (with a codebook for both quantitative and qualitative data), including original field notes for KIIs and FGDs, as well as recorded audio material, if available, should be submitted with the draft report.
9. Hard and Digital Copies of Signed Consent provided by respondents.
10. Final PDM Survey Report – submitted as one signed digital copy submitted to RACIDA by the agreed submission deadline.

7.5. Corruption or Fraudulent Practices

RACIDA requires that Bidders observe the highest standards of ethics during the procurement process and execution of contracts. A tenderer shall sign a declaration that he has not and will not be involved in corrupt or fraudulent practices.

RACIDA will reject a proposal for award if it determines that the tenderer recommended for the award has engaged in corrupt or fraudulent practices in competing for the contract or completing any contract awarded.

A tenderer who is found to have indulged in corrupt or fraudulent practices risks being debarred from participating.

Please report any malpractices to complaints@racida.org.