Terms of Reference: Endline Review for HBCC Project: Inclusive Communities: Changing behaviours to respond to COVID-19 At CARE

1.0 Overview and Background

CARE International UK received funding from Unilever-DFID HBCC (Hygiene Behaviour Change Coalition) to drive hygiene behaviour change communication to the poor communities living in rural, urban and ID centres, across five countries: Zimbabwe, Rwanda, Somalia, Jordan and North Eastern Syria. The project aimed to support communities respond to the Covid-19 pandemic through a multi-pronged approach. CARE International implemented an extensive mass media, digital and interpersonal hygiene promotion information and messaging campaign in communities and institutions supported by the provision of water supply and handwashing kits and infrastructure as well as relevant PPE, as per context.

The initial phase of the project aimed to rapidly distribute messaging in support of the government’s actions for a wider reach of information dissemination and to stem the Covid-19 pandemic. The second phase aimed to work with relevant government institutions and community-based organisations to engage vulnerable communities and institutions to promote effective hygiene with a Covid-19 preventive measures focus. Messages were developed following a rapid baseline assessment survey using mainly WASH’Em approach (an approach developed and promoted by the London School of Hygiene and Tropical Medicine and that is mainly qualitative in nature) to understand the health characteristics of target communities; most preferred touch-points and to have a basis on which to adapt existing messages or to design new ones. Some countries also combined the use of WASH’Em approach and quantitative approaches to enrich the process especially on quantitative processes. A mix of existing government messages and Unilever assets were brought in for both the design of promotional materials, and campaign management.

1.1 The Theory of Change is below

Objective Statements

Indicators

Goal: Contribute in reducing incidences of covid19 transmissions in Somalia

R-0’ value maintained below 1.0 between Jan and March 2021 in all HBCC targeted regions in Somalia**

Outcome1: Handwashing with water and soap practiced at key times for at least 20 seconds to interrupt the spread of covid19 transmission

· % of targeted population who demonstrate correct handwashing practice with water and soap for at least 20 seconds**

· % of mothers/caregivers observed to wash hands with water and soap for 20 seconds before eating, before preparing food, before feeding young children, after using the toilet, after cleaning child faeces.

· % of targeted people who report being satisfied with the quality and quantity of hygiene kits distributed.

· % of targeted people who report that public handwashing stations were functional, accessible and satisfactory (satisfactory specifically meaning clean and safe to use)

Outcome2: increased knowledge and information of the targeted people on COVID19 prevention and mitigation

· % of targeted populations recalling three messages from the radio spots (billboards, posters etc

· % of target populations recalling at least 3 key times for handwashing with soap and water

Outcome3: Social distancing and avoidance of public gatherings are practiced widely in all the targeted areas

· % of target populations who maintain social distancing while interacting with the community

· % of target population who avoid public gatherings in the last one month.**

Outcome4: more people accept the severity of COVID19 and that it can affect everyone in the community

· % of target population who are willing to get the COVID19 vaccination

· % of target population who are confident to report if they are tested with COVID19**

2.0. CARE International HBCC Campaign Approach

At a local level, the project focused on mass media, digital media and community level interpersonal campaigns (where possible due to lockdowns and travel restrictions) across all project areas. CARE International executed a variety of messages in line with the national/local Health Service approved guidelines as well as some of the Unilever Global assets like the PASSWORD Campaigns, Mums; Magic Hands, Mobile Doctorni, School of 5 among others. Messages covered issues of prevention, protection, safety, security and where to seek early support when showing signs and symptoms of Covid-19.

The messages were delivered through a variety of channels, including:

1. Community information through loudspeakers and mobile information vans
2. Messaging distributed in mosques and churches
3. Installation of handwashing facilities and water tanks in public centres, like markets, hospitals, health clinics (MNCH), community social halls etc coupled with distribution of essential hygiene kits, e.g. handwashing soaps, sanitisers, face masks etc to vulnerable families and groups
4. National/Community radio stations and TV through talkshows and spots
5. Posters, flyers, brochures and out-of-home banners
6. Interpersonal campaigns in households, schools, mosques or through influencers, religious leaders or by ‘*champions*’
7. Digital campaign messaging using SMS and Social Media accounts including Twitter, Facebook, and YouTube.

To ensure campaign consistency and access to hard-to-reach audiences, CARE International collaborated with BBC Media Action and a host of local TV and Radio stations. These partnerships enabled the process of campaign messaging design and deployment to be as inclusive as possible, targeting specific people, such as persons with disabilities, marginalized groups, and the elderly, leaving no one behind in the fight against the pandemic. At a global level, CARE International as a member of the HBCC initiative continued to be supported and coordinated by Unilever in developing and releasing COVID 19-enhanced versions of their most effective hygiene campaign materials such as School of 5 and Mum’s Magic Hands, Global PASSWORD Campaign, etc.

3.0 Endline Assessment Review Objectives and Methodology

3.1. Purpose and Objectives of the Endline Assessment Review

The primary purpose of this Endline Review is to assess the overall behavior change outcomes of the COVID-19 Hygiene Behaviour Change Campaign as per the Theory of Change above and identify key lessons learned for the campaign and for future strategies.

The endline assessment should focus on the following key objectives:

1. Measure the behavioral outcomes, and determine how the project has contributed to these changes; with a special focus on how the project has generated positive changes in the lives of targeted women, girls, boys, and men; including vulnerable groups such as those living in remote locations as well as the elderly and people with disabilities
2. Identify unintended consequences of the project, both positive and negative; for target groups and others impacted;
3. Document the enabling factors and challenges or barriers that influenced project implementation; and
4. Provide evidence-based recommendations for all stakeholders for future programming in light of the review findings, including specific recommendations in relation to gender equality/women’s empowerment issues.

While this process may give early indications of possible behavior change, the review is not expected to provide a full impact-level assessment of behavioral changes due to the difficulties of attribution.

3.2 Key Learning Questions

Key Learning Questions: (refer to RCCE Strategy questions)

1. Primary question: How did the HBCC program influence participants’ adoption of COVID-19 preventive practices and related behaviors?
2. Secondary questions:

· 1.a) How did the HBCC program impact participants’ frequency of handwashing w/ soap?

· 1.b) How did the HBCC program impact participants’ adoption of other COVID-19 preventive measures, such as wearing face masks, physically distancing and cleaning surfaces?

3. Other/optional questions based on countries’ behavior change focus outlined in their RCCE strategies (examples below).

· How did the HBCC program impact the reduction of stigma, rumors, and misinformation? (Somalia)

3.3 The specific Methodology and Review questions are as follows:

3.3.1 Assessment Methodology

It is expected that this review will adopt a mix of qualitative and quantitative approaches. Some of the basic tools in the WASH’Em approach like in-depth interviews using focus group discussions (FGDs), structured demonstrations and observations as well as quantitative approaches including self-reporting hygiene behavior measures; open and close-ended questions; and secondary information including the use of log records derived from digital media, will be utilized.

The following are data collection methods to consider in undertaking this assessment (not exhaustive):

• Review and analysis of project documents from the HBCC Project (Milestone and quarterly project reports) as well as from local, national and international agencies including relevant government Ministries, local partners, WHO, UNICEF Unilever, and any other response documents from key partners

• Meetings/discussions/interviews with key team members at the Country level

• Meetings/discussions/interviews with key authorities and key implementation partners listed above

• Focus group discussions and key informant interviews with key user groups and individuals targeted to receive messaging/engage in HBCC programs to better understand their perspectives on if and how the program has impacted their behavior and well-being. Disaggregated by sex, age, and disability, where possible.

• Household Surveys should be considered where an appropriate sampling methodology is able to locate those who are likely to have received messaging but are not a firm requirement of the assessment review.

3.3.2 Possible Review questions

a) Acceptability of behavior change campaign materials

· Assess the quality of the various communications materials. Did some provide more compelling or memorable messages than others?

· How was messaging under the project well-aligned and complementary to the national hygiene strategy and other major Covid-19 communications?

b) Campaign reach and inclusion

· Assess the effectiveness of the various communications channels. Were some channels more trusted, credible, or impactful than others?

· Assess the extent to which intended recipients recall receiving messages through different channels. Were some channels more likely to be overlooked or ignored?

· As an optional secondary objective of the evaluation: verify the reach of communication messages as reported through milestone and quarterly progress reports.

· Did recipients understand the messaging? How did the ease of understanding compare to other materials being distributed at the time?

· Were intended recipients able to recall key components of the communication materials?

· Were intended recipients able to recall where they learned these key components?

· Assess recipient attitudes towards the key behaviors in the communication materials following the project. How serious a risk do they consider Covid-19 to be? To what extent do they consider these behaviors important in mitigating that risk?

c) Outcomes-based Behaviour Change

To what extent has the HBCC Project achieved the following outcome objectives as per the Theory of Change?

1) People, disaggregated by sex, age, and disability practice frequent handwashing with water and soap at key times for at least 20 seconds to interrupt the spread of Covid-19 transmission.

2) Low-income households have access to and are satisfied with the quality and quantity of hygiene materials/products received.

3) Increased knowledge and information of the targeted people, disaggregated by sex, age, and disability, on Covid-19 prevention and mitigation.

4) Social distancing and avoidance of public gatherings are practiced widely in all the targeted areas.

5) People, disaggregated by sex, age, and disability practices correct wearing of masks in public places.

d) What lessons can be learned in relation to project delivery and coordination

· What were the key challenges that arose during the project implementation and how could these have been mitigated?

· How can these lessons be integrated into CARE International programs for future similar programming?

· Assess whether project activities are likely to continue beyond the support received in the period of intervention.

3.5 Endline Review Dates

The endline review is expected to take place between 15^th June to 30^th July

Milestones/Deliverables with Dates

Activity

Days

1.

preliminary meetings with CARE staff **

10^th July

1. Inception report describing the methodology/approach and considerations for carrying out each of the deliverables and containing a work plan with dates of submission of deliverables.

10-15th July

1. Finalization of inception report and the data collection tools

16-17th July

1. Enumerators training and pre-testing tools

18^th -21st July

1. Field data collection, including

22^nd -30^th July

1. First draft report

05^th Aug

1. Technical Review feedback

10^th Aug

1. Presentation of Key findings

13^th Aug

1. Submission of the final report.

17^th Aug

4.1 Profile

To achieve efficiency and objectivity in this process, CARE International seeks to engage a Consultant with the following profile:

Required

1. Demonstrated knowledge and experiences in assessing and reviewing complex public health interventions and behavior change or hygiene education campaigns to fully demonstrate the understanding scope of work.
2. Extensive experience in communications, public relations, marketing, or relevant Social Sciences, and use of the WASH’Em approach is an added value
3. Ability to manage a potentially large-scale and complex review and research process, including remote data collection
4. Experience in managing data and information systems capable of handling large datasets for monitoring and evaluation purposes

5. Experience collaborating with high-level government stakeholders and/or private sector senior management.**

6. Strong analytical and writing skills and the ability to clearly present findings and drawing practical conclusions and recommendations. **

1. Provision of evidence documents such as contracts on past experience

4.2 Reporting and Liaison

The consultant will closely work with the Emergency MEAL Specialist and WaSH Manager. In Addition, further technical support will be given by CARE UK/International WaSH Technical Advisors.

4.3 Responsibilities of CARE

· Care will provide all logistics support including flights, accommodation, transport, enumerators recruitment etc.

· Provide consultancy fee for the task

· Review and approve the study instruments/tools

· Support supervision of the consultant during the entire process of planning, enumerator training, data collection and reporting

· Provide input to the draft report and final report

4.4 Responsibilities of the Consultant

· Develop methodology and tools for the data collection and analysis process. The tools will be shared and approved by CARE before starting fieldwork

· Develop a practical work plan for the work

· Do field travel and data collection?

· Train enumerators who will be involved in the data collection.

· Prepare and submit a final evaluation report to CARE Somalia/Somaliland as per time frame set in the ToR.

4.5 Deliverables

The consultant will produce a precise final report (maximum 45 pages) written in simple and understandable English. The draft report is to be shared with field teams and discussed with CARE Somalia. Comments and inputs from the CARE will be included in the final report. We expect the report to have clearly articulated and actionable recommendations which is informed by the study findings. We also expect him/her to hand over all data of any form collected for this exercise to CARE. Report findings and recommendations will be validated with the relevant technical people at Country Office or CARE UK/International.

5. Application procedure

Interested firms/individuals with the expertise should send their Proposal which should include the following:

a. Letter of expression of interest/technical understanding of the TOR.

b. Proposed methodology

c. Detailed work plan,

d. Study team composition and Curriculum Vitae(s) for lead consultants demonstrating the relevant technical skills,

e. At least three references of which at least one of them is an evaluation of complex hygiene behavioral change intervention. Samples of the reports can be shared as well.

f. A financial quote for the consultancy specifying specific unit’s costs

Applicants should only quote for professional fees only). Please send your application to SOM.consultant@care.org quoting “Application for HBCC End line Review” as the subject line of the application no later than 07^th July 2021**