Service Consultancy – CBED-II Project End-line Survey and Photographs At Afghanaid

The Organisation

Afghanaid is a British humanitarian and development organisation operating in Afghanistan. For close to forty years, we have worked with millions of deprived, excluded, and vulnerable families in some of the poorest and most remote communities in Afghanistan. We build basic services, improve livelihoods, and strengthen the rights of women and children, help communities protect against natural disasters, adapt to climate change, and respond to humanitarian emergencies.

Our community-led approach gives ordinary Afghans a voice in their own development, making them active participants in shaping the future of their country. With our years of experience, the majority of the Afghan team, and our deep understanding of local, cultural, and ethnic issues, we have earned great trust and respect among the communities we work alongside. This has allowed us access to some of the most underserved areas of the country.

The Project

Afghanistan is especially susceptible to natural disasters and ranks at the top of the Ecological Threat Register as the country most affected by ecological threats including droughts, floods, increasing temperatures, and food insecurity. These hazards harm people, lands and infrastructure alike, wiping out family, community and national development gains, devastating agricultural productivity, and holding back the future development and job creation that would allow for families and communities to mitigate hazards, build resilience, and lift themselves out of poverty.

To address this complex set of challenges, Afghanaid and its partners (ActionAid, Concern Worldwide and Save the Children) in the Afghanistan Resilience Consortium (ARC) have implemented the Community-Based Eco-DRR (CBED) project since 2018. The CBED project is implemented in Afghanistan’s 245 communities in 6 provinces (Takhar, Badakhshan, Samangan, Jawzjan, Sar-e-Pul and Bamyan). The first phase of the project (CBED-I), implemented between November 2018 and April 2021, focused on improving local ecosystems by undertaking Integrated Watershed Management (IWM) in 30 micro-watersheds and Community-Based Disaster Risk Reduction (CBDRR) in 245 communities. The project’s second phase (CBED-II) is being implemented from April 2022 to the end of December 2024 and focuses on improving the Livelihoods of vulnerable households in the 245 communities.

Summary of Project Outcomes and Outputs

The proposed impact of CBED-II is: Afghanistan’s vulnerable communities and households are more resilient to and able to mitigate the impacts of climatic and economic shocks

CBED-II has two inter-related outcomes, which are:

Outcome 1: Rural livelihoods are better adapted and more resilient to climate change and natural disasters.

Outcome 2: Rural communities benefit from improved stewardship and usage of natural resources.

The outcomes are achieved through the following outputs:

Output 1: Vulnerable households are supported to strengthen food security and recover from climatic and economic shocks.

Output 2: Men and women are supported to increase production, productivity, quality, and diversity of on- and off-farm products.

Output 3: Men and women are supported to improve value addition and access to markets and services for on- and off-farm products.

Output 4: Key stakeholders gain knowledge and skills in climate adaptation.

1. Purpose of the assignment

This consultancy assignment focuses on conducting an end-line evaluation to gather comprehensive data, determining the final values of the project’s outputs, outcomes, and impacts as specified in the project’s logical framework. The end-line study will concentrate on collecting and analyzing data to assess the project’s progress and in relation to the baseline indicators. This will involve a rigorous comparison of current data and outcomes against the initial baseline measures, providing a robust basis for measuring the project’s effectiveness and the extent of change that has occurred since the project’s inception.

This information will act as a primary data source for further final evaluation of the project. Impact and outcome indicators of the project are listed below as an indication – the consultant will be provided with the full set of indicators and other relevant documentation after signing of the contract:

Impact Indicator: % households with 50% improvement household coping capacity according to the Coping Strategy Index in target communities against the baseline

Outcome Indicator 1.1: % households meeting vulnerability criteria having increased food security

Outcome Indicator 1.2: % increase in productivity and production of crops and livestock achieved in CBED communities

Outcome Indicator 1.3: % improvement in income generation from various livelihood interventions in CBED communities

Outcome Indicator 1.4: Reduced % of households whose livelihoods were disrupted were disrupted or destroyed due to disaster in target communities

Outcome Indicator 2.1: % increase in enhanced ecosystem service benefits in land under improved stewardship as a result of CBED-I&II interventions

Outcome Indicator 2.2: % increase in capacity of the community institutions (CBDMCs/WMCs/Producer Groups/VFUs/ASCs) measured by maturity index

Outcome Indicator 2.3: % Increase in frequency and quality of agricultural and veterinary advisory services received by the community members

In addition, the consultant will provide exposure opportunities and tailored training for Afghanaid’s M&E staff. The consultant will include Afghanaid M&E staff in all steps of the end-line process, and Afghanaid M&E staff will participate in the consultant’s team meetings and decision-making processes for their exposure. In addition, the consultant will develop and facilitate training sessions for Afghanaid’s M&E team on every phase of the end-line process, including, but not limited to, tool development, data collection, data cleaning and analysis, and reporting; the materials developed for these sessions (PowerPoint presentations as well as any other documents) will form part of the consultant’s deliverables.

The end-line project evaluation necessitates the submission of a comprehensive photo report, documenting visual evidence of project outcomes and impacts. The parameters for the photo report is given in Section 6.

1. Scope of work

The end-line evaluation is to be conducted in 6 provinces (with target districts and implementing partners):

• ActionAid: Bamyan (Bamyan Centre and Yakawlang).
• Afghanaid: Badakhshan (Argo and Kishem), Samangan (Aybak and Hazrat-e-Sultan),
• Concern Worldwide: Takhar (Chahab),
• Save the Children: Jawzjan (Shebergan), Sar-e-pul (Sar-e-Pul Centre)

Responsibilities of the Consultant/Firm:

• Develop a detailed evaluation plan, including methodology, sampling strategy, and data collection tools.
• Organise logistics and conduct the evaluation autonomously, engaging Afghanaid staff at every step of the process. Engage high-quality consultants and surveyors.
• Coordinate with the teams of Afghanaid and ARC partners (ActionAid, Concern Worldwide and Save the Children). Travel to the project’s field locations, complying with Afghanaid and its partners’ policies and security protocols
• Provide exposure opportunities to Afghanaid M&E staff throughout the various phases of evaluation process, including the development of data collection tools, data collection, data cleaning and analysis, and report writing
• Facilitate at least 1 training session per phase of the end-line evaluation, for a total of at least 4 sessions (tool development, data collection, data cleaning and analysis, and report writing), for Afghanaid M&E staff, explaining key approaches and practical advice for future surveys
• Collect both quantitative and qualitative data to assess the project’s outcomes and impacts.
• Analyze the data to compare end-line values with baseline values.
• Prepare a detailed report of the findings, including statistical analysis and qualitative insights.Ensure on-time delivery of the evaluation report by 31 October 2024, with at least 2 review rounds (1 week per review) by Afghanaid and its partners prior to the final deadline
• Provide actionable recommendations for future project phases or similar initiatives.

Afghanaid:

• Introduce the consultant (team) to the field teams
• Introduce the consultant (team) to the target communities
• Introduce the Afghanaid M&E staff who will be included in the evaluation process for exposure and training purposes

Payment:

• 40% on signing of contract
• 40% on submission of the first draft report
• 20% on submission of the final report and other deliverables as listed below

1. Timeline

The study will take maximum 4 months, with a final deadline of 31 October 2024, and is expected to start as soon as possible

The activity period of the project will continue until 31 December 2024. Due to the seasonal nature of Agriculture in Afghanistan, the end-line evaluation will be conducted towards harvest time of 2024 agriculture crop, before the end of the project. This timeline is expected to capture majority of agriculture-related project information. This should be the basis for preparing the draft report.

1. Methodology

The end-line evaluation will encompass a mix of qualitative and quantitative data gathering and analysis techniques, with an emphasis on triangulating available data sources.

Methods for data gathering for this evaluation may include, but are not limited to, the following:

• Desk Review
• Survey (at least 600 respondents)
• Focus Groups Discussions
• Key Informant Interviews
• Observations and visits

The consultants will further elaborate on the evaluation methodology in the Inception Report, which will determine the exact focus and approach for the evaluation.

The team of consultants will ensure the wide representation of the project stakeholders, considering the inclusion of those disadvantaged, minority groups, persons with disabilities, as appropriate.

The evaluation will adhere to the highest ethical standards, respecting informed consent, confidentiality, and the rights of all participants. It will also incorporate a human rights-based approach, gender equality considerations, and the inclusion of persons with disabilities.

1. Reporting Line

The consultant will work closely with the ARC Deputy Director, the ARC MEAL Specialist, the ARC Secretariat team, and the Afghanaid M&E Manager. The consultant will include the Afghanaid M&E team in all phases of the survey and reporting process.

1. Deliverables

The following deliverables are expected from the evaluation:

1. Inception Report, covering at minimum:

• Introduction
• Methodology and approaches: design, the sources, methods for data collection and data collection tools, details of how the evaluation will be inclusive and reaching women, people with disability, the elderly and others, work plan with the detailed timeframe and team structure, points of contacts including for field deployment and ground work.
• Quality Assurance
• Data Analysis
• Ethical considerations
• Any revisions needed in the budget or work plan for the evaluation job
• Any other reflections of the consultants for the project
• A details and practical plan for capacity building and engagement of Afghanaid’s M&E team

1. Draft Narrative Report

• A first draft report, followed by a week of review time by Afghanaid and its partners
• A second draft report, incorporating comments from the first review, followed by a week of review time by Afghanaid and its partners

1. Final Narrative Report, covering at minimum:

• Executive Summary
• Introduction: project background, evaluation objectives
• Methodology: the quantitative and qualitative methods used, sampling strategy, data analysis: the analytical techniques used to compare end-line data with baseline data and interpret the findings.
• Findings
• Challenges, Lessons Leant and Recommendations
• Conclusions
• Annexes

1. Full survey database, including all tools used and any supporting documentation produced over the course of the end-line evaluation
2. PowerPoint presentation of the evaluation covering the findings, to be scheduled by Afghanaid and the consultant after acceptance of the Final Narrative Report by the end of October 2024
3. PowerPoint presentations for at least 4 training sessions for Afghanaid M&E staff, each covering one phase of the end-line evaluation process (tool development, data collection, data cleaning and analysis, and reporting)
4. Photo Report (original format) taken during the study

Photo Report

The end-line project assessment places great importance on the submission of a comprehensive technical photo report, which serves as a crucial component of the evaluation process. This report is tasked with visually documenting the tangible outcomes and profound impacts that have materialized as a result of the project’s implementation.

Key elements of the comprehensive photo report include:

1. The report should vividly showcase project successes and achievements. This includes after the intervention photographs illustrating how project interventions have transformed communities, landscapes, and livelihoods. For example, photographs can capture degraded landscapes into thriving ecosystems through watershed management initiatives, the evolution of kitchen gardens into sources of fresh produce, or the growth of bio-briquette production facilities.
2. Photographs should highlight the active engagement of project participants. This can encompass images of community members actively participating in project activities, such as tending to crops and livestock, or attending training sessions. These images help underscore the community-driven approach of the project.
3. The photo report should visually convey the impact of the project on vulnerable households, including their improved living conditions, increased access to food and resources, and enhanced resilience to climatic and economic shocks. This can involve images of families with healthier and more abundant harvests, households utilizing solar pumps for improved water management, and beneficiaries proudly showcasing their kitchen gardens or bio-briquette production.
4. Highlight the sense of community collaboration and collective efforts that have been fostered by the project. Capture moments of collaboration, dialogue, and cooperation among community members, as well as their active involvement in disaster risk reduction and climate resilience activities.
5. Emphasize gender inclusivity by capturing the active participation and leadership of women in project activities. This can include photographs of women farmers working in their kitchen gardens, women-led poultry initiatives, and women actively engaged in community-based disaster risk reduction efforts.
6. Document the construction, rehabilitation, or establishment of project infrastructure and facilities. This may include images of flood protection walls, irrigation canals, agro-service centers, veterinary units, and bio-briquette production facilities, highlighting their functionality and impact on communities.
7. Ensure clear, high-resolution images suitable for digital use.
8. Provide date and location stamps for each photograph. Add descriptive captions for context and identification.
9. Obtain consent for individuals appearing in the photographs
10. Represent diverse genders, ages, and ethnicities in the photos.