CTG overview:
CTG staff and support humanitarian projects in fragile and conflict-affected countries around the world, providing a rapid and cost-effective service for development and humanitarian missions. With past performance in 17 countries – from the Middle East, Africa, Europe, and Asia, we have placed more than 20,000 staff all over the world since operations began in 2006.
CTG recruits, deploys and manages the right people with the right skills to implement humanitarian and development projects, from cleaners to obstetricians, and mechanics to infection specialists, we’re skilled in emergency response to crises such as the Ebola outbreak in West Africa. Key to successful project delivery is the ability to mobilise at speed; CTG can source and deploy anyone, anywhere, in less than 2 weeks and have done so in 48 hours on a number of occasions.
Through our efficient and agile HR, logistical and operational services, CTG saves multilateral organisations time and money. We handle all our clients’ HR related issues, so they are free to focus on their core services.
Visit www.ctg.org to find out more
Background & context:
The conflict in Yemen has brought the economy to a near collapse & made Yemen one of the protracted conflicts has made Yemen one of the poorest & most food insecure countries in the world. The conflict has destroyed livelihoods & the ability to purchase food. This is being compounded by the impact of climate related shocks. The fishery sector provided job opportunities for more than half a million individuals which supported 1.7 million people, forming 18% of the coastal population prior to the conflict. It contributed up to 3% of the country’s Gross Domestic Product (GDP) as the third most important agricultural sector & second primary source of export earnings before the conflict. Yemen’s fisheries sector holds untapped promise in contributing to the national economy, in which the potential of women is underutilized due to social norms. The conflict has caused severe damage to the entire fishery value chain. Overall, the entire fish supply chain has been massively destroyed.
The development objective of the project is to strengthen mechanisms for regional collaborative management of fisheries in the RSGA region & improve the effective fishery production & value chain in Yemen. The project will focus on improving economic opportunities, food security & effective management of fisheries production in Yemen promoting the greater involvement & participation of women & the youth in the fishery sector. Its primarily aims to support actions to improve fishery production & quality by reducing post harvest losses & improving climate resilience & access to markets, thus contributing to restoring fishery sector related livelihoods & create economic opportunities for women & men. It will also promote interaction & networks between fishers, micro & small fish processors, wholesalers & retailers to improve access to markets in targeted coastal areas. It will also support developing local governance systems & knowledge to effectively manage fisheries & ensure climate resilience that aligns with the fishery sector strategy of Yemen.
Evaluation purpose , scope & objective:
The Mid Term Review (MTR) aims to inform our client in Yemen, project donor World Bank & its national implementing partners of lessons learned, promising practices, results achieved & areas for improvements. The evaluation will draw out progress towards project deliverables, assess whether the project interventions are being implemented & in the right direction to achieve its intended objectives & goals, conduct SWOT 1 analysis to guide the existing implementation arrangement & any course correction required for the current implementation process & future as well. The evaluation is expected to produce a comprehensive report that provides a detailed assessment in related to the purpose & objectives of this MTR with evidence, lessons learned & best practices. Responding to the Theory of Change (ToC) as described in the project document, the agreed Results & Resource Framework (RRF) & the approved work plans, the MTR is expected to look at the relevance of the project, quality of the project design, effectiveness & efficiency of the implementation to date, sustainability of the overall project results, impact of the intervention & forward looking directions for future. To meet these requirements the MTR will serve the following:
Assess project performance & progress against the expected outputs, targets including indicators presented in the RRF & contribution to the expected outputs, outcomes.
Examine the assumptions embedded in the ToC of SFISH & assess the relevance, effectiveness, efficiency, likely impact of the project drawn from its design & implementation, as well as the sustainability of the project interventions.
Assess the level of satisfaction of beneficiaries & stakeholders with the project results so far.
Draw the positive, negative, foreseen & unforeseen, changes & effects driven by project supported interventions.
Review, document the success, draw lessons learned & best practices for replication & / or up scaling & provide forward looking recommendations.
Assess the effectiveness of the project in terms of engagement with the respective local fishery communities/ stakeholders, fishery supply chain enablers, fishery business associations & respective fishery national authority including Department of Fishery & Ministry of Fishery.
Identify challenges & the effectiveness of the strategic approaches that project adopted for addressing those challenges.
Outline recommendations, including potential realignments in scope & approach in line with the project’s outcome.
Provide forward looking recommendations that contribute to enhancing the implementation process in order to achieve project’s intended goals.
The MTR will examine in particular results at the outputs level with a focus on the overall implementation process & progress towards project targets at the time of the midterm evaluation, covering the period from the project launch. This includes a review of allocated resources for the spent / planned outputs & identification of implementation issues under each Responsible Partner (RP), furthermore at the activity level to pin down any alarming barriers & bottlenecks & come up with recommendations. This will also cover the reassurance of the ToC & results chain envisaged in the project document towards achieving the overall objectives.
Scope of evaluation:
Under the lead of the International MTR Consultant the evaluation requires field visits & Key Informant Interviews (KII) with our client & World Bank staff, RP’s & the respective local fishery communities / stakeholders covering a representative where SFISH project has a footprint of delivering the project activities, fishery supply chain enablers, fishery business associations & representatives from national fishery authority especially who are directly engaged with the project. Furthermore, it may also require household survey / interviews along with direct observation of project sites where SFISH supported families in livelihood restoration interventions. The evaluation will focus on the following key areas:
Assess the quality, functionality & durability of the rehabilitated infrastructure, including fishing landing sites, storage facilities & associated market access points.
Evaluate the alignment of the rehabilitation works with the specified technical standards & environmental sustainability criteria.
Determine the effectiveness of these rehabilitations in enhancing the operational capacity & safety of fishery operations.
Evaluate the design, deployment & functionality of the DIS, focusing on its usability, reliability & integration with existing fishery management practices.
Assess the system’s effectiveness in providing real time market pricing, weather updates & other critical data to fishery stakeholders.
Measure the socio economic impacts of the rehabilitated infrastructure & DIS on the local fishery communities.
Assess the capacity building & training provided to the local stakeholders for managing & maintaining the infrastructure & DIS.
Evaluate the sustainability prospects of the interventions, including an analysis of ongoing maintenance & operational support.
Methodology:
MTR will apply the standard OECD / DAC criteria using a mixed methods approach, i.e., qualitative & quantitative data collection. This should be further developed by the Evaluator(s) & approved by the Evaluation Manager with the support of evaluation reference group during the inception phase of the evaluation. This document therefore envisages a general approach for conducting the evaluation, as well as data sources & tools that will likely yield the most reliable & valid answers to the evaluation questions within the limits of resources. However, final decisions about the specific design & methods for the evaluation should emerge from consultations among the evaluation reference group with the support of our clients Evaluation Manager about what is appropriate & feasible to meet the evaluation purpose, objectives & answer the evaluation questions, considering the limitations of budget, time & data. Methodological approaches may include some or all the following:
Evaluation should employ a combination of both qualitative & quantitative evaluation methods & instruments.
Surveys & questionnaires including direct & indirect beneficiaries, respective fishery communities with gender balanced (at least 30% female to be engaged during the evaluation survey) & / or surveys & questionnaires to other stakeholders at strategic & programmatic levels (if necessary).
Field visits & on site validation of key outputs & interventions. The evaluation team is expected to follow a participatory & consultative approach that ensures close engagement with the evaluation manager, project team, implementing partners & direct beneficiaries.
Other methods such as outcome mapping, case study approach, stakeholder analysis / consultations, observational visits, group discussions, etc.
Data review & analysis of monitoring data & other data sources & methods. Ensure maximum validity, reliability of data (quality) & promote use; the evaluation team will ensure triangulation of the various data sources.
Gender & human rights lens. The evaluation process & products need to address gender & disability issues.
Document review of all relevant documentation. This would include a review of inter alia.
Project document (project proposal).
Project Operations Manual (POM).
ToC & RRF.
Annual Work Plan & Budget (AWP & B).
TPMA reports.
Quarterly, bi annual & annual progress reports.
Implementation Support Mission (ISM) report of the World Bank.
Technical / financial monitoring reports.
Landing sites lists.
Other relevant available documents / reports.
Interviews & meetings:
Semi structured interviews, based on questions designed for different stakeholders & also evaluation questions around relevance, effectiveness, efficiency, impacts & sustainability, environment & climate change related impacts & resilience, gender equality & women’s empowerment.
Key informant & Focus Group Discussions (FGD’s) with fishery beneficiaries, communities & stakeholders with gender balanced.
All interviews with men & women should be undertaken in full confidence & anonymity. The final evaluation report should not assign specific comments to individuals.
The final methodological approach including interview schedule, field visits & data to be used in the evaluation will be clearly outlined in the inception report & be fully discussed & agreed between our client, national implementing RP & the Evaluators.
Role objectives:
Assess project performance and progress against the expected outputs, targets including indicators presented in the Results and Resource Framework (RRF) and contribution to the expected outputs, outcomes.
Examine the assumptions embedded in the Theory of Change of SFISH and assess the relevance, effectiveness, efficiency, likely impact of the project drawn from its design and implementation, as well as the sustainability of the project interventions.
Assess the level of satisfaction of beneficiaries and stakeholders with the project results so far.
Draw the positive and negative, and foreseen and unforeseen, changes and effects driven by project-supported interventions.
Review and document the success and draw lessons learned and best practices for replication and/or up-scaling and provide forward-looking recommendations.
Assess the effectiveness of the project in terms of engagement with the respective local fishery communities/ stakeholders, fishery supply chain enablers, fishery business associations, and respective fishery national authority including Department of Fishery and Ministry of Fishery .
Identify challenges and the effectiveness of the strategic approaches that project adopted for addressing those challenges.
Outline recommendations, including potential realignments in scope and approach in line with the project’s outcome.
Provide forward-looking recommendations that contribute to enhancing the implementation process in order to achieve project’s intended goals.
Project reporting:
Under the lead of the International MTR Consultant the MTR will be expected to deliver the following:
Evaluation inception report (maximum 15 pages except annexes). The inception report should be carried out following & based on preliminary discussions with our client after the desk review & should be produced before the evaluation starts (before any formal evaluation interviews, survey distribution or field visits) & prior to the country visit / project site visits in the case of National Evaluators respectively. The evaluation inception report should highlight how (methodology) the evaluation is planning to integrate major gender aspects during data collection & reporting.
Evaluation debriefings. Immediately following an evaluation, the evaluation team will conduct a preliminary debriefing of findings & key critical observations including all relevant cross cutting issues gender, environment & climate change issues.
Draft evaluation report (maximum 60 pages including 4 – 5 pages executive summary). Our client & stakeholders will review the draft evaluation report & provide an amalgamated set of comments to the evaluation team within 10 days, addressing the content required (as agreed in the inception report) & quality criteria as outlined in our clients evaluation guidelines.
Evaluation report audit trail. Comments & changes by the evaluation team in response to the draft report should be retained by the Evaluators to show how they have addressed comments.
Presentations to stakeholders & the Evaluation Reference Group (ERG).
Final MTR report.
Evaluation team composition & required competencies:
The MTR team will consist of experienced multi disciplinary team of consultants (one International Lead Consultant & two National Consultants Fisheries Development Specialist & Enterprise (Agriculture / Fishery SMEs) Development Specialist) with experience in designing & conducting evaluation for national fisheries development, livelihoods especially in the context of humanitarian & development responses.
The International Consultant will be the Team Leader (TL) & take a lead role during all phases of the evaluation & coordinate the work of all the two National Consultants. S / he will ensure the quality of the evaluation process, outputs, methodology & timely delivery of all products. The TL, in close collaboration with the other evaluation team members, leads the conceptualization & design the evaluation & plays a lead role in shaping the findings, conclusions & recommendations of the report.
The National Consultants will be comprised of two multidimensional professionals in accordance with the nature & structure of the project interventions & will be recruited to work under the leadership of the International Lead Consultant, be responsible for the overall assistance to the TL to implement the evaluation inception guideline including application of all agreed evaluation methodologies to collect, analysis & draft report in line with field findings covering all agreed approaches such as consultations & meetings with selected different stakeholders, FGDs, etc. The National Consultants will contribute substantively to the work of the TL, by providing substantive inputs & context in the drafting & finalizing the inception & final evaluation reports. Both the International & National Consultants should have M&E technical knowledge & experience in key critical cross cutting areas such as gender equality, empowerment, environment & climate change impact, disability issues & capacity development.
Key qualifications & experience of the National Consultant:
Master’s degree or higher in fisheries management, development studies, economics, business administration, civil engineering & / or a related field.
Minimum of 5 years of professional experience in conducting evaluations, preferably within the fisheries sector or related fields.
Demonstrated understanding of the socio economic & cultural context of Yemen.
Proficiency in Arabic, strong report writing & communication skills in English.
Key competencies expected of the consultant for the successful delivery of the milestones:
Proven track record in evaluating large scale infrastructure rehabilitation projects within Yemen or similar contexts.
Significant experience in integrating gender equality & women’s empowerment into infrastructure project evaluations.
Expertise in applying results based & human rights based approaches specifically tailored to infrastructure & humanitarian response programs.
Comprehensive knowledge of the national literature related to infrastructure development under crisis conditions, including the specific challenges &d strategies pertinent to Yemen.
In depth understanding of Yemen’s socio cultural & political environment, especially how it affects infrastructure projects & technology implementations in public sectors.
Excellent bilingual communication skills in English & Arabic, essential for drafting clear, comprehensive evaluation reports & for effective stakeholder engagement.
Team management:
This role has no team management responsibility.
Method of payment:
Payment is contingent on approval by the Team Leader of OST & SFISH Project Manager (PM) upon satisfactory dispensing of the milestones & it will be paid in the instalments as stated in the deliverable table above.
Implementation arrangements:
Our clients Yemen Country Office will select the consultants through a competitive process in line with their rules and regulations. They will be responsible for the management of the evaluation team & will in this regard designate an Evaluation Manager & a focal point. The PM with the support of project M&E team will assist in facilitating the whole evaluation process, providing relevant documentation, constituting the evaluation reference group, support to conduct selected project site visits / interviews with key informants, reviewing evaluation products stated above etc.
The Evaluation Manager will convene an evaluation reference group comprising of technical experts from partners & our client with gender balance to enhance the quality of the evaluation. The reference group will review the inception & the draft evaluation reports, providing detailed comments related to the quality of methodology, evidence collected, analysis & reporting. The reference group will also advise on the conformity of the evaluation process to our client & UNEG standards.
Evaluation ethics:
This evaluation will be conducted in accordance with the principles outlined in the UNEG ‘ethical guidelines for evaluation’. The consultant must safeguard the rights & confidentiality of information providers, interviewees & stakeholders through measures to ensure compliance with legal & other relevant codes governing collection of data & reporting on data. The consultants must also ensure security of collected information before & after the evaluation & protocols to ensure anonymity & confidentiality of sources of information where that is expected. The information knowledge & data gathered in the evaluation process must also be solely used for the evaluation & not for other uses with the express authorization of our client & partners.
Timeframe for the evaluation process:
The evaluation is expected to be completed by 20 workdays within three months. Under the lead of the International Consultant, the national evaluation team should propose a timeline to submit the deliverables in their proposals. Necessary & adequate time (at least two weeks) should be allocated for review & quality assurance processes of the deliverables by our clients team & partners.
Other information:
For breakdown of deliverables, please refer to this TOR on CTG careers portal.