Final evaluation – Employment & Disability phase 2 – Senegal, Benin, Morocco, Tunisia At Handicap International – Humanity & Inclusion

https://www.hi.org/fr/appels-d-offres#240208-1

The external evaluation of the Employment and Disability project phase 2 is one of the expected deliverables of the implementation.

It is part of a dual issue of accountability towards the donor and beneficiaries but also for learning purposes. The external evaluation will thus make it possible to assess the effects of the interventions on the beneficiaries, the sustainability of the implemented actions and the effectiveness of the implementation strategy with regard to the level of achieving the expected results.

The results of this evaluation will therefore be intended for the financial partner AFD, HI and its partners. They can also be shared with other donors who contributed to financing the project in the different countries.

In addition, the strategy put in place lays the foundations for a change in practices; this change must be consolidated through an institutional anchor guarantee of sustainability. The evaluation should propose avenues for reflection and recommendations aimed at making this institutional anchoring effective.

The external evaluation report of the project will allow HI and its partners to analyze the results and recommendations in order to move towards other issues related to the integration of people with disabilities. These results and recommendations will also be used as inputs in the discussions around a possible phase 3 of the project.

General evaluation objectives and expectations

The general objective of the evaluation is to measure the levels of achievement of planned results as well as the developments recorded, considering the Benefits, Management and Stakeholders.

Specific objectives :

Specific Objective 1 : Evaluate the quality of the BENEFITS of the project through the Changes and Relevance criteria.

Specific Objective 2 : Evaluate the quality of collaboration with ACTORS through the criteria of Partnership and Accountability to populations.

Specific objective 3 : Evaluate the quality of project MANAGEMENT through the Efficiency criterion.

Specific objective 4 : Propose recommendations that could guide the NGO and the donor in the context of a reflection concerning a phase 3 by paying attention to the improvements to be made, according to the direct beneficiaries (according to gender, age and disability) and partners with regard to the results achieved.

Evaluation methodology and organization of the mission

Collection method

The final evaluation of the project will cover the 4 countries of intervention of the project. This choice will be confirmed by the evaluator and the project coordinator based on the available budget.

The service provision contract will cover all costs relating to expenses incurred by the consultant: travel, communication, accommodation, catering and fees.

The focus of the evaluation should be on qualitative aspects. The proposed methodology must therefore take into account a documentary review which will be carried out rigorously by the consultant. For this purpose, a set of documents will be made available:

• Project documents (narrative and financial, logical framework, activity programs, evaluation of phase 1 of the project, etc.).
• Project productions (guides, video capsules, technical sheets, Tranche 1 report and activity reports, etc.).
• Mid-term self-assessment carried out.
• Action tracking databases etc.

Actors involved in the evaluation

The evaluation will be coordinated by the specialist, project coordinator, based in Dakar, Senegal. In each country, the target groups to be met will be: young people and adults with disabilities, beneficiaries of the action, those involved in guidance, vocational training and employment, at operational and institutional levels, social actors, at operational and institutional levels, financing systems and service providers, partner associations (Organization of People with Disabilities (OPH) and CSOs), businesses, unions, decentralized financial systems, HI country teams and their operational partners, CSR & PED, main project partner and its country partners, if available, representatives of the donor in the country.

The roles of the different stakeholders are as follows:

• The sponsor produces the evaluation guidelines and ensures the smooth running of the evaluation in accordance with the implementation schedule. He ensures that the costs linked to the service are paid on time and takes care of the organization of the different moments of exchange (preparation and restitution).
• The evaluation steering committee is the supervisory body of the evaluation process. To this end, he will be called upon in the key phases of the process: validation of the terms of reference, proofreading and validation of provisional and final reports. Alongside the specialist, country coordinator, the composition of the Copil is as follows:
  • HI project managers: they will provide documentation (reports and activity reports, multi-stakeholder plan, etc.) and will facilitate contacts between the evaluator and the targeted stakeholders. They will ensure the conformity of the data collected and the conclusions presented in the provisional report according to the reality of implementation in the different countries concerned.
  • The Director of RSE and PED will facilitate contacts with operational partners of RSE and PED in the four countries and the verification of data with regard to the implementation of the project.
  • The MEAL of the ACO program supports the framing and implementation of the evaluation in compliance with the standards set out by HI’s project quality policy (PQP).
  • The ACO program compliance officer ensures compliance of the process with HI directives in this area and scrupulous compliance with the various HI protection policies.
  • Optionally and depending on needs, the copil can call on other skills present at HI to support the evaluation process: Global specialist, O2, TUM ACO etc.
  • The target groups listed above will mainly be used in data collection by the evaluator.

Permanent communication will be established between the steering committee and the evaluator. To this end, three meetings are planned: 1 at the start of the mission, 1 after the field surveys and 1 to present the provisional report. Between these different moments, telephone exchanges, by email or on the Teams platform will make it possible to maintain contact with the evaluator.

The evaluator will propose an inclusive data collection methodology and tools.

Organization of the mission

Under the supervision of the specialist, coordinator of the multi-country project, the consultant will implement the following tasks in compliance with HI and AFD policies, standards and procedures, and overall project planning. :

• Document review :
  • Take note of the project documentation (project documents, donor report, mid-term self-evaluation report, etc.) and other reference documents collected by the project team.
  • Take note of the documentation from HI, AFD, the countries concerned and other national and international players in the field.
    • Adjust, if necessary, the methodology, tools and schedule for carrying out the evaluation following the scoping meeting with the sponsor.
      • Develop and propose interview guides/evaluative questionnaires based on the indicative evaluation questions proposed in the Terms of Reference. The validation of the data collection tools will be done in conjunction with the specialist, the country project managers and the MEAL of the HI ACO program.
    • Take part in the first restitution of data to the Steering Committee.
    • Write the preliminary data analysis report according to a plan validated with the project team.
    • Facilitate the data restitution and validation workshop with the project teams.
    • Finalize and send to the sponsor the final report incorporating the observations made during the feedback workshop.

The consultant will be able to benefit throughout the mandate from the facilities of HI offices in the countries of intervention.

However, the organization of travel to different countries and meetings with stakeholders is the responsibility of the Consultant. He may be supported by HI, particularly in establishing contact with stakeholders and making appointments.

Expected deliverables and proposed schedule

Deliverables

The expected deliverables of the evaluation are:

• An inception report of 5 to 10 pages, refining/specifying the methodology proposed to answer the evaluative questions and integrating an action plan. This start-up plan must be validated by the CoPil.
• A restitution support of 5 to 10 pages, presenting the first results, conclusions and recommendations, to be presented to the CoPil.
• A final report of approximately 20 to 30 pages maximum and the following annexes: the different collection tools used (questionnaires, interview guides, etc.) the start-up report and a Powerpoint presentation of the results of the evaluation.
• A 4-page summary of the evaluation report.

Dates and indicative timetable for the evaluation

The evaluation is planned over a period of 5 months from the launch of the call for tenders (February 2024) to the submission of the final report (June 2024). For the different phases of the evaluation and their duration, refer to page 9 of the ToR