Monitoring and Evaluation Consultant At International Organization for Migration

Project Context and Scope:

The International Organization for Migration (IOM) Community Resilience Activity – North (CRA-N) is designed to support community-level resilience and conflict prevention activities within the Newly Merged Districts (NMDs) of Khyber, Kurram, North Waziristan and Orakzai, Khyber Pakhtunkhwa (KP) Province. CRA-N works in close coordination with the Government of Pakistan (GOP) at the regional and district level, to enhance civic engagement, promote social cohesion and extend support for former Temporary Displaced Person (TDP) communities, particularly those with social, ethnic, or religious identities which have been exploited by Violent Extremist Organizations (VEO). CRA-North designs programming to ensure that communities have access to public information and benefit from increased social connections across conflicting groups while addressing barriers that prevent human security. The CRA-North Theory of Change denotes that ‘If we increase the political, social and economic integration of targeted Newly Merged Districts’ marginalized communities and populations, especially youth, THEN they will be more resilient to Violent Extremist Influence’ BECAUSE (i) They will have the abilities to participate in the democratic decision-making process and believe their voices are heard; (ii) They will have the means available to seek peaceful redress of grievances and this will reduce space for Violent Extremist Organizations; and (iii) They will restore a sense of agency and ownership over their future and increase economic self-reliance.’ Given the dynamic context in which CRA-N operates, the theories of change at the Resilience Activity and Intermediate Result Level will be evaluated and updated on an ongoing basis. Explicit grant award-funded Community Resilience Activity ‘Theories of Change’ will be developed for each Activity; while explaining how the Activity Components are supposed to produce a series of community-based results that contribute to achieving one or more of CRA-North’s three programmatic objectives; which are (i) Increase Civic Engagement (ii) Strengthen Community Cohesion and (iii) Support TDP Reintegration In Targeted Areas.

CRA-North utilizes small grant awards to fund our Direct Resilience Activity Implementation Efforts and those Resilience Activities are managed by our Implementing Partners and Service Providers. The current average value of each Grant Award is in/around USD$100,000, and each Resilience Activity is designed with a 6-month implementation timeframe. While individual Grant funded Resilience Activities are expected to have a modest impact in line with our project objectives; it is understood that a critical mass of Grant Funded Resilience Activities designed to continuously work with the same target beneficiaries, and tailored to specific thematic areas will, over time contribute substantially towards one or more of our CRA-North Programmatic Objectives. Currently, the CRA-North M&E Department evaluates each Resilience Activity in line with its stated Theory of Change, shortly after Activity completion. These evaluations, while thorough does not provide sufficient data to infer and/or demonstrate that the CRA-North Project is achieving its overall Theory of Change and/or effectively meeting its programmatic objective requirements, which is an existing gap within our M&E Framework.

Purpose of Assignment:

CRA-North would like to recruit an M&E Consultant to critically review and optimize the existing M&E Evaluation Systems in line with IOM’s best practices in PVE M&E approaches and conflict-sensitive communications. The Consultant will review CRA-North’s Cooperative Agreement and implementation strategies to ensure that M&E Systems align with the Project’s overall efforts while supplementing existing institutional tools to streamline conflict sensitivity evaluation principles throughout the CRA-North Project design and implementation efforts. In coordination with the IOM Transition and Recovery Division (TRD) at HQ, review and strengthen existing M&E evaluation standards and policies to assist in learning and conflict communications across contexts, ensure coherence in practice and policy, promote partnership and collaboration both internally and externally, and maintain IOM’s institutional knowledge, while strengthening existing programming and processes. Without empirical evidence to show progress towards the goals and objectives of CRA-North, the current M&E system requires a critical review and optimization in line with IOM’s best practices in the PVE M&E approach. In line with this, an M&E PVE expert will be recruited to review CRA-North’s project premise and implementation strategy to incorporate best practices and optimize the existing CRA-North M&E System toward higher-level results measurement, reporting, and communication.

Organizational Department / Unit to Which the Consultant Is Contributing:
CRA-North Monitoring & Evaluation Department
CRA-North Programming Departments
Category B Consultants: Tangible & Measurable Outputs from This Assignment
Desk Review of CRA-North Project Documentation: The CRA-North Project has evolved from its inception considering developments in an operational environment, security landscape, and increased partnerships with Government Entities, Academia, Civil Society Groups, Implementing Partners, and Service Providers. The programming has adapted to these changes, by utilizing updated programmatic strategies and M&E thematic (cluster) approaches. The Consultant will be required to study and analyze CRA-North’s evolution and the strong contextual dynamics which the project has responded over its current timeframe. Please see the following Documents that will be considered for review.
CRA-North Cooperative Agreement
CRA-North MEL Plan, Indicators List, and Results Framework
CRA-North Clusters Narrative (Objective-Based Strategy)
CRA-North Regional & District Programmatic Strategies
CRA-North Quarterly Reports (2021 & 2022)
CRA-North Project Brief
USAID Pakistan Country Development Cooperation Strategy (2018-2023)
Khyber Pakhtunkhwa Tribal Decade Strategy (2020-2030)
Khyber Pakhtunkhwa Sustainable Development Strategy (2019-2023)
TRD Briefing Notes on IOM’s PVE Programming
TRD’s PVE Tools and Guidelines
Institutional Guidance on Conflict Analysis

(xiii) Interview and discussions with CRA-North Senior Program and M&E Leadership

Strengthening M&E Evaluation & Learning To Improve Programmatic Approaches.

During 2022, CRA-North is quickly increasing the size of our Grant Funded Resilience Activity Portfolio, with 100+ active Resilience Activities underway; while 30 Resilience Activities have been completed, closed, and evaluated. These evaluations include the collection of both quantitative and qualitative data; and whether the Resilience Activity is in line with our Intermediate Results. The Consultant will review Resilience Activity Designs, Project Narrative Reports, and Evaluations to ensure a complete understanding of the CRA-North programmatic approaches, coupled with donor guidelines and requirements. This will be done to determine a holistic view of the PVE programmatic and evaluation ecosystem, with an exclusive focus on existing capacities (adequacy, efficiency, and effectiveness), identification of evaluation and design gaps, recognition of challenges, and recommendations for improvement in line with best practices. Please see the following actions that will be required under this Deliverable:

Review the following available CRA-North Project documentation.

CRA-North Grant Department Resilience Activity Portfolio Matrix
CRA-North Resilience Activity Grant Funded Awards, Representing Each of Our Four Clusters
CRA-North M&E Resilience Activity Final Evaluation Reports (FER’s), Representing Each of Our Four Clusters.

Prepare a concise Critical Analysis Report ( no more than 10 pages), which reflects an overview of CRA-North’s current program implementation designs and approaches; and efforts by our M&E Department to evaluate these Resilience Activities and integrate learning into strengthening our future programmatic strategies; identify the salient gaps in design, evaluation, and learning; followed by recommendations for CRA-North on how best to increase the effectiveness of our design and learning efforts; in order to better meet our CRA-North Project Objectives and Intermediate Results.
Prepare the first draft of this Critical Analysis Report for review by the CRA-North M&E Department, Transition & Recovery Division, and CRA-North Senior Program Leadership.
With the feedback provided, prepare and draft a Final Critical Analysis Report, which incorporates the final recommendations, with the inclusion of revised Data Collection Tools and Templates as required.

Strengthen M&E Evaluation Systems

The CRA-North M&E System is adaptive and seeks to harmonize Project Evaluation Requirements, Operational Constraints, and Donor Requirements while determining whether the CRA-North programming is meeting the Project’s stated Objectives and overall Theory of Change. The Consultant will be required to review the CRA-North M&E System and its respective components; including but not limited to (i) CRA-North MEL Plan, (ii) Results Framework, (iii) Performance Indicators, (iv) Data Collection Tools, (v) Analysis & Reporting Templates, (vi) M&E Personnel Terms of Reference, (vii) Learning/Management Response Matrix and other relevant documents and literature to familiarize the Consultant with the existing practices of the M&E Department. The Consultant will recommend improvements to the CRA-North M&E System; serving to strengthen, streamline and integrate Learning; improve data collection tools, recommend template improvements, improve the design of M&E Impact/Results Findings; bolster the after-action review process and overall learning-to-action methods. The Consultant will compare CRA-Norths M&E System with IOM’s existing M&E PVE institutional tools and UN Sustainable Development Goals and processes and recommend where steps may be taken to realign approaches, while still meeting the required CRA-North Objectives and Theory of Change requirements. Please see the following actions that will be required under this Deliverable:

Prepare a concise Critical Analysis Report (no more than 10 pages) that reflects an overview of CRA-North’s current M&E System, including data collection approaches, evaluation, and integration of learning into forward-looking programmatic Resilience Activity designs. This Report will provide recommendations on how to strengthen the current M&E System, describing recommended changes to the System in detail, coupled with annexes that comprise the updated templates, data collection tools, and/or reporting templates. Recommendations within the Critical Analysis Report will serve to enhance the responsiveness of the M&E System to CRA-Norths Programmatic PVE requirements; in that the M&E System may be better placed to determine whether specific programmatic activities are on point, in line with existing objectives and serve to meet the program’s overall Theory of Change.
Prepare the first draft of this Critical Analysis Report for review by the CRA-North M&E Department, Transition & Recovery Division, and CRA-North Senior Program Leadership.
With the feedback provided, prepare and draft a Final Critical Analysis Report, which incorporates the final recommendations, with the inclusion of revised Data Collection Tools and Templates as required.
Engage In The Following Review Process.

Review The CRA-North Monitoring, Evaluation & Learning (MEL) Plan & Related Annexes
Review The CRA-North M&E Resilience Activity Final Evaluation Reports (FERs), Representing Each of Our Four Clusters.
Participate In Round Table Discussions With Senior Program Leadership & M&E Department Leadership & Team Members to ensure M&E harmonization with CRA-North Programmatic Requirements.
Participate In Round Table Discussions With Donor M&E Specialists To Ensure That Recommendations To Enhance The Current CRA-North M&E Systems Is In Line With Donor Expectations.
Standardization of Conflict-Sensitive Communication In Peacebuilding Programming

In line with IOM CRA-North’s efforts to mainstream ‘Conflict Sensitive Communications’ throughout the program, the Consultant will create a ‘Guidance On Conflict Sensitive Communications In Peacebuilding Programming’ Manual which may be utilized by the Project. This Manual will serve to increase CRA-North’s effectiveness, by guiding the provision of Resilience Programming in conflict-prone settings; identifying the opportunities to have significant positive impacts, while also highlighting the unintended consequences of this programming that may contribute to further social division and/or violence. Conflict Sensitivity is based on the premise that the provision of assistance/resources may not always be considered neutral when applied to areas affected by ethnic, tribal, or religious divisions. Assistance is a form of resource that can be misused to strengthen one party over another, and the ‘possibility of substantial harm increases when interventions fail to identify and address the detrimental effects of otherwise well-intended actions.’ This Manual would be shared with CRA-North Stakeholders, Implementing Partners, and Service Providers, ensuring that our communications are conducted in a sensitive and responsible manner, mitigating the risks of inadvertently exacerbating existing conflict dynamics. This Manual will be attached as an Annex to the ‘Standardized Guidance On Conflict Analysis’ and ‘Beneficiary Targeting Within IOM’s Peacebuilding Portfolio’; and will guide CRA-North programmatic efforts to develop conflict-sensitive communications for our Community Resilience and Peacebuilding Programming. Please see the following actions that will be required under this deliverable.

Prepare a ‘Conflict Sensitive Communications Manual’ (no more than 15 Pages) which serves to provide the CRA-North Project, with sufficient guidance to enhance the Project’s Conflict Sensitivity Communication efforts within our target regions; in recognition of existing social, ethnic, religious, and tribal divisions; and the necessity to identify and address the potentially detrimental effects our planned Community Resilience Programming.
Prepare the first draft of this Conflict Sensitive Communications Manual for review by the CRA-North M&E Department, Transition & Recovery Division, and CRA-North Senior Program Leadership.
With the feedback provided, prepare and draft a Final Conflict Sensitive Communications Manual, which incorporates the final recommendations, with the inclusion of revised Data Collection Tools and Templates as required.
Provide a ‘Conflict Sensitive Communications’ Workshop for CRA-North Program Leadership, Communications Department, M&E Department, and other related personnel; to ensure that the Manual Content is understood, and Project Personnel is clear on how to integrate these Concepts into current programmatic strategies.

Final Report & Analysis

After the completion of Deliverables I, II, III & IV, the Consultant will be required to consolidate these Deliverables into a condensed and succinct Final Report, which will be submitted to the CRA-North Senior Program Leadership and M&E Department Head for final review and approval. This Final Report will highlight the key recommendations and learning provided under each of the separate Deliverables; including but not limited to; (i) Integrating PVE learning into strengthening our future programmatic strategies; identifying the salient gaps in design, evaluation, and learning, followed by recommendations on how best to increase the effectiveness of our design and learning efforts; (ii) How to strengthen the current M&E System, describing recommended changes in detail, coupled with annexes that comprise the updated templates, data collection tools and/or reporting templates (iii) Guiding the provision of Resilience Programming in conflict prone settings; identifying the opportunities to have significant positive impacts; while also highlighting the unintended consequences of this programming that may contribute to further social division and/or violence. Please see the following actions that will be required under this Deliverable.

Prepare a ‘Strengthening Monitoring & Evaluation’ Final Report (no more than 25 Pages) which serves to provide the CRA-North Project with clear and concise recommendations and learning, related to (i) Integrating PVE learning into strengthening our future programmatic strategies; identifying the salient gaps in design, evaluation, and learning, following by recommendations on how best to increase the effectiveness of our design and learning efforts; (ii) How to strengthen the current M&E System, describing recommended changes in detail, coupled with annexes that comprise the updated templates, data collection tools and/or reporting templates (iii) Guiding the provision of Resilience Programming in conflict prone settings; identifying the opportunities to have significant positive impacts; while also highlighting the unintended consequences of this programming that may contribute to further social division and/or violence. This Report will also incorporate a reflection on the Challenges, Lessons Learned, Promising Methods & General Recommendations; that are relevant to the design, implementation, and monitoring of the PVE Program in post-conflict environments. This Final Report will serve as a guide for future IOM programs that are implemented within Pakistan and centered on the themes of PVE, Community Resilience, and Peacebuilding.
Prepare the first draft of this ‘Strengthening Monitoring & Evaluation’ Final Report for review by the CRA-North M&E Department, Transition & Recovery Division, and CRA-North Senior Program Leadership.
With the feedback provided, prepare and draft a Final ‘Strengthening Monitoring & Evaluation’ Report, which incorporates the final recommendation and learning, with the inclusion of revised Data Collection Tools and Templates as required.
Provide a Workshop & PowerPoint Presentation for CRA-North Program Leadership, Communications Department, M&E Department, and other related personnel; to ensure that the ‘Strengthening Monitoring & Evaluation Report’ Content is understood, and Project Personnel is clear on how to integrate the recommendations and learning into current programmatic strategies; for effective and impactful project implementation.

Qualifications/Experience/Competencies

Essential Requirements

Master’s degree in political or social sciences, international relations, law, or a related field. Ph.D. in related subject matter is preferred.
Strong team leadership and management record; with a commitment to delivering timely and high-quality strategic and analytical reports.
Extensive technical evaluation expertise (at least 8 years) of evaluation methods ( experimental and non-experimental) with strong mixed-method approaches and innovative evaluation methods.
Considerable experience (at least 5 years) managing or supporting Peacebuilding, Preventing Violent Extremism (PVE), or related programming.
Extensive monitoring expertise (at least 10 years), leading monitoring activities, including designing monitoring frameworks, identifying indicators, data sources, etc. with experience supporting the development of M&E Strategies and Workplans.
Strong interpersonal and communication skills, ability to interact with various stakeholders, and to concisely express ideas and concepts in written and oral form.
Excellent and proven research, analytical, and writing skills.

Travel Requirements

To be able to successfully achieve the tasks and deliverables, it is expected that the Consultant will have to travel to Islamabad, Pakistan, to engage with stakeholders. One trip of between 45-60 days is envisioned during the consultancy period of 90 days.