The objective of this evaluation is to provide an assessment of the Irish Aid funded programme against each of the DAC criteria. The evaluation will focus on the design, implementation, activities and results and will cover the period of Programme implementation.

The Evaluation Team (Consultants) are expected to develop an appropriate work plan for the evaluation that is based on the context. The work plan must be as participatory as possible under the current conditions, involving different stakeholders including beneficiaries, partners, Concern staff and other stakeholders.

The prescribed methodology will include the following activities:

• Detailed programme document review and review of other emergency programme evaluations conducted before

• Assessment of achievement of indicators under each outcome

• Key Informant Interviews with Key Programme staff; partner staff; relevant local authorities; key programme participants/community leaders

• Focus Group Discussions with programme participants (appropriately disaggregated). Where focus groups are not possible, remote data collection with programme participants should be considered (tools and approaches)

• Household surveys with a sample of beneficiaries using quantitative data aspects

In addition to the mixed methods approach outlined above, the evaluators will also be applying Qualitative Comparative Analysis alongside the data validation exercises to increase the robustness of the evaluation process and confidence in the findings.

The outputs of this evaluation report which will contain:

• An executive summary (no more than 3 pages)

• An appraisal of how well the project has fared against each of the extended OECD-DAC criteria using the following grading scale, where:

• 5 – outstanding performance

• 4- very good overall performance with few shortcomings

• 3 - good overall performance but with some minor shortcomings

• 2 – generally acceptable performance but with some major shortcomings

• 1- barely acceptable performance with some major shortcomings

• An examination of the extent to which programme design, implementation and monitoring have considered the relevant Concern cross-cutting issues

• Targeted recommendations for improving the programme

The report should be no more than 25 pages (15 pages focused on findings and conclusions against the OECD-DAC criteria).

The evaluation of the Programme will be carried out in November 2023.

The Lead Evaluator should have the following abilities:

• Experience of conducting evaluations of humanitarian responses

• Experience in emergency responses in complex crises such as Somalia

• Experience of qualitative data collection methods, including participatory approaches

• Experience of working remotely with a distributed team, including providing support to colleagues at a distance

• Ability to assess the quality of programmatic data collection systems, analyse budgets, results frameworks, M+E reports and surveys, and other documents.

• Experience of writing evaluation reports to a high standard in English

• Availability to travel, for the purpose of data collection, to Somalia, in November 2023.

How to apply

Applications for this contract from qualified consultants must include the following:

• A Cover Letter

• Evaluation Plan (including a timeline and methodology)

• Evaluation Team, their Roles and Responsibilities

• CVs of evaluators and examples of previous similar work

• Comprehensive budget and costings

Please email application documents to Susan Finucane susan.finucane@concern.net before COB Wednesday 11th October 2023.