Terms of Reference - External evaluation

Socio-economic empowerment of vulnerable families in Baidoa through climate resilient farming methods

Funded by: BMZ / Hermann-Gmeiner Fonds Deutschland (HGFD)
Implemented by: SOS Children’s Villages Somalia
Project Duration: 01.12.2022 - 31.12.2025
Project Location: Baidoa District, Southwest State, Somalia

1. Introduction

These Terms of Reference (ToR) serve as a request for proposals from qualified external evaluators to conduct the endline/impact evaluation of the BMZ-funded project “Socio-economic Empowerment of Vulnerable Families in Baidoa through Climate Resilient Farming Methods” implemented by SOS Children’s Villages Somalia in partnership with SOS-Kinderdörfer weltweit Hermann-Gmeiner-Fonds Deutschland e.V. This evaluation will determine the extent to which the project has achieved its intended objectives, assess impact on beneficiaries, and provide recommendations for future interventions.

SOS Children’s Villages Somalia, established in 1984, is a non-governmental social development organisation dedicated to child rights and committed to the care, protection, and empowerment of children without parental care and families at risk of losing it. We are a member of the SOS Children’s Villages International Federation, active in 138 countries and territories, committed to advancing children's rights, strengthening families, and building communities’ capacity to care for and protect children. Working in partnership with communities, government institutions, and civil society, SOS CV Somalia operate in the regions of Banadir, Bay, Bakol, Middle Shabelle and lower Shabelle and delivers programmes in Alternaive care, family strengthening, child protection in emergency, education (development and EIE), health, and climate-smart livelihoods, with a focus on building resilience in fragile and conflict-affected contexts.

2. Background and rationale

Background
SOS CV Somalia has been operational in Baidoa for more than the past ten years providing multisectoral lifesaving humanitarian response as well as long term developmental interventions. Baidoa has been the epicentre of Somalia’s humanitarian crises, and the city host large number of protracted Internally displaced populations. Somalia is one of the areas hardest hit by recurrent droughts, erratic rainfall, and climate-induced displacement. Vulnerable households particularly female-headed families and households with children at risk of losing parental care face chronic food insecurity, limited livelihood options, and weak protection systems.

In response, SOS CV Somalia, with support from BMZ/HGFD, has been implementing a three-year project (01.12.2022 - 31.12.2025) aiming to strengthen climate-resilient livelihoods and child protection systems in six target communities. The project combines:

• Climate-smart agricultural production (including hydroponics, drought-resistant crops, and training in climate adaptation techniques)

• Economic empowerment through Village Savings and Loan Associations (VSLAs)

• Child protection capacity-building for community-based networks, parenting skills, and child rights awareness

Project target group:

The project directly targets 200 vulnerable families in the six communities of Isha, Horseed, Wadajir, Towfiq, Bonkay, and Salamay in Baidoa District, including 150 households headed by single mothers and 50 households headed by young people (aged 18–35), with an estimated 1,200 children benefiting from a protective and caring environment. In addition, the project has established two community-based child protection networks (30 representatives in total) and engaged multipliers including 20 teachers, 20 district-level agricultural professionals, and 20 trained caregivers (ToT) to extend knowledge and practices within the communities. Beyond these direct beneficiaries and multipliers, the project has reached approximately 10,000 community members through awareness-raising, capacity-building initiatives, and improved services.

Rationale for evaluation:
BMZ-funded projects require an independent endline/impact evaluation to assess the project’s achievements against planned results, verify the performance of indicators, measure changes in socio-economic status and protection environment, and capture lessons for replication and scaling. The final evaluation of the project will provide an evidence-based result which will be help in the replication of the similar project ideas for the crises affected population in the region.

2. Purpose, Objectives and Use

Purpose: To assess the impact, effectiveness, efficiency, relevance, sustainability, and

management of the project, with a focus on both livelihood and protection outcomes.

Specific objectives:

1. Measure changes in socio-economic status of targeted households, including adoption of climateresilient farming methods and improved income stability.

2. Assess improvements in household food security, savings, and financial resilience through VSLA

participation.

3. Evaluate the effectiveness of community-based child protection networks and parenting skills

initiatives in reducing protection risks.

4. Examine the inclusiveness and gender-responsiveness of the project.

5. Assess sustainability prospects of climate-resilient livelihoods and protection systems beyond project

closure.

6. Generate actionable recommendations for scaling and improving similar interventions in Somalia.

Key users of evaluation results:

• SOS CV Somalia project team and National Office

• SOS CV ESAF Regional Office

• SOS-Kinderdörfer Weltweit and BMZ/HGFD donor

• Local government stakeholders in Baidoa

• Target communities and partner organizations

3. Scope of work

4.1 Geographical Reach

The evaluation will cover all six target communities (Horseed, Isha, Wadajir, Towfiq, Bonkay, Salamay)

in Baidoa District, Southwest State, Somalia, where the project has been implemented since December

2022 to 31.12.2025. These communities were selected in the project design based on their high

vulnerability, prevalence of female-headed households, exposure to climate-induced shocks, and need

for strengthened child protection systems.

The evaluation will assess project interventions in these six locations only, ensuring representation of the

200 vulnerable families (150 single-mother headed households and 50 youth-headed households) and

the established community-based child protection networks.

The evaluation will assess progress against the BMZ-approved impact matrix and project logframe

indicators, ensuring that findings are measured against the specific targets and outcomes defined in the

original proposal.

4.3 Interventions requiring special analysis

The evaluation will place particular emphasis on the following four project components, which

correspond to the sub-goals approved in the BMZ proposal, due to their strategic importance,

innovation, and relevance to BMZ and SOS C

4. Methodology

The external evaluation will adopt a mixed-methods, participatory, and rights-based approach, integrating

both qualitative and quantitative techniques to ensure a comprehensive, credible, and contextually

relevant assessment. The methodology will be grounded in the principles of accountability, inclusivity,

and human rights, ensuring the active engagement of diverse stakeholders including rights holders

(project beneficiaries) and duty bearers (local authorities, service providers, and partners).

Active stakeholder participation will be central to the process, fostering ownership, enhancing the

sustainability of outcomes, and increasing the likelihood that evaluation recommendations will inform

future programming. This participatory lens will ensure the evaluation captures lived experiences,

community perceptions, and both intended and unintended changes that have occurred over the life of

the project.

The evaluation will be results-oriented, generating robust quantitative and qualitative evidence on the

project’s relevance, effectiveness, efficiency, impact, sustainability, and management. Findings will be

triangulated across multiple data sources, and where possible benchmarked against baseline values and

relevant midline monitoring data to assess progress toward the targets outlined in the project’s results

framework.

The methodology should:

• Engage a wide range of stakeholders, including rights holders (beneficiaries such as VSLA

members, farmers trained in climate-resilient methods, child protection network members) and

duty bearers (local authorities, service providers, partners).

• Apply gender and social inclusion lenses to assess participation, benefit distribution, and

empowerment of women, youth, and marginalized groups.

• Facilitate triangulation of findings from multiple data sources to ensure credibility and robustnes

While SOS CV Somalia expects the evaluation to combine desk review, household surveys, key

informant interviews, focus group discussions, case studies/most significant change (MSC) story,

thematic analysis, comparative analyses, the final methodology, sampling design, data collection tools

and other methods relevant to evaluation objectives and scope are to be proposed by the external

consultant. The consultant is expected to comprehensively, explicitly, and clearly elaborate on how the

proposed data collection methods for the evaluation will be applied, indicating which tools will be used

for which stakeholder groups and specifying the aspects and dimensions that each method will address.

The proposed methodology must be:

1. Clearly justified in terms of relevance to the evaluation objectives and criteria.

2. Feasible within the available resources, time frame, and field access conditions in Baidoa.

3. Ethically sound, safeguarding the dignity, rights, and safety of participants, especially women and

children.

4. Approved by SOS CV Somalia and BMZ before data collection begins

4. Process of evaluation

The evaluation will be carried out in three main phases – Inception, Field Data Collection, and Analysis

& Reporting – each involving specific activities and responsibilities.

Phase 1: Inception and evaluation design

Activities

• Hold an initial inception meeting (virtual or in person) with SOS CV Somalia’s National Office

team to agree on the scope, objectives, and timeline of the evaluation.

• Review key project documents including the BMZ-approved proposal, results framework,

baseline study, progress reports, monitoring data, training records, financial records, and

relevant national/regional sectoral reports.

• Develop and submit a detailed evaluation design and inception report, specifying:

o Data collection methodology and sampling strategy

o Stakeholder engagement plan

o Data collection tools and frameworks

o Ethical protocols, particularly for engaging women, children, and vulnerable groups

• Agree with SOS CV Somalia and BMZ on site visit schedules, target communities, and

stakeholder groups to be engaged.

• Finalize all data collection tools after incorporating feedback from SOS CV Somalia and BMZ.

Key Actors: External evaluator (lead), National Programme Development Director (NPDD), National

Family Strengthening Programme Advisor (NFSPA), Project Coordinator, BMZ Project Focal Point.

Phase 2: Field data collection in Baidoa

Activities

• Conduct site visits in all six target communities in Baidoa, ensuring representative coverage of

direct and indirect beneficiaries, including women-headed households, youth-led households,

and IDPs

• Administer household surveys to capture quantitative endline data aligned with the project’s

impact matrix.

• Conduct Key Informant Interviews (KIIs) with project staff, local authorities, implementing

partners, and community leaders.

• Facilitate Focus Group Discussions (FGDs) with VSLA members, trained farmers, and child

protection network members (disaggregated by gender, age, and status).

• Undertake case studies of selected households to assess longitudinal change since project

inception.

• Apply gender and inclusion analysis to assess participation, benefit distribution, and

empowerment outcomes.

• Record observations of community-based structures such as hydroponic farming units, VSLA

group meetings, and child protection activities.

Key Actors: External evaluator (lead), enumerators (if engaged), Project Coordinator (logistical

support), community facilitators, local leaders

Phase 3: Data analysis and reporting

Activities

• Analyse quantitative and qualitative data, applying triangulation to ensure validity and reliability

of findings.

• Conduct a SWOT analysis to contextualize project performance.

• Prepare a draft evaluation report in line with the TOR, detailing:

o Findings by OECD-DAC criteria (relevance, effectiveness, efficiency, impact,

sustainability, project management & coordination)

o Progress against project indicators in the BMZ results framework

o Positive and negative, intended and unintended outcomes

o Lessons learned and practical recommendations

• Present preliminary findings to SOS CV Somalia (National Office), the Baidoa project team, and

BMZ representatives to validate results and recommendations.

• Incorporate stakeholder feedback and submit the final evaluation report in English, including

annexes with applied tools, data tables, and case study narratives.

Key Actors: External evaluator (lead), NPDD, NFSPA, Project Coordinator, SOS CV Somalia National

Director, BMZ representative.

11. Selection criteria

The selection of the external evaluation consultant/firm will be based on a transparent and competitive

process, using the following criteria:

• Methodology: The proposed methodology must be robust, contextually relevant, and aligned

with the Terms of Reference. It should clearly demonstrate how the evaluation will address the

key evaluation questions, integrate participatory approaches, and meet BMZ and SOS CV

Somalia standards.

• Work Plan and timetable: The proposed work plan must be realistic, feasible within the

stipulated timeframe, and demonstrate a logical sequencing of activities to ensure high-quality

deliverables.

• Experience and qualifications: Proven experience in conducting impact and end-of-project

evaluations, preferably for BMZ-funded or similar donor-funded projects in Somalia or comparable

contexts. Demonstrated expertise in child protection, livelihoods, climate resilience, gender and

inclusion, and participatory methodologies will be an added advantage.

• Team composition: The evaluation team must have the technical expertise and complementary

skill sets outlined in Section 6 (Expert Profile), with clearly defined roles and responsibilities.

• Cost: The financial proposal must be reasonable, competitive, and reflect value for money,

considering the scope, methodology, and quality standards required.

• References and past performance: Strong references from previous clients and a track record

of delivering timely, high-quality evaluation reports.

• Compliance: Commitment to safeguarding, gender equality, inclusion, and the Do No Harm

principle, as well as adherence to SOS CV Somalia’s ethical guidelines.

Documents to submit

Interested applicants must submit the following:

1. Bid submission / Identification form – including name of applicant/firm, contact details, and

legal registration (if applicable)

2. Technical proposal – detailing the understanding of the TOR, proposed methodology, work

plan, and timeline.

3. Previous experience format – outlining relevant assignments with brief descriptions, dates,

locations, and client references.

4. CVs of evaluation team members – including current geographical location and relevant

qualifications.

5. Price schedule form – sealed in a separate envelope or submitted as a separate PDF file.

6. Three references – at least two must be from organizations familiar with the applicant’s

evaluation work.

7. Sample evaluation report – a recent and relevant evaluation report (if available for public use)

demonstrating writing quality, analytical depth, and methodological rigour

12. Mode of payment

Payments will be made in three instalments upon satisfactory completion of agreed deliverables and

submission of required documentation, as follows:

• 1st Phase – contract signing

The consultant shall receive 50% of the total agreed amount upon signing the contract and

submission of an inception report outline, including a proposed work plan and methodology,

approved by SOS CV Somalia.

• 2nd Phase – draft report submission

The consultant shall receive 25% of the total agreed amount upon submission of the draft

evaluation report and presentation of preliminary findings to SOS CV Somalia and BMZ.

Payment will be contingent on the draft meeting the agreed quality standards and incorporating

initial stakeholder feedback from the validation workshop.

• 3rd Phase – final report submission

The consultant shall receive the remaining 20% of the total agreed amount upon submission

and acceptance of the final evaluation report, incorporating all feedback from SOS CV

Somalia, BMZ, and other relevant stakeholders. The final report must be approved in writing by

SOS CV Somalia before payment is released.

Note: All payments will be made via bank transfer in USD to the consultant’s nominated account,

subject to statutory tax deductions as per the laws of Somalia.

How To Apply

Interested consultancy firms or individual consultants must submitted in PDF format and in English their full application. The complete application package should be sent by email no later than 4th October 2025 12:00 am (East Africa time) to: procurement@sossomalia.org

The email subject line should be titled: “External Evaluation of BMZ Baidoa CSFL Project” Proposals will be evaluated based on technical quality, relevant experience, cost-effectiveness, and alignment with the scope and expectations outlined in this Terms of Reference