End-Line Evaluation

PLAN INTERNATIONAL ZAMBIA

1. About Plan International

We strive to advance children’s rights and equality for girls all over the world. As an independent developmental and humanitarian organization, we work alongside children, young people, our supporters and partners to tackle the root causes of the challenges facing girls and all vulnerable children. We support children’s rights from birth until they reach adulthood and enable children to prepare for and respond to crises and adversity. We drive changes in practice and policy at local, national and global levels using our reach, experience and knowledge. For over 80 years we have been building powerful partnerships for children, and we are active in over 80 countries. Plan International has been operating in Zambia since 1996 and continues to work in 4 provinces namely Luapula, Eastern, Central and Lusaka.

2. Project Background

Plan International Zambia with partners Afya Mzuri, Generation Alive, SAfAIDS, Restless Development and Childline/Lifeline is implementing the project Strengthening civil society organisations (CSOs) for the promotion of a safe and secure environment for children and young people (CIVSAM project) which is part of the global Generation Change! civil society strengthening programme financed by the Swedish International Development Cooperation Agency (Sida).  It started 1 July, 2019 hence to be implemented until 30 June 2024. The main focus of the project is to strengthen civil society organizations to promote a safe and secure environment for children & young people through building the capacity of CSOs around thematic areas ie, child protection and participation, adolescent sexual reproductive health and rights (ASRHR) as well as ensuring the meaningful participation of children and youth   in the fulfilment of children’s rights and equality for girls as well as women. The project is being implemented in Plan Central Program Area in 4 districts.

3.1 Purpose of the Evaluation

The purpose of this external evaluation is to conduct an assessment of the overall results of the project to determine if outcomes were achieved during the project cycle period, July 2019- June 2024.

3.2 Evaluation Criteria

The evaluation criteria applicable for the evaluation are effectiveness, efficiency and sustainability notably assessing:

  • Effectiveness: the extent to which, and the reasons behind, the achievement (or not) of the project or programme’s objectives, and whether these are leading to unintended (positive or negative) consequences for anybody involved in or affected by the interventions. It is expected to assess the progress in relation to baseline study and indicators.
  • Sustainability: the probability of continued long-term benefits to the target populations after the project or programme has been completed.
  • Efficiency: the extent to which financial resources were used economically and efficiently, potentially including cost-benefit ratios and alternative programming approaches
  • Relevance: the extent to which the project’s objectives and activities are consistent with the needs and priorities of the target participants, the policies, and the broader context.
  • Impact: the positive or/and negative, intended or/and unintended, long-term effects of the project on the project participants and the community.

3.3 Evaluation Questions

Effectiveness:

To what extent has the project achieved its expected outcomes, including results on different societal level (among children and youth, at community-level and in relation to expected results on a system and policy level)?

To what extent has the project contributed to partner civil society organisation’s increased capacity and organisational development?

To what extent has PI CSS aligned with Plan Internationals partnership principles as described in The Building Better Partnerships guidance[1]?

Efficiency:

To what extent has the project delivered results in a timely and cost-efficient manner?

Sustainability:

Is their evidence of that the benefits of the programme will last after the project is finished?

Relevance: To what extent has the project and its approaches suited to the priorities and policies of the people and communities it intended to benefit? What extent did the interventions achieve the intended impact?

Impact: To what extent did the project achieve the intended outcomes as well as the broader goal and impact of the project? What were the unintended or unexpected outcomes and impacts of the project, both positive and negative?

3.4 Child rights, gender and inclusion

To what extent has the overall project activities applied gender transformative approaches, and explicitly contributed to gender equality results that improve the rights of girls, boys and young people in all their diversity?
Questions based on the six elements of gender transformative change:

  • Has the programme adhered to Plan’s gender transformative approach (six elements of gender transformative approach) in its application and achieved its goal of being gender transformative?
  • Evaluate if there has been change of norms and attitudes which is aligned with the gender transformative approach (focused on six elements of gender transformative approach)?
  • What root causes of gender inequality/ gender and social norms related to the programme’s thematic focus that have been tackled? (Element 1)
  • How has the programme improved girls/ young women agency (knowledge, confidence, ability, empowering, and lead action) to challenge and influencing others for gender equality and inclusion? (Element 2)
  • How has the programme worked with men and boys to change the patriarchal norms and promote positive masculinities toward gender equality? (Element 3)
  • How has the programme improved equality conditions (well-being, equal resources, and opportunities) and position (social stature, equal value, respect and access to power of decision making) of girls/ young women in all their diversity? (Element 4)
  • How have the programme worked with diversity and taken an intersectional lens to engaging with girls, women, boys and men in all their diversity for change in particular, ethnic minorities, indigenous groups, people with disabilities and LGBTIQ+? (Element 5)
  • How has the programme created a more “enabling environment” (Element 6) and strengthened societal structures, systems, engaged duty-bearers and NGOs partners to enable gender equality across the different stakeholder groups of individuals, community, civil society, service provider, and policy makers? What efforts did the programme make to improve policies and budget allocations that enable gender equality and inclusion?

4. Users of the Evaluation

The intended users of the endline data are Plan International Zambia, Plan International National Offices, CSO partners and the Swedish International Development Cooperation Agency (Sida). The endline study will set the benchmark for future programming around CSO strengthening and promotion of a safe and secure environment for children and young people.

5. Methods for Data Collection and Analysis

Approach and Design

Both Qualitative and Quantitative approaches will be followed. In the quantitative approach, a descriptive survey design will be used and surveys will describe systematically and accurately the facts and characteristics of sample and thematic area of interest (child protection, child participation, ASRHR as well as Governance). Information will be collected through one-to-one administered questionnaires.

In the qualitative approach data will be collected using focus group discussions, Interviews and close observations. This approach will be used to gain a rich, detailed understanding and validate the quantitative information.  Desk review of the Gender Transformative Marker (GTM tool) updated at design, implementation and Results stages will be used to complement analysis of both quantitative and qualitative information on Gender Transformation.

Data analysis

The main data analysis test for quantitative data will be descriptive disaggregated statistics and content analysis for qualitative data. Frequency distribution tables and graphs, means (standard deviations) and cross tabulations will be used to describe the pattern and distribution of the variables (indicators) of interest.

Content analysis will be used to quantify and analyse the presence, meanings and relationships of certain words, themes, or concepts from the interviews and focus group discussions.

5.1 Sample

Quantitative Sample

A sample size of 718 households split in 12 wards will be reached through one-to- one mobile aided household surveys.

Qualitative Sample

Data will be collected from right holders, primary duty bearers and secondary duty bearers through focus group discussions and informant interviews.

5.2 Participant selection and recruitment

Selecting Qualitative participants

At each 12th and 4th house, one respondent aged either 10-18 or 20-24 years will be interviewed. If at a selected household, no one meets the inclusion criteria, that household will be skipped until the required sample size is obtained.

At each household, the enumerator will introduce him/herself, explain the purpose of the study, seek consent for children (anyone below 18 years) respondents and invite respondents to voluntarily participate. Those who agree will sign an informed consent/assent before data is collected. Ethical and child safeguarding policy will be explained and adhered to.

Selecting Qualitative participants

The three groups will be selected because of the different roles they play in exercising, and or promoting a safe and secure environment for children and young people.

Right holders –They include children (10-18) and young adults (20-24). These will be selected because they are the legal entity or persons with rights and are supposed to exercise the rights in accordance with regulations and laws.

Primary duty bearers – these are forefront officers who work to promote a safe and secure environment for children and young people. These include, police officers, social workers, adolescent health officers etc.

Secondary duty bearers – these are auxiliary officers or persons who support promoting safe and secure environment by creating enabling environments. These include parents, CSOs, policy makers etc.

6. Ethics and Child Protection

The consultant and research team shall comply with Plan International’s Global Policy on Safeguarding: Say Yes to Keeping Children and Programme Participants Safe and Protected, Preventing Sexual Harassment, Exploitation and Abuse (PSHEA) Policy, Code of Conduct and other required policies.

The consultant and research team must sign the Safeguarding Policy Acknowledgement Form and commit to adhere to the contents of the Safeguarding Policy, PSHEA Policy and Code of Conduct during the course of conducting and reporting on the endline. The consultant and research team should also ensure that participants give their consent to participate. It is Plan International’s duty and responsibility to protect from harm and abuse children and programme participants who come into contact with Plan International employees, volunteers, partner organizations, individuals including consultants who are working on behalf of Plan International.

Plan International is committed to ensuring that the rights of those participating in data collection or analysis are respected and protected, in accordance with Framework for Ethical MERL and our Global Policy on Safeguarding Children and Young People. All applicants should include details in their proposal on how they will ensure ethics and safeguarding in the data collection process. Specifically, the consultant(s) shall explain how appropriate, safe, non-discriminatory participation of all stakeholders will be ensured and how special attention will be paid to the needs of children and other vulnerable groups. The consultant(s) shall also explain how confidentiality and anonymity of participants will be guaranteed. The consultant is expected to seek consent from respondents before taking interview, conducting focus group discussions and taking photographs and ask if their photographs, verbatim or case stories could be used in reports and for public dissemination. Such consent must be documented and submitted to Plan International Zambia along with the final report and ethical approval.

7. Key Deliverables

The following deliverables are expected from the consultant:

a) Inception Report: The consultant shall submit an inception report after signing of the agreement detailing on the survey methods, tools and work plan. The ethical approval should be taken by the consultant from authentic institution. Further it should include following as well;

  • Develop evaluation plan (brief concept) includes problem statement, research questions, conceptual frame of the research;
  • Develop final evaluation plan which includes introduction, literature review and methodology including sample districts/communities;
  • Prepare schedule for data collection with time frame for the entire period of evaluation,

b) Draft report for review and input from partners and Plan International,

c) Presentation of the key findings to the Plan International Zambia, Plan International Sweden and CSO partners.

d) Final report. The consultant shall submit a final report in both hard copies and electronic copies along with all data (in Excel or SPSS compatible formats), transcripts of the FGDs, KIIs, photographs and ethical approval etc. The draft report is expected from the consultant before final report. The report will be written in English language and must be comprehensive. All data presented should be disaggregated by age disability e.t.c as required for all indicators evaluated. Reference will be cited after each important facts and figures. The final report should be edited by professionals incorporating all comments and corrections if any. Completed checklists, questionnaires, case stories, quotes, photos have to be submitted to Plan International Zambia.

i. Deliverable

Inception Report

Format
Word document
Length
Max. 15 pages
Detail

Inception report shall include;

  • Evaluation plan
  • an updated timeline;
  • detailed methodology, including draft sampling methodology and size;
  • draft data collection tools;
  • ethical considerations;
  • consent forms for any primary data collection;
  • (draft) methods for data analysis;

brief justification of the methods and techniques used (including relevant underlying values and assumptions/ theories) with a justification of the selections made (e.g. of persons interviewed).

ii. Deliverable
Draft Endline Report

Format
Word Document
Length
Max 40 pages starting with Context analysis and ending with recommendations (excluding executive summary)
Detail
Including an Indicator Tracking Table with baseline and end line data inserted. Disaggregated data by age (10-14yrs,15-18yrs,19-24 yrs), disability, etc. and Statistical data presented in both percentage & number.

iii. Deliverable
Final Evaluation Report (including executive summary, context analysis)

Format
Word Document
Length
Max 40 pages starting with Context analysis and ending with recommendations (excluding executive summary)
Detail

iv. Deliverable
Final Data Collection Tools

Detail

v. Deliverable
Cleaned Data (including transcripts)

Detail
(including data files (e.g. Excel, SPSS), transcripts of qualitative data, syntax/ code books etc.)

vi. Deliverable
Completed Consent Forms

vii. Deliverable
Other Communication Products for Dissemination

8. Timeline

The assignment is to be undertaken within 65 days.

9. Budget

The consultant should submit the total budget in the proposal with detailed breakdown that cover all related costs for the endline study. Thirty percent of the contract amount will be paid in advance after signing of the agreement and remaining Seventy percent amount will be paid after submission of the final report.

Milestone
Amount to be Paid (%)
i
Upon contract signature
30%
ii
Upon submitting the final report
70%
10

Expected Qualifications

The endline study will be conducted by highly qualified independent external consultant(s). The consultant will have the overall responsibility for delivery of a quality review report in accordance with norms and standards for evaluation acceptable internationally.

The following are expected requirements of the consultant:

  • The consultant(s) should have proven and extensive experience in carrying out institutional, capacity development programme and project evaluations and have working experience and/or solid technical knowledge of non-governmental organizations
  • Master’s Degree in Social Sciences, a PhD will be an added advantage.
  • The consultant and/or team members must have a strong background in conducting research on Child Protection, Reproductive Health Rights, Gender and Disability Inclusion.
  • The consultant should have the ability to present credible evidence of findings, conclusions and recommendations.
  • Proper understanding of rigorous research designs including evidenced experience in conducting gender sensitive participatory qualitative and quantitative studies involving multiple locations, respondents and processes.
  • Fluency and exceptional drafting/ reporting skills in English is required.
  • Experience in the formulation, monitoring and strategy reviews.
  • High level of professionalism and an ability to work independently and in high-pressure situations under tight deadlines.
  • The consultant must have recent and relevant work experience in developing countries in the past 3 years including Zambia and be familiar with the cultural background of communities where the project was implemented.
  • Demonstrate experience with community development approaches; gender responsive participatory methodologies, advocacy, disability inclusion, environmental protection, and child participation.
  • Demonstrates meeting all legal requirements.
  • Copy of the latest completed assignment with contactable references.

11. Applications

The consultant shall prepare both the “Technical” and “Financial” Proposal to include the following:

  • Detailed response to the TOR (In the cover letter of the proposal, the offeror must have to mention “How did they know about this Request for Proposal” e.g. either through website or other means
  • Proposed methodology
  • Ethics and child safeguarding approaches, including any identified risks and associated mitigation strategies.
  • Proposed timelines.

CVs

  • Example of previous work with contact details of reference.
  • Detailed budget, including daily fee rates, expenses, etc.
  • Police Certificates of Good Conduct

12. How to Apply

Please send your bid applications to [email protected] and cc [email protected], By 17:00hrs, 16th April, 2024 local time referencing “Endline evaluation for the “Strengthening civil society organisations (CSOs) for the promotion of a safe and secure environment for children and young people project” in the subject line. Any bids received after this time and date will not be accepted.

NB: All successful applicants will receive notifications within 07 days from closure of Tender.

To apply for this job email your details to Planzamtenders@plan-international.org


* Legitimate employers do not ask for payment. Find out more at safe job search tips.