End of Project Evaluation

  • Consultancy
  • Lusaka, Zambia
  • Applications have closed

Young Women's Christian Association (YWCA) Council of Zambia

Introduction:

Y Care International (YCI) and Zambia YWCA are implementing a slum upgrading and development project in Linda and George compounds, Lusaka, Zambia, fully funded by Comic Relief. The project is part of the ‘4 cities initiative’, an initiative by Comic Relief to share knowledge and learning around various aspects of slum upgrading and development by organisations in Lusaka, Freetown, Kampala and Cape Town.

Project Overview:

The project outcomes are:

  1. Young women have increased emotional resilience, improved economic security and have greater influence in their families and informal settlements
  2. Service providers are more accountable and accessible to GBV survivors or young women at risk of GBV
  3. Young women enjoy more equal gender relations within families and communities who reject all forms of GBV
  4. CSOs have increased capacity to respond to the needs and rights of young women and survivors of GBV

The project set out to reach over 4,000 beneficiaries directly, including young women (at risk of becoming) survivors of GBV; young men (at risk of becoming) perpetrators of GBV, and their community and household members. In addition, the project aimed to reach 19,000 indirect beneficiaries: law enforcement agencies, mobile legal clinic workers, staff of CSO/CBOs working in Linda and George slums, and community members.

Purpose of the Evaluation:

The key objective of this evaluation is to gather and analyse primary and secondary data on project participant groups to assess the four above stated outcomes of the project and generate lessons and recommendations that can be used in the design and implementation of similar interventions in Zambia and elsewhere in the future.

The evaluation will be designed to allow measurement of the extent to which the project has contributed to the socio-economic empowerment of 4,000 beneficiaries including young women (at risk of becoming) survivors of GBV; young men (at risk of becoming) perpetrators of GBV, and their community and household members. The consultant is expected to construct counterfactuals from the baseline values and if that is not possible then using methods that could construct counterfactuals.

If data and time permits, the evaluation is also expected to assess the Value for Money of different economic activities adopted by young people.

Use of the evaluation findings:

We will use the information generated through this evaluation to:

  • Help the Zambia YWCA, WLSA and Y Care International to plan and design future work in Zambia;
  • Improve our knowledge on what works/doesn’t work for young women and men in relation to enterprise and employability, tackling GBV, youth advocacy, slums development and collaboration of grassroots organisations in slums;
  • Report to project participants, stakeholders and donors on what has been achieved through the project life and how;
  • Understand best practice in adaptive project management

Stakeholders of the evaluation:

Project participants, Comic Relief, Y Care International, YWCA Zambia, WLSA Zambia, Vocational Trainers and the Community Steering Group (CSG), Ward Development Committee, Service Providers ( Zambia Police, Health Workers – Neighbourhood Health Committee, Ministry of Education, Community Based Organisations (Youth Action Zambia, Youth for Change, Family Builders, Venture of Mercy), Community Structures (churches, Catholic Commission for Justices and Peace) and Tiyende Pamodzi Partners (Water and Sanitation, Care International, People Process on Housing and Poverty)

Scope, Focus and Evaluation Criteria

The end of project evaluation should focus on identifying and assessing the changes brought about through the project and should be assessed in line with the OECD DAC Criteria: Relevant, Impact, Effectiveness, Efficiency, Sustainability and additional YCI criteria including gender, partnerships, participation and disaster risk reduction.

It is advisable to divide lessons learnt into project, sector and broader developmental lessons. Where possible, combine these lessons with action-oriented and specific recommendations that can be taken forward by Y Care International and its partners. Suggestions for effective ways of disseminating results and learning within YWCA Zambia and beyond should also be included.

We are specifically interested in learning more in the following areas:

  • The project’s responsiveness and adaptability given the multiple levels of vulnerability (e.g., poor health, education, sanitation, poverty);
  • Do young people feel empowered to have the power and ability to create change/impact at policy level?
  • The relationship between increase/decrease in gender-based violence (if any) and economic empowerment either at individual or community level.

Verification and Validation of Monitoring Data

The Consultant(s) should review, test and verify the quality of the monitoring data provided by Zambia YWCA in line with a sample of the project indicators to confirm the accuracy and quality of the data. The consultant(s) will be provided with the indicators and data to test.

Note: All data collected is to be disaggregated by men, women, boys and girls and people with disabilities.

The impact survey is expected to include the Washington Group disability questions.

Evaluation Process and Methodology

The Consultant(s) will take mainly a mixed methods approach to this evaluation which will be agreed and finalised with Zambia YWCA and YCI at the Inception Report stage. The end of project evaluation should focus on a participatory methodology whereby the work engages all key stakeholders including beneficiaries, family and community members, CBOs, local decision makers and the Zambia YWCA.

The sampling strategy, including the total sample size, will be confirmed at the time of the Inception Report, using information or estimates on the population’s statistical characteristics (e.g., their levels of income, literacy, etc.) with representation of both men and women in the communities. The consultant is required to propose an appropriate sampling strategy in the Inception Report. The consultant should provide a justification for the sampling strategy including the power calculation that lead to determine the sample sizes. Risk of spill overs effects and contamination, as well as potential biases that could occur while targeting marginal groups must be taken into due account in the sampling phase and discussed in the technical proposal.

All evaluation tools should be based on a thorough review of relevant literature and existing data, including the baseline, mid-term and end of project workshop.

To ensure that the evaluation process is conducted in a participatory and representative manner, the process will involve both direct and indirect beneficiaries including:

  • Direct beneficiaries (young women and young men) of the vulnerabilities reached by the project
  • Family and household members of direct beneficiaries
  • Young Business Coaches
  • CBOs that have been involved in the implementation of the project
  • Local and elected leadership of Linda and George compounds
  • Relevant Ministries and Local Government Departments
  • Y Care International, Zambia YWCA and WLSA staff and volunteers, who have been directly involved in the implementation and monitoring of the project

Geographical Locations:

The Consultant(s) must visit the locations, Linda and George compounds, and sample from within these areas.

Timelines and Deliverables

The timeframe allocated to the end of project evaluation process is between 20 to 25 days, covering design and finalisation of methodology and tools, data collection and analysis, and preparing and finalising the report.

The Consultant(s) must share a work plan with the three partners for approval before the field work commences. The process should ideally start week beginning 21 January 2019, but this is dependent on the Ethical Clearance in the country. A first draft report should be submitted to the two partners no later than two weeks after all field work is completed. The deadline will be agreed on selection of the Consultant(s) however, it is expected that this process is completed by March 11, 2019.

The consultant will be expected to update the two partners on progress of the evaluation on a weekly basis and highlight any challenges or delays faced as soon as they are aware of them.

The final timeline can be confirmed with the two partners at the inception meeting depending on the proposed methodology and work plan. Below is an indicative list of actions to be completed within the evaluation:

  • Initial project document review
  • Desk review of available monitoring data from YWCA
  • Development of methodology and tools for data collection
  • Agreement and finalisation of tools with three partners
  • Training of enumerators
  • Field data collection
  • Data entry and analysis of qualitative data
  • Quantitative Data collation, cleaning and analysis of data.
  • Validation workshop with team and key stakeholders
  • Preparation and submission of the Draft Report
  • Review and feedback from three partners
  • Finalisation of report

Deliverables

  1. Inception Report with detailed work plan, methodology and tools.
  2. Report: A draft report should be submitted to Zambia YWCA and Y Care International electronically in Microsoft Word format. The report should be no longer than 30 pages excluding cover page, table of contents, summary and appendices.
  3. Appendices should include: work schedule of evaluation team; list of key informants interviewed; examples of evaluation tools used; minimum of 4 case studies & photos of beneficiaries; and photos of key project sites. Y Care International will provide a template for the report.

The report will not be considered final until approved by Zambia YWCA and Y Care International.

All deliverables are to be in English.

Roles and Responsibilities

Zambia YWCA and Y Care International will recruit a Consultant(s). A consultancy agreement will be signed by all partners and the Consultant(s) clearly outlining specific tasks, roles and responsibilities of all parties. Payment of consultancy fees will be made by Y Care International directly to the Consultant(s).

Roles and responsibilities of the Consultant(s):

  1. To adequately prepare for the field work by reading background information and conducting desk research.
  2. To work with the implementing and technical partners to finalise the methodology of the evaluation
  3. To conduct the field work, in line with the agreed methodology.
  4. To upload and store electronically all data collected during the exercise.
  5. To analyse the findings of the evaluation and produce a report in line with this TOR and within the agreed deadline.
  6. To share the draft report with Zambia YWCA and Y Care International for review and feedback prior to finalisation.

Roles and responsibilities of Zambia YWCA:

  1. To recruit an appropriate Consultant(s) in close coordination with Y Care International
  2. To sign a consultancy contract with the Consultant(s) and Y Care International
  3. To review the tools and methodology designed by Y Care International and the Consultant(s) and provide feedback prior to finalisation.
  4. To provide the Consultant(s) with relevant project documentation as stated in the Consultancy Agreement
  5. To accompany the Consultant(s) during the field work in each of the locations, provide logistical support and enable him/her to access beneficiaries and stakeholders.
  6. To provide feedback on the Consultant(s)’s draft report.

Roles and responsibilities of Y Care International:

  1. To recruit an appropriate Consultant(s) in close coordination with Zambia YWCA
  2. To draft and sign a consultancy contract with the Consultant(s) Zambia YWCA
  3. To draft the tools and methodology with the Consultant(s) and provide feedback prior for finalisation
  4. To provide feedback on the Consultant(s)’s draft report and to approve the final report in line with quality standards.
  5. To pay the consultant(s)

Ethical Considerations

The Consultant(s) will comply with Y Care International’s “Working with Children and Young People Policy and Procedures”, taking particular note of the code of conduct and procedures relating to confidentiality, consent and soliciting information from young people. The Consultant(s) will be expected to sign a statement of commitment to this policy before the start of the consultancy. YWCA Zambia will facilitate the process for Ethical Clearance before the field work either from University of Zambia or EREs consult.

The Consultant(s) must ensure that this evaluation is conducted in an ethical and sensitive manner. Vulnerable children and young people should be protected and potential harm from the research tools, methodology, or researchers should be avoided. The Consultant(s) must ensure:

  • Respondents are respected by the researchers and research tools.
  • They seek informed consent from all respondents.
  • The participation of local community representatives in planning and conducting the survey. Community representatives and researchers can work together to make sure that research is conducted in the most appropriate way.
  • Communities are informed of the research, possible outcomes (positive and negative), and the results of the research.

Budget and Fees

The budget should not exceed USD 10,000 and should include a breakdown of daily rate plus number of days and other costs. YCI reserves the right to withhold payment if the final report does not the meet the requirements of the terms of reference. YCI will pay all fees directly to the Consultant(s). The payments will be as follows:

The payments will be as follows:

  • 50% upon signature of the consultancy agreement
  • 50% upon satisfactory completion of the assignment and presentation of an invoice

YCI reserves the right to withhold payment if the final report does not the meet the requirements of the terms of reference.

YCI further reserves the right to deduct 5% of the payment for each week the report is delayed from the agreed date where there has been no prior agreement with YCI and [Partner].

The Consultant(s) is to submit the invoice for payment to YCI no later than 30 days after completion of the assignment, otherwise it may be disregarded.

Bank charges: Neither YCI nor Zambia YWCA will be responsible for bank charges incurred by the Consultant(s) during funds transfer. YCI will pay the sender’s fees, whereas the Consultant(s) will pay any fees occurring at the receiving end. The tenderer is to specify anticipated reimbursable costs. If per-diem costs are included, they shall be specified separately and follow the thresholds from the Tax Agency (or equivalent).

Qualifications and Experience Required

  • Master’s degree in development studies, Social Studies and/or other related fields,
  • At least five years’ experience in conducting or commissioning development or humanitarian evaluations, preferably in Zambia
  • Excellent evaluation skills including use of participatory appraisal techniques in data collection, sensitive to gender issues.
  • Excellent analysis (both qualitative and quantitative) and report writing skills Strong communication and interpersonal skills especially with vulnerable groups
  • Experience of engaging with a range of external actors, including interacting with senior government officials and NGOs
  • Excellent written and spoken English
  • Ability to travel to and/or within Zambia (if it is an international consultant)
  • Experience of working on youth-focused projects

Application Procedure:

Qualified candidates should submit the following information as part of the initial bid:

  • CV(s) of the evaluation team member(s) (maximum 3 pages per CV)
  • A proposal detailing their experience as per the above criteria, including their proposed plan, suggested sample, time frame and key deliverables for the consultancy work (maximum 5 pages)
  • Detailed budget with breakdown of daily rate plus number of days and other costs. The budget will be evaluated alongside the technical proposal and we reserve the right to make alternative suggestions on costing. The Consultant(s) is responsible for meeting their own subsistence and accommodation costs.
  • Two references from previous clients.
  • An example of a recent/relevant evaluation report. Please share the web link if it is published online.

Applications should be sent to [email protected] and copied to Hur Hassnain [email protected] using reference ZAMBIA EVALUATION in the subject line not later than January 6, 2019. Any queries to the Terms of Reference can be referred to [email protected] by or before January 3rd, 2019.

Please ensure that you mention www.gozambiajobs.com as the source of this job advertisement.

Please note that submissions which do not meet all the above requirements will not be reviewed. Only shortlisted candidates will be contacted.


* Legitimate employers do not ask for payment. Find out more at safe job search tips.