Website Oxfam
Reports to
MEL Officer, Oxfam Canada
1. Introduction to Project
Oxfam Canada is an affiliate of the international Oxfam Confederation, networked in over 90 countries as part of a global movement for change. Our mission is to build lasting solutions to poverty and injustice with a focus on improving the lives and promoting the rights of women and girls. We work directly with communities, partners and women’s rights organizations (WROs) to challenge the systems that perpetuate inequality and keep people poor.
Oxfam Canada’s Her Future Her Choice (HFHC) project is a Sexual and Reproductive Health and Rights (SRHR) project funded by Government of Canada. HFHC is a response to gender inequality and women’s rights violations in four countries in East and Southern Africa. With an ultimate outcome of improved SRHR for adolescent girls and young women (AGYW) in targeted districts of Ethiopia, Malawi, Mozambique, and Zambia, the project directly addresses barriers that hinder access to SRHR in program communities. These barriers include harmful social norms, traditional practices, and taboos about gender and sexuality; lack of access to sexual and reproductive health (SRH) information and services; and AGYW’s lack of meaningful decision-making power regarding their health and sexuality. In addressing these areas, HFHC contributes to transforming gender inequality and discrimination, which are foundational to these barriers.
During its 4.75-year duration (March 2019 to November 2023), HFHC aims to reach approximately 240,000 direct beneficiaries in 10 districts in Ethiopia, Malawi, Mozambique, and Zambia, and an additional 1,400 direct beneficiaries through activities in Canada. Oxfam and its partners (Pathfinder International, Action Canada for Sexual Health and Rights, and nine CSOs and 2 WROs in the four countries) seek to improve comprehensive SRHR for AGYW through three strategic pillars, each corresponding to one of HFHC’s expected intermediate outcomes:
Pillar 1: Engage AGYW and community members (women, men, boys, influencers) to understand and transform discriminatory social norms, enabling AGYW to exercise more meaningful decision-making power regarding their SRHR. This pillar seeks to promote the uptake or “demand” for SRH information and services by transforming negative social norms through awareness-raising and positive behavior modeling, strengthening linkages and referrals for SRH services, working with schools, and supporting the creation of community-based youth friendly spaces for SRHR peer dialogue and information sharing.
Pillar 2: Strengthen knowledge and capacity of health providers and healthcare facilities to improve the provision of comprehensive SRH information and services. This pillar seeks to address the “supply” of comprehensive SRH information and services, including access to contraceptives, safe abortion (where legal), and post-abortion care and secondary prevention services for Gender-based Violence (GBV). The project aims to achieve this by training health facility service providers in delivering gender-responsive and youth-friendly services free from stigma and discrimination; strengthening health system management capacity, governance structures, and quality improvement practices; community outreach; and supporting supply-chain management of SRH commodities.
Pillar 3: Promote change in SRHR policy frameworks through strengthening the capacity of local and Canadian WROs and YLOs to influence change. This pillar will support partners in research, knowledge exchange, collaboration, and innovation on SRHR, and promote public engagement and mobilization on global and domestic SRHR issues.
2. Introduction to Project Midterm Evaluation
The midterm evaluation for HFHC project will be conducted during the third year of project implementation. The third year of the project is from 1st April 2021 till 31st March 2022. The midterm evaluation is divided into two components: 1/ midline survey, and 2/ midterm review. This Terms of Reference (ToR) document is about the midterm review. The data collection, analysis and report writing for the midline survey will be conducted separate to the midterm review, with its own consultant. Below is a brief overview of the midline survey for informational purposes.
The objective of the midline survey is to fulfill project monitoring and evaluation needs. The data will establish a midline value and track project progress towards outcome indicators that are in the project Performance Measurement Framework (PMF). The following are some of the key resources used to develop the survey tool:
- Measure evaluation’s Family Planning and Reproductive Health Indicators,
- Global Affairs Canada’s Sexual and Reproductive Health and Rights indicators,
- Coverage Survey developed by the Real Accountability Data Analysis for Results (RADAR) project team at John Hopkins Bloomberg School of Public Health.
- Oxfam Canada’s pilot Community Attitude Index.
The respondents for the midline survey will be members from the communities where HFHC project is being implemented.
The results from the midline survey will be a component of the midterm review since as part of the midterm review the project teams will review the baseline vs. midline results and evaluate the progress made towards the project’s outcome(s).
3. Objective of Midterm Review
The overall objective of the midterm review is to help better monitor, learn from and improve the project implementation.
- To assess the project’s progress on achieving outcomes, keeping in mind the project’s Theory of Change and Logic Model;
- To incorporate identification and tracking of outcomes into ongoing project monitoring;
- To identify any implementation gaps, and where possible opportunities for course correction;
- To identify project learnings;
- Facilitate cross-partner and cross-country exchange of experiences and learnings;
- To assess the effectiveness of the Monitoring and Evaluation Strategy, in particular measurement methodologies and tools;
- To identify effective implementation practices and/or strategy from the project that promote SRHR. In particular, practices and/or strategies that respond to local SRHR needs during the COVID-19 pandemic.
4. Approach to Midterm Review
Oxfam Canada intends to use a transformative gender lens throughout the midterm review. As part of our work to achieve gender justice, Oxfam Canada seeks to apply Feminist Principles to Monitoring, Evaluation, Accountability and Learning (MEAL). Central to our understanding of feminist MEAL is a recognition of how transformative change in unequal gender and power relations are complex and nonlinear. As such, we prioritize the following seven key foundations:
- Understanding feminist MEAL as an approach,
- Positioning MEAL as an integral part of social transformation,
- Shifting power to participants in evaluations,
- Understanding the role of the evaluator as a facilitator,
- Valuing collective, context-driven knowledge generation,
- Providing a learning orientation to evaluative exercises,
- Rooting feminist MEAL is safe programming, guided by ‘do no harm’.
The expectation is that the consultant will act as facilitator(s) throughout the review.
5. Scope and Methodology
The midterm review and its outputs will help in improving project’s performance and progress towards achieving outcomes during the remainder of the project. The primary audience is internal, namely: Oxfam Canada, Global Affairs Canada (the donor), Regional and Country Oxfam and Implementing partners.
Oxfam Canada is looking to use outcome harvesting for the midterm review. Along with outcome harvesting, the midterm review may include elements of other methodologies as per requirement such as outcome mapping, most significant change, contribution analysis and process evaluation. The consultant should explicitly specify in the proposal the methodology/methodologies that will be used for the midterm review.
Proposals specifying a methodology other than outcome harvesting are welcomed. The team is open to other creative ideas/methodologies.
Irrespective of the methodology, the midterm review must align as much as possible with Global Affairs Canada’s (GAC) results-based management framework such as Theory of Change, Logic Model and PMF.
GAC results-based management guide can be found in the following link:
6. Data Collection Methodology
The midterm review will include documentation review, interviews and group discussions with project staff. Due to COVID-19, data collection will happen remotely unless the chosen Consultant is based in one of the project countries and local guidelines allow for in-person data collection in that country. The primary participants in the review will be project staff. If feasible, project beneficiaries (i.e. community members) may be included. Use of quantitative method such as a survey is optional. The final data collection tools will be designed by the consultant in collaboration with key stakeholders.
Documentation review
The consultant will be reviewing at minimum the following documents. The document review will inform the initial outcome harvest, and the design of the midterm review data collection tools:
- HFHC Project Implementation Plan (PIP) – this document includes the PMF and project Theory of Change
- HFHC Baseline study report
- HFHC Year 1 and Year 2 Semi-Annual and Annual reports
- HFHC Health Facility and Quality of Care Baseline study report
- HFHC midline survey report o Midline survey is a component of the project midterm evaluation (see section 2. Introduction to Project Midterm Evaluation). The data collection, analysis and report writing for this midline survey will not be part of this TOR.
- The results and learnings from the midline survey (comparing to baseline to midline) will be a component of the midterm review. The consultant hired for the midterm review will be expected to familiarize themselves with the baseline and midline survey results, and incorporate it into the midterm review. Oxfam Canada’s project MEL Officer will support the Consultant on this task.
- Country specific national policies, guidelines etc. Such as national policy on adolescent sexual and reproductive health. (Some of these documents will be provided by Oxfam team. However, the consultant will need to do their own desk review to identify additional documents).
- Per country Information, Education, and Communication (IEC) material, training manuals, campaign material and such that have been developed by the project.
Qualitative Data Collection
The participants for the midterm review will be Oxfam and Implementing partners’ staff. The consultant will be responsible for training the participants on the evaluation methodology, qualitative data collection, analysis and validation. As mentioned above under Introduction to Project, the project is made up of 3 strategic pillars. Within each country setting there is a team (Oxfam + 1 or 2 implementing partner) responsible for one or more strategic pillars (aka Pillar 1, Pillar 2 and Pillar 3). Peer review across teams will be an important element for data collection, analysis and validation. The peer review approach is focused on promoting cross-partner and cross-country exchange of learnings.
Data collection will be done remotely, unless the chosen Consultant is based in one of the project countries and local guidelines allow for in-person data collection in that country. The expectation is that the consultant will pick a digital communication tool that is accessible for Oxfam and Implementing partners. Some of the options include regular phone call, Signal, MS Teams, Facebook, Miro, Mural and Zoom. The Consultant will need to build in time to allow for the teams to familiarize themselves with the digital communication tool.
The selected consultant must ensure that data collection can accommodate the local languages of each country context. At minimum, the consultant should be able to conduct the midterm review in Portuguese since majority of the review in Mozambique will take place in Portuguese. Added advantage if the consultant is able to conduct the review in Amharic and Chichewa. The consultant will be responsible for finding translators and budgeting for translation.
It is important to keep in mind that at times network connectivity will likely pose an issue. Meetings may need to be rescheduled to a different time in some scenarios. The consultant should plan accordingly and budget for delays with respect to remote data collection.
7. Key Review Questions
The following are draft review questions to be answered by the midterm review. It is important that Oxfam and Implementing partners see value in the review questions. Hence, the consultant will further refine the review questions based on in-depth consultations with Oxfam and Implementing partners.
Key review questions regarding project Theory of Change:
1. To what extent are HFHC project general principles being applied in project planning and implementation?
2. Do the assumptions, strategies and drivers of change as per the Theory of Change continue to hold true? Is there a change in the local context or project learnings that support or contradict the Theory of Change? (Note – The consultant will conduct an orientation to the Theory of Change for the midterm review participants).
3. Do the outcomes or changes achieved thus far in the project align with the Theory of Change? Is there a need to change parts of the Theory of Change? If yes, what are the changes based on implementation learnings?
Key review questions regarding project progress on outcomes:
1. What outcomes or changes in the key stakeholders (aka drivers of change as laid out in Theory of Change OR boundary partners OR social actors) have been achieved thus far?
2. What is the project’s type and level of contribution to the outcomes or changes seen thus far in the key stakeholders (aka drivers of change as laid out in Theory of Change OR boundary partners OR social actors)? How does this compare to the level of effort in implementation?
3. Is there a gap in the number and extent of outcomes or changes achieved across the key stakeholders (aka drivers of change as laid out in Theory of Change OR boundary partners or social actors) or project strategic pillars (aka Pillar 1, Pillar 2 and Pillar 3)?
4. Based on inter-country and intra-country comparison, what are the common or diverging ideas or beliefs in relation to women/girl’s autonomy, women/girls’ rights, SRHR and intersectionality held by Oxfam in Country teams, implementing partners and people we work with? How are they promoted in IEC material, training manual, campaign, advocacy messaging and overall? If there are outliers, then what are they? How have the outliers influenced project implementation and strategy?
5. What challenges and setbacks are being faced by the implementing teams? What are the strategies being developed to address these hurdles?
Key review questions regarding project monitoring:
1. What are the key progress markers across key stakeholders (aka drivers of change as laid out in Theory of Change OR boundary partners or social actors) that can be used for project monitoring? (Note – developing progress markers will help monitor the project’s progress towards achieving outcomes (in alignment with outcome mapping methodology). This is a useful output of the midterm review. But the consultant must align the progress markers with GAC Logic Model and PMF so as to avoid having multiple methodologies and processes to monitor progress towards outcomes).
2. How and to what extent are project learnings or evidence of outcomes achieved is being captured, disseminated and incorporated into adapting the project?
3. What are common strengths and weaknesses in the Monitoring, Evaluation and Learning plan for the project? How to overcome these moving forward?
Key review questions regarding project learnings:
1. What are some of the effective implementation strategies or practices that can serve as lessons or guidance for other HFHC partners?
2. What can be learned about the enabling factors and other conditions that contributed to successful implementation in some contexts /communities over others?
Key review questions regarding institutional capacity and sustainability
1. How is the project and its learnings supporting Oxfam Canada, Oxfam in Country and Implementing partners’ institutional capacity to design and/or implement SRHR programs?
2. What are some of the key technical support the implementing teams require to support them to design and/or implement SRHR programs? What kind of capacity strengthening can be undertaken in the remainder of the project?
8. Building Capacity
Evaluation methodology
It is important that Oxfam and Implementing partners are trained on the methodology used in the midterm review. The consultant will do a short, but effective, training on the methodology as part of this consultancy.
Project Theory of Change
The project Theory of Change is a component to be included in the midterm review. It is critical that the consultant accounts for orienting Oxfam and Implementing partner staff to the project Theory of Change.
Data collection, analysis and validation
It is important that the data analysis and results are of value to Oxfam and Implementing partners.
Hence, it is important the participants play an active role in data collection, analysis and validation.
Within each Peer group, one or more focal point persons will be identified who will be trained by the consultant on data collection, analysis and validation. However, the consultant will be the final person accountable for the data analysis, collaborative sense making with the participants, and report writing.
9. Key Activities and Deliverables
Along with reports, this Consultant will work with Oxfam and Implementing teams to produce useful knowledge product(s). The decision on the type of knowledge product will be made in collaboration between consultant, Oxfam and Implementing partners. This assignment is expected to be executed between May and December 2021. The Consultant will develop a schedule of works detailing key activities, milestones and deliverables with the guide of the MEL Officer, Oxfam Canada.
10. Consultant Profile
This ToR is aiming to find one consultant or a team of consultants who will manage the entire midterm review design, data collection, analysis, report writing and knowledge product generation. If a team of consultants are applying for this ToR, it is essential to identify the Lead Consultant in the proposal.
Ideally, the consultant(s) will have extensive geographic experience and language requirements specific to Ethiopia, Malawi, Mozambique, Zambia and Canada. In case the consultant(s) cannot meet the language requirements, the consultant will be responsible for hiring translators to support data collection activities. Depending on the methodology, the translators may also need to do the data collection.
Profile of Consultant(s)
- 3 – 5 years experience designing and leading multi-country project evaluations. Added asset if the experiences were focused on SRHR;
- 1 – 3 years experience leading evaluations that used outcome harvesting/outcome mapping/most significant change or a similar methodology;
- Experience implementing/incorporating feminist MEAL into evaluation work;
- Ability to facilitate a participatory approach to data collection and evaluation. Experience doing this type of evaluation remotely will be an added asset;
- Ability to relate to diverse stakeholder groups;
- Proven ability to design qualitative and quantitative data collection tools, and conduct data analysis;
- Expertise in qualitative data analysis and tools such as NVivo, Atlas etc.;
- Proven ability to build capacity among evaluation participants so that the participants can actively participate in data collection, analysis and validation;
- Strong written, verbal communication and presentation skills in English;
- Added asset if consultant(s) can communicate in any of the following local languages namely: Portuguese in Mozambique, Amharic in Ethiopia and Chichewa in Malawi.
11. Submission and Evaluation of Proposals
Consultants meeting the above profile criteria are invited to submit a proposal by email to [email protected] with the subject line: “Proposal for HFHC Midterm Review Consultant”. Proposals should be received no later than 16th April 2021.
The proposal should include the following:
- Cover letter – no more than 4 pages, font size 12, single space o Cover letter should provide concrete and detailed examples that clearly demonstrate that the consultant(s) meet the criteria listed above under the Profile of Consultant(s).
- Include 2 references in the cover letter
- Include a statement confirming acceptance of the following requirement – The consultant shall acquire and maintain appropriate insurance at his/her own expense. The insurance must be in place within 5 days of the signature of the final Contract for the duration of the period of the Contract.
- CV of consultant(s) – ensure that the CV is no more than 3 pages per team member, font size 12, single space
- Outline of the proposed midterm review – no more than 5 pages (proposals may be discarded if the outline submitted exceeds the page limit) o Consultant should clearly outline the methodology. If the consultant is proposing a methodology other than outcome harvesting, please provide an explanation of how the proposed methodology aligns with the review questions and objective.
- Consultant should use this space to demonstrate understanding of the methodology. Please do not simply copy and paste sections from the ToR.
- Consultant should use this space to provide some insights or learnings or suggestions that would demonstrate technical skill to conduct the midterm review.
- Sections to cover in this outline:
Methodology
Why/how the methodology aligns with the midterm review objective/review questions?
- Data collection methodology
- Data analysis and validation
- Strategies to build capacity among midterm review participants
- Challenges and contingencies
- Other relevant information
Budget breakdown
- Please provide a detailed breakdown of all the costs (ex. translation)
- In terms of consultant/human resource cost, please provide cost per day. If a team is applying, provide cost per day per consultant.
- Provide budget breakdown in Canadian Dollars reflecting maximum of 60 days Level of Effort
Sample of previous work
- Ideally the sample evaluation/study would be one that used the same methodology which is being proposed for the midterm review. Otherwise, previous work that demonstrates experience in feminist / participatory evaluation are welcomed.
- Added asset if the example is of a multi-country project evaluation.