Individual consultancy to evaluate the outcomes of the MMU initiative
UNICEF works in some of the world’s toughest places, to reach the world’s most disadvantaged children. To save their lives. To defend their rights. To help them fulfill their potential.
Across 190 countries and territories, we work for every child, everywhere, every day, to build a better world for everyone.
And we never give up.
For every child, [Equity]
Purpose and Objective:
The consultancy will produce an evaluation report of the outcomes of the Multimedia Mobile Unit initiative in terms of attitudes and practices change, awareness and knowledge level and participation on nutrition, sanitation, HIV, quality education, birth registration and early marriage in selected priority districts from Zambézia and Nampula.
Methodology and Technical Approach:
The evaluation will combine a desk review of relevant and available documentation, reports and data in relation to the intervention, as well as key informant interviews to assess the appropriateness and timing of the evaluation. In particular, the study will be elaborated based on the recent evaluability assessment conducted in 2017. The evaluation checklist will be provided by UNICEF Office and adapted by the consultant as necessary. The results generated by a scored checklist should be seen as an index of difficulty, which then needs to be responded to by program managers and/or evaluators in the evaluation planning phase.
Adherence to ethical standards: All research and evaluations are undertaken or supported by UNICEF that involve primary data collection from human subjects or the analysis of sensitive secondary data must explicitly consider its ethical implications and ensure that the rights and well-being of research subjects are respected throughout the research process. This entails reflection, planning and management of research and its outcomes to ensure that: the benefits of the research are maximized and risks to participants are mitigated; appropriate mechanisms are in place to ensure the privacy of participants and the security of their data; participants are respected through appropriate and informed consent processes; the need for and nature of any payment or compensation is carefully considered; and that there is full disclosure of any conflict of interest.
The research protocol will clearly identify any potential ethical issues and risks, as well as the processes for ethical review and oversight of the research/evaluation/data collection process in their proposal.
Activities and Tasks:
Under the direct supervision of the Communication for Development Specialist, the consultant will take up and complete the following activities and tasks during the course of the assignment, in line with the above objectives:
The main activities and tasks under this consultancy can be grouped as follows:
- Review of programme documentation;
- Complete intervention documentation review, including relevant contracts and progress reports;
- The documentation will be provided by UNICEF and ICS in hard and soft copies. These include but are not limited to:
- ICS Multimedia Mobile Unit Evaluability assessment;
- DCT docs, requests, programme docs;
- Progress reports;
- ICS Strategic Plan and ICS Institutional Assessment.
- Analysis of the information system defined in the programme (or related to the programme) and determination the information needs;
- Availability, relevance, and quality of data, (information system, monitoring system);
- The capacity of systems and staff to deliver what is needed;
- Examine implementation relative to plans;
- Interview with the main stakeholders. In order to complement the documentary analysis and clarify stakeholders’ intentions and expectations, the consultant is expected to conduct few key interviews with different relevant key influencers in Zambezia and Nampula Provinces including:
- ICS Provincial Delegates and programme managers;
- Health District Directorate staff of the selected districts;
- representatives of the assumed beneficiaries at the community level in the selected districts;
- community leaders, teachers, nurses, Community Health Workers, member of Health Committees of the villages reached by the multimedia mobile unit in the selected districts;
- A representative from service providers engaged during the MMU sessions in HIV testing, birth registration, vaccination and nutrition in the selected districts.
- Study design.
- Pre-post interviews with participants of the Multimedia Mobile Units sessions at the community level will be included to better analyze achieved results in terms of practices, knowledge, and participation.
- Pre-intervention interviews will be conducted with community members over 18 years old before an MMU session in two districts of Zambezia and two districts of Nampula. In each district, two localities will be selected, which were not reached by the ICS MMU intervention at least 12 months before;
- Post-intervention interviews will be conducted with the same districts, localities, and individuals 1 week and 4 weeks after the MMU session in the two provinces (Zambezia and Nampula);
- The suggested sample will include 20 community members will be interviewed for each, summing up 20×2 =40 members per district, 80 per province, 160 for the two provinces (160 for pre-intervention and 160 for post-intervention), for a total of 320 people interviewed for the whole study.
The research protocol will clearly identify any potential ethical issues and approaches, as well as the processes for ethical review and oversight of the research/evaluation/data collection process in their proposal.
- Assessing to what extent the intervention is linked to basic services;
- Which services (like HIV counseling and testing, immunization, vitamin A and deworming and birth registration) are offered during a multimedia mobile unit in collaboration with other institutions/NGOs? How consistent is the offer of the services? What are the constraints? What can be done to overcome the constraints?
- If the intervention is relevant in the communities where it has been implemented, considering the available channels of communication (mass media, mid-media, and interpersonal communication)?
- How efficient is the intervention in terms of cost/benefits considering the number of people reached, the frequency of exposure to messages and the costs of the intervention, also comparing the costs of other C4D interventions being implemented by UNICEF, as well as other partners in the same provinces?
- How effective is the intervention in increasing community awareness on child right particularly on HIV, cholera and malaria prevention, promotion of breastfeeding and girl’s education?
- Based on analysis conducted in the field, develop conclusions and make recommendations for the UNICEF Country Office and the Insitute of Social Communication (ICS) on:
- What are the effects on practices in target communities and how they were achieved?
- Which innovations could be considered to improve the sustainability of the expected results in the long term?
- Which measures could be considered to enhance the provision and implementation of the Mobile Units to achieve greater demand for public services?
- Which changes could be introduced in the project’s design and in monitoring and evaluation methods for the Multimedia Mobile Unit intervention
Deliverables and Payments:
Payments will be processed upon acceptance of the corresponding deliverable and against an invoice that will make reference to the contract reference and deliverable number. Payments will be approved by the supervisor.
- Monthly work programme of consultancy including the travel plan;
- Monthly monitoring report considering CAP partners implementation’ rates;
- Quarterly programmatic reports on the status of UNICEF partners’ communication and social mobilization activities, identifying existing synergies and highlighting bottlenecks in the implementation or lack of collaboration among partners if any.
Deliverable 1: Desk Review and Evaluation Protocol;
Deliverable 2: Draft Report for Nampula and Zambezia provinces;
Deliverable 3: Final Report on all provinces.
Management and Supervision:.
The consultant will be hired by UNICEF and will report to Luca Solimeo, UNICEF Communication for Development Specialist.
Qualifications and Specialized Knowledge:
Individual consultants are invited to apply for this consultancy.
At least a Master’s degree in social sciences, is required for this consultancy. Ph.D. would be considered an asset.
At least 5 years of relevant work experience in conducting development evaluations, preferably in UNICEF CP countries and for UN agencies.
Specific knowledge, competencies, and skills required:
- Extensive experience in conducting project and programme evaluations, particularly on C4D programmes and initiatives;
- Strong knowledge of RBM, M&E systems, and ToC;
- Familiarity with the socio-economic situation in Mozambique and especially key challenges for women and children;
- Knowledge of the UN Convention on the Rights of the Child and relevant international standards;
- Previous experience in working with UNICEF;
- Knowledgeable of UN Evaluation policy;
- Excellent analytical and writing skills.
- Language skills: Excellent knowledge of Portuguese and Basic knowledge of English language are required.
- Possibility to identify and recruit an assistant or translator in each province with knowledge of the respective local languages.
For every Child, you demonstrate…
UNICEF’s core values of Commitment, Diversity and Integrity and core competencies in Communication, Working with People and Drive for Results.
UNICEF is committed to diversity and inclusion within its workforce, and encourages all candidates, irrespective of gender, nationality, religious and ethnic backgrounds, including persons living with disabilities, to apply to become a part of the organization.
Only shortlisted candidates will be contacted and advance to the next stage of the selection process.