In-Depth Analysis Consultant for MOMENTUM Routine Immunization Transformation and Equity endline evaluation

In-Depth Analysis Consultant
Scope of Work

Purpose: The consultant will conduct in-depth analysis of routine data for the MOMENTUM Routine Immunization Transformation and
Equity endline evaluation

Period of Performance: October 2024 to September 2025

Place of Performance: Remote but will collaborate with teams in the US

Objective: The primary objective of this consultancy is to conduct in-depth analysis of routine data to
evaluate the contribution of MOMENTUM Routine Immunization Transformation and Equity
interventions in the Democratic Republic of the Congo (DRC), Kenya, Mozambique and Nigeria.

Background: JSI Research & Training Institute, Inc. (JSI) is a public health management consulting and research organization dedicated to improving the health of individuals and communities throughout the world. JSI manages the USAID-funded MOMENTUM Routine Immunization Transformation and Equity project. The project is working in 18 countries with the overarching goal of strengthening routine immunization (RI) programs to overcome the entrenched obstacles contributing to stagnating and declining immunization rates and barriers to reaching zero-dose and underimmunized children with life-saving vaccines. The project works with countries to implement COVID-19 vaccination, including supporting strategies to reach hard-to-reach and priority populations.  The project also provides country, regional, and global technical support for routine immunization of children and older populations.

The purpose of this consultancy is to assess if the expected changes in immunization coverage and intermediate program outcomes occurred in DRC, Kenya, Mozambique and Nigeria. If there were changes, to estimate to what extent the changes were attributable to MOMENTUM Routine Immunization Transformation and Equity.

 

Activities: The assessment will be conducted at multiple levels: start at a higher administrative unit (e.g. province and state) and then work down from there to specific health facilities. A controlled interrupted time series (cITS) design along with Difference-in-Difference (DiD) will be used to estimate the contribution of the project to the RI coverage. The routine health management information system (HMIS) data will be the primary data source which may include the number of children who received basic childhood vaccines, number of children who received vaccines at outreach sites and the number of facilities with full stock. In addition, country specific intermediate program outcomes, which will be gathered from project records, will be analyzed. The intermediate program outcomes may include cold chain capacity indicators, health worker knowledge and practice,  training and supervisions, and service quality indicators.

  

During the performance period, the consultant should perform the following activities across the four countries:

1. Brief literature review on previous work done in the same area
2. Data cleaning and imputation
3. Collation and generation of covariates (e.g., geospatial smoothing of DHS/MIS data)
4. Generation of alternate denominators, for sensitivity analyses and results corroboration
5. Working through a GBM-PSM process to find suitable matched controls, if necessary and feasible, given study design
6. Assumption testing (i.e., common trends, love plots, etc.)
7. Execution of different, but related analyses to corroborate results (cITS vs ITS vs DID)
8. Assessment of cases averted/incurred
9. Execution of sensitivity analyses, if necessary (e.g., sub-analyses by administrative unit or facility type, comparison of analysis units by treatment differences)
10. Multiple hypothesis testing, if necessary
11. Model diagnostics
12. A write-up of results & interpretation, including limitations
13. Periodic check-in meetings with teams to discuss/reframe analysis approach and to review and interpret the results

 

Table 1: Study areas of the assessment

Country	Project intervention area	Study area	Comparison groups
DRC	Haut-Katanga and Kasaï-Oriental Provinces	TBD by the in-country team	TBD – using propensity score matching.
Kenya	Homa Bay and Vihiga Counties	TBD by the in-country team
Mozambique	Nampula and Zambezia Provinces	TBD by the in-country team
Nigeria	Bayelsa, Edo, Imo, Jigawa, and Lagos States	TBD by the in-country team

 

Table 2. Timeline

This proposed timeline is subject to change based on country specific activities.

Activity	DRC	Kenya	Mozambique	Nigeria
HMIS data acquisition	Aug-Sept 2024	Nov – Dec 2024	Sept-Oct 2024	Jan – Mar 2025
Kick-off meeting with country team	Oct 2024	Jan 2025	Nov 2024	Mar 2025
HMIS and project data analysis	Oct-Dec 2024	Jan – Feb 2025	Nov 2024 – Feb 2025	Mar-May 2025
Biweekly check-in meetings	Oct-Dec 2024	Jan – Feb 2025	Nov 2024 – Feb 2025	Mar-May 2025
Present quantitative results	Dec 2024	Feb 2025	Feb 2025	May 2025
Draft quantitative report, including methodology, findings and limitations	Jan – Feb 2025	Mar – April 2025	Mar – May 2025	June – July 2025
Circulate report to the project team	Feb 2025	April 2025	May 2025	August 2025
Finalize quantitative report based on the project team’s input	March 2025	May 2025	June 2025	Sept 2025

 

Deliverables: The following required deliverables and reports will be submitted to the MOMENTUM Routine Immunization Transformation and Equity Monitoring, Evaluation and Learning (MEL) team for each country:

1. A data analysis plan
2. A preliminary report of the findings
3. A final report which includes the results and interpretation

Expected LOE: The total expected LOE for this scope of work is up to 55 days as detailed below:

• 25 days for the first country DRC
• 10 days for Kenya
• 10 days for Mozambique
• 10 days for Nigeria

Qualifications:

• Masters or PhD in Public Health, Health Policy, Health Economics, Implementation Science, or relevant field of study
• Exceptional quantitative analytic and communication (written and verbal) skills.
• Expertise in complex quantitative or mixed methods evaluations, including the application of quasi-experimental study designs including interrupted time series, comparative interrupted time series, and difference-in-difference.
• Expertise in application of quantitative software tools for data analysis and visualization.
• Experience working with routine health information systems and analyzing routine data in low and middle income countries.
• Research or evaluation experience with development aid and/or donor programs.
• Fluency in French is preferred.

How to apply: Interested applicants, who meet the qualifications, should submit an application with the following to momentumri@jsi.com with subject line: In-Depth Analysis Consultant by 5:00PM EDT on August 28, 2024. 

1. CV
2. Three references
3. Daily consultant rate
4. Cover letter describing their interest, qualifications, and experience to complete the SOW

Questions: Any questions concerning the consultancy can be sent to momentumri@jsi.com by 5:00PM EDT on August 23, 2024.

 

JSI is an Equal Opportunity; Affirmative Action Employer committed to workplace diversity. We are committed to providing equal employment opportunities for all qualified applicants and employees without regard to age, race, color, national origin, ancestry, creed, religion, gender, disability, marital status, sexual orientation, sexual preference, genetic information, political affiliation, HIV status, or protected veteran status in any employment decisions. M/F/V/D

 

JSI is a child-safe organization, and the safety and wellbeing of children is a priority of our organization. We have robust recruitment procedures to ensure that all staff are suited to work with the children served by our programs. A criminal record check will be undertaken for successful applicants.

In-Depth Analysis Consultant

Date Issued: August 13, 2024 12:00 am
Due Date: August 28, 2024 5:00 pm EASTERN STANDARD TIME (EST)

View All Consultancies