SCOPE

The USAID Medicines, Technologies, and Pharmaceutical Services (MTaPS) Program enables low- and middle-income countries to strengthen their pharmaceutical systems, which is pivotal to higher-performing health systems. MTaPS focuses on improving access to essential medical products and related services and on the appropriate use of medicines to ensure better health outcomes for all populations. The program brings expertise honed over decades of seminal pharmaceutical systems experience across more than 40 countries. The MTaPS approach builds sustainable gains in countries by including all actors in health care—government, civil society, the private sector, and academia. The program is implemented by a consortium of global and local partners and led by Management Sciences for Health (MSH), a global health nonprofit.

ACTIVITY DESCRIPTION

We will conduct a data quality audit in 6 countries for the MTaPS project. These countries include Bangladesh, The Philippines, Mali, Burkina Faso, Kenya, and Tanzania. The purpose of this audit is to identify areas to improve the quality of project data and the system producing these data and propose remedial actions. The MTaPS HQ MERL team will follow up on the action plans and audits to strengthen the project’s data management system and improve data quality.

Preference will be given to in-country applicants to avoid travel. Applicants must indicate the countries in which they are applying to lead the DQA activities. Applicants may apply for all countries, or one or more countries.

The MTaPs Audit will include the following key steps:

1. DQA Kick-off Meeting

Lead a kickoff meeting, with the MTaPS Monitoring, Evaluation, Research, and Learning (MERL) team that includes a presentation of the Data Quality Audit (DQA) objectives, methods, workplan, and deliverables. Respond to questions and update the DQA work plan as required. The DQA work plan must indicate all activities for each country, including proposed travel dates.

2. Attend the DQA Tool Training

A DQA tool will be provided by MSH. MSH staff will train the DQA staff to use the MSH DQA Tool just after the Kickoff Meeting. More information on the tool is provided in activity 4 below.

3. DQA Preparation and Communication

Prepare for the DQA by developing email communication to participating countries describing the objectives, roles and responsibilities, activities, and timeline. Confirm travel dates and other logistics for implementing the work plan. All communications for this project will be to be conducted in English and/or French with the relevant MTaPS Country point of contact.

4. Conduct the DQA using the MTaPS DQA tool

A tool developed by the USAID-funded MEASURE Evaluation was adapted by MSH to better align with MSH projects. This DQAudit tool (excel or online platform) is designed to verify the quality of reported project-level data, assess the project’s data management and reporting system, and define a clear action plan to address the weaknesses observed. MSH projects are expected to follow up on action plans and audit findings to strengthen a project’s data management system and improve data quality. The MSH Audit tool is designed to:

• Verify the quality of reported project level data
• Assess the project’s data management and reporting system
• Define a clear action plan to address the weakness observed

Based on the DQA workplan and DQA tool training, the consultant will implement the DQA activities. Please see Attachment C for indicator selection criteria, list of countries, and indicators to be included in the DQA.

The tool encompasses 3 dimensions of data quality:

• Completeness: Data are considered complete when all required information is collected and submitted (i.e., data are not missing in the reporting instrument(s);
• Timeliness: Are data current and available on time or when needed. Timeliness will take into consideration the data collection and data entry process, the rate at which the program’s information system is updated, and when the information is actually used or required.
• Accuracy: Also known as validity. data are considered accurate when the data measure what they are intended to measure, and errors are minimized to the point of being negligible (e.g., no transcription or data entry errors).

5. Project Management

The contractor will manage the DQA process with involvement from the MSH MEL and country-based staff as described in the bullets below. Additionally, they will submit a monthly report and convene meetings with the Home Office MEL team on a weekly basis to share progress updates and planning for next steps.

Team and Roles and Responsibilities

Contractor(s): Manage and execute the full DQA process as outlined in the scope of work.

Home Office MERL Team: The MTaPS MERL Director, MEL Practice Area Lead, and MEL Advisor will oversee the contractor(s), including reviewing all deliverables to ensure they meet the highest quality. Additionally, they will provide the DQA training.

MTaPS Country team: The country-based project director and country MERL advisor will help identify a contractor. Next, they will be invited to attend the kick-off meeting, review project deliverables, and attend the final presentation. The country MERL advisor or his/her designee(s) will provide the contractor with access to source data (i.e., MTaPS records, MOH records) in accordance with the indicators under review. Given that the final deliverable is a DQA action plan, it is recommended that the country-based project director and MEL advisor review the final report to ensure the feasibility and practicality of implementing the action plan in the MEL system.

6. Report on the DQA

Develop a DQA report for each country. The report will describe the objectives, methods, findings (including raw data), recommendations, and a concrete and responsive action plan for improving data quality.

7. Final DQA presentation and slide deck presentation

Develop a slide deck, complimentary to the report, for each country and present the findings to key stakeholders. Respond to questions during the presentation and update the report accordingly.

8. Deliverables

Each of the below deliverables will be submitted to the MTaPS MEL Management team for review and approval. The MEL Management team will request revisions to the deliverables as needed, and the contractor will respond to those requests.

• Prepare a slide deck/presentation for project kick-off meeting
• Attend the DQA tool training and share an attendance sheet and post training test findings
• Prepare and provide a DQA workplan for program management (including preparations and communications to country POCs)
• Conduct the DQA in the identified countries and provide a weekly progress report to the MTaPS MEL Management team
• Create a final report on the DQA and an action plan for improvement
• Create a final DQA presentation and slide deck presentation for each country