REVIEW OF MONITORING OF MALARIA IN PREGNANCY THROUGH NATIONAL HEALTH MANAGEMENT INFORMATION SYSTEMS: TANZANIA

Transcription

1 REVIEW OF MONITORING OF MALARIA IN PREGNANCY THROUGH NATIONAL HEALTH MANAGEMENT INFORMATION SYSTEMS: TANZANIA April 2014 Giulia Besana Ikupa Akim Marya Plotkin

2 The findings of this review are based on Tanzania s health management information system forms that were collected and reviewed during the period of October 2012 March Every attempt was made to get the latest tools available. Qualitative information included in this report was collected during key informant interviews conducted from November 2013 to January This report was compiled by the Maternal and Child Health Integrated Program (MCHIP) for review by the President s Malaria Initiative and Roll Back Malaria Initiative. This report was made possible by the generous support of the American people through the United States Agency for International Development (USAID), under the terms of the Leader with Associates Cooperative Agreement GHS-A and Cooperative Agreement AID-OAA-A The contents are the responsibility of MCHIP and The Maternal and Child Survival Program (MCSP), and do not necessarily reflect the views of USAID or the United States Government. MCHIP is the USAID Bureau for Global Health s flagship maternal, neonatal, and child health program. MCHIP supports programming in maternal, newborn, and child health, immunization, family planning, malaria, nutrition, and HIV/AIDS, and strongly encourages opportunities for integration. Cross-cutting technical areas include water, sanitation, hygiene, urban health, and health systems strengthening. MCSP is a global USAID cooperative agreement to introduce and support high-impact health interventions in 24 priority countries with the ultimate goal of ending preventable child and maternal deaths (EPCMD) within a generation. MCSP supports programming in maternal, newborn and child health, immunization, family planning and reproductive health, nutrition, health systems strengthening, water/sanitation/hygiene, malaria, prevention of mother-to-child transmission of HIV, and pediatric HIV care and treatment. MCSP will tackle these issues through approaches that also focus on health systems strengthening, household and community mobilization, gender integration and ehealth, among others. Visit to learn more.

3 Table of Contents Abbreviations... iv Acknowledgments... vii Introduction... 1 Background... 2 Malaria Situation in Tanzania... 2 World Health Organization and Tanzania Malaria Monitoring and Evaluation Recommendations... 4 Methods... 5 Desk Review... 5 Key Informant Interviews... 6 Findings... 6 Health Management Information System Structure and Function... 6 Malaria in Pregnancy Indicators in National Plans, Health Management Information System Registers, and Reports... 7 Data Flow and Reporting Process Malaria in Pregnancy Data Quality Use of Malaria in Pregnancy Data Stock Management Other Themes Discussion Strengths and Opportunities Weaknesses Recommendations Annex 1: Guiding Questions for Key Informant Interviews Annex 2: List of People Interviewed Annex 3: Indicators Related to Malaria in Pregnancy Case Management Annex 4: Flow of Data in the Health Management Information System / DHIS Annex 5: Summary of Health Management Information System Tools Annex 6: DHIS 2 Malaria Module Review of Monitoring of MIP through National HMISs: Tanzania iii

4 Abbreviations ACT ANC CDC CHMT DfID DHS DMIFP DRCHCo eidsr FANC Global Fund HIS HMIS HSSP IDSR IMCI IPD IPT/IPTp ITN LLIN M&E MAISHA MCHIP MIP MOH MoHSW MPR mrdt MSD MTMSP MTUHA NATNETS NMCP OPD P4P PMI RBM RCH RCHS RDT SBM-R Artemisinin-Based Combination Therapy Antenatal Care Centers for Disease Control and Prevention Council Health Management Team Department for International Development Demographic and Health Survey District Malaria and IMCI Focal Person District Reproductive and Child Health Coordinator electronic IDSR Focused ANC Global Fund to Fight AIDS, Tuberculosis and Malaria Health Information System Health Management Information System Health Sector Strategic Plan Integrated Disease Surveillance and Response Integrated Management of Childhood Illness Inpatient Department Intermittent Preventive Treatment in Pregnancy Insecticide-Treated Net Long-Lasting Insecticide-Treated Net Monitoring and Evaluation Mothers and Infants, Safe, Healthy, and Alive Maternal and Child Health Integrated Program Malaria in Pregnancy Ministry of Health Ministry of Health and Social Welfare Malaria Program Review Malaria RDT Medical Stores Department Medium Term Malaria Strategic Plan Mfumowa Taarifaza Uendeshajiwa Hudumaza Afya National Insecticide-Treated Nets National Malaria Control Program Outpatient Department Pay for Performance President s Malaria Initiative Roll Back Malaria Reproductive and Child Health RCH Section Rapid Diagnostic Test Standards-Based Management and Recognition iv Review of Monitoring of MIP through National HMISs: Tanzania

5 SMI SMS SP THMIS USAID WHO Safe Motherhood Initiative Short Message Service Sulfadoxine-Pyrimethamine Tanzania HIV/AIDS and Malaria Indicator Survey United States Agency for International Development World Health Organization Review of Monitoring of MIP through National HMISs: Tanzania v

6 vi Review of Monitoring of MIP through National HMISs: Tanzania

7 Acknowledgments The Maternal and Child Health Integrated Program (MCHIP) is grateful for the support provided by Jhpiego staff in Tanzania and for their participation in this work. The authors would like to express our gratitude to the key informants who spared time to inform this review, which was made possible by their efforts. Our gratitude also goes the President s Malaria Initiative and the many reviewers who provided helpful comments at several stages of the review, with particular appreciation to Fabrizio Molteni, Lynn Paxton, and Mary Drake. Review of Monitoring of MIP through National HMISs: Tanzania vii

8 viii Review of Monitoring of MIP through National HMISs: Tanzania

9 Introduction MCHIP works closely with the President s Malaria Initiative (PMI) and the Roll Back Malaria (RBM) Partnership community including key stakeholders in maternal health and child health to support reduction in the global burden of malaria morbidity and mortality. MCHIP supports this reduction by helping to improve the quality of malaria programs, strengthening health systems, and helping countries achieve sustained results. A critical aspect of health systems strengthening is ensuring that appropriate high-quality data on malaria service delivery are available to policymakers and program managers. Obtaining reliable, valid, and timely malaria service data, especially data related to the control of malaria in pregnancy (MIP), is challenging. While population-based MIP indicators are very useful, the timing of population-based surveys, generally every two to five years, is too infrequent for program monitoring. National health management information system (HMIS) data are more frequently collected, complement survey data, and have the potential to be more useful for ongoing service improvement and decision-making. However, the quality of HMIS data in low-income settings is poor; often data are missing, report formats are outdated, and reporting is late. Furthermore, it is not widely known what data are being recorded at the facility level, what data are reported up through the health system, and whether those data are being used at the facility. MCHIP conducted a review of national HMISs in six selected PMI focus countries to improve understanding of how Ministries of Health (MOHs) both National Malaria Control Programs (NMCPs) and Reproductive Health Units are monitoring and reporting their MIP-related program results and how the data are being used. This MIP-specific review fits within a larger review of routine maternal and newborn health data collection systems by MCHIP in the same six countries and additional non-pmi/non-malaria-endemic countries. The PMI countries selected for this review are Kenya, Malawi, Mozambique, Mali, Tanzania, and Uganda. Each of these countries is one of the19 focus countries benefiting from PMI, which is implemented by the United States Agency for International Development (USAID) in partnership with the US Centers for Disease Control and Prevention (CDC). The review focuses on the public sector and examines how HMIS and supplemental routine data collection and reporting strategies are used at different levels of the health system to capture MIP indicators. The review describes MIP information, data quality gaps, and best practices. This report presents findings from the review, recommendations on priority indicators that should be monitored at the facility level, and data collection formats, as well as ways to interpret and use data to improve services and ways to report data up through the health system. Information from this report, along with the other five country reviews, will be used to propose revisions to the World Health Organization (WHO)/RBM manual, Malaria in Pregnancy: Guidelines for Measuring Key Monitoring and Evaluation Indicators. 1 The findings and recommendations from this review will be shared with the countries to help improve their routine monitoring systems. Findings and recommendations will also be shared with PMI, as well as the RBM MIP working group and RBM Monitoring and Evaluation (M&E) Reference Group, for further review, discussion, and development of final recommendations for global and country levels. 1 World Health Organization Malaria in Pregnancy: Guidelines for Measuring Key Monitoring and Evaluation Indicators. Geneva, Switzerland: World Health Organization. Review of Monitoring of MIP through National HMISs: Tanzania 1

10 Background MALARIA SITUATION IN TANZANIA In Tanzania, malaria still remains a severe public health threat and the leading cause of mortality and morbidity in the country, accounting for 40% of all outpatient visits. 2 It is estimated that 93% of the population lives in areas that are at risk, with pregnant women and children under the age of five being especially vulnerable. Great variation is seen in terms of prevalence, with highest rates in the Great Lake Zones (3 33%) and Southern lowlands (17 26%) and lowest rates in the Northern and Central ( 3%) Zones. Malaria prevalence is highest in rural areas (10%) compared to urban areas (3%), where more than 80% of the country s 47.7 million people live (see Figure). Figure. Malaria prevalence in Tanzanian children aged 6 59 months, Source: Tanzania Commission for AIDS (TACAIDS), Zanzibar AIDS Commission (ZAC), National Bureau of Statistics (NBS), Office of the Chief Government Statistician (OCGS), and ICF International Tanzania HIV/AIDS and Malaria Indicator Survey: Key Findings. Dar es Salaam, Tanzania: TACAIDS, ZAC, NBS, OCGS, and ICF International. Reduction of malaria has improved through the years, as shown in recent Demographic and Health Surveys (DHSs) and the Tanzania HIV/AIDS and Malaria Indicator Surveys (THMISs), which have documented improvements in coverage of malaria prevention and control interventions (see Table 1). Table 1. Population-based malaria indicators for Tanzania MALARIA INDICATOR DHS a THMIS b DHS 2010 c THMIS d All-cause under-five mortality rate 112/1,000 81/1,000 All-cause maternal mortality rate 578/100, /100,000 Proportion of children 6 59 months positive for malaria parasites (malaria rapid diagnostic test [mrdt]) 18% 9% 2 United Republic of Tanzania Ministry of Health and Social Welfare Human Resource for Health Strategic Plan Dar es Salaam, Tanzania: Ministry of Health and Social Welfare. 2 Review of Monitoring of MIP through National HMISs: Tanzania

11 MALARIA INDICATOR Proportion of households with at least one insecticide-treated net (ITN) Proportion of children under five years old who slept under an ITN the previous night Proportion of pregnant women who slept under an ITN the previous night Proportion of women who received any sulfadoxinepyrimethamine (SP)/Fansidar during the pregnancy for their last live birth in the two years preceding the survey, during an antenatal care (ANC) visit Proportion of women who received two or more doses of IPTp (intermittent preventive treatment in pregnancy) during the pregnancy for their last live birth in the two years preceding the survey, during an ANC visit Proportion of women who took any SP/Fansidar during the pregnancy for their last live birth in the two years preceding the survey Proportion of women who took two or more doses of SP/Fansidar during the pregnancy for their last live birth in the two years preceding the survey DHS a THMIS b DHS 2010 c THMIS d 23% 39% 64% 91% 16% 26% 64% 72% 16% 27% 57% 75% 52% 57% 61% 60% 22% 30% 26% 32% 53% 59% 63% 63% 22% 31% 27% 33% a. National Bureau of Statistics and ORC Macro Tanzania Demographic and Health Survey Dar es Salaam, Tanzania: National Bureau of Statistics and ORC Macro. b. Tanzania Commission for AIDS (TACAIDS), Zanzibar AIDS Commission (ZAC), National Bureau of Statistics (NBS), Office of Chief Government Statistician (OCGS), and Macro International Inc Tanzania HIV/AIDS and Malaria Indicator Survey Dar es Salaam, Tanzania: TACAIDS, ZAC, NBS, OCGS, and Macro International Inc. c. National Bureau of Statistics (NBS) and ICF Macro Tanzania Demographic and Health Survey Dar es Salaam, Tanzania: NBS and ICF Macro. d. Tanzania Commission for AIDS (TACAIDS), Zanzibar AIDS Commission (ZAC), National Bureau of Statistics (NBS), Office of Chief Government Statistician (OCGS), and ICF International Tanzania HIV/AIDS and Malaria Indicator Survey Dar es Salaam, Tanzania: TACAIDS, ZAC, NBS, OCGS, and ICF International. Great strides have been made in improving usage of ITNs for both pregnant women and children through the Tanzania National Voucher Scheme or Hati Punguzo program. This program was launched in October 2004 by the Ministry of Health and Social Welfare (MoHSW) to provide vouchers to subsidize the price of ITNs for all pregnant women and infants attending health facilities. On the other hand, improvement has been poor in uptake of two or more doses of SP for IPTp, only increasing by 10 percentage points during an eight-year interval. The low level of increase in IPTp uptake may be tied to relatively poor attendance at multiple ANC visits and late attendance at ANC, as measured by median months of pregnancy at first ANC visit: 5.6 months in and 5.4 months in The median month of attendance of the first ANC visit has not changed in the last 10 years and remains later than optimal for the first two doses of SP. In the 2010 DHS, 50% of respondents (women aged years who had a live birth in the five years preceding the survey) reported being four to five months pregnant at the time of their first ANC visit. 5 3 Bureau of Statistics and Macro International Inc Trends in Demographic, Family Planning, and Health Indicators in Tanzania. Calverton, MD: Bureau of Statistics and Macro International Inc. 4 National Bureau of Statistics (NBS) and ICF Macro Tanzania Demographic and Health Survey Dar es Salaam, Tanzania: NBS and ICF Macro. 5 National Bureau of Statistics (NBS) and ICF Macro Tanzania Demographic and Health Survey Dar es Salaam, Tanzania: NBS and ICF Macro. Review of Monitoring of MIP through National HMISs: Tanzania 3

12 Another factor influencing the slow increase in uptake of IPTp2 (second dose of IPTp) is stockouts of SP in health facilities. Factors that have contributed to the stock-outs include poor ordering and forecasting at the facility level, lack of communication between ANC clinics and pharmacy departments on routine needs, SP for IPTp being provided free of charge to ANC clients but the facility being charged by the Medical Stores Department (MSD) for procurement, the regional MSD not providing adequate amounts to the facilities, and national-level stockouts. WORLD HEALTH ORGANIZATION AND TANZANIA MALARIA MONITORING AND EVALUATION RECOMMENDATIONS In October 2012, the WHO updated its policy recommendation on IPTp-SP in an effort to increase access to the intervention during ANC in all sub-saharan African areas with moderateto-high malaria transmission. 6 WHO urged national authorities to disseminate the new guidance and ensure that it is implemented correctly. Additionally, WHO recommends key indicators for MIP monitoring at output, outcome, and impact levels (see Table 2). Table 2. WHO-recommended indicators to be used for monitoring MIP OUTPUT INDICATORS OUTCOME INDICATORS IMPACT INDICATORS Percentage of ANC staff (pre-service, in-service, or at supervisory visits) trained in control of MIP in the past 12 months (including IPTp, counseling on long-lasting insecticidetreated net [LLIN] use, and case management for pregnant women) Percentage of health facilities reporting stock-outs of the recommended drug for IPTp (currently SP) in the past month Percentage of pregnant women receiving IPTp under direct observation (first dose, second dose, third dose, according to national guidelines) Percentage of pregnant women who report having slept under an LLIN the previous night Percentage of low-birthweight singleton live births (< 2,500g) by parity Percentage of screened pregnant women with severe anemia (hemoglobin [Hb] < 7g/dl) in third trimester by gravidity Adapted from Blouse, Ann Prevention and Control of Malaria in Pregnancy in the African Region: A Program Implementation Guide. Baltimore, MD: Jhpiego. During the writing of this report, the NMCP disseminated a final draft of the Malaria Strategic Plan for the period to stakeholders for approval; the plan was expected to be approved in early The new plan addresses MIP in the third strategic approach of the second component of the strategic plan chapter: malaria diagnosis, treatment, preventive therapies, and vaccine. The new Strategic Plan seeks to reduce vulnerability to malaria infection and its complications among specific at-risk populations, including pregnant women. The focus of the strategy will be to increase the number of women accessing IPTp2 through improved management of the SP supply chain, IPTp administration at each scheduled ANC visit, training and supervision to improve capacity of health care providers, and improved frequency of ANC attendance. NMCP has recently completed an exercise to review the National Guidelines for Malaria Diagnosis and Treatment The guidelines have been validated by stakeholders and now await the chief medical officer s final sign-off before mass reproduction and dissemination. Guidelines specific to MIP are in the Management of Malaria, in chapter 7, Special Situations and Groups. 6 World Health Organization and Global Malaria Programme Updated WHO Policy Recommendation (October 2012): Intermittent Preventive Treatment of Malaria in Pregnancy Using Sulfadoxine-Pyrimethamine (IPTp-SP). 4 Review of Monitoring of MIP through National HMISs: Tanzania

13 Methods DESK REVIEW For each country review, MCHIP field offices collected HMIS forms. A content analysis was done on these forms to determine what was being monitored and reported related to MIP. Second, in each country, a review was conducted of national policies, strategies, and guidelines with information related to MIP M&E, as well as technical reports, publications, and Web materials related to MIP. The following documents were reviewed: Reports and Strategic Documents National Malaria Control Program Monitoring and Evaluation [NMCP M&E] Plan National Guidelines for Diagnosis and Treatment of Malaria (2006) 8 National Malaria Strategic Plan , draft document 2.3 National Guidelines for Malaria Diagnosis and Treatment 2013, draft document 25, November 2013 Harmonization of RCH [Reproductive and Child Health] M&E Framework to RCH HMIS Data Collection Tools, report from meeting held December 2009 PMI Malaria Operational Plan FY Focused Antenatal Care Malaria and Syphilis in Pregnancy, Antenatal Care Quality Improvement Tool (July 2013), using the Standards-Based Management and Recognition (SBM-R ) process The National Road Map Strategic Plan to Accelerate Reduction of Maternal, Newborn and Child Deaths in Tanzania, Health Sector Strategic Plan [HSSP] III: July 2009 June Pwani HMIS Pilot, HMIS Indicator Revision Team, September 2010, Maternal Health Indicators and Data Dictionary Tools HMIS Instruction Manual ANC register, tally form, and monthly summary form Outpatient department (OPD) register, tally form, and monthly summary form Inpatient department (IPD) register, tally form, and monthly summary form ANC client card 7 United Republic of Tanzania Ministry of Health and Social Welfare National Malaria Control Program Monitoring and Evaluation Plan United Republic of Tanzania Ministry of Health and Social Welfare National Guidelines for Diagnosis and Treatment of Malaria. 9 President s Malaria Initiative. Tanzania Malaria Operational Plan FY United Republic of Tanzania Ministry of Health and Social Welfare The National Road Map Strategic Plan to Accelerate Reduction of Maternal, Newborn and Child Deaths in Tanzania, United Republic of Tanzania Ministry of Health and Social Welfare. Health Sector Strategic Plan III: July 2009 June Review of Monitoring of MIP through National HMISs: Tanzania 5

14 Death register NMCP health facility monthly summary form DHIS 2 ANC monthly summary form DHIS 2 malaria monthly summary form KEY INFORMANT INTERVIEWS Key informant interviews were conducted at the facility level, district level, and national level to understand the HMIS strengths and weaknesses with respect to MIP information. Heads of departments and M&E focal people at NMCP, HMIS, Reproductive and Child Health Section (RCHS), PMI, USAID, and WHO were all interviewed. For a more practical understanding of implementation and how data are collected, reported on, and reported back, a site visit to a health facility and a district hospital was used to facilitate more in-depth information on the reporting system. District focal persons and health care providers tasked with recording and reporting were all interviewed. Specific questions developed to guide the HMIS desk review and key informant interviews are included in Annex 1. The list of persons interviewed is included in Annex 2. Findings HEALTH MANAGEMENT INFORMATION SYSTEM STRUCTURE AND FUNCTION Tanzania s HMIS, also known as Mfumowa Taarifaza Uendeshajiwa Hudumaza Afya (MTUHA), was established in the late 1980s to collect and report on routine health service provision from service delivery points. The system became nationally operational in The HMIS is the system used in the health sector to collect routine data from all health facilities. For years, the routine data collected through HMIS have had a number of limitations, including inaccuracy, incompleteness, delayed reporting, and poor data management. The HMIS unit, supported by vertical programs including the NMCP and RCHS, has undertaken ambitious efforts to improve both data quality and reporting. In 2005, it was decided to use the District Health Management Information System (DHIS) for the electronic component of HMIS, with the objective of improving sharing and coordination of health and health-related information being collected by the HMIS for the sake of creating a functional national electronic database. DHIS 2 began as a Microsoft Access database in 2005 and was upgraded to a Web-based system in With the refinement of the new HMIS tools (see next paragraph), once again in 2009 the online system was refined. The University of Dar es Salaam has provided technical support to the MoHSW in the development of Tanzania s DHIS 2 database, while other implementing partners have provided funding. As of January 2014, all districts had been trained and connected to DHIS 2. All data entry and reporting at district level will now be done using DHIS 2. HMIS registers and monthly summary forms were revised and piloted in Pwani Region for two years, through the end of The purpose of the pilot was to receive feedback from health care providers who were using the tools for data entry and reporting. Their feedback was then used to refine the tools. The revised tools were rolled out beginning with six regions: Pwani, Lindi, Mtwara, Shinyanga, Dodoma, and Dar es Salaam. Rollout of the new HMIS registers to the six regions was complete in mid-2012, and then, after a final revision of the tools, nationally. 12 DHIS 2 is being used as the primary HMIS in 30 countries across four continents. DHIS 2 helps governments in developing countries and health organizations to manage their operations, monitor processes, and improve communication. See 6 Review of Monitoring of MIP through National HMISs: Tanzania

15 In 2012, in compliance with the HSSP, an updated version of the HMIS was rolled out nationally. Two providers per dispensary, 10 per health center, and 20 per hospital in all regions were trained on the use of the newly updated HMIS client registers and monthly summary forms. Although the new tools had been launched, startup varied due to procurement and printing delays. Almost all facilities began using the new tools in August 2013; facilities in Mbeya region, however, faced a one-month delay and started using the tools in September Through the rollout process, other gaps were identified. With the launch of new guidelines during the implementation stage, slight revisions of these tools have been discussed in a number of meetings. System Structure, Training, and Implementation of DHIS 2 Selected representatives from each government level are trained in the DHIS 2 and assigned a username and password to access the database. Council Health Management Team (CHMT) members, regional and zonal coordinators, and responsible program managers at central level will all be trained in DHIS 2. More than one individual is trained from each level to share the workload and to anticipate absenteeism, such as leave. Access rights will vary by level; however, the district level will be the only one able to enter and edit data. All levels will be able to run pregenerated reports and view graphs through a dashboard system. In theory, the position of district HMIS focal person was designed so that person could take on the responsibility of data entry, data cleaning, and data management. However, a budget line for the position was not preplanned and may vary from location to location. For example, the position of district HMIS focal person and malaria focal person is often assigned to an existing probably overworked CHMT member, district RCH coordinator (DRCHCo), or other health care worker. Some districts are assigning full time staff to these positions. In Kibaha district, the HMIS focal person is a member of the CHMT who was sent to study information systems and has now been assigned as a full-time HMIS focal person. As mentioned above, routine service delivery data will continue to be paper based from the facility to the district. With time, more and more HMIS monthly summary forms will be added as modules into DHIS 2. Future plans include allowing implementing partners to have viewer rights to the DHIS 2; this, however, has yet to be implemented and is still under discussion. As Tanzania s DHIS 2 is still fairly new, the HMIS team is expecting some problems that may need to be fixed in the months to come as more users enter data in the system. Computers and functioning Internet have been purchased for all districts through Global Fund to Fight AIDS, Tuberculosis and Malaria (Global Fund) resources. MALARIA IN PREGNANCY INDICATORS IN NATIONAL PLANS, HEALTH MANAGEMENT INFORMATION SYSTEM REGISTERS, AND REPORTS The Medium Term Malaria Strategic Plan [MTMSP] has two core strategies and three supportive strategies. The first supportive strategy Monitoring, Evaluation, Surveillance and Operational Research has four targets. 13 The NMCP M&E Plan presents the NMCP s M&E objectives; lists associated indicators, data sources, and frequency of collection; shows who is responsible; and includes an M&E action plan. 14 The indicators in Table 3, all from the M&E Plan, correspond to the national MTMSP and have been adapted 13 United Republic of Tanzania Ministry of Health and Social Welfare National Malaria Control Programme Medium Term Malaria Strategic Plan United Republic of Tanzania Ministry of Health and Social Welfare National Malaria Control Program Monitoring and Evaluation Plan Review of Monitoring of MIP through National HMISs: Tanzania 7

16 from the RBM Partnership Guidelines for Core Population-Based Indicators. 15 Table 3 includes an exhaustive list of all MIP indicators mentioned in the following strategic documents: NMCP M&E Plan Harmonization of RCH M&E Framework to RCH HMIS Data Collection Tools, report from meeting held December 2009 The National Road Map Strategic Plan to Accelerate Reduction of Maternal, Newborn and Child Deaths in Tanzania, HSSP III: July 2009 June The National Malaria Strategic Plan and the National Guidelines for Malaria Diagnosis and Treatment 2013 were excluded from the list as they were still under revision at the time this report was written. Table 3. MIP indicators in national policy documents INDICATOR DOCUMENT MEANS OF VERIFICATION Vector control (ITN) Proportion of pregnant women and children under five sleeping under an ITN the night preceding the survey HSSP III THMIS Proportion of pregnant women who slept under an ITN the night preceding the survey NMCP M&E Plan MTMSP Proportion of pregnant women who slept NMCP M&E Plan under an ITN the night preceding the survey in household with at least one ITN Denominator: Total number of pregnant women surveyed in household owning at least one ITN Behavior change communication and voucher system Proportion of pregnant women who NMCP M&E Plan received a voucher at first ANC visit Proportion of pregnant women receiving ITN vouchers Number of vouchers redeemed by pregnant women Proportion of women of childbearing age aware of importance of early attendance at ANC Harmonization of RCH M&E Framework report 2009 NMCP M&E Plan NMCP M&E Plan THMIS DHS National Insecticide-Treated Nets (NATNETS) Programme DHS THMIS NATNETS DHS THMIS NATNETS Activity and supervision monthly monitoring report / participating partners HMIS Activity and supervision monthly monitoring report / participating partners DHS THMIS NATNETS 15 Roll Back Malaria Partnership, MEASURE Evaluation, MEASURE DHS, USAID, UNICEF, World Health Organization, CDC, MACEPA Guidelines for Core Population-Based Indicators. Calverton, MD: MEASURE Evaluation United Republic of Tanzania Ministry of Health and Social Welfare The National Road Map Strategic Plan to Accelerate Reduction of Maternal, Newborn and Child Deaths in Tanzania, United Republic of Tanzania Ministry of Health and Social Welfare. Health Sector Strategic Plan III: July 2009 June Review of Monitoring of MIP through National HMISs: Tanzania

17 INDICATOR DOCUMENT MEANS OF VERIFICATION Proportion of respondents who know that malaria becomes more dangerous after a woman becomes pregnant IPTp Total number of pregnant women (denominator for IPTp indicators) Proportion of women who received at least two doses of IPTp during their last pregnancy a Number of pregnant women who received IPTp1 Number of pregnant women who received IPTp2 Case management Number of rapid diagnostic test (RDT)- confirmed outpatient cases of malaria <5 years, 5+, pregnant women Number of clinical inpatient cases of malaria <5, 5+, pregnant women Standardized laboratory-confirmed malaria cumulative incidence per year (among children <5 years, 5+, and pregnant women) NMCP M&E Plan NMCP M&E Plan MTMSP HSSP III Harmonization of RCH M&E Framework report 2009 NMCP M&E Plan THMIS NATNETS HMIS / health facility sentinel surveillance THMIS DHS NMCP M&E Plan Health Facility Sentinel Surveillance / HMIS NMCP M&E Plan Health Facility Sentinel Surveillance / HMIS NMCP M&E Plan Health Facility Sentinel Surveillance / HMIS NMCP M&E Plan Health Facility Sentinel Surveillance / HMIS NMCP M&E Plan Health Facility Sentinel Surveillance / HMIS a. NMCP M&E Plan specifically words indicator as Proportion of women who received at least two doses of IPTp during their last pregnancy that led to a live birth within the last 2 years (emphasis added). It is notable that the NMCP M&E Plan cites the total number of pregnant women as the denominator for IPTp indicators. 18 The global recommendation is that number of first ANC visits is the denominator. Further, the globally recommended indicator is used at district level (see later section, Use of Malaria in Pregnancy Data ). Data from multiple sources are used to provide strategic information for malaria M&E. Data sources include standard monthly reports from the NMCP implementing partners and other government line ministries, routine reporting from national surveillance systems (HMIS / Integrated Disease Surveillance and Response [IDSR] / health facility based sentinel surveillance), periodic household surveys (population based, national and subnational), and facility surveys. Mainland Tanzania adopted the IDSR strategy in 1998 to strengthen surveillance of key infectious diseases. Central to the IDSR strategy is the integration of multiple existing surveillance and response systems and linking of surveillance, laboratory, and other data with public health action. IDSR is overseen by the epidemiology section in the MoHSW M&E department with funding from the Global Fund, CDC, and other partners. IDSR collects data on a number of priority diseases including cholera, bacillary dysentery, neonatal tetanus, polio, 18 United Republic of Tanzania Ministry of Health and Social Welfare National Malaria Control Program Monitoring and Evaluation Plan Review of Monitoring of MIP through National HMISs: Tanzania 9

18 measles, meningococcal meningitis, and malaria. For the NMCP, the purpose of the IDSR is to provide denominator data for measuring the proportion of cases so the NMCP can detect malaria epidemics and respond appropriately within two weeks of onset at the national level. The malaria form reports confirmed cases and deaths, disaggregated by age, monthly. This information is not disaggregated by pregnancy status. Currently, the paper-based IDSR system is supposed to collect the following indicators: Number tested for malaria (disaggregated by under vs. over five years of age) Number positive for malaria (disaggregated by under vs. over five years of age) Number clinically diagnosed with malaria However, the paper-based IDSR does not function optimally, despite being rolled out nationally. Many health facilities do not have the recording forms, and there is no designated person to compile the information in facilities or at the district level. More recently, the epidemiology section has been working to roll out an electronic IDSR (eidsr), which will be implemented through the newly rolled out DHIS 2. A pilot of eidsr is currently taking place in Temeke district and will provide information on malaria cases on a weekly basis. A separate eidsr initiative, implemented by RTI International with PMI support, has also been launched in three districts in the Lake Zone regions (Kagera, Mwanza, and Mara). This initiative is still part of the larger IDSR; scale-up is expected to be done in different stages. Periodic Surveys Impact and outcome indicators are principally made available through national representative surveys conducted by the National Bureau of Statistics: mainly the Tanzania DHSs, THMISs, and Tanzania Service Provision Assessments. These surveys are performed regularly at fixed intervals, usually every four to five years. They collect core impact and outcome indicators to assess long-term progress toward achieving the malaria control strategic objectives defined in the NMCP M&E Plan. 19 Health Management Information System Content The objective of the HMIS is to provide data for measuring/monitoring the following key impact MIP indicators over time: Standardized laboratory-confirmed malaria cumulative incidence per year among children less than a month, 1 11 months, under five years old, and five or older IPTp uptake among pregnant women Standardized crude laboratory-confirmed malaria death rate among children less than a month, 1 11 months, under five years old, and five or older This information is reported annually through CHMTs and the Health Statistics Abstract. Data flow from the health facility level up to the central level, where they are compiled, analyzed, and reported. Health facility data are stored in a database at the epidemiology unit of the MoHSW. The NMCP and RCHS also receive informal reports directly from the districts and regions. 19 United Republic of Tanzania Ministry of Health and Social Welfare National Malaria Control Program Monitoring and Evaluation Plan Review of Monitoring of MIP through National HMISs: Tanzania

19 While the HMIS books were being revised, the M&E unit of the MoHSW decided to simultaneously improve the aggregate monthly summary, making it electronic through entry in DHIS 2. The routine DHIS 2 reports have been set up in the form of modules, each module specific to a service delivery or illness (e.g., ANC, malaria, family planning, labor and delivery). Each module collects monthly aggregate information for a few standardized key indicators being collected and reported nationally. There are currently 17 modules on DHIS 2 (see Box), 3 of which are in the process of being launched. Presently only the malaria module includes information on medical supplies and stock-outs. All the modules aside from the malaria one are register-specific: that is, the ANC module reports information collected from the ANC register and the family planning module from the family planning register. In contrast, the malaria module draws information from five locations/registers: OPD, IPD, deaths, laboratory, and commodities. But MIP indicators are only being collected and reported under the ANC module. For a detailed breakdown of all the forms containing malaria indicators, please see Annex 3. A national reporting system for capturing training information is not available, with the exception of family planning trainings, which have recently been collected through an RCHS-run family planning specific database. There is the possibility that this database will be used to capture all national trainings in the future; however, it is still too early to assess how efficient the database really is. Please visit for more information. The revised version of HMIS collects information on MIP at three service delivery sites: ANC, OPD, and IPD. Information for MIP as a cause of maternal death is also collected through death registers. Box. Modules on the DHIS 2 database 1. Malaria 2. Family planning 3. ANC 4. Labor and delivery 5. OPD 6. IPD 7. Diarrhea Treatment Corner 8. Voluntary medical male circumcision 9. Population 10. Tracer medicine 11. Child health 12. Prevention of mother-to-child transmission of HIV 13. Postnatal case 14. Death registry 15. Gender-based violence still new 16. Cervical cancer prevention still new 17. Postexposure prophylaxis still new Paper tools now record cases of malaria confirmed by RDT and microscopy, as well as fever cases, as confirmation of clinical diagnosis can now be conducted in all facilities. The indicators of primary interest that were reviewed included those having to do with the three components of MIP control promoted by WHO: IPTp ITN use among pregnant women MIP case management with RDTs and artemisinin-based combination therapy (ACT) The authors reviewed ANC client cards; ANC, OPD, and IPD registers; daily tally sheets; and monthly facility summary forms to closely determine how MIP indicators were being collected and reported. We also reviewed the facility death notification and report form. Table 4 summarizes the indicators collected through the HMIS. Tables 5 and 6 summarize key MIP and ANC data elements captured in HMIS registers and reports. More detailed results are summarized in Annexes 3 and 4. Review of Monitoring of MIP through National HMISs: Tanzania 11

20 Table 4. List of indicators being collected through HMIS INDICATOR 1. Number of clients given ITN/LLIN vouchers ANC client 2. Number of clients tested for malaria ANC client 3. Number of clients tested for malaria with positive results ANC client 4. Number of clients given IPT1 ANC client 5. Number of clients given IPT2 ANC client 6. MIP a OPD and IPD client 7. Maternal cause of death: MIP Deaths SERVICE DELIVERY POINT / CLIENTS a. Indicator number 6, MIP collected at OPD and IPD, is currently under discussion. Proposed changes have been discussed between HMIS and the NMCP as this indicator no longer satisfies NMCP needs. Table 5. Indicators related to MIP prevention in HMIS tools DOES THE TOOL HAVE A PLACE TO RECORD THE FOLLOWING INFORMATION? IPTp1 IPTp2 ANC REGISTER (BOOK 6) Yes (date recorded, col 16) Yes (date recorded, col 16) ANC DAILY TALLY FORM ANC MONTHLY SUMMARY FORM LABOR AND DELIVERY REGISTER LABOR AND DELIVERY DAILY TALLY FORM Yes Yes No No No Yes Yes No No No IPTp3+ No No No No No No ITN voucher Malaria test done Malaria test negative (all tests) Malaria test positive (all tests) Are instructions for completing the tool included inside the tool book? Yes (date recorded, col 16) Yes (first visit test, col 16) Yes (first visit test, col 16) Yes (first visit test, col 16) Yes Yes No No No Yes Yes No No No No No No No No Yes Yes No No No Yes No No Yes No No Table 6. Other ANC indicators relevant to control of MIP DOES THE FORM HAVE A PLACE TO RECORD THE FOLLOWING? Are instructions for completing the form included? MATERNAL AND CHILD HEALTH CARD ANC REGISTER No No No LABOR AND DELIVERY MONTHLY SUMMARY FORM ANC MONTHLY REPORT ANC visit All Not recorded First, follow-up, and fourth visits recorded Gestation of pregnancy at visit (in weeks) Recorded Recorded Gestational age <16 or 16+ weeks Iron/folate given Hb, packed cell volume recorded Blank field for data element Hb level recorded Recorded # of iron and folate given separately Not recorded HIV testing done pregnant woman Not recorded Recorded Recorded Recorded 90+ tabs of iron and folate together # of women who were tested for Hb on first visit and Hb <8.5g/dl (anemia) on first visit 12 Review of Monitoring of MIP through National HMISs: Tanzania

21 DOES THE FORM HAVE A PLACE TO RECORD THE FOLLOWING? Prevention of mother-to-child transmission on co-trimoxazole (prevention of opportunistic infections) MATERNAL AND CHILD HEALTH CARD ANC REGISTER Recorded Recorded Recorded ANC MONTHLY REPORT DATA FLOW AND REPORTING PROCESS Data Collection When a pregnant woman attends ANC services, IPT1 and 2 and ITN voucher provision is entered on her ANC card. It is national policy that pregnant women are tested for malaria during first ANC visit. In theory, pregnant women tested and treated for malaria are recorded in a separate OPD register for ANC; however, at Mkoani Health Centre, ANC nurses explained that there is no place for recording the results of this test, so they use the IPT1 column to write in the results. The ANC register and tally form record the result of the malaria test on the first visit, whether an ITN voucher has been given, the date of IPT1, and the date of IPT2. On their first visit to ANC, clients are referred to the laboratory, which is usually several meters away, for their malaria test. They return with the results, which are recorded on their ANC cards, in the ANC register, and on the ANC tally form. In large health centers and district hospitals, pregnant women with malaria-like symptoms, such as fever, are generally sent to the laboratory for a malaria test, then referred to the OPD if the test is positive. At the OPD, their details are entered into the OPD register and the women are also counted in the OPD tally form. The daily tally form records daily number of blood-slide positives, number of mrdt positives, number clinically diagnosed as having malaria, and number of MIP cases seen. Pregnant women attending smaller health centers and dispensaries, where all services are likely to be provided in the same room, are sent to the laboratory, if present, or clinically diagnosed and treated in one place. The health worker in charge then records their information in the OPD register as above. Limitations are experienced if the client does not know, or chooses not to tell her clinician, that she is pregnant (as pregnancy tests are not generally available in most health facilities). Flow of Data Reported through the DHIS 2 Electronic Database System Service delivery data flow in paper form from the facility to the district or council, specifically to the HMIS focal person. The reports are checked by CHMT members assigned to oversee M&E. These include the HMIS focal person, the DRCHCo, the district social welfare officer, and the district HIV/AIDS control coordinator. This team then enters the reports into the DHIS 2. Information can be accessed at other levels of the health system (e.g., regional and central) through this online information system. There are some routine data sources with MIP information that are not included in the national HMIS / DHIS 2 (e.g., training and supervision information). Please see Annex 4 for detailed explanation on the flow of reporting. Routine service delivery data will continue to be paper based from the facility to the district. With time, more and more HMIS monthly summary forms will be added as distinct modules into DHIS 2. For example, the facility-level malaria report is sent to the district HMIS focal Review of Monitoring of MIP through National HMISs: Tanzania 13

22 person, who shares the report with the district malaria and Integrated Management of Childhood Illness (IMCI) focal person (DMIFP) for validation. The facility-level reports are then entered into the DHIS 2 malaria module. Before DHIS 2, the DMIFP would forward the report to the regional malaria and IMCI focal person, who in turn compiled the region s report and forwarded it to the NMCP M&E unit. Now, as time passes and information is entered into the DHIS 2 database, regional- and central-level staff with a username and password who have been trained in DHIS 2 will be able to view facility-level, district-level, regional-level, and national-level reports. Malaria Monthly Aggregate Report To address the substantial delay in receiving reports through HMIS, the NMCP created the malaria health facility summary form, which is compiled monthly. Until recently, the form was a parallel system of reporting, but it has now been integrated into the DHIS 2 and has been rolled out in approximately half of the country. The report is prepared by facility staff who fill out the forms using information recorded in the HMIS registers, as well as laboratory and pharmacy records. Approximately half of the regions have been trained on this new malaria monthly summary form. See Annex 5 for DHIS 2 malaria monthly summary forms. In the malaria health facility summary form (see Annex 6: DHIS 2 Malaria Module), MIP is only recorded under subsection 1.(d)ANC (Malaria for Pregnant Women). All other subsections OPD, Admission, Deaths, Laboratory report malaria-related information but only disaggregate by sex (male and female) and by the following age categories: < 1 month, 1 11 months, months, and 5 years and above). Section 3. Logistic Data for Malaria Commodities records SP availability. MALARIA IN PREGNANCY DATA QUALITY Data quality checks are theoretically carried out at all levels of reporting, with particular emphasis at facility and district levels. Mechanisms set up to improve data quality include the following: The practice of compiling reports at facility level, with at least two people responsible to have a final look at the report. Once satisfied, the person responsible (usually the section incharge) signs off on the report. At district level, reports are delivered to the HMIS focal person. This person works with the M&E / DHIS 2 team to check completeness and reporting accuracy. The team follows up on missing reports or irregular data, usually by telephone. Another level of validation is during data entry: the DHIS 2 has in place predetermined minimum and maximum parameters for certain indicators. CHMT members visit the sites with problems during routine supportive supervision visits to rectify data entry and reporting errors. The majority of facility staff interviewed did not report problems with data quality and felt they had adequate data for making decisions. Problems with accuracy and timeliness of reporting still remain due to several factors, including work overload, dependence on the submission of hard copies of reports, and poor understanding of indicators by facility workers. The CHMT felt that the lag between training on the revised HMIS (which took place in July 2011) and provision of tools (in August 2012) was too long. The CHMT M&E / DHIS 2 team felt that data quality (including IPTp2 and LLINs) and completeness of reporting is an issue. The DRCHCo felt that there are too many clinical malaria diagnoses in spite of the shift in policy to confirm all malaria cases. 14 Review of Monitoring of MIP through National HMISs: Tanzania