PNPM Generasi Quarterly Progress Report: January to March 2014 Summary Information Status Active Activity Number RETF: P122032 (TF097410), P132585, and P147658 (TF014769) BETF: P111966 (TF092194) Task Team Leader Robert Wrobel (rwrobel@worldbank.org) Executing Agencies Directorate for the Empowerment of Community Social and Cultural Institutions, Directorate General for Village Community Empowerment (PMD), Ministry of Home Affairs Start date to Closing Date BETF: 26 May 2008 to 31 December 2017 (115 months) RETF: TF097410: 10 August 2010 to 31 December 2014 (52.5 months); TF014769: 24 June 2013 to 31 December 2017 (54 months) Geographic Coverage 6,000 villages in 370 poor sub-districts in eleven provinces (East Nusa Tenggara, West Nusa Tenggara, West Java, East Java, North Sulawesi, Gorontalo, West Sulawesi, Maluku, West Kalimantan, Central Kalimantan, and South Sumatra) Approved Budget US$ 110,840,297 Disbursements during the US$ 6,168,922 Quarter Disbursements US$ 94,228,346 Progress Project Overview The development objective of PNPM Generasi is to empower local communities in poor, rural subdistricts in project provinces to increase the utilization of health and education services. The program aims to facilitate the achievement of three Millennium Development Goals in which Indonesia s performance is lagging: (i) the achievement of universal basic education; (ii) a reduction in child mortality; and (iii) improvements in maternal health. Based on the existing PNPM Rural platform and utilizing the CDD approach, PNPM Generasi uses community planning and incentivized sub-district grants to improve outcomes in terms of twelve priority health and education indicators. Communities, with assistance from PNPM facilitators, work with health and education service providers to identify locally appropriate ways to improve access to and increase the use of health and education services. Sub-district grants are used to address either small-scale supply or demand constraints, depending on where the need is the greatest. Overall Progress Towards Development Objective Progress toward the project s development objective continues to be satisfactory. An impact evaluation completed in 2011 showed that the project has been successful in achieving its target outcomes in terms of improving immunization coverage, prenatal care visits and assisted deliveries (10-11 percent increase in associated indicators) in the period from 2007 to 2010. On average, PNPM Generasi had a statistically significant positive impact on the twelve target health and education indicators, with the greatest impacts observed in areas with low baseline health and education indicators. The evaluation also showed that the program successfully targeted program benefits,
particularly in-kind benefits, to people in the bottom two income quintiles. By 2014, PSF Grant funding has been used to support government efforts to scale-up PNPM Generasi to at least 499 poor, rural sub-districts that perform sub-optimally in terms of specified health and education indicators. During the reporting period, a number of key achievements had been made. PMD has mobilized project managers at the provincial level and district and sub-district facilitators in the 130 new target sub-districts in three provinces (Central Kalimantan, West Kalimantan, and South Sumatra). PMD has also revised its training curriculum for facilitator pre-service and refresher training to focus on maternal and child nutrition and children with disabilities. PMD s Project Secretariat and National Management Consultant (NMC) conducted extra Financial Management-focused supervision during the first quarter of 2014 to mitigate risks associated with the bunching of sub-district grant disbursements during the last quarter of calendar year 2013. Key Developments during the Quarter From 2014 onwards, PMD has been using data from its Performance Monitoring Survey (PMS), based on a small cluster sampling methodology, to report on progress towards achieving key performance indicators (KPIs). The use of this strategy means that results from the survey can be used to report on how the program is performing on average across all participating villages. However, the methodology does not allow a causal link to be built between PNPM Generasi and reported outcomes. The first round of the survey was delivered by Universitas Gajah Mada (UGM) in October 2013 across 30 sub-districts in five provinces. The results show that in 2013 PNPM Generasi met or exceeded targets for five out of seven KPIs. For example, 91 percent of pregnant women in targeted villages received four prenatal care visits (against a target of 85 percent); 89 percent of deliveries were assisted by trained professionals (against a target of 80 percent); and 71 percent of community members involved in project planning and decision-making meetings were women (against a target of 65 percent). The project fell short in 2013 on involving 60 percent of the poorest community members in project planning and decision-making meetings. Only 75 percent of children under five were weighed monthly, whereas the target was 80 percent. The provision of intensive support to the implementing agency contributed to the following outputs during the quarter: PMD s 2014 budget for PNPM Generasi, which totals US$60.8 (US$19.9 of which is government-financed), was made effective; PMD issued decrees establishing national, provincial, and district work units (satker); PMD mobilized provincial specialists, district and sub-district facilitators in the 130 new target subdistricts in West Kalimantan, Central Kalimantan, and South Sumatra; The qualitative study on PNPM Generasi s impacts on maternal and child nutrition was finalized and disseminated; and PMD has initiated procurement for the follow-on contract for the Administrative Services Firm that manages national and provincial specialist HR functions. Critical Challenges Indonesia s political transition in 2014 creates risks that the incoming government may not meet the multi-year funding needs of PNPM Generasi. To mitigate this risk, the PSF is working with PMD, Bappenas, and Menko Kesra to formulate a strategy and work plan for a three-year transition from PNPM to Village Law implementation. Additional work is needed to assist the Ministry of Health (MoH), PMD, Bappenas, and the MCA-I to coordinate operational and analytical activities linked to PNPM Generasi. An implementation manual has been drafted by a technical team represented by the stakeholders above. It proposes that a sub-committee be established under the PNPM Pokja Pengendali chaired by Bappenas and
supported by the PSF and be tasked with overseeing the work of MoH, MCA-I, and PMD. Activities Planned for the Next Quarter Support will be provided to the Government to finalize additional financing to PNPM Generasi for the period from 2014 to 2018. It is anticipated that the additional financing grant amendment will be negotiated in April 2014; Support will be provided to Bappenas to coordinate with the MCA-I to implement impact evaluation in the three new PNPM Generasi provinces. Technical assistance will be provided to PMD to formulate the three-year transition plan from PNPM to Village Law implementation, and introduce design changes to PNPM Generasi if needed; Support will be provided to PNPM stakeholders to finalize and enact a governance structure and general guidelines for the Millennium Challenge Account-Indonesia (MCA-I), the Ministry of Health, the Ministry of Education and Culture, PMD, Bappenas, and Kemenko Kesra, which are expected to ensure the smooth implementation of complementary supply-side activities in PNPM Generasi areas; and Support is being provided to PMD to conduct refresher and pre-service trainings for facilitators at the national and provincial levels.
Key Performance Indicators Indicator Base line Achievements for 2014 Achieved in 2014 Project Development Objective: Empower local communities in poor, rural sub-districts in the project provinces to increase utilization of health and education services. # of direct project beneficiaries # of kecamatans with communities benefiting from improved access to health and education services. 5.4 # of female beneficiaries 2.7 Improved access to and utilization of health services in the targeted areas: % of pregnant women receiving four prenatal care visits % of deliveries assisted by trained professionals % of children under five weighed monthly Improved access to and utilization of education services in the targeted areas: junior secondary enrollment rate % community members involved in planning and decision-making meetings: women % community members involved in planning and decision-making meetings: poorest community members % of sub-districts in which service providers attended 6.7 3.255 n/a 6.7 1.7-5 212 499 369-130 499 499 0-80 75 75 70 65 58 60 3.05 1.89-1.16 3.05 973,456-2.08 Remarks Data from 75% and 41% of villages were uploaded to MIS for 2012 and 2013 respectively. The incomplete data entry is due to the slowness of facilitators on filling-up the forms and also that some data are being inserted by the district computer operator. Anticipated that target will be met once remaining MIS forms are uploaded. Data from 75% and 41% of villages uploaded to MIS for 2012 and 2013 respectively. This is due to the slowness of facilitators on filling-up the forms and also that some data are being input by the district computer operator. Anticipated that target will be met once remaining MIS forms are uploaded. >85 91 +11 85 N/A N/A From 2014 onwards, PMD is using data collected through its Performance Monitoring Survey, which was delivered by UGM in October 2013. The survey was conducted across 30 subdistricts in five provinces. The sampling strategy is such that results from the survey can be used to understand how the program is performing on average. However, the methodology does not allow a causal link between PNPM Generasi and reported outcomes to be established. Data for 2014 will be collected through a second round of the survey, to be conducted in October 2014. (Remark1) >80 89 +14 80 N/A N/A See above (Remark1) >80 75 0 80 N/A N/A See above (Remark1) >75 99 +24 75 N/A N/A See above (Remark1) >65 71 +6 65 N/A N/A Data is supposed to be transferred from MIS but there has been a delay in data entry as discussed above. (Remark 2) >60 57-1 60 N/A N/A See above (Remark 2) >65 99 +34 65 N/A N/A See above (Remark 2)
Key Performance Indicators Indicator Base line MAD (Musyawarah Antar Desa) to discuss status of health and education services Component 1: Generasi Kecamatan Grants % villages meet minimum target for all 12 performance indicators % of sub-districts with 100% disbursement rate at the end of program cycle FY 2013 Achievements for 2014 Achieved in 2014 Remarks 25 >30 42 +12 30 N/A N/A See above (Remark 2) 85 >90 99 +14 90 N/A N/A See above (Remark 2) % of previous non-users as 25 >30 31 +6 30 N/A N/A See above (Remark 2) beneficiaries of sub-projects % of village facilitators provided feedback on health and education services 30 >40 33 +3 40 N/A N/A Cf. In 2013, of the 17 percent of villages who provided data, 33 percent reported that facilitators provided feedback. Component 2: Facilitation Support % of district government conducted supervision to communities as planned % sub-districts conducted planning and coordination workshop with district-level health and education office to discuss Generasi activities % of district-level MIS data completed (verified, entered and submitted) 40 >45 45 N/A N/A Planned for later in 2014. 40 >45 45 0-45 The year 2014 is still in the socialization stage, with workshop coordination with districts health and education services planned in May / June. 80 >85 44-41 85 N/A N/A The process for uploading MIS forms for 2013 began in Oct 2013. Communities are now beginning to implement the proposed activities. % of sub-districts in which 50% of villages conducted crossvillage audits as planned 60 >70 24-36 70 N/A N/A data from 89 of 369 2013 sub-districts. Component 3: Implementation Support and Technical Assistance % of planned facilitators at all levels were recruited and trained according to the agreed training plan % of sub-districts audited each year and for which the results are published Component 4: Project Management Support Multi-sectoral regional and national evaluation workshops conducted 80 >85 85 72-13 72% of the facilitators at all levels in existing locations have been trained. Total recruited (including those in new locations but no yet trained) are 691 facilitators. The training for new facilitators will be conducted in April-May 2014. 20 20 20 0-20 No audit activities will be conducted during the first quarter 2014. 0 16 12-4 3 2-1