Aual Targeted Itervetio s Evaluatio eptember 010 Compiled Report Uttar Pradesh tate AID Cotrol ociety (UPAC) UNITED NATION CHILDREN FUND (UNICEF)
Uttar Pradesh tate AID Cotrol ociety Aual Targeted Itervetios Evaluatio eptember 010 Uttar Pradesh tate AID Cotrol ociety (UPAC) as respose to HIV situatio i the state has iitiated Targeted Itervetios (TIs) amog most at risk populatio (MARP) for improvig their sexual health, cotrol the spread of HIV ad icrease access to prevetio through o-govermetal orgaizatios (NGOs) ad commuity based orgaizatios (CBOs). As part of the Natioal AID Cotrol Orgaizatio s (NACO) atioal policy, UPAC with the support of UNICEF has carried out a aual evaluatio of 1 TIs durig eptember 010, who have completed the aual cycle of implemetatio. Objectives of the evaluatio: The objectives of the TI evaluatio were: A). To assess the performace of the programme 1. To assess the performace of TIs i terms of gaps betwee plaed targets ad actual achievemet.. To assess compoet-specific quality of TI.. To assess the kowledge level, codom use, health seekig behaviour for TI.. To assess the expediture compoet wise ad look for variace. 5. To assess the quality ad performace of project staff ad peer educators durig the period. B). To assess the systems i place 6. To assess various systems (accouts/ fiace/huma resource/program maagemet) i place at NGO level ad their effectiveess i the implemetatio of TIs. 7. To assess the orgaizatio capacity Methodology The TI evaluatios were carried out as per the tools ad methodology suggested by NACO i the Aual Evaluatio for TI NGOs 010 maual. Team of two programme ad oe fiacial evaluator evaluated each itervetio for a period of two days. UNICEF ad UPAC idetified the exteral experts as evaluators for the evaluatio task. Before iitiatig the evaluatios, the evaluators were orieted o the tools, maual ad methodology apart from the logistic arragemets o 1 th eptember 010 i Luckow. Altogether 8 programme experts ad fiacial experts, divided ito teams, coducted the evaluatio. UPAC ad UNICEF officials allocated cluster of itervetios to each of the team. Three teams were allocated with 5 TIs each ad 1
team was allocated 6 TIs. This allocatio was based o the geographical clusterig ad the experiece of the evaluators. All evaluators atteded the traiig. The orietatio focused o providig clarity o TIs i UP, Methodology of Evaluatio & corig ad submissio of reports of evaluatio, dos ad do ot s for the evaluators, harig of experiece related to moitorig of TIs i UP, fiacial evaluatio ad team meetig, sharig of tools ad documets regardig TIs by UPAC, submissio of the pla for retur trip ad iformatio sharig regardig the NGOs, Logistical arragemets, paymet of advace; submissio of deliverables. UPAC, TU officials provided guidace to evaluators o the logistic facilities. The teams departed to their destiatios ad iitiated the evaluatios from eptember 1, 010. UPAC has developed team wise pla for coverig all projects iitiated durig the period. The pla for the TI evaluatios was as follows: Evaluatio Pla No Name of the NGO Typology Locatio Date of Evaluatio 1 arathi Developmet Foudatio Truckers Luckow 1 1 ep 10 Grami Vikash iksha astha FW Raibareilly 15-16 ep 10 aram astha Luckow 17-18 ep 10 Krishi Evam Gramodyog Vikas 0 1 ep 10 Baharaich astha. 5 Youth Roud Table ociety Faizabad ep 10 6 Zila Yuwa Kalya amiti FW Allahabad 1 1 ep 10 7 Idia Istitute of Rural 15-16 ep 10 Truckers Allahabad Techology 8 Carig Of People Ad Advacig 17-18 ep 10 MM Pratapgarh Life ociety 9 Maav Gaurav Nirma astha FW Varaasi 0 1 ep 10 10 Abhudaya astha Bada ep 10 11 ChadraKata Gramodyog ewa 1 1 ep 10 iddharth Nagar astha 1 Baal Vai Avam Nirbal ewa 15-16 ep 10 Mau Naari Kala Kedra amiti 1 Prograsiv Agecy to Humaity Azamgarh 17-18 ep 10 1 Vaishavi shiksha samiti oebhadra 0 1 ep 10 15 Nav Bhartiya Nari Vikas amiti Truckers Gorakhpur ep 10 16 Kartik iksha astha Moradabad 1 1 ep 10 17 Gramee Vikas astha 15-16 ep 10 Meerut (GRAVI) 18 Grami Vikas Evam Maav ewa 17-18 ep 10 Muzaffaragar astha. 19 Warsi ewa ada Etawah 0 1 ep 10 0 Pachsheel ocial Welfare ep 10 Agra ociety 1 Maav Vikas Parishad Bareilly 5 ep 10 oo after evaluatios, the team leaders i cosultatio with the co-evaluator ad fiacial cosultat developed detailed arrative report o the performace of the projects ad scored as per the criteria suggested i evaluatio tool from NACO. The score sheets were mailed to NACO.
UPAC with the support of UNICEF arraged a debriefig workshop o 7 th eptember 010 to share the key fidigs from the evaluatio process. Officials from UPAC JD (TI), AD (TI), NACO, TU members icludig team leaders ad programme officers, Evaluatio team leaders, Techical cosultats ad Fiacial cosultats atteded the workshop. Officials from UNICEF, Fuctioaries of NGO parters ad the key facilitators participated i the workshop. Process of debriefig meetig: The team leader from each team made a presetatio o the key fidigs related to program, fiace ad orgaizatioal capacities. They also made idicative suggestios for improvemet. The process icluded: The Process : 1. Itroductio to the programme for participats. Presetatio of Key observatios by the cosultats o fiace, orgaizatioal capacity ad programme delivery. Feed back sharig from the NGO participats ad TU programme officers ad NACO represetative. Clarificatios from the cosultats to the commets of participats 5. I additio towards the ed a feed back o the etire evaluatio process was sought from the NGO parters. Key observatios ad uggestios Key observatios o the TI programme : 1. Over all the participats were satisfied with the evaluatio processes.. ome of the participats shared their cocer o the delay i gettig fuds, which subsequetly affected the programme delivery.. The cosultats shared their cocer about the documetatio systems i the project. They felt that the documets kept i some of the orgaizatios were just to meet the tool requiremets 1. Over all the projects presece felt i the field i case of most of the projects.. I some projects visibility of HRG ad cotactig them i the filed was a issue.. Commuity mobilizatio iitiatives eed to be stregtheed.. taff tur over ad staff capacities were the key ifluecig factors 5. takeholder participatio i project plaig ad implemetatio eeds improvemet. 6. pecific capacity buildig programmes eed to be orgaized for the team members of projects across the state ad exposure visits eed was clearly visible 7. Trackig of referrals ad referral systems eeds to be stregtheed. 8. ocial marketig of codoms yet to take off i most of the projects. 9. Fuds release to projects has bearig o the staff tur over 10. Likages with govermet to be stregtheed
Overall the NGO represetatives expressed that the evaluatios happeed i a smooth, commuity friedly eviromet ad up to the satisfactory level of all the stakeholders associated with whole process of TI implemetatio. They ackowledged the fact of the effort put by the evaluatio team coversig with the commuity members. NGO represetatives welcomed the fidigs alog with TU officials. 5
Performace rakig of TIs Name of the Orgaisatio Typology Locatio Fiace Orgaisatioal core - Basic core - upport derived Recommedatio s by the evaluatio team 1 Prograsiv Agecy to Humaity Azamgarh 8 10 116.8 1.5 87.1 developig learig site ChadraKata Gramodyog ewa astha iddharth Nagar 81 10 11 1 85. developig learig site Pachsheel ocial Welfare ociety Agra 80 0 8 108.8 1 8.9 developig learig sites. Baal Vai Avam Nirbal ewa Naari Kala Kedra amiti 5 Vaishavi shiksha samiti 6 Maav Gaurav Nirma astha FW Mau 81 1 9 111. 1.5 8.8 oebhadr a 75 0 9 10 0.8 1 78.9 Varaasi 65 9 98.6 11.5 75.5 developig learig site specific iputs o areas of improvemet oted. cotiuatio as NGO has good presece as well as peetratio i the field 7 Grami Vikas Evam Maav ewa astha. Muzaffara gar 68 0 8 96 8. 10 69.8 cotiuatio 8 Warsi ewa ada Etawah 67 1 9 97 7.6 10 68.7 cotiuatio 9 Abhudaya astha Bada 6 9 96 5. 9.5 66.8 cotiuatio of cotract 10 Gramee Vikas astha (GRAVI) Meerut 56 1 9 86 8.8 10 65 Cotiuatio 6
Name of the Orgaisatio Typology Locatio Fiace Orgaisatioal core - Basic core - upport derived Recommedatio s by the evaluatio team 11 Maav Vikas Parishad 1 Kartik iksha astha Bareilly 5 19 8 80.8 11 60 Moradabad 56 8 86 1. 8.5 59. specific suggestio o improvig the quality of the project activities. specific suggestio o improvig the quality of the project activities. 1 Carig Of People Ad Advacig Life ociety MM Pratapgarh 5 9 76 6. 6 5. cotiuatio of cotract 1 Grami Vikash iksha astha 15 arathi Developmet Foudatio 16 Youth Roud Table ociety 17 Krishi Evam Gramodyog Vikas astha. Truckers FW Raibareilly 0 19 8 67. 5.5 8.1 Luckow 1 8 5 11. 5 5.8 Faizabad 0 8 70 5. Baharaich 1 19 6 66. 6.5. icreased moitorig o programme maagemet ad service delivery. specific iputs for improvemet o the guided lies of the Natioal Networked Targeted Itervetio for Truckers Project. specific iputs related to Harm Reductio Approaches. Recommeded that the cosideratio of accordig the extesio of cotract or otherwise i favor of the TI NGO be decided by the UPAC as the TI NGO is disqualified i Orgaisatioal. 7
Name of the Orgaisatio Typology Locatio Fiace Orgaisatioal core - Basic core - upport derived Recommedatio s by the evaluatio team 18 aram astha 19 Zila Yuwa Kalya amiti FW Luckow 0 8 70 1.6 6.5 Allahabad 19 10 6 1.6 1. specific iputs related to Harm Reductio Approaches. extesio of cotract for moths with specific iput for strict supervisio of field level performace. After moths TI must be evaluated agai by exteral evaluators the cotract ca be reewed or termiated. 0 Nav Bhartiya Nari Vikas amiti Truckers Gorakhpur 16 1 5 8.8.5 1.9 discotiuatio 1 Idia Istitute of Rural Techology Truckers Allahabad 0 18 7 5 0 0 0 disqualified because NGO failed to qualify i Fiace ad Orgaizatioal. Out of the 1 TIs evaluated 17 projects could qualify demostratig adequate capacities ad itervetio implemetatio, ad 1 project with specific coditio o extesio of cotract for moths with strict supervisio of filed level performace followed by exteral evaluatio to decide o reewal or termiatio of cotract. Remaiig TIs were ot recommeded for cotiuatio by the evaluatio team. Aalysis of the above performace rakig based o the differet idicators reveals the followig:.no. Recommedatio category Number of NGOs 1 developig learig sites cotiuatio 6 specific iputs 7 discotiuatio due to iadequacy i orgaizatioal capacities (ad fiacial capacities) 5 coditio 1 1 8
Cosolidated FW projects performace Name of the Orgaisatio Locatio Fiace Org Basic upport derived Recommedatio 1 Maav Gaurav Nirma astha Grami Vikash iksha astha Zila Yuwa Kalya amiti Varaasi Raibareilly Allahabad 65 9 98.6 11.5 75.5 0 19 8 67. 5.5 8.1 19 10 6 1.6 1. cotiuatio as NGO has good presece as well as peetratio i the field icreased moitorig o programme maagemet ad service delivery. extesio of cotract for moths with specific iput for strict supervisio of field level performace. After moths TI must be evaluated agai by exteral evaluators the cotract ca be reewed or termiated. Cosolidated MM projects performace Name of the Orgaisatio Locatio Fiace Org Basic upport derived Recommedatio 1 Carig Of People Ad Advacig Life ociety Pratapgarh 5 9 76 6. 6 5. cotiuatio of cotract 9
Cosolidated projects performace Name of the Orgaisatio Locatio Fiace Org Basic upport derived Recommedatio 1 Pachsheel ocial Welfare ociety Abhudaya astha Agra Bad a 80 0 8 108.8 1 8.9 6 9 96 5. 9.5 66.8 developig learig sites. cotiuatio of cotract Kartik iksha astha Moradabad 56 8 86 1. 8.5 59. specific suggestio o improvig the quality of the project activities. Youth Roud Table ociety Faizabad 0 8 70 5. specific iputs related to Harm Reductio Approaches. 5 aram astha Luckow 0 8 70 1.6 6.5 specific iputs related to Harm Reductio Approaches. Cosolidated Trucker projects performace Name of the Orgaisatio Locatio Fiace Org Basic upport derived Recommedatio 1 arathi Developmet Foudatio Luckow 1 8 5 11. 5 5.8 specific iputs for improvemet o the guide lies of the Natioal Networked TI for Truckers Project. Nav Bhartiya Nari Vikas amiti Gorakhpur 16 1 5 8.8.5 1.9 discotiuatio Idia Istitute of Rural Techology Allahabad 0 18 7 5 0 0 0 disqualified because NGO failed to qualify i Fiace ad Orgaizatioal. 10
Cosolidated projects performace Name of the Orgaisatio Locatio Fiace Org Basic upport derived Recommedatio 1 Prograsiv Agecy to Humaity ChadraKata Gramodyog ewa astha Baal Vai Avam Nirbal ewa Naari Kala Kedra amiti Vaishavi shiksha samiti Azamgarh iddharth Nagar Mau oebhad ra 8 10 116.8 1.5 87.1 81 10 11 1 85. 81 1 9 111. 1.5 8.8 75 0 9 10 0.8 1 78.9 developig learig site developig learig site developig learig site specific iputs o areas of improvemet oted. 5 Grami Vikas Evam Maav ewa astha Muzaffar agar 68 0 8 96 8. 10 69.8 cotiuatio 6 Warsi ewa ada Etawah 67 1 9 97 7.6 10 68.7 cotiuatio 7 Gramee Vikas astha (GRAVI) Meerut 56 1 9 86 8.8 10 65 cotiuatio 8 9 Maav Vikas Parishad Krishi Evam Gramodyog Vikas astha. Bareilly Baharaich 5 19 8 80.8 11 60 1 19 6 66. 6.5. specific suggestio o improvig the quality of the project activities. Recommeded that the cosideratio of accordig the extesio of cotract or otherwise i favor of the TI NGO be decided by the UPAC as the TI NGO is disqualified i Orgaizatioal. TIs recommeded for discotiuatio:.no Orgaizatio Locatio Thematic group 1 Krishi Evam Gramodyog Vikas astha Baharaich Nav Bhartiya Nari Vikas amiti Gorakhpur Truckers Idia Istitute of Rural Techology Allahabad Truckers 11