REQUEST FOR APPLICATIONS TO SERVE AS A LOCAL RESEARCH PARTNER FOR THE EVALUATION OF THE IMPROVED SERVICES FOR VULNERABLE POPULATIONS (ISVP) JANUARY 2018 Overview and Purpose of RFA Introduction The MEASURE Evaluation Phase IV project (http://www.cpc.unc.edu/measure ) is a United States Agency for International Development (USAID)-funded cooperative agreement headquartered at the Carolina Population Center of the University of North Carolina at Chapel Hill (UNC-CH). MEASURE Evaluation seeks to strengthen monitoring and evaluation functions and systems and build individual, organizational and national capacity to assess the effectiveness of public health interventions. MEASURE Evaluation is implemented by UNC-CH in partnership with The Futures Group International, ICF International, John Snow, Inc., Management Sciences for Health, and Tulane University. MEASURE Evaluation seeks one or more research organization(s) to serve as our local partner(s) for the purpose of endline data collection and management for the impact evaluation of the Improved Services for Vulnerable Populations (ISVP) Project in Rwanda. The purpose of this Request for Applications (RFA) is to determine the organization(s) best suited to play this role. The successful applicant(s) will demonstrate the superior technical, logistical, and organizational capacity skills needed to conduct a large-scale quantitative study. If one or more successful applicant(s) is/are selected, they will be contracted through the University of North Carolina at Chapel Hill. Applicants must choose to apply for 1) endline survey management/oversight; 2) data collection implementation, or 3) both endline survey management/oversight and data collection implementation. Improved Services for Vulnerable Populations (ISVP) Project ISVP, known locally as Twiyubake, is a 5-year, USAID-funded project awarded to Global Communities in partnership with AVSI, Partners in Health, and Plan, as well as local Rwandan civil society organizations (CSOs). The overarching project goal is to improve the protection of vulnerable populations against adverse circumstances, thus contributing to reducing the risk and impact of HIV/AIDS and other health conditions on the most vulnerable populations. Vulnerable populations are defined as Orphans and Vulnerable Children (OVCs), People Living with HIV/AIDS (PLHAs), including members of the household caring for these two groups, very poor households, especially female and widow-headed households, and out of school youth.
Twiyubake aims to assist 50,000 households (including 250,000 children, youth and adults) by reducing economic vulnerability and empowering families to make investments to meet the unique needs of young children and adolescents. The project, led by Global Communities, will focus on knowledge-based skills development that enhances households capacity (knowledge, opportunities, and resources) to mitigate the impact of HIV/AIDS. In so doing, the Twiyubake project will address four intermediate results (IR): IR 1: Increased capacity of families and communities to provide healthy, nurturing, and engaging environments for vulnerable children <5; IR 2: Family economic vulnerability decreased; IR 3: Increased knowledge, attitudes, skills, aspirations and confidence of adolescents transitioning to adulthood; and IR 4: Increased capacity of communities to provide essential preventative and protective services to vulnerable families and children. Strategy The foundation of the Twiyubake strategy is four core household economic strengthening (HES) interventions: 1) integrated savings and lending groups (ISLGs); 2) financial education for ISLG members; 3) promotion of micro and small enterprise and cooperative development to ISLG members; and 4) activities to improve intra-household communication and joint economic decision-making. In subsequent years, groups will be able to access additional services such as training and business advisory services through a fee-for-service model. Building on the four core HES interventions and specifically layering on the ISLG platform, Twiyubake is implementing and/or promoting a number of additional wrap-around services. Twiyubake will work with families to identify economic, health, and education needs, then promote or refer to services as appropriate. Some of the specific individual and household interventions include: Consumption support (or household grants); health promotion and referrals promotion of HIV testing and counseling for all ages; referrals and assistance to receive treatment among PLHA; family planning and male involvement advocacy; parenting education on early childhood development; and, sexual and reproductive health and gender-based violence education and referrals for adolescents. Additional work by Twiyubake through local partners will include working alongside government agencies to improve health service delivery and referrals, strengthen child protection, and support locally-formed gender-based violence committees to combat violence in the home and the community. The Twiyubake Project is being implemented in 12 districts (See Appendix A for district list) and 75 sectors and runs from March 2015 March 2019.
Impact Evaluation MEASURE Evaluation has been designated as the external evaluator for the Twiyubake Project. MEASURE Evaluation, with the support of USAID/Rwanda, will examine changes in key outcome indicators and will evaluate the impact of the ISVP interventions among beneficiaries in the 12 districts. The study will use a prospective, experimental research design, using a difference-in-differences (DID) estimation strategy with longitudinal data to evaluate the relative impact on economic, health and education outcomes, of the full package of Twiyubake services (henceforth Full ISVP) compared to receipt of HES-only services (henceforth HES-Only), and compared to a control group receiving no ISVPrelated services. Baseline data collection took place April to July 2017. Endline data collection is planned July-September 2018. The cross-sectional survey at endline will survey households with at least one child less than 18 years of age from active beneficiary households in 45 intervention sectors. The control group consists of households eligible for the program but living in 24 sectors assigned to the control arm. The same 4,000 households surveyed at baseline will be surveyed at endline in 2018. Endline Survey Implementation The objective of the endline survey is to collect endline quantitative data on indicators of child health and nutrition, food consumption, food security, HIV testing, household economic strengthening (HES) status, and education, among the target population in ISVP project areas and their respective comparison areas located in the 12 districts. All data collection will be completed using computer tablets provided by and pre-programmed with CSPro by the MEASURE Evaluation team. Survey tools The Twiyubake Endline Survey will be designed to measure key indicators at the household and individual level. Data will be collected from primary caregivers of children 0-17 years of age, youth 13-17 years of age, heads of household, and ISLG participants. Similar tools will be applied across primary caregivers, heads of household, and ISLG participants, with duplicative modules skipped when one respondent replies for multiple roles (e.g., head of household may also be primary caregiver). The indicators to be measured will be mainly, but not limited to, those listed in Appendix B. Each strata of respondents will be administered unique and detailed survey. The questionnaires will be the same as those used at baseline with potential for limited additions, but applicants should prepare their applications assuming approximate total household interview time of 3-3.5 hours, using the following instruments: 1. Household Questionnaire To be administered to the head of the household. It is designed to capture demographic and socioeconomic characteristics of the household, including consumption and housing characteristics. It will also collect information on participation in social or development programs. Approximate time is 75 minutes. 2. Caregiver Questionnaire
To be administered to all of the primary caregivers of children 0-17 years of age in the household. Tool is designed to record demographic characteristics of the caregiver, health status of caregiver, and use of services. Approximate time is 60 minutes. 3. Youth 10-17 years Questionnaire To be administered to one child age 10-17 in each household. Tool covers questions about education, chores, disabilities, psychosocial well-being, and sexual and reproductive knowledge, and use of services. Approximate time is 30 minutes. 5. ISLG Questionnaire To be administered to one household member most knowledgeable about household participation in a local savings and lending group. Tool covers social capital, illness and health seeking behavior, financial self-efficacy, and group participation. Approximate time is 45 minutes. Sampling The study applied a multi-stage sampling design to obtain a representative sample of households (HH) in two intervention and one control arms. The sampling size estimated for this study was based on the outcomes of percent of 6-59 month olds who meet minimum dietary diversity standards ( 4 food groups past 24 hrs), percent of 13-17 year olds with regular school attendance, and percent of HH with moderate or severe HH hunger (per FANTA scale). Approximately 4,000 households were surveyed at baseline. These same households will need to be tracked and interviewed for endline. Activities and Responsibilities for the Organization(s) The successful applicant(s) will be responsible for one or both sets of the following activities and outputs/deliverables: Role 1. Research partner and endline survey management/oversight Activities Serve as local primary investigator; Lead regular update calls/meetings with MEASURE Evaluation and data collection organization during fieldwork preparation and conduct; Participate in the (minor) revision and finalization of the questionnaires; Translate questionnaire revisions, as needed; Lead training of the data collection field team, in coordination with data collection organization; organize and host training, including securing and paying for space, food, etc.; adequate time should be planned for training on all questionnaires with appropriate presentations and on how to use the
tablet, for role-playing, and for field testing with all enumerators and supervisors; assume minimum of 10 days training; Review and revise supervisor and enumerator manuals drafts developed at baseline as needed; consult with data collection organization and MEASURE Evaluation on this; Submit final surveys, other required materials to local IRB, NISR, and local ministries (e.g., Ministry of Gender, Ministry of Health, Ministry of Local Governance, etc.), and conduct regular follow-up inperson and by phone as needed; Oversee the pre-test of questionnaires, as conducted by local data collection organization; primary investigator must go to the field along with field staff for pre-testing; Develop pre-test report, with input from data collection organization; Develop fieldwork plan describing projected dates/locations/steps of field work activities in consultation with data collection organization; Provide oversight of all field work and management with appropriate quality control measures/checking; Maintain regular communication with supervisors for data collection; Primary investigator must travel to and stay in field for the first 1-2 weeks of data collection to monitor quality and help address problems as they arise; thereafter, visit bi-weekly for 2-3 days each trip; Manage tablet software (CSPro) updates in collaboration with MEASURE Evaluation; Draft bi-weekly reports describing supervisory and monitoring findings and actions; Following data collection, provide input into fieldwork report developed by data collection organization; Participate in the writing of a series of preliminary and final reports concerning the results of the ISVP baseline survey; and, Organize and host a half-day dissemination event for 30-40 participants. Outputs/Deliverables Detailed workplan and timeline of activities; Final edited questionnaires (household, caregiver, children 10-17 years, ISLG member) in Kinyarwanda and English; Report on pre-testing of questionnaires; Final supervisor and enumerator field manuals;
Report on training activities; Biweekly reports on field work preparations, progress of data collection, supervisor observations/comments, and limitations/problems encountered; Input into the fieldwork report from data collection organization; Input into the drafting of the endline survey report; Dissemination meeting for the endline survey report. Role 2. Data collection implementation Activities Organize field work activities; Recruit, hire, co-train, and manage the field work team (under the lead of the research partner organization); Provide input on supervisor and enumerator manuals; print copies of both for field staff; Implement key aspects of the sampling strategy, including tracking and locating surveyed households from the baseline in both program and control areas; Print photocopy back-ups of surveys in case of tablet failure; Conduct field work with appropriate supervisory and quality check activities; Organize and conduct the pre-test of questionnaires under lead of local research partner; data collection lead must go to the field along with field staff for pre-testing; print copies of surveys for back-up in case of tablet failure in pre-test; Provide input on pre-testing report developed by local research partner; Organize and conduct field work, ensuring appropriate quality checks at different stages of field work and data management process, including follow-up to data quality inquiries from MEASURE Evaluation and local research partner and clear and prompt communication of challenges encountered; data collection lead must accompany fieldworkers for at least the first 1-2 weeks of data collection and thereafter visit regularly for 1-2 days each visit; Conduct appropriate quality checks at different stages of field work and data management process, including follow-up to data quality inquiries from research team;
Provide secured storage of all hard copy documents with identifying information (e.g., interview assignments, household tracking sheets); Make tablet software (CSPro) updates under lead of local research partner; Purchase and manage devices and any associated data/cellular contracts to upload data from tablets to online server; Develop fieldwork report providing schedule of work, successes, challenges, with input of local research partner; Participate in the writing of a series of preliminary and final reports concerning the results of the ISVP endline survey; Participate in a dissemination event. Outputs/Deliverables Detailed workplan and timeline of activities; Daily uploads of data to UNC s secure server from tablets; Bi-weekly reports on supervisor observations/comments, and limitations/problems encountered; and, Report on fieldwork successes/challenges/changes to procedures/etc, Provision of secured storage of all hard copy documents with identifying information (e.g., interview assignments, household tracking sheets). Timeline MEASURE Evaluation has already begun preliminary preparations for the survey. The successful applicant(s) should plan to start activities in March 2018. The expected timeframe for the main survey activities covered by this RFA is presented below. Main Activity Target Dates IRB submission February/March 2018 Pretesting questionnaires July 2018 Supervisor and interviewer training July 2018 Production of final questionnaire July 2018 Data collection August-September 2018
Preliminary tabulations and report November/December 2018 Final report March 2018 Application Requirements Organizations wishing to serve as MEASURE Evaluation s local research partner(s) for the ISVP endline survey should submit: 1) a technical proposal, clearly stating the role(s) for which they are applying: Role 1 - endline management/oversight; Role 2 - data collection fieldwork; or both Role 1 and Role 2 (see Table 1 below for summary of RFA application options); 2) an organizational description demonstrating the capacity to serve in the role(s) to which they are applying; 3) a detailed budget for each role; and 4) a description of financial/accounting structures and practices. The application should include: 1. A Cover Letter that clearly identifies the application as responding to this RFA and stating the applicant organization s name, address, phone numbers, URL, and main email address. There should be a contact person listed for any purpose related to this RFA. The cover letter should also note which role(s) the organization is seeking. 2. Technical Proposal/Scope of Work The applicant should describe in detail their approach to addressing the technical and logistical requirements to conduct a population-based panel household survey of the type and magnitude described above. Applicants for Role 2 must describe their prior experience conducting panel surveys and locating households at endline; they must also state as their strategy would be for tracking and locating households from baseline for the current endline study. This section should be presented separately for activities covered under Role 1 and Role 2 and should describe in detail how the organization will address the responsibilities and activities outlined in the sections above. The applicant should include a description of its available resources that will be used to carry out the required tasks. 3. Detailed timeline that lays out all the project activities and tasks with projected completion dates for each activity and task. 4. Detailed budget and budget narrative that breaks down costing information by line item. Organizations applying to serve in both roles must show a separate budget for Role 1 and Role 2. Include detailed costing information for all line items in Rwandan Francs and U.S. Dollars. It should include, but not be limited to: Personnel cost: List name and/or position title, annual base salary or daily rate, percent of effort or number of workdays for each category of staff (e.g. interviewer, supervisor, data entry clerk, statistician, drivers). Please provide justification and a description of responsibilities for each category of staff. Travel: List travel expenses, including mileage and fuel cost per mile, per diem, vehicle maintenance and/or rental, if necessary. Project Materials: Indicate cost of printing supervisor and enumerator manuals; interviewer control sheets; back-up copies of questionnaires; interviewers equipment; other equipment and material used for data collection and management; incentives for participants. Other Direct Costs: List miscellaneous or any other costs.
Budgets can be supplied in a separate spreadsheet along with budget notes in a Word document. Table 1. Summary of RFA Application Options RFA Application Option Apply for Role 1 only Apply for Role 2 only Apply for both Role 1 and Role 2 Role description Serve as local research partner and provide endline survey management/oversight of data collection team Carry out data collection; serve as data collection team Serve as local research partner and provide endline survey management/oversight; also carry out the data collection/serve as data collection team Application Parameters The application should be no more than 15 pages, 1.5 spaced with 1 inch margins and 11 point Arial font. Curriculum vitae, descriptions of past projects, and the budget will not count against page limits. CVs should not be longer than 2 pages per person. RFA Questions and Answers Questions about this RFA may be submitted to MEASURE Evaluation via email at measure_rfp@unc.edu in English, through January 25, 2018, 11:59pm Eastern Daylight Savings Time (EDST). Answers will be provided via email to each declared/intended bidder by close of business on January 30, 5:00 p.m. EDST. A list of all questions and answers will be posted at http://www.cpc.unc.edu/measure/about/contracting-with-us. Proposal Review and Notification of Intent to Enter into a Sub- Agreement Following receipt of applications, MEASURE Evaluation will review the received materials and may conduct a second round review of best and final applicants. If this occurs, MEASURE Evaluation will follow-up with specific questions and may request additional information from the best and final applicants. Applications will be reviewed in terms of their technical soundness, organization past experience, quality of key staff, and financial competitiveness. MEASURE Evaluation will inform the
successful applicant(s) (and notify the organizations not selected). The process of developing a subagreement with the successful applicant(s) will then begin. Deadline Proposals must be submitted electronically to measure_rfp@unc.edu by 11:59pm U.S. EDST on February 8, 2018. The submission should include all materials related to the application. MEASURE Evaluation is funded by the U.S. Agency for International Development (USAID) through cooperative agreement AID-OAA-L-14-00004. Views expressed in this document do not necessarily reflect the views of USAID or the United States government.
Appendix A: List of Districts 1 Burera 2 Gasabo 3 Gicumbi 4 Huye 5 Kamonyi 6 Karongi 7 Kayonza 8 Kicukiro 9 Musanze 10 Nyamasheke 11 Nyarugenge 12 Rutsiro
Appendix B: Key Indicators Economic Strengthening: 1. Percent of households with moderate or severe household hunger hunger scale created by FANTA and used in the USAID/Feed the Future project. 2. Allocation of household consumption by food, education, health services, and other. Health: 3. Percent of 6-59 months olds who meet minimum dietary diversity defined as consuming from four or more food groups in the past 24 hours. 1 4. Percent of caregivers for 0-17 year olds who know the child s HIV status Education: 5. Percent of 13-17 year olds with regular school attendance binary indicator for no missed days during last week of instruction. 6. Percent of 13-17 year olds who progressed in school binary indicator for advancement defined as current school attendees who were enrolled in a school grade this year that was above the one attended the previous year. Additional secondary outcomes to be collected and analyzed include: Household consumption patterns o Absolute and proportion of expenditures used for food, education, health services; o Percent of households with increased savings or productive asset ownership; Economic outcomes individual o Percent of youth reporting new or improved paid employment within the past six months; Household decision-making and gender-related attitudes and behaviors o Percent of female caregivers who report joint, sole or partner-only household decisionmaking power for various decisions (e.g. seeking healthcare for children, major household purchases, etc.); o Percent of female caregivers reporting experience of intimate partner violence within the previous 12 months; Use of health and social services o Percent of children 0-59 months receiving routine growth monitoring and nutrition services; o Among children 0-59 months with fever in the last two weeks, percent for whom advice or treatment was sought at a health facility/provider; o Among children 0-59 months with diarrhea in the last two weeks, percent for whom advice or treatment was sought at a health facility/provider; o Percent of children 0-17 for whom caregivers report birth was registered at the sector level; 1 Ftnote final food consumption group list used (FANTA, DHS, FTF, FAO)
o o o Percent of 10-17 year olds reporting having had an HIV test; Percent of caregivers reporting having had an HIV test; Percent of caregivers reporting use of a modern family planning method; Nutrition knowledge and behavior o Percent of 6-59 months olds who meet minimum dietary diversity defined as consuming from four or more food groups in the past 24 hours; o Mean score among caregivers on a test of nutrition; Youth HIV Knowledge and reproductive health o Percentage of 10-17 year olds who correctly identify ways of preventing HIV; o Percentage of 10-17 year olds reporting using a condom with their partner the last time they had sex; Early childhood development o Percent of children 36-59 months old who are attending an early childhood education program; o Percent of children 0-59 months old with whom an adult has engaged in four or more activities to promote learning and school readiness in the last 3 days; Education o Percent of school aged children who progressed in school from previous year; o Percent of school aged children with regular school attendance binary indicator for no missed days during last week of instruction; o Percent of youth graduating from primary school and returning to secondary school. OVC Outcome Monitoring: 9 Essential Indicators 1. Percent of children <5 years of age who are undernourished 2. Percent of children whose primary caregiver knows the child s HIV status 3. Percent of children regularly attending school 4. Percent of children who progressed in school during the last year 5. Percent of children too sick to participate in daily activities 6. Percent of children who have a birth certificate 7. Percent of children <5 years of age who recently engaged in stimulating activities with any household member over 15 years of age 8. Percent of caregivers who agree that harsh physical punishment is an appropriate means of discipline or control in the home or school 9. Percent of households able to access money to pay for unexpected household expenses