Organizational Effectiveness 2014 Subprogram Dashboard Strategy Period: Staff: 2013- Current Kathy Reich (PD), Linda Baker (PO), Jamaica Maxwell (PO), Cheryl Chang (PS), Kai Carter (RA), Prithi Trivedi (PA) Goal(s) and Theory of Change The goal of the Organizational Effectiveness (OE) Program is to increase the effectiveness of grantee organizations and networks, to enhance their capacity to meet the Foundation s goals. Our grants address the many organizational and capacity challenges that may affect nonprofits from strategic planning to strengthening networks to leadership development. As a result of this work, we expect to see healthier, better connected organizations ready to bring about greater change on issues the Foundation cares about most. Annual Progress Toward Impact How are we doing? Exceeding Expectations The team is making significant, strategic contributions to the work of grantees as well as the work of our four major Programs. What went well? High- impact Grantmaking. New assessments from our external evaluators and the Center for Effective Philanthropy found that OE grants to individual grantee organizations the bread and butter of our work have positive impact on grantees that lasts a year or more after the OE grant concludes. From July 2013- July 2014, 94 percent of OE grants that closed met their objectives, and 24 percent exceeded their objectives, according to our external evaluators. Eighty percent of grantees reported at grant close that the OE grant already has had a positive impact on their programmatic work. In interviews 1-2 years after grants ended, grantees reported that the capacity built from the grants continues after the grant period and is more significant with time. Foundation grantees that receive an OE grant provide higher absolute ratings on most measures in the CEP Grantee Perception Report (GPR) than grantees who do not receive OE funds. OE grantees rate the Foundation more favorably on GPR measures including impact on the organization, impact on the field, and responsiveness of Foundation staff. Focus on Leadership. OE launched an exploration of how we might support the development of emerging leaders in the fields we care about. The exploration resulted in five new Partnership Projects to develop cohorts of leaders in the Marine Fisheries, West Coast, C&S domestic, PRH- U.S., and Children s Health subprograms. These projects will be implemented in 2015. Several of these projects aim to strengthen leadership at the field- level, improving the capacity of not only organizations, but whole sectors. New Partnerships with Programs to Benefit Grantees. In addition to the leadership development cohorts, OE developed six other Partnership Projects, working with program staff and grantees to implement cohort capacity- building projects in the Children s Health, Early Learning, Gulf of California, Local, South Asia, and Summer Enrichment subprograms. These projects deepened the collaboration between OE and the Foundation s major grantmaking Programs and enabled us to serve a greater number of grantees.
What has been challenging? Meeting the Needs of Diverse Grantees. With 20 different subprograms and hundreds of grantees to serve, the team sometimes struggles to meet everyone s unique capacity needs within our time and budget constraints. This is particularly true for grantees and subprograms working in Africa and Asia. Evaluation and Learning. We spent significant time and resources improving our evaluation and learning systems in 2014, but we still lack data for some outcome measures. We will begin evaluating our Partnership Projects and our services to grantmaking programs in 2015. What has changed (internally and externally)? A Larger, Stronger Team. With OE now managing six funds at the Foundation, the team grew to seven members in 2014. All of these staff members work at least part- time on OE. This has enabled us to assign a liaison to each grantmaking program, who can spend much more time helping program officers weave capacity building into their strategies and provide advisory services to Programs as needed. Increased team capacity allowed for an opportunity to provide enhanced coaching and support to grantee organizations. We also were able to deepen our work on leadership development. Trends in the Field. Nonprofits and foundations increasingly focused on three key issues: leadership, full- cost funding, and pathways to scale. On leadership, there were growing calls for increased foundation and nonprofit investment in developing and supporting young nonprofit leaders, particularly people of color. Nonprofits are growing more assertive about the need for flexible, multi- year funding that covers their overhead expenses. And grantee Bridgespan sparked a conversation about how nonprofits can scale promising ideas beyond simply replicating programs, since replication does not take into account specific contexts and has been proven to be difficult to implement and sustain. What have we learned? How have we adjusted? We learned that our fundamental approach to helping grantees build capacity individual, responsive grants continues to deliver high impact and value for grantees. We are excited by our Partnership Projects grantmaking, but it is quite labor- intensive and we are not yet sure of its value, so we have made evaluating this work a high priority in 2015. We made adjustments to our grantmaking in 2014 as a result of what we learned from grantees and the field, such as increasing our focus on leadership and agreeing to provide overhead on some OE grants a departure from past policy. What are the key areas of focus for the coming year? First, the team will continue to experiment with new models for developing emerging leaders in our issues areas, since there is clearly high demand for this among Program staff and grantees. This work will tie in with a potential joint effort of the Packard and Hewlett Foundations to develop nonprofit leaders of color in California. Second, we will evaluate our Partnership Projects to assess whether these cohort capacity- building projects are providing value for grantees and furthering the goals of Programs. Third, we will explore developing a new system for linking grantees to high- quality consultants, possibly using LinkedIn. Comments: All of the graphs in the "Monitoring Data" section start from 2014; data from previous years are not included. However, if available, we have included data points from previous years in the indicator notes. Since it is a relatively new approach, we currently do not have monitoring data on "Partnership Projects". Data will be available in 2015.
Monitoring Data Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 1. Individual Grants (100% Progress) Outcome: 1. Grants Meet Project Objectives High proportion of OE grants meet or exceed project objectives at project close. Grant results are ranked as follows: 1 = No grant objectives were met; 2 = Some grant objectives were met; 3 = All grant objectives were met at a satisfactory level; 4 = All grant objectives were met at a satisfactory level and some objectives were exceeded; and 5 = All project objectives were exceeded, leading to significant organizational transformation (meaning both significant for the capacity focus of the project and with other capacities beyond the capacity focus). 100% 1. % of Grants that Meet Objectives 0 Percent 94 Percent (100%) 90 Percent % of grants that meet or exceed (3 rating or higher) planned project objectives at grant close based on external evaluations. Source: Final grant report; PO feedback. 2013 indicator = 97% (Start Date: 7/1/2013) 2. % of Grants that Exceed Objectives % of grants that exceed (4 or 5 rating) project Source: Final grant report evaluation conducted by the Vallarta Institute. Note: Based on 71 grants closed between July 1, 2013 and June 30, 2014. Does not include projects categorized as "Other". 0 Percent 24 Percent (100%) 15 Percent Source: Final grant report
objectives at project close based on external evaluations. Source: Final grant report; PO feedback. 2013 indicator = 21% (Start Date: 7/1/2013) evaluation conducted by the Vallarta Institute. Note: Based on 71 grants closed between July 1, 2013 and June 30, 2014. Does not include projects categorized as "Other". Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 1. Individual Grants (100% Progress) Outcome: 2. Increased Organizational Capacity is Sustained High proportion of OE grantees increase their organizational or network capacity at moderate to transformative levels. Capacity is ranked as follows: 1 = No increase in capacity; 2 = Slight increase; 3 = Moderate increase; 4 = Significant increase, in the specific capacity focus of the OE grant; and 5 = Great increase (transformative), including beyond the capacity focus of the OE grant. 100% 1.Individual Grantees Report that Increased Capacity is Sustained % of grantees that report sustained capacity increase at moderate to transformative levels (3 rating or higher) 1-2 years after grant close. Source: External evaluation conducted 1-2 years after grant close (Lasting Change) (Start Date: 7/1/2012) 0 75 (100%) 75 Source: 2014 Lasting Change Report conducted by the Vallarta Institute. Note: Dataset includes 20 grants closed between July 1, 2012 and June 30, 2013.
Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 1. Individual Grants (100% Progress) Outcome: 3. Grants are Perceived as High Quality (based on GPR scores) Grantees perceive OE grants and services as high in quality, as reported by biennial GPR ratings. 100% 1. Grants' "Impact on Organizations" Score GPR "Impact on Grantees Organization" rating. Source: GPR Evaluation. 2012 and 2010 GPR scores = 6.6 (Start Date: 1/1/2014) 0 GPR rating 6.5 GPR rating (100%) 6.5 GPR rating 2014 GPR score = 6.5 2. Grants' "Impact on Organizations" Score Compared to Non- OE Grants 0 binomial (statistically higher) 1 binomial (statistically higher) (100%) 2014 OE- grant score was statistically higher than non- OE grants score 1 binomial (statistically higher) GPR "Impact on Grantees Organization" rating compared to non- OE grant score (The aim is for OE grants to rate statistically higher than non- OE grants). Source: GPR Evaluation. OE- grant score was statistically higher than non- OE grant scores in 2010 and 2012 (Start Date: 1/1/2014) 3. OE Grant Recipients' Perception of Responsiveness of Funder Staff GPR "Responsiveness of Funder Staff" rating. Source: GPR Evaluation. 2012 and 2010 GPR scores = 6.4 (Start Date: 1/1/2014) 0 GPR rating 6.4 GPR rating (98%) 6.5 GPR rating 2014 GPR Score = 6.4
Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 2. Strategic Integration with Programs (85% Progress) Outcome: 1. Individual Grants Directly Impact Program Work Increase in the proportion of OE individual grantees that report that their OE grant had a direct, positive impact on program work funded by Packard. 87% 1. Individual Grantees Report Direct Impact on Program Work at Grant Close % of individual grantees that report direct, positive impact on program work because of OE grant. Source: Final Report (Start Date: 7/1/2015) 0 81 (100%) 70 Source: Final grant report evaluation conducted by the Vallarta Institute. Note: Based on 71 grants closed between July 1, 2013 and June 30, 2014. Does not include projects categorized as "Other". Only a portion of the 2014 sample (26) were asked about impact of program work. All grantees will be asked about this moving forward. 2. Individual Grantees Report Direct Impact on Program Work 1-2 Yrs after Grant Close % of individual grantees that report direct, positive impact on program work because of OE grant. Source: External evaluation conducted 1-2 years after grant close (Lasting Change) (Start Date: 7/1/2014) 0 40 (67%) 60 Source: 2014 Lasting Change Report conducted by the Vallarta Institute. Note: Dataset includes 20 grants closed between July 1, 2012 and June 30, 2013.
Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 2. Strategic Integration with Programs (85% Progress) Outcome: 2. Partnership Projects Directly Impact Program Work High proportion of OE partnership project grantees that report that their participation in the partnership project had a direct, positive impact on program work funded by Packard. 0% 1. Partnership Project Grantees Report Direct Impact on Program Work % of parternship project grantee beneficiaries that report direct, positive impacts on program work 6 months after grant close. Source: Partnership Project external evaluation 0 0 (0%) 60 No data available for 2014
Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 2. Strategic Integration with Programs (85% Progress) Outcome: 3. OE Grants Enhance Packard Program Goals Program staff perceive OE grants as a tool to to enhance their ability to achieve program goals. 0% 1. Program Staff Attest to Impact on Program Work % of program officers/directors stating that OE grants and services significantly enhanced their ability to achieve program goals. Source: Program survey (needs to be developed) 0 0 (0%) 70 No data available for 2014 Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 3. OE Thought Leadership (81% Progress) Outcome: 1. OE Asserts Leadership OE asserts its voice and leadership in the philanthropic sector. 73% 1. Number of OE Team Produced External Publications & Presentations OE team publications and presentations produced for the general public each year. Source: Team reporting through Fluxx (Start Date: 1/1/2014) 0 Pubs./Pres. 8 Pubs./Pres. (80%) 10 Pubs./Pres. 2. Number of Public Speaking or Writing Invitations 0 Invitations 10 Invitations (83%) 12 Invitations
Invitations to OE staff to to speak or write in a public forum within a year. Source: Team reporting through Fluxx (Start Date: 1/1/2014) 3. Number of Outside Foundations that Consult the OE Team Outside foundation consults with team members for advice about OE grantmaking within a year. Source: Team reporting through Fluxx (Start Date: 1/1/2014) 0 Consultations 15 Consultations (75%) 20 Consultations 4. Avg Number of Unique Wiki Visitors per Day Avg unique visitors to wiki page per day (est.). Source: Wiki Analytics. 2013 indicator = 150 (est.) (Start Date: 1/1/2014) 5. Number of Twitter Followers 0 Visitors 200 Visitors (80%) 250 Visitors estimated value from Wiki Analytics 0 Followers 251 Followers (31%) 800 Followers Number of @PackardOE Twitter followers at the end of each year. Source: Twitter Analytics (Start Date: 1/1/2014)
Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 3. OE Thought Leadership (81% Progress) Outcome: 2. OE Invests in Bold, Innovative Projects OE invests in bold, innovative projects (as defined by OE team) designed to move the field forward. 100% 1. Number of "Game Changing" Grants Number of experimental or learning grants related to a topic identified by team as "game changing" or "forward thinking" each year. Source: Grant Tracker (Start Date: 1/1/2014) 0 Grants 7 Grants (100%) 5 Grants
Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 4. Partnership Projects (0% Progress) Outcome: 1.Grants Meet Project Objectives High proportion of OE grants meet or exceed project objectives by project close. 0% 1. % of Grants that Meet Objectives 0 0 (0%) 90 % of grantees reporting that they meet or exceed (3 rating or higher) planned project objectives at grant close based on external evaluations. Source: Final grant report; PO feedback. 2. % of Grants that Exceed Objectives % of grants that exceed (4 or 5 rating) project objectives at project close based on external evaluations. Source: Final grant report; PO feedback. No data available for 2014 0 0 (0%) 15 No data available for 2014
Organizational Effectiveness and Philanthropy > Organizational Effectiveness > 4. Partnership Projects (0% Progress) Outcome: 2. Increased Organizational Capacity is Sustained High proportion of grantees increase capacity at moderate to transformative levels. 0% 1. Partnership Project Grantees Report that Increased Capacity is Sustained % of partnership project grantee beneficiaries that report increased capacity at moderate to transformative levels (3 rating or higher) 6 months after close of partnership project. Source: Partnership project external evaluation. 0 0 (0%) 75 No data available for 2014
PROGRAM SERVICE: Organiza onal Effec veness 100 50 0 1. Grants Awarded by Program/Fund 88 92 93 85 93 2010 2011 2012 2013 2014 2. Dollars Awarded by Program/Fund $4M $2M $0M $5,244,738 $3,158,791 $3,491,284 $3,478,263 $3,885,123 2010 2011 2012 2013 2014 Approval Process Board PAG 2 PAG 1 3. Percent of Grants Awarded by Approval Process 100% 3% 10% 10% 9% 15% 14% 80% 4. Percent of Dollars Awarded by Approval Process 100% 27% 26% 34% 80% 38% 39% PAG = President's Approval Grant PAG 1: $0- $50,000 PAG 2: $50,001- $250,000 Board: > $250,000 "Board" includes: Board, Execu ve Commi ee, and Emergency grants 60% 40% 20% 0% 90% 90% 88% 85% 86% 2010 2011 2012 2013 2014 60% 40% 20% 0% 13% 73% 74% 61% 66% 48% 2010 2011 2012 2013 2014
PROGRAM SERVICE: Organiza onal Effec veness (con nued) $30K $20K $10K 5. Median Grant Award Size by Dollar Amount $30,000 $31,786 $30,000 $32,360 $31,953 2010 2011 2012 2013 2014 6. Top 10 Grant Awards in 2014 by Dollar Amount Reference # Grantee Project Descrip on Term (Months) $ Awarded 2014-40295 Fondo Mexicano para la Conser.. for management and implementa on of the Pescadero Program to strength.. 12 $200,000 2014-40261 Context Partners, Inc. for a pilot of the Conserva on Alliance Fellowship to strengthen the sustaina.. 12 $192,243 2014-39854 Spi ire Strategies, LLC for Phase IV of the Friending the Finish Line project 12 $130,000 2014-40115 CompassPoint Nonprofit Services for a fund development cohort for Summer Ma ers par cipants 12 $105,000 2014-40407 Third Plateau Social Impact Stra.. for a networked leadership program for emerging nonprofit leaders 12 $100,000 2014-40486 Georgetown University for the Center for Children and Families for planning of a children's health an.. 12 $100,000 2014-39808 The Vallarta Ins tute LLC for evalua on and learning for the Organiza onal Effec veness Program, its.. 12 $85,000 2014-40566 Management Assistance Group for comple on of research on complexity analysis and frameworks 12 $78,695 2014-40041 Community Partners for the Talent Philanthropy Project, to promote investment in the developm.. 12 $75,000 2014-40191 Bridgespan Group for the Bridgespan nonprofit tools and tac cs survey 12 $75,000 7. Top 10 Grant Awards to Grantees New to the Founda on in 2014 by Dollar Amount Reference # Grantee Project Descrip on Term (Months) $ Awarded 2014-40407 Third Plateau Social Impact Stra.. for a networked leadership program for emerging nonprofit leaders 12 $100,000 2014-40680 RIZ Consul ng for assessments and planning for a cohort project to strengthen the capacity.. 12 $42,658 2014-40251 Mannion Daniels Limited for branding and strategic communica ons planning for the Civil Society Fun.. 12 $40,843 2014-40575 Jacaranda Health for development of opera onal and financial systems 12 $40,000 2014-40171 Mississippi First for strategic and organiza onal planning 12 $33,100 2014-39707 Community Science Workshop.. for strategic planning 12 $22,500 2014-39850 Orchestra in the Schools, Inc. for strategic planning and fund development planning 12 $15,000
OE Grants Awarded in 2014 by Primary Project Focus OE Grants Awarded in 2014 by Subprogram Planning 32% 30 30 Fund Dev. / Feasibility Studies Leadership/Coaching Strategic Comm. Planning *Other/Misc. Board Dev. / Governance Operational Systems OE Exploration & Innovation Organizational Assessment Executive Search/Transition Evaluation Network 13% 10% 9% 8% 5% 5% 5% 4% 4% 4 2% 2 2% 2 12 9 8 7 5 5 5 4 0 5 10 15 20 25 30 35 % and Number of Grants out of 93 Total Number of Grants Awarded 25 20 15 10 5 0 Preschool Early Learning Children s Health After School & Summer Enrichment Strategic Opp. Marine Birds Science Western Conservation Western Lands Western Pacific Climate & Land Use Gulf of California Marine Fisheries U.S. West Coast Comm. Init. Food & Shelter Other Conser. & Science Children & Youth Arts South Asia Sub- Saharan Africa Global U.S. CFC C&S Local PRH *Other *Other/Misc. includes miscellaneous (3), facilities (1), strategic restructuring (1), human resources/personnel (1), and staff development (1) projects *Other includes support for OE exploration and innovation, evaluation, and philanthropy
OE Grants Awarded in 2014 by Geographical Area Served UNITED STATES 69 grants $2,689,850 PAKISTAN 1 grant $42,658 MEXICO 3 grants $243,550 EAST AFRICA 3 grants $132,860 INDIA 1 grant $60,000 THAILAND 1 grant $42,180 GLOBAL 15 grants $674,025 TOTAL AWARDED 93 grants $3,885,123