At their best, systems for monitoring and measuring nonprofit performance illuminate what an organization is accomplishing, where its resources are going, and how that organization might address weaknesses and build on successes. At their worst, such systems become an expensive compliance exercise, diverting resources from program delivery without returning a greater understanding of how to achieve an organization’s goals.
Donors and nonprofits alike are deeply invested in creating the change they seek, as efficiently and effectively as possible. There are difficulties in communication and expectations, but the central questions are the same: Did I do what I set out to do? Is it making the difference I seek? How can I do it better? The many available measurement tools and resources can add to the noise by speaking to different audiences or addressing single questions without a clear linkage to the broader goals of measurement.
We see several ways for funders to use measurement to learn and improve, rather than as a compliance exercise. Broadly, we suggest that funders and grantees clarify their measurement goals. A funder must have reasonable expectations about what they can learn from the measurement effort they support. Is measurement going to provide new information, or is the existing evidence strong enough to make it redundant? Is it going to improve the organization’s performance? Measurement decisions should be made openly and clearly, with an eye to what is truly useful.
There are many opportunities for funders and grantees to improve communication around measurement goals. In facilitating these conversations, we suggest that donors be guided by the following questions and recommendations:
Question One: Given the impact I seek, what outcomes can the nonprofit reasonably measure and attribute to its own efforts?
Not all nonprofits can or should measure to their ultimate, longer-term impact. A gut “reasonability test” would consider which outcomes are clearly and reasonably related to a non-profit’s activities and its role within a broader theory of change. The non-profit would then be responsible for reporting on only those outcomes. For example, a food pantry can report on the food it distributes and the nutritional value of each item, but there is no way to estimate how its provision of food has affected its clients’ life expectancy. Even asking the organization to make a “best guess” requires them to make estimates beyond the “common sense” limit.
Smaller nonprofits, which may have low annual budgets and a heavy reliance on volunteers, will often have especially limited capacity for data collection and management. The challenge is exacerbated when different funders each require a different set of outcomes measures. For small nonprofits, the work of reporting different measures to multiple funders often wastes resources and distracts from effective execution of mission.
Recommendation: Assess what is reasonable to measure as a direct result of an organization’s work, rather than forcing organizations to develop potentially empty measurements of final outcomes. If an impact assessment is of interest to you and the organization, provide additional support to enable it. In cases where capacity is a concern, consider using metrics the nonprofit already collects to measure the effects of your donation, and look to match your requests with those of other funders, when possible.
Question Two: Is there existing evidence linking the approach used to the impact sought?
If there is already a strong evidence base around how the nonprofit’s activities are likely to result in the desired social impact, then reporting on activities and outcomes can be as meaningful as trying to report farther along the chain.
For example, there is strong evidence that sleeping under a chemically treated bednet reduces the risk of contracting malaria and therefore the risk of dying from malaria. If a nonprofit can verify that they distribute chemically treated bednets, and that people are sleeping under the bednets they receive, then they can rely on the existing evidence base to demonstrate that their bednet distribution reduces malaria transmission and saves lives. They may not need to measure malaria infection and mortality rates in order to draw that conclusion. This is especially true if another organization – e.g., health ministry – is measuring rates for that region. By focusing on the activity of distribution and the outcome of increased bednet use, which are both relatively easy to measure, the organization and its funders can feel reasonably confident in their ultimate impact: lives saved.
Recommendation: Familiarize yourself with the evidence base (via the nonprofit or one of the many field resources) to understand whether the organization is positioned to achieve the impact sought based on the activities they conduct. If the evidence base is strong, adjust measurement expectations accordingly, avoiding reporting requirements that force non- profits towards redundant measurements.
Question Three: If the evidence base is weak, should I support an impact assessment, either from within or outside of the organization?
When the field’s knowledge about what works or doesn’t work is incomplete, supporting an impact assessment — rather than simply performance management — can increase the effectiveness of multiple organizations working within that sector. Impact assessment can come from within the organization providing the services, from intermediaries such as academics or consultants, or even from partnerships between intermediaries and nonprofits. The most common approach is for individual non- profits to bear responsibility for impact measurement as they work to meet the requirements of individual grants.
Measuring results from within an organization can have advantages; those on the ground will often have the best understanding of their work and the populations they serve, particularly if they are implementing an innovative or unique approach. In either case, if an impact assessment effort is conducted at the organizational level, there must be adequate, dedicated support for those activities, in addition to the funds used for program implementation. Some nonprofits have internal expertise in evaluation and may have dedicated support for that work; these tend to be established and highly sophisticated organizations. Smaller organizations may also be able conduct rigorous evaluation studies, but they will usually require dedicated funding and capacity to do so — and some organizations may not be structured to conduct an impact assessment, even with additional funding.
For evaluations that go beyond a single organization, intermediaries are well positioned to identify gaps and synthesize information for the field. This high-level work can also contribute to consensus-building around what works and how it works, which can help multiple parties clarify where and how they can add value. Working through intermediaries can also reduce the inefficiencies that occur when multiple organizations put resources towards ultimately over-lapping measurement efforts — this is particularly relevant for donors who are funding multiple organizations in a single sector, and perhaps paying for those inefficiencies.
Recommendation: Do not assume that an organization can conduct an impact assessment without dedicated resources. If the organization has the capacity to manage an appropriately funded impact assessment, or if they are implementing a unique or innovative model which they are best positioned to evaluate, consider supporting assessment from within the organization. If the organization is not set up to manage an impact assessment — even with additional funding — or if there is a need for a broader evaluation that goes beyond a single organization’s approach, consider supporting an intermediary to conduct a sector-level evaluation.
This page was adapted from Beyond Compliance: Measuring to Learn, Improve, and Create Positive Change, guidance produced by the Center for High Impact Philanthopy and Wharton Social Impact Initiative.