Philanthropy’s growing reliance on evidence and measurement raises a divisive question: which data truly matters, and how do we act when the data is incomplete or imperfect? This is the reality for most of the sector, where information gaps are common and certainty is rare.

 

Consider a few scenarios that highlight both the promise and pitfalls of data use:

• Education impact reporting: A foundation publishes detailed student outcome metrics to show progress. Policymakers welcome the data, but donors question whether the chosen indicators capture what truly matters and point to gaps that leave parts of the story untold. The lesson is clear: incomplete evidence must be used responsibly to keep focus on meaningful outcomes.
• Health dashboards: An organisation shares dashboards tracking programme reach across several countries. Governments welcome the transparency, but grantees question whether raw numbers capture what truly matters across vast contexts. The lesson is that incomplete data can obscure local realities, making relevance and interpretation just as important as disclosure.
• Climate initiatives: A funder reports on carbon footprint reductions across its portfolio. The data sparks enthusiasm among partners eager to align with sustainability goals, but some community groups question whether a single metric captures their lived experience. The lesson is that incomplete measures can oversimplify complex trade‑offs, making relevance and context essential to guide action.

 

Taken together, these fictitious examples highlight a deeper dilemma: whether the data being shared is relevant enough to guide action when evidence is partial. In philanthropy, most datasets are incomplete, and certainty is elusive. The challenge is how to use imperfect information responsibly, without letting gaps or oversimplifications derail progress.

 

This is why disclosure is not a binary choice. It requires judgment:

• Relevance vs. distraction: Which indicators illuminate what matters most, and which add noise?
• Learning vs. contention: Which numbers spark constructive dialogue, and which risk polarising audiences?
• Context vs. oversimplification: Which measures reflect lived realities, and which reduce them to misleading abstractions?

 

Ultimately, the question is how to design strategies that build shared understanding and strengthen relationships, even in the face of uncertainty. The real test of leadership in philanthropy is how to use imperfect data wisely to guide collective action.

 

How do you decide which data truly matters in your own reporting frameworks? Do you prioritise relevance and dialogue, or comprehensiveness even when the evidence is incomplete?