Innovation Programme Evaluation: More Data Won’t Fix a Weak Decision
Why does innovation programme evaluation leave renewal decisions unclear, even when you have plenty of data?
The dashboard is complete. Participation is rising, founders are satisfied and supported ventures have raised capital. Yet the board still cannot confidently decide whether to renew the programme, redesign it or fund something else.
That is a familiar problem in innovation programme evaluation: more reporting does not necessarily make the next commitment clearer. The information may be accurate. The conclusion placed on top of it may still be unresolved.
A well-documented programme is not automatically a decision-ready programme.
Four things worth knowing
The tension: reliable numbers can leave a strategic choice open.
The consequence: another reporting cycle can become another year of default continuation.
The distinction: a positive result does not answer every question about contribution or renewal.
The opportunity: better evaluation can clarify the commitment, not just enrich the dashboard.
What can innovation programme evaluation actually tell you?
Attendance, satisfaction and follow-on investment are useful facts. They help institutions understand delivery and participant progress. But each answers a different question. A financing round does not, by itself, establish how much the programme contributed or whether the same intervention deserves the next budget.
The European Commission’s Better Regulation Toolbox treats monitoring and evaluation as distinct activities. Relevance, effectiveness, efficiency and added value also remain separate judgements. A busy programme can be well monitored while its strategic justification still needs examination.
This connects to why additionality belongs before impact measurement: the institution needs a clear account of the contribution it is trying to make before headline results can meaningfully support that claim.
Why can more KPIs leave the real question unanswered?
Adding indicators can improve operational visibility. It can also produce a longer report without addressing what makes leaders uncertain. If the unresolved question concerns the institution’s role, more precise delivery numbers may not resolve it.
A 2022 review of public-sector performance measurement by Berend van der Kolk spans several domains and emphasises that measurement systems’ use and characteristics matter for their consequences. The lesson is not to abandon KPIs. It is to avoid confusing the size of the dashboard with the strength of the decision.
For innovation programmes, this becomes consequential at renewal. A result can remain positive while the ecosystem, the available alternatives or the next funding commitment changes.
What happens when a programme continues by default?
Imagine a programme with satisfied participants and growing investment totals. Those results may support renewal. They may also reflect strong selection, favourable market conditions or contributions from several actors. This is a hypothetical example, not an assessment of a named institution.
The results need not be disputed for the renewal question to remain open. But if that uncertainty is buried inside a reassuring report, continuation may become the easiest choice rather than the best-supported one.
The potential cost extends beyond the existing budget. Resources remain committed while other useful interventions wait. Teams keep producing evidence of delivery, but the institution still lacks a clear reason for its next move.
How can innovation programme evaluation support a defensible next commitment?
Better evaluation does not mean demanding certainty or judging every programme by immediate investment returns. Early experiments, long-term capability-building and large funding commitments face different evidentiary demands.
The practical aim is to understand what the existing evidence supports, what remains uncertain and why that matters for the particular decision. Through independent institutional reviews, I work with organisations facing renewal, redesign and portfolio choices. Where evidence is considered in separate silos, QUATISE decision intelligence addresses the basis for a consequential commitment. The work is tailored to the mandate and situation, not a universal scorecard.
More data are useful when they improve what can responsibly be concluded. More data alone are not more evidence.
Read the full analysis: More Data Is Not More Evidence
The full subscriber essay examines why credible results can support competing interpretations, what other disciplines reveal about this problem, and where the demand for decision-ready evidence has limits. Subscribe to The Arise Vault for deeper analyses across innovation, commercialisation and capital—not another dashboard checklist.
Kommentare