Some great quotes in a new working paper proposing a different approach to M&E by Lant Prichett et al. My eye was particularly caught by these two from the conclusion.
“The reality of the project selection process, inside government organizations and between government organizations, tends to be an adversarial process of choosing among projects, which puts project advocates in the position of making much stronger claims for project benefits than can be supported, and being more specific than they would like to be.”
I’m relatively relaxed about the tendency to make over-ambitious claims of expected project impact since everyone does it, and is thus likely to fairly well factored into how projects are viewed. The problem of over-specificity in design is, I think, a bigger problem since it leads to significant wasted effort during the project proposal stage developing ridiculously over-detailed action plans and budgets. Most donors like to think they are flexible when it comes to plan and budget changes mid-grant, but the simple requirement to obtain approval is a deterrent to project managers and a source of risk: what if they do not approve the changes?
The issue of over-specified designs has other implications for implementation too:
“Organizations like the World Bank perpetually over-emphasize, over-reward, and over-fund ex ante project design over implementation. This is because in the standard model, implementation is just faithful execution of what has already been designed, whereby the thinking is done up front and the implementation is just legwork. However, de facto many successful project designs are discovered when project implementers are given the flexibility to learn, explore and experiment.”
As I wrote before: good strategies need good implementation. If the implication – that big donors like the World Bank already know this basic fact – is correct then it really makes me question the whole competitive grant awarding process that dominates NGO involvement in conservation and development. Donors could save everyone a lot of trouble by awarding grants on much shorter project outlines combined with a good track record of delivery (which needs to be much more robustly assessed). Good NGOs would be strongly incentivised to deliver good outcomes since otherwise they would lose their future funding. An entry level system would still allow new players to prove themselves, and also those fallen stars to re-establish themselves.
I will blog again tomorrow on the core proposal of the paper when I’ve had longer to digest it.
Hat tip: the Blattman
Bottom Up Thinking 