humanitarian.info

because information can save lives

Measuring Progress (humanitarian NGO version)

with one comment

Fellow itinerant keyboard-basher Michael Howden sent me a link to the specification that he developed for monitoring and evaluation (M&E) database that he’s developed for Save the Children in Aceh. He’s become something of a one-man database development shop recently, working in Aceh and Pakistan and soon in Uganda.

In the accompanying post, he mentions that the critical difference between development work and emergency relief is that the former operates on a much longer timeframe than the latter. In my experience, development projects aren’t necessarily any longer-term in their thinking than emergency projects, but that’s not my main point.

Michael is talking specifically about the problem of incorporating qualitative information into M&E processes, particularly if you’re building a database to deal with those processes. Qualitative info - narrative text, pictorial records, and so on - is notoriously difficult to deal with.

I tend towards the maxim “if you can’t measure it, you can’t manage it”, so I often question the value of much qualitative information for the purposes of project management. It is extremely useful, however, for a number of other things - fundraising or advocacy work, for example.

This argument often gets me into bar fights with disgruntled development workers, who feel that the qualitative information is in fact the more important stuff. In particular there’s a feeling that factors such as capacity or attitude can’t be measured by numbers alone, which may be true; but they can be measured (opinion polls being the obvious example), and that makes them amenable to a quantitative approach.

[Slashdot] [Digg] [Reddit] [del.icio.us] [Facebook] [Technorati] [Google] [StumbleUpon]

Written by Paul Currion

October 4th, 2006 at 8:58 am

Posted in Development, M&E, NGO

One Response to 'Measuring Progress (humanitarian NGO version)'

Subscribe to comments with RSS or TrackBack to 'Measuring Progress (humanitarian NGO version)'.

  1. I have been struggling with measuring qualitative information through both Pakistan and Yogyakarta earthquakes for shelter. There are a couple of ways that I have appoached it:

    The most common method was through subjective assessment by trained surveyors. After surveyors were given detailed training in what constitutes the quality standards for a shelter, they would be able to evaluate through visual inspection to what level a particular shelter had achieved. Criteria are based upon simple, measurable aspects of the standards that are aimed for by the strategic framework of the cluster - for example - head height, floor area, % of walls infilled, interior privacy spaces, etc. Surveyors can supply data in the form of (percentages of shelters satisfying all criteria in a particular area) or (quantitative numbers in a particular area satisfying all criteria). This data can be further mined for the specifics that can be fed back to the coordination effort.

    The key (and Paul hit it on the head here) is you need to quantify quality. Find indicators of quality that can indeed be measured and set that as a criteria for evaluation.

    Make any sense? Didn’t think so…

    Neil Bauman

    4 Oct 06 at 12:07

Leave a Reply