My article on crowdsourcing in emergencies, published on MobileActive last week, received a good number of intelligent comments. I’d like to thank all the commenters, who all raised valuable points that filled in gaps in my critique and helped to focus my thinking. My only regret is that nobody from Ushahidi had the time or inclination to join the debate – or indeed to acknowledge the article – although Robert Munro of Mission4636 posted a response on his own blog. For my own reference I wanted to gather some of the critical points they made and my responses to those points in one place.
A number of comments suggested something along the lines that “maybe [Ushahidi] will turn out to be something far more important or useful than any of us can currently imagine?” Well, maybe: but the subject of the article was very specific – whether crowdsourcing adds value to large-scale humanitarian operations, to which my answer was no. If people want to argue that it’s useful for other things, then I fully agree, my point being that just because crowdsourcing is useful for some activities does not mean it’s useful for every activity.
Mark Prutsalis, whose views I respect greatly, summed it up saying “It seems like a little early to be so definitive about the value of crowdsourcing. Let’s see where we are in even 12 months.” The problem I have is the proponents of crowdsourcing claim that the value has already been demonstrated, but are entirely unclear about what that value consists of. What will have changed in 12 months that will allow us to make a clear judgement? Or will we be asked to wait another 12 months, and another 12 months after that, while we wait for crowdsourcing to show its stuff?
Let’s look at this way. Anonymous said that “it is better to nurture the baby’s potential, even though they already haven’t completely demonstrated their value added sufficient to our liking, in hopes for all the things that they might become in the future.” But if your baby is better off growing up to be a concert pianist, it’s probably not a good idea to force them to train as a cage fighter. That’s what I think is happening with Ushahidi – a perfectly good tool is being shoehorned into an inappropriate niche, enabled by breathless press coverage.
Mark acknowledges “the limited value to 99% of the information that came in through the 4636 system; but lives were saved through the Search and Rescue efforts – that makes it all worthwhile IMO even if that part was technically not “crowdsourcing”.” I can well agree with him that it was worthwhile if it saved lives, but the article was very specifically discussing crowdsourcing, and my conclusion was that to the extent Ushahidi was a crowdsourcing tool, it wasn’t useful; but to the extent that it was useful, it wasn’t a crowdsourcing tool.
However the ICT4D Jester made the valuable point that “Ushahidi [is] two distinct entities which happen to be named the same thing… (1) the technology platform; (2) the people behind the organization who are dedicated to international development.” He also pointed out that the “excessive hype around Ushahidi comes from people who think that (1) is the secret sauce and what offers a glimmer of hope for development. But, actually, it’s (2) that makes Ushahidi great.”
I agree with him completely, and in response to a comment from Juergen, I tried to make clear that I am happy about the positive momentum that the Ushahidi team has gathered, and I wish the iHub in Nairobi the best of luck. The Ushahidi team are surfing a wave and I have no desire to knock them off their board. If this is the start of something big for the African technology sector, that would be fantastic –contrary to what Senam accused me of, I have absolutely no problem at all with Africans doing it for themselves. However I’m not sure that the people of Haiti would find it the success of African tech particularly comforting in itself.
Staying on the topic of people, Andrew Turner made a valuable point that “the crowd does not mean amateur”. I’m not opposed to the use of volunteers; I do not think volunteers are necessarily amateurs; and the NGO community is based on a long and rich volunteer history. While crowdsourcing is a new type of volunteer endeavour, it has the same constraints and opportunities as any type of volunteer endeavour, and the Ushahidi team are responding to that following Haiti.
A big problem with volunteer management is contextual awareness. While volunteers can be tasked, they don’t necessarily know anything about how aid is delivered, leading to the question that Ben Parker raised: “If a 4636-type system is established to gather urgent individual needs, what ethical and practical obligations ensue from gathering that information?” In some ways it’s more important than the technical issues, and it’s been worrying me greatly ever since I started reading about this.
When I said that reading through the Haiti data was heartbreaking, I meant it. Many of the 4636 messages are from people trying to cope with truly appalling situations, and I don’t want to think about the people who texted 4636 in desperation – and never received a response. Who takes responsibility for that? Nobody. The question of accountability doesn’t seem to trouble the proponents of crowdsourcing greatly if their public writings are anything to go by, but it needs to be at the heart of responsible software development.
Lack of institutional memory is another problem for volunteer initiatives. Rob Salkowitz described how “Ushahidi has opened several important dialogues – one [of which is] about technology for humanitarian purposes”. The dialogue about humanitarian IT has been going on for a long time, yet few people who showed up recently seem to have paid much attention. Inability to learn from experience is one of the biggest failures of the humanitarian community; and watching technology people repeating exactly the same mistakes that were made two years ago is a little frustrating.
Juergen raised an important point which I didn’t make in the original article. Ushahidi was developed to track election violence, and perhaps that’s a type of crisis (although I’m not convinced); but a colossal earthquake in Haiti is a completely different type of crisis. I think it’s this conflation of different types of crisis that may have lead us in the wrong direction – surely one tool is unlikely to be suitable for both? That’s where the title of the article came from, which comes from Abraham Maslow: “if all you have is a hammer, every problem looks like a nail.”
I think my overall point about crowdsourcing was summed up in my reply to Mark: there’s a lot of grandiose yet vague promises that crowdsourcing will revolutionise humanitarian response, and I think we need more than vague promises. Misinformed reporting plays a role in my frustration, but nobody seems to be interested in correcting that misinformation – and when people persist in claiming that their tool will revolutionise the sector based on no evidence, I get suspicious.
When I was writing the article, I could only judge whether crowdsourcing added value based on the evidence that was available to me – just like everybody else. If presented with new evidence (perhaps an expanded dataset or actual testimonials), I’m prepared to change my opinions – but nobody has presented any such evidence, and we just get repeated anecdotes about how the director of FEMA really liked the Ushahidi map. In particular I asked whether anybody had a clear use case scenario, but none has been forthcoming.
Robert Kirkpatrick is right to point out that “this kind of information will be generated increasingly by disaster-affected communities… [and] We need to develop policies, processes and tools to deal with this information, because it isn’t going away.” I agree that projects like Swift River or InSTEDD’s RIFF or Tweak the Tweet “are designed to make sense of streams of information like this”, but once again the question of cost comes into play. Imagine that I came to you and said:
“I’ve got a revolutionary new approach to community sanitation which your organisation must adopt or be left behind. It’s been set up several times before, although almost nobody used it and there’s no evidence that it had any impact. This approach will definitely save lives, although we can’t explain exactly how, or how many lives, or what it will cost, or when it will finally work.”
Resources are scarce in this sector – not just funding, but organisational time. Given that, I don’t think that any professional would give such a proposition the time of day if it was in sanitation – so why should we accept it in the case of ICT projects? This article focused on 4636 and Ushahidi, but these questions need to be asked about all social media – or any new technology, for that matter. Once again, thanks to everybody who commented on the article – and let’s keep discussion going in order to make sure that the technology we have at our disposal is being used appropriately.