Sun, Jan 28, 2007 page9

• The civilian death toll in Iraq war proves a nebulous statistic

  • By Beth Osborne Daponte
  • • 
    • 
    • 

  In times of war, accurate figures on the civilian death toll are almost always hard to come by. With few exceptions, demographers and epidemiologists have not applied their expertise to making rigorous, credible estimates of civilian mortality and morbidity.

  Sometimes, a lack of professional freedom prevents those who may be most familiar with the data -- for example, analysts whose livelihoods depend on the governments involved in the conflict -- from using their expertise for purposes that could be politically damaging.

  But there are other challenges as well. Isolating the conflict's impact from that of other interventions (economic sanctions, for example) may be impossible. Moreover, the high-quality population data needed for credible estimates may not be available because of their "sensitive nature," because they never have been collected (sometimes the case in developing nations) or because refugee movements have made data obsolete. As a result, the degree of uncertainty in such estimates may be unacceptably high, making them of little real worth.

  Consider the different approaches that have been used to examine the Iraq war. The Iraq Body Count aims to tally only deaths from violence during the current war by creating a data set based on media reports. If there is no double counting, and if the incidents included in the data were reported correctly, their tally represents a minimum number, because media reports may not be comprehensive.

  Another approach estimates the total change in mortality that the war caused (including deaths because of the war's direct and indirect effects) by calculating the change in the death rate from the pre-war period. This requires data upon which to base the rise in mortality, usually derived by conducting a household survey on a random sample of the population.

  Typically, interviewers ask the head of the household to disclose the number and demographic characteristics of pre-war household members, whether any of the people in the pre-war household had died between the pre-war period and the time of the survey, and the date of any household member's death.

  If household surveys are carried out properly, the number of excess deaths during the war can be estimated within a range of statistical uncertainty. But, when conducted during wartime, risks abound. Aside from the risks to interviewers collecting such data during a conflict, these include the selection bias of households in the sample, a lack of credible population data to which to apply the changed mortality rates and mistaken or misleading accounts by participants.

  The survey approach was used twice by a group of researchers based primarily at Johns Hopkins University, who published their results in the medical journal the Lancet. Their estimates have been lauded, but also questioned because of their misinterpretation of their own figures.

  For example, in a summary of the 2004 study, they wrote: "Making conservative assumptions we think that about 100,000 excess deaths, or more, have happened since the 2003 invasion of Iraq."

  But the first study yielded very imprecise estimates of the number of deaths, which the authors glossed over. They should have said: "We can say with 95 percent certainty that between 8,000 and 194,000 excess Iraqi deaths occurred during the period."

  The group essentially repeated the study last year, using a larger sample size. Again, the researchers had interviewers administer what resembled a typical survey of a random sample of households. Appropriately, at the end of the article in the Lancet, the authors discuss issues that may have resulted in a sample that in fact did not meet the "random" threshold.

  Problems with interpretation also plagued that second effort. The authors used crude death rates (CDR), which reflect the number of deaths per thousand people, in explaining the rise in mortality. But demographers rarely use CDR, thinking instead in terms of age and sex-specific mortality rates, usually summarized as "life expectancy." That being said, the group reported that the CDR increased from 5.5 per thousand people in 2002 to 13.3 per thousand in the post-invasion period (March 2003 to March 2006).

  To put the pre-invasion figure in perspective, consider UN Population Division figures, which are generally considered to be of very high quality. The UN estimates that Iraq's pre-invasion CDR was 10 per thousand, not the 5 per thousand estimated from the two studies. Comparing internationally, the UN reports that Iran's CDR in the 2000-2005 period was 5.3 per thousand. Prior to the war, most observers thought that the situation in Iraq was considerably worse than in Iran.

  So the pre-war CDR that the two Lancet studies yield seems too low. It may not be wrong, but the authors should provide a credible explanation of why their pre-war CDR is nearly half that of the UN Population Division. If the pre-war mortality rate was too low and/or if the population estimates were too high -- because, for example, they ignored outflows of refugees from Iraq -- the resulting estimates of the number of Iraqi "excess deaths" would be inflated.

  More fundamentally, what purpose do these numbers serve?

  Certainly, after the dust has settled, numbers play a role in evaluating the costs and benefits, if any, of a war. But in real time, do the numbers really add to the debate? Do they really provide us with more information than the Iraq Body Count figures provide? Do we have the appropriate context to help us interpret the numbers? The war in Iraq has been exceptionally bloody. For now, that is about all that statistics can safely tell us.

  Beth Osborne Daponte is a senior researcher at Yale University's Institute for Social and Policy Studies. Copyright: Project Syndicate
• Most Popular

  • 1

    Police warn of paid trips to Cambodia, Thailand

  • 2

    Master sergeant killed after being sucked into engine

  • 3

    Tourist faces a fine after being struck by a train

  • 4

    Dozens injured after quakes damage buildings

  • 5

    HSR to encircle Taiwan