home / subscribe / donate / tower / books / archives / search / links / feedback / events / faq
The New Print Edition of CounterPunch, Only for Our Newsletter Subscribers! IRAQ: WHAT HAPPENED? Is the bloodbath over? Is the Occupation settling in? Learn the real story from Patrick Cockburn, the war's most experienced reporter. Also in this exclusive bulletin for CounterPunch subscribers: Jeffrey St Clair on the destruction of America; Alexander Cockburn on how the Left loves to scare itself; Ignacio Ramonet on Africa's No to "free trade". Plus "Waterboarded"--Why the CIA destroyed its videos. Get your copy today by subscribing online or calling 1-800-840-3683 Contributions to CounterPunch are tax-deductible. Click here to make a donation. If you find our site useful please: Subscribe Now! CounterPunch books and gear make great holiday presents.
Order CounterPunch By Email for Only $35 a Year ! David Vest's Pianorama Tours the Northwest!!
|
Today's Stories January 12 / 13, 2008 Andrew Cockburn Saul Landau Corey D. B. Walker Col. Dan Smith Eric Toussaint Ron Jacobs Fred Gardner Stan Cox Ramzy Baroud Joseph Grosso David Díaz-Arias
January 11, 2008 Dave Lindorff Paul Craig
Roberts Andy Worthington Kenneth Couesbouc Jeff Ballinger Christopher
Brauchli Manuel Garcia, Jr. Andrew Silverstein Marwan Bishara Robert Weissman Patrick Irelan Website of
the Day
January 10, 2008 Alexander Cockburn Bob Wing Michael Donnelly David Macaray China Hand Ayesha Ijaz Khan Rannie Amiri Website of the Day
January 9, 2008 Cockburn /
St. Clair Dave Lindorff John Chuckman James Bovard Alan Farago Russell Mokhiber William S. Lind Peter Morici Josh Reubner Mike Roselle Website of the Day
January 8, 2008 Paul Craig
Roberts Russell Mokhiber Robert Fantina Dave Zirin Shamako Nobel John Ross Brenda Norrell Laura Carlsen Patrick Irelan Evelyn J. Pringle Jonathan M.
Feldman Michael Dickinson Website of
the Day
January 7, 2008 Chris Floyd John Blair Uri Avnery Andy Worthington Binoy Kampmark David Macaray Ralph Nader Michael Donnelly Ron Jacobs Gideon Levy Dave Lindorff Website of
the Day
January 5 / 6, 2008 Douglas Valentine Kevin Young Richard Rhames Saul Landau Marc Lynch Robert Fantina Donna Volatile Jelle Bruinsma Bob Sutcliffe Harvey Wasserman Missy Beattie David Swanson Jacob Hornberger Shepherd Bliss Ron Jacobs Poets' Basement Website of the Weekend
January 4, 2008 Cockburn /
St. Clair Jonathan Cook Paul Craig Roberts Stan Goff Dave Lindorff Niranjan Ramakrishnan Allan Nairn Joshua Frank Peter Morici Mary McInnis Website of the Day
January 3, 2008 Fatima Bhutto Pam Martens Joanne Mariner Zoltan Grossman David Domke Norman Solomon Nikolas Kozloff Jacob G. Hornberger Martha Rosenberg Russell Means Website of the Day
January 2, 2008 Jeff Taylor M. Shahid Alam Gary Leupp Paul Craig Roberts Heather Gray Fred Gardner David Macaray Benjamin Dangl
January 1, 2008 Iain A. Boal B. R. Gowani Shahid Mahmood Linn Washington,
Jr. Harvey Wasserman John Ross Website of the Day
December 31, 2007 Alexander Cockburn Tariq Ali Liaquat Ali Khan Wajahat Ali Robert Fisk Ajai Sahni Marwan Bishara Uri Avnery Mark T. Harris Brenda Norrell Website of the Day
December 29 / 30, 2007 Alexander Cockburn Tariq Ali Fawzia Afzal-Khan Gary Leupp China Hand Jacob Hornberger John Chuckman Missy Beattie Ralph Nader Fidel Castro Robert Fantina Greg Moses Catherine Lutz Kristin Van
Tassel Kim Nicolini Phyllis Pollack Poets' Basement Website of
the Weekend
December 28, 2007 Farzana Versey Wajahat Ali Binoy Kampmark Ayesha Ijaz
Khan Anthony DiMaggio Ray McGovern Jim Goodman Ron Jacobs Russell Hoffman John Murphy Website of the Day
December 27, 2007 Dilip Hiro Murtaza Shibli Stephen Soldz Bill Quigley Paul Craig Roberts Omer Subhani Marjorie Cohn Allan Nairn Jacob G. Hornberger Norman Solomon Patrick Irelan Ben Tripp Website of the Day
Charles Tripp Paul Armentano Rannie Amiri Stanley Heller John Walsh Martha Rosenberg Norman Madarasz Website of
the Day
December 25, 2007 Patrick Cockburn December 24, 2007 Andrea Peacock Tariq Ali Uri Avnery Jill Jameson Steve Melendez Mike Whitney Chuck Munson John Walsh Farzana Versey Richard Neville Website of the Day
Alexander Cockburn Ralph Nader Andy Worthington Ahmad Faruqui Bill Moyers Rev. William
E. Alberts Timothy J. Freeman Anthony DiMaggio Fred Gardner Paul Krassner Seth Sandronsky William Loren
Katz Michael Dickinson Ron Jacobs David Vest Poets' Basement Website of the Weekend
December 21, 2007 John Ross Jacob Hornberger Dick J. Reavis Jeff Cohen
Peter Morici Jack McCarthy Raúl Zibechi Steve Early David Macaray Patrick Bond Lakota Freedom Delegation Website of
the Day
December 20, 2007 David Rosen Alan Farago Laura Carlsen Ashley Dawson Wayne Smith Website of
the Day
December 19, 2007 Saul Landau Paul W. Lovinger Norman Solomon Dave Zirin Marjorie Cohn Sen. Russell
Feingold Sonja Karkar Anthony Papa Christopher Ketcham Davey D Website of
the Day
December 18, 2007 R. F. Blader George Wuerthner Steven Higgs Vijay Prashad David Macaray Ralph Nader Eva Liddell Martha Rosenberg Dave Lindorff Peter Morici Website of
the Day
December 17, 2007 Mike Whitney Tom Barry Uri Avnery Greg Moses Allan Nairn Patrick Bond Stephen Lendman Charles Jonkel Laray Polk Stephen Fleischman December 15 / 16, 2007 Peter Linebaugh Howard Zinn Standard Schaefer Raymond J.
Lawrence Alan Farago Saul Landau Jenna Orkin Ahmad Samih
Khalidi Robert Fantina Missy Comley
Beattie Ramzy Baroud James L. Secor Elijah Wald Website of
the Weekend
December 14, 2007 JoAnn Wypijewski John Ross Jacob Hornberger Andy Worthington Allan Nairn Dave Zirin Dave Lindorff Misty MacDuffee Ben Terrall Dr. Mustafa
Barghouthi Website of the Day
December 13, 2007 Paul Craig
Roberts Mike Whitney Ron Jacobs Norman Solomon Peter Morici Sandy Mayes Franklin Lamb Jacob Hornberger Nadim Rouhana Dave Zirin Website of the Day
Allan
Nairn Alan
Farago Ray
McGovern Winslow
T. Wheeler Evan
Jones James
Petras Joel
Hirschorn Joshua
Frank Sherry
Wolf Dan
Bacher Website
of the Day
![]()
![]()
Subscribe Online
|
Weekend
Edition Gross Distortions, Sloppy Methodology and Tendentious ReportingHow the New England Journal of Medicine Undercounted Iraqi Civilian DeathsBy ANDREW COCKBURN Almost five years into the destruction of Iraq, the orthodox rule of thumb for assessing statistical tabulations of the civilian death toll is becoming clear: any figure will do so long as it is substantially lower than that computed by the Johns Hopkins researchers in their 2004 and 2006 studies. Their findings, based on the most orthodox sampling methodology and published in the Lancet after extensive peer review, estimated the post-invasion death toll by 2006 at about 655,000. Predictably, this shocking assessment drew howls of ignorant abuse from self-interested parties, including George Bush ("not credible") and Tony Blair. Now we have a new result complied by the Iraqi Ministry of Health under the sponsorship of the World Health Organization and published in the once reputable New England Journal of Medicine, (NEJM) estimating the number of Iraqis murdered, directly or indirectly, by George Bush and his willing executioners at 151,000--far less than the most recent Johns Hopkins estimate. Due to its adherence to the rule cited above, this figure has been greeted with respectful attention in press reports, along with swipes at the Hopkins effort as having, as the New York Times had to remind readers, "come under criticism for its methodology." However, as a careful and informed reading makes clear, it is the new report that guilty of sloppy methodology and tendentious reporting -- evidently inspired by the desire to discredit the horrifying Hopkins findings, which, the NEJM study triumphantly concludes "considerably overestimated the number of violent deaths." In particular, while Johns Hopkins reported that the majority of post invasion deaths were due to violence, the NEJM serves up the comforting assessment that only one sixth of deaths in this period have been due to violence. Among the many obfuscations
in this new report, the most fundamental is the blurred distinction
between it and the survey it sets out to discredit. The Johns
Hopkins project sought to enumerate the number of excess deaths
due to all causes in the period following the March 2003 invasion
as compared with the death rate prior to the invasion, thus giving
a number of people who died because Bush invaded. Post hoc, propter
hoc. This new study, on the other hand, Superficially at least, both the Hopkins team and the new study followed the same methodology in conducting their surveys: interviewing a random sample of households drawn from randomly selected "clusters" of houses around the country, in which the head of the household was interviewed. While the Johns Hopkins team demanded death certificates as confirmation of deaths and their cause, the NEJM study had no such requirement. That survey was based on a sample of 9345 households, while the 2006 Johns Hopkins report drew on a sample of 1849 households. In reports on the NEJM study, much respectful attention was paid the fact that their sample was bigger, which, uninformed reporters assumed, had to mean that it was more accurate. In fact, as their papers' own pollsters could have told them, beyond a certain point the size of a sample makes less and less difference to the accuracy of the information, with accuracy increasing as a factor of the square root of the ratio between the two. Far, far more important than the size of the sample, however, is the degree to which the overall sample is truly random, that is, truly representative of the population sampled and here is where the first of many serious questions about the NEJM effort arise. As the authors themselves admit, they did not visit a significant proportion of the original designated clusters: "Of the 1086 originally selected clusters, 115 (10.6%) were not visited because of problems with security," meaning they were inconveniently situated in Anbar province, Baghdad, and two other areas that were dangerous to visit, (especially for Iraqi government employees from a Shia-controlled ministry.) While such reluctance is understandable--one of those involved was indeed killed during the survey--it also meant that areas with very high death tolls were excluded from the survey. To fill the gap, the surveyors reached for the numbers advanced by the Iraq Body Count, (IBC) a U.K. based entity that relies entirely on newspaper reports of Iraqi deaths to compile their figures. Due to IBC's policy of posting minimum and maximum figures, currently standing at 80,419 and 87,834, their numbers carry a misleading air of scientific precision. As the group itself readily concedes, the estimate must be incomplete, since it omits deaths that do not make it into the papers, a number that is likely to be high in a society as violently chaotic as today's Baghdad, and higher still outside Baghdad where it is even harder for journalists to operate. Nevertheless, the NEJM study happily adopted a formula in which they compared the ratio between their figures from a province they did visit to the IBC number for that province, and then used that ratio to adjust their own figures for places they did not dare go. Interestingly, the last line of the table on page 8 of the Supplementary Appendix to the report, "adjustment for missing clusters using IBC data," reveals that in using the Body Count's dubious figures to fill the holes in their Baghdad data, the formula they employ actually revises downward the rate of violent deaths on what they label "low mortality provinces." A paragraph in the published abstract of the report, blandly titled "Adjustment for Reporting Bias" contains an implicit confession of the subjectivity with which the authors reached their conclusions. As Sprey points out, "they say 'the level of completeness in reporting of death was 62%,' but they give no real explanation of how they arrive at that figure." Les Roberts, one of the principal authors of the Johns Hopkins studies, has commented: "We confirmed our deaths with death certificates, they did not. As the NEJM study's interviewers worked for one side in this conflict, [the U.S.- sponsored government] it is likely that people would be unwilling to admit violent deaths to the study workers." The NEJM does cite an effort to check information given by the household heads by also interviewing household daughters about any deaths among their siblings. Again, this data is rife with inconsistencies, particularly in the siblings' reports of pre- and post- invasion deaths, inconsistencies egregious enough that these interview results were not folded into the calculations used to determine the report's conclusions. Further evidence of tendentious assessment surfaces in the section blandly titled "Response Rates" in which the authors report that "Of the households that did not respond, 0.7% were absent for an extended period of time, and 1.1% of households were vacant dwellings." Given current Iraqi conditions, houses are likely to be vacant, or their owners absent for long periods, because something nasty happened there--i.e. higher death rates. Yet, as Sprey points out, there is no effort by the authors to account for this in their conclusions. As a statistician, Sprey is most affronted by the enormities committed under the heading "Statistical Analysis" in the NEJM paper, where it is stated, "Robust confidence intervals were estimated with the use of the jackknife procedure." The "confidence interval" cited in the report is 104,000 to 223,000 with a 95% uncertainty range. This does not mean, as many laypeople assume, that there is an 85% chance that the "true number" lies somewhere between those two figures. Sprey explains its true meaning this way:
If any further confirmation of the essential worthlessness of the NEJM effort, it comes in the bizarre conclusion that violent deaths in the Iraqi population have not increased over the course of the occupation. As Iraq has descended into a bloody civil war during that time, it should seem obvious to the meanest intelligence that violent deaths have to have increased. Indeed, even Iraq Body Count tracks the same rate of increase as the Hopkins survey, while NEJM settles for a mere 7% in recent years. As Roberts points out: "They roughly found a steady rate of violence from 2003 - 2006. Baghdad morgue data, Najaf burial data, Pentagon attack data, and our data all show a dramatic increase over 2005 and 2006." These distortions come as less of a surprise on examination of page 6 of the supplementary appendix, an instructive table that reveals that the 279 men and women engaged in collecting data for the survey labored under the supervision of no fewer than 128 local, field, and central supervisors and "editors." Senior supervisors were shipped to Amman for a training course, though why the Iraqi government should want to send its own officials abroad for training is unexplained, unless of course some other government wanted a hand in the matter. Finally, there is the matter of the New England Journal of Medicine lending its imprimatur to this farrago. Once upon a time, under the great editor Marsha Angell, this was an organ unafraid to cock a snoot at power. In particular, Angell refused to pander to the mendacities of the drug companies, thereby earning their undying enmity. Much has evidently changed, as the recruiting ad for the U.S. Army on the home page of the current New England Journal reminds us. Andrew Cockburn is the author of Rumsfeld: His Rise, Fall and Catastrophic Legacy.
![]()
|
How the Press Led the US into War ![]() Buy End Times Now! CounterPunch Books of the Crossroads: HOW THE IRISH INVENTED SLANG By Daniel Cassidy AMERICAN BOOK AWARD! ![]() Click Here to Buy! Click Here for Dates & Venues Michael Neumann's Devastating Rebuttal of Alan Dershowitz ![]() Click Here to Buy! Saul Landau's Bush and Botox World with a Foreword by Gore Vidal ![]() Click Here to Order! How They Made a Killing on the War on Terrorism ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() The Occupation by Patrick Cockburn ![]() ![]() ![]() Humanitarian Imperialism By Jean Bricmont ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() CITY BEAUTIFUL By Tennessee Reed ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |