Click amount to donate direct to CounterPunch
  • $25
  • $50
  • $100
  • $500
  • $other
  • use PayPal
Please Support CounterPunch’s Annual Fund Drive
We don’t run corporate ads. We don’t shake our readers down for money every month or every quarter like some other sites out there. We only ask you once a year, but when we ask we mean it. So, please, help as much as you can. We provide our site for free to all, but the bandwidth we pay to do so doesn’t come cheap. All contributions are tax-deductible.
FacebookTwitterGoogle+RedditEmail

The Army’s Flawed Resilience-Training Study

Ten years of continuous war — characterized by multiple deployments, elusive guerilla adversaries, and occupied populations seemingly more tilted toward resentment than gratitude — have taken a significant toll on US troops. In addition to those who have been killed, physically maimed, or neurologically impaired by combat, many soldiers have experienced debilitating psychological disorders including post-traumatic stress disorder (PTSD), depression, and anxiety. Large numbers are on antidepressants and other psychotropic medications, while the suicide rate among troops has risen to alarming levels.

The sobering realities of the psychological effects of war pose a serious challenge for the US military tasked with simultaneously fighting multiple wars and anticipating years of “persistent conflict” ahead. The good news is that key sectors within the military have now identified the mental health of our troops as a major issue that must be addressed. Indeed, in addition to treatment for those suffering psychological impairment, the military leadership is pursuing intervention efforts aimed at preventing such adverse outcomes by increasing soldiers’ psychological resilience to combat exposure. The largest of these new initiatives is the Army’s Comprehensive Soldier Fitness (CSF) program, launched in 2009 and based upon the “positive psychology” framework of psychologist Martin Seligman. And that brings us to the bad news: despite the over-hyped claims of CSF’s leading proponents, at this point there is little evidence to suggest that CSF works.

Since its inception, CSF has been the target of numerous criticisms from psychologists and others, including an article, “The Dark Side of Comprehensive Soldier Fitness,” we co-authored with colleague Marc Pilisuk last year, a series of critical comments published in the October 2011 issue of the American Psychologist, and criticism voiced on PBS NewsHour. Concerns raised by critics span a wide range of significant issues (and led to Congressional inquiries last year): the questionable empirical evidence behind the rapid creation and implementation of CSF; indications that CSF is actually a research study involuntarily imposed upon troops without appropriate protections such as independent ethical review and informed consent; the possibility that CSF may distract attention from addressing the documented adverse effects of multiple and lengthy deployments and high levels of combat exposure; potential negative effects of CSF, common in prevention programs, that have not been carefully considered or monitored; concerns as to whether the “spirituality” component of CSF is inappropriately promoting religion; the insufficient examination of ethical questions posed by efforts to build “indomitable” soldiers; issues concerning the awarding of a $31 million no-bid contract to Seligman’s positive psychology center at the University of Pennsylvania for CSF development; and the seemingly uncritical embrace and promotion of CSF by the American Psychological Association (of which Seligman is a past president).

Recently we identified yet another deeply problematic issue with the CSF program: The research evaluating the program is of questionable quality and it does not support the strong claims being made about CSF’s effectiveness. Most notably, last December CSF researchers released a report, “Report #3: Longitudinal Analysis of the Impact of Master Resilience Training on Self-Reported Resilience and Psychological Health Data,” purporting to demonstrate that CSF “works.” On the report’s first page, the researchers boldly assert: “There is now sound scientific evidence that Comprehensive Soldier Fitness improves the resilience and psychological health of Soldiers.” And, in a prefatory statement to the report, Army Vice Chief of Staff General Peter Chiarelli writes: “I and other Army senior leaders are often asked if it [CSF] really works – if it actually makes Soldiers more resilient and psychologically healthier. I believe the answer is yes.”

The Army News Service quickly and broadly disseminated the “news” this way: “The Master Resilience Training aspect of Comprehensive Soldier Fitness is working well. That’s the conclusion of an Army report, released last month, covering a 15-month period of statistical evaluation.” This summary has appeared on dozens of websites, including the official websites of the U.S. Army, the CSF program, the Army National Guard, the U.S. Army magazine Soldiers, and the Fort Hood Sentinel.

Report #3 assesses the Master Resilience Trainer component of CSF. After undergoing an intensive 10-day training course, each newly-minted “Master Resilience Trainer” is placed in an Army unit. Trainers are charged with equipping fellow soldiers with thinking skills and strategies intended to help them more effectively handle the physical and psychological challenges of military life, including, most especially, combat operations.

In our report released this week, “Does Comprehensive Soldier Fitness Work? CSF Research Fails the Test,” we critique Report #3 in detail and identify five major areas of weakness: (1) the researchers’ failure to measure the important outcomes of PTSD, depression, or other psychological disorders despite the availability of validated measures for doing so, (2) a flawed research design that fails to control for important confounding variables, (3) significant problems with the method of data analysis, (4) the researchers’ failure to acknowledge plausible risks of harm from the CSF intervention, and (5) a miscellaneous set of related issues of concern. (While much of our report addresses issues of research design and methodology, we have aimed to make it as accessible as possible to the broader public.)

Based upon our careful analysis of Report #3, we believe that the claims of CSF proponents regarding the program’s effectiveness are vastly inflated. We therefore call upon the Army to retract this report or, at a minimum, issue an unambiguous and widely disseminated statement acknowledging that the report is seriously flawed and that, as a result, the verdict is still out as to whether CSF actually “works.”

In making this recommendation we fully recognize that large-scale evaluation research is an intrinsically difficult undertaking inevitably imperfect in its execution. However, the public that has paid over $100 million for the CSF program and, even more, the one million soldiers who are involuntarily subjected to CSF’s resiliency training deserve much better than the misrepresentations of effectiveness aggressively promoted by Report #3.

Certainly, the psychological health of our nation’s soldiers, and of all citizens, should be a top priority. As a country we must commit ourselves to addressing the alarming rates of PTSD, suicide, and other serious behavioral and emotional difficulties among our troops, especially those repeatedly exposed to the horrors of combat and war. But it is simply wrong at this time to present CSF as part of a solution, because to date there is no solid empirical evidence demonstrating that the program accomplishes any of these lofty goals.

Note: This article draws upon material in our report “Does Comprehensive Soldier Fitness Work? CSF Research Fails the Test.”

Stephen Soldz, PhD, is a psychologist and researcher in Boston. He is Director of the Center for Research, Evaluation, and Program Development at the Boston Graduate School of Psychoanalysis. Soldz is especially interested in the intersection of research methodology with clinical and policy efforts. He is an Associate Editor of the Journal of Research Practice and on the editorial board of Psychotherapy Research and Politics and Psychotherapy International. He coedited Reconciling Empirical Knowledge and Clinical Experience: The Art and Science of Psychotherapy (APA Books, 2000). He is a member of the Coalition for an Ethical Psychology and is Past-President of Psychologists for Social Responsibility (PsySR). Soldz is a consultant to Physicians for Human Rights and co-authored their report Experiments in Torture: Human Subject Research and Experimentation in the “Enhanced” Interrogation Program. He also served as a consultant on several Guantánamo trials.

Roy Eidelson, PhD, is a clinical psychologist and the president of Eidelson Consulting, where he conducts research, writes, and consults on the role of psychological issues in political, organizational, and group conflict settings. He is a past president of Psychologists for Social Responsibility, associate director of the Solomon Asch Center for Study of Ethnopolitical Conflict at Bryn Mawr College, and a member of the Coalition for an Ethical Psychology. The former executive director of the Solomon Asch Center at the University of Pennsylvania, Eidelson is the author of numerous scholarly articles on a range of topics in peer-reviewed journals, including intergroup conflict; group identification; anxiety and depression; interpersonal and marital satisfaction; and agent-based computer simulations of political instability.

Stephen Soldz, PhD, is a psychologist and researcher in Boston. He is Director of the Center for Research, Evaluation, and Program Development at the Boston Graduate School of Psychoanalysis. Soldz is especially interested in the intersection of research methodology with clinical and policy efforts. He is an Associate Editor of the Journal of Research Practice and on the editorial board of Psychotherapy Research and Politics and Psychotherapy International. He coedited Reconciling Empirical Knowledge and Clinical Experience: The Art and Science of Psychotherapy (APA Books, 2000). He is a member of the Coalition for an Ethical Psychology and is Past-President of Psychologists for Social Responsibility (PsySR). Soldz is a consultant to Physicians for Human Rights and co-authored their report Experiments in Torture: Human Subject Research and Experimentation in the “Enhanced” Interrogation Program. He also served as a consultant on several Guantánamo trials.

Roy Eidelson, PhD, is a clinical psychologist and the president of Eidelson Consulting, where he conducts research, writes, and consults on the role of psychological issues in political, organizational, and group conflict settings. He is a past president of Psychologists for Social Responsibility, associate director of the Solomon Asch Center for Study of Ethnopolitical Conflict at Bryn Mawr College, and a member of the Coalition for an Ethical Psychology. The former executive director of the Solomon Asch Center at the University of Pennsylvania, Eidelson is the author of numerous scholarly articles on a range of topics in peer-reviewed journals, including intergroup conflict; group identification; anxiety and depression; interpersonal and marital satisfaction; and agent-based computer simulations of political instability.

More articles by:

Roy Eidelson, PhD, is a past president of Psychologists for Social Responsibility, a member of the Coalition for an Ethical Psychology, and the author of the new book POLITICAL MIND GAMES: How the 1% Manipulate Our Understanding of What’s Happening, What’s Right, and What’s Possible. His website is www.royeidelson.com and he’s on Twitter at @royeidelson

October 16, 2018
Gregory Elich
Diplomatic Deadlock: Can U.S.-North Korea Diplomacy Survive Maximum Pressure?
Rob Seimetz
Talking About Death While In Decadence
Kent Paterson
Fifty Years of Mexican October
Robert Fantina
Trump, Iran and Sanctions
Greg Macdougall
Indigenous Suicide in Canada
Kenneth Surin
On Reading the Diaries of Tony Benn, Britain’s Greatest Labour Politician
Thomas Knapp
Facebook Meddles in the 2018 Midterm Elections
Muhammad Othman
Khashoggi and Demetracopoulos
Gerry Brown
Lies, Damn Lies & Statistics: How the US Weaponizes Them to Accuse  China of Debt Trap Diplomacy
Christian Ingo Lenz Dunker – Peter Lehman
The Brazilian Presidential Elections and “The Rules of The Game”
Robert Fisk
What a Forgotten Shipwreck in the Irish Sea Can Tell Us About Brexit
Martin Billheimer
Here Cochise Everywhere
David Swanson
Humanitarian Bombs
Dean Baker
The Federal Reserve is Not a Church
October 15, 2018
Rob Urie
Climate Crisis is Upon Us
Conn Hallinan
Syria’s Chessboard
Patrick Cockburn
The Saudi Atrocities in Yemen are a Worse Story Than the Disappearance of Jamal Khashoggi
Sheldon Richman
Trump’s Middle East Delusions Persist
Justin T. McPhee
Uberrima Fides? Witness K, East Timor and the Economy of Espionage
Tom Gill
Spain’s Left Turn?
Jeff Cohen
Few Democrats Offer Alternatives to War-Weary Voters
Dean Baker
Corporate Debt Scares
Gary Leupp
The Khashoggi Affair and and the Anti-Iran Axis
Russell Mokhiber
Sarah Chayes Calls on West Virginians to Write In No More Manchins
Clark T. Scott
Acclimated Behaviorisms
Kary Love
Evolution of Religion
Colin Todhunter
From GM Potatoes to Glyphosate: Regulatory Delinquency and Toxic Agriculture
Binoy Kampmark
Evacuating Nauru: Médecins Sans Frontières and Australia’s Refugee Dilemma
Marvin Kitman
The Kitman Plan for Peace in the Middle East: Two Proposals
Weekend Edition
October 12, 2018
Friday - Sunday
Becky Grant
My History with Alexander Cockburn and The Financial Future of CounterPunch
Paul Street
For Popular Sovereignty, Beyond Absurdity
Nick Pemberton
The Colonial Pantsuit: What We Didn’t Want to Know About Africa
Jeffrey St. Clair
The Summer of No Return
Jeff Halper
Choices Made: From Zionist Settler Colonialism to Decolonization
Gary Leupp
The Khashoggi Incident: Trump’s Special Relationship With the Saudi Monarchy
Andrew Levine
Democrats: Boost, Knock, Enthuse
Barbara Kantz
The Deportation Crisis: Report From Long Island
Doug Johnson
Nate Silver and 538’s Measurable 3.5% Democratic Bias and the 2018 House Race
Gwen Carr
This Stops Today: Seeking Justice for My Son Eric Garner
Robert Hunziker
Peak Carbon Emissions By 2020, or Else!
Arshad Khan
Is There Hope on a World Warming at 1.5 Degrees Celsius?
David Rosen
Packing the Supreme Court in the 21stCentury
Brian Cloughley
Trump’s Threats of Death and Destruction
Joel A. Harrison
The Case for a Non-Profit Single-Payer Healthcare System
Ramzy Baroud
That Single Line of Blood: Nassir al-Mosabeh and Mohammed al-Durrah
FacebookTwitterGoogle+RedditEmail