FacebookTwitterRedditEmail

Follow the Money: How to Read Peer-Reviewed Science

I regularly hear or read arguments from agencies compromising our natural heritage that such and such studies support their management decisions.  However, often the agencies overlook or ignore contrary science that does not support the policy or management decision.

To give them a break, the average district ranger or even specialists like wildlife biologists, fire managers, and others often do not have time to keep up with the latest science. So, recognize that they may not really know the “best” science.

Yet, the public, and often the media, naively accepts without question the assertions of public agencies as “unbiased” observers. One often hears agencies defend their statements and policies by suggesting if everyone is angry with their positions, they must be “doing something right.”

Well not everything is splitting the baby. The Earth is round, not flat or half way flat.  Gravity exists whether you believe it or not—just try jumping off a cliff. There are some things that are more accurate than others.

Both proponents and opponents of various public policies rely upon scientific studies to give credibility to their positions and boost confidence in their assertions. So how does one determine whose science is reliable?

There are several ways that I decide the relative veracity of scientific research and whether to grant authority to agency representatives—I follow the money.

The Upton Sinclair quote that “It is difficult to get a man to understand something when his salary depends upon his not understanding it” often is a good starting point for determining the accuracy of statements.

I know few foresters, for instance, who are opposed to logging. If you are a forester, your job depends on cutting trees.

The first thing I do is look at the occupation and affiliation of the spokesperson. Obviously if you are reading a study about the safety of smoking cigarettes and the authors work for tobacco companies, this would raise a yellow flag of caution. But it is not always as obvious that there are conflicts.

For instance, one of the ideas we hear surrounding livestock grazing is that grazing can prevent large wildfires by targeted removal of the fuel—grasses—that sustains fires.

There have been several studies that purport to show that “targeted” grazing can halt large fires. So, the first thing I do is look at who the authors are and where they are employed. The studies that suggest that livestock grazing—at least the ones I’m aware of—are all done by people in range departments.

Why is this important? Because if you are a professor or graduate student in a range program, your entire budget and survival as a professor and department depends on maintaining livestock grazing on public lands. Hence you have a vested interested in promoting livestock “benefits” whether real or imagined, and minimizing any known negative effects.

Next I look at the journal where the research was published. Not all journals are equal. Some are much more discriminating in the papers accepted for publication. Some journals also have unspoken biases. For instance, the Journal of Rangeland Ecology and Management published by the Society for Range Management is biased towards promoting livestock production.

You will find few papers in this journal that recommends removal of livestock as the best management option, even when the authors may document significant resource damage from livestock. They almost always recommend “proper grazing management” as the solution to problems, whether proper management can work under field conditions.

Beyond the journal publication, one then must look at the funding source for the study. If you are doing range studies in the western United States, most of your funding will be coming from either livestock organizations, and/or federal/state money appropriated to demonstrate why livestock grazing is a beneficial use of the landscape.

In all instances of the above examples, money and jobs dictates the perspective of the individual, and woe to the person who steps over the line and does not promote the accepted policy positions.

So, in the case of targeted grazing, you must read crucially the study methods, and conclusions. Most scientists have integrity—even though who are advocates of grazing, logging, oil extraction or whatever. They do not out-right lie or distort their findings.

What they do instead is restrict the kinds of questions they ask, how they set up their experimental design, how they interpret their findings and what they propose for solutions.

For instance, I studied wildlife biology in college. There was not one professor of mine that questioned or even raised the question whether hunting wildlife was appropriate and perhaps harmful to the long-term survival of the animals. (And yes, there is evidence that even “regulated” hunting can negatively impact wildlife).

We simply never discussed this idea because almost all wildlife biology professors get a substantial amount of their research funding from Fish and Game agencies.

As an example of the unexamined assumptions, one of the papers widely referenced by the BLM in its management plans to save sage grouse champions “targeted grazing” to reduce western range fires.

The original study was based on the grazing of several small plots where the cattle were confined by fences and herding. While the grazed areas did have less fuels, the applicability of this management of confinement to large public lands allotments is questionable. The cost of such confinement would be prohibitive.

While the research might show that “targeted” grazing might reduce some wildfires, the practical application of this approach to wide-open public lands allotments is questionable.

Beyond the costs and the lack of landscape scale application, the study relied on “models” of fire behavior to conclude that grazing would reduce wildfires.

Models are notoriously imprecise. As the saying goes, what goes into the model affects what comes out.

One of the factors in their model was limiting the wind speed in the fire models.

Why is this important? Because nearly all large wildfires are driven by high winds. Under less than high winds, wildfires do not spread rapidly and are easy to control—whether grazed or not.

Models are better than nothing, but they are no substitute for empirical data. In other words, direct observation of how real wildfires interact with grazed landscapes.

Finally, in at least one of these studies, the authors admitted in the very final paragraph that their findings only applied to wildfires burning under low to moderate weather conditions.

One had to read the entire paper to find this one line which is a dead giveaway that targeted grazing is not likely to significantly influence the large wildfires burning across the West. These large wildfires all burn under extreme fire weather conditions.

The same caution applies to other science as well. Nearly all the science supporting thinning/logging to reduce high severity wildfire is done by forestry schools and/or researchers who work for federal or state forestry agencies like the US Forest Service.

For instance, the Oregon State University Forestry School gets 10% of its funding from a tax on logging, which alone would be enough incentive for the department to have a favorable perspective on logging issues, not to mention that timber industry dollars also directly fund some of the department’s research.

No one wants to bite the hand that feeds them.

I hasten to add that this does not mean all research done by forestry schools, nor are all professors in such departments minions for industry. Nevertheless, there are often unquestioned assumptions that permeates the science. A reasonable person would exercise caution in accepting all “peer reviewed” science as equally valid.

More articles by:

George Wuerthner has published 36 books including Wildfire: A Century of Failed Forest Policy. He serves on the board of the Western Watersheds Project.

bernie-the-sandernistas-cover-344x550

June 18, 2019
John McMurtry
Koch-Oil Big Lies and Ecocide Writ Large in Canada
Robert Fisk
Trump’s Evidence About Iran is “Dodgy” at Best
Yoav Litvin
Catch 2020 – Trump’s Authoritarian Endgame
Thomas Knapp
Opposition Research: It’s Not Trump’s Fault That Politics is a “Dirty” Game
Medea Benjamin - Nicolas J. S. Davies
U.S. Sanctions: Economic Sabotage that is Deadly, Illegal and Ineffective
Gary Leupp
Marx and Walking Zen
Thomas Hon Wing Polin
Color Revolution In Hong Kong: USA Vs. China
Howard Lisnoff
The False Prophets Cometh
Michael T. Klare
Bolton Wants to Fight Iran, But the Pentagon Has Its Sights on China
Steve Early
The Global Movement Against Gentrification
Dean Baker
The Wall Street Journal Doesn’t Like Rent Control
Tom Engelhardt
If Trump’s the Symptom, Then What’s the Disease?
June 17, 2019
Patrick Cockburn
The Dark Side of Brexit: Britain’s Ethnic Minorities Are Facing More and More Violence
Linn Washington Jr.
Remember the Vincennes? The US’s Long History of Provoking Iran
Geoff Dutton
Where the Wild Things Were: Abbey’s Road Revisited
Nick Licata
Did a Coverup of Who Caused Flint Michigan’s Contaminated Water Continue During Its Investigation? 
Binoy Kampmark
Julian Assange and the Scales of Justice: Exceptions, Extraditions and Politics
John Feffer
Democracy Faces a Global Crisis
Louisa Willcox
Revamping Grizzly Bear Recovery
Stephen Cooper
“Wheel! Of! Fortune!” (A Vegas Story)
Daniel Warner
Let Us Laugh Together, On Principle
Brian Cloughley
Trump Washington Detests the Belt and Road Initiative
Weekend Edition
June 14, 2019
Friday - Sunday
Michael Hudson
Trump’s Trade Threats are Really Cold War 2.0
Bruce E. Levine
Tom Paine, Christianity, and Modern Psychiatry
Jason Hirthler
Mainstream 101: Supporting Imperialism, Suppressing Socialism
T.J. Coles
How Much Do Humans Pollute? A Breakdown of Industrial, Vehicular and Household C02 Emissions
Andrew Levine
Whither The Trump Paradox?
Jeffrey St. Clair
Roaming Charges: In the Land of 10,000 Talkers, All With Broken Tongues
Pete Dolack
Look to U.S. Executive Suites, Not Beijing, For Why Production is Moved
Paul Street
It Can’t Happen Here: From Buzz Windrip and Doremus Jessup to Donald Trump and MSNBC
Rob Urie
Capitalism Versus Democracy
Richard Moser
The Climate Counter-Offensive: Secrecy, Deception and Disarming the Green New Deal
Naman Habtom-Desta
Up in the Air: the Fallacy of Aerial Campaigns
Ramzy Baroud
Kushner as a Colonial Administrator: Let’s Talk About the ‘Israeli Model’
Mark Hand
Residents of Toxic W.Va. Town Keep Hope Alive
John Kendall Hawkins
Alias Anything You Please: a Lifetime of Dylan
Linn Washington Jr.
Bigots in Blue: Philadelphia Police Department is a Home For Hate
David Macaray
UAW Faces Its Moment of Truth
Brian Cloughley
Trump’s Washington Detests the Belt and Road Initiative
Horace G. Campbell
Edward Seaga and the Institutionalization of Thuggery, Violence and Dehumanization in Jamaica
Graham Peebles
Zero Waste: The Global Plastics Crisis
Michael Schwalbe
Oppose Inequality, Not Cops
Ron Jacobs
Scott Noble’s History of Resistance
Olivia Alperstein
The Climate Crisis is Also a Health Emergency
David Rosen
Time to Break Up the 21st Century Tech Trusts
FacebookTwitterRedditEmail