FacebookTwitterGoogle+RedditEmail

Grading Teachers, Failing Kids

by MOSHE ADLER

What would children gain from teachers who have the highest evaluations as measured by the metric that Mayor Rahm Emanuel wants to implement for Chicago’s public school (but not charter school) teachers?  This is precisely what three Columbia and Harvard economists researched in a study that has received wide attention from the media and politicians.  According to the authors’ own interpretation—the sky.  But if you read the study itself—nothing at all.

The study examined the incomes of adults who, as children in the 4th through the 8th grades, had teachers of different “Value Added” scores, with Value Added defined as improvement in the scores of students on standardized tests.  The researchers found that the average wage and salary of a 28 year old who had an excellent teacher was $20,509 in 2010 dollars, $182 higher than the average annual pay of all 28 year olds in the study.

How does this compare to the average salary and wage of a 28 year old in this country? The authors chose not to make the comparison, but we can make it for them.  They excluded from their study people whose income was higher than $100,000. As we shall see, this exclusion is problematic; but to do the comparison we must do the same. The average salary and wage in 2010 of a 28 year old who earned less than $100,000 a year was $29,041, 42% higher than the income of a 28 year old in the Columbia-Harvard study who had an excellent teacher. In other words, even if we accept the spin the authors put on their numbers, having an excellent teacher does not pull people out of poverty.

But tiny as it is, even the gain of $182 a year from having a high “value-added” teacher may not really exist.   First, the exclusion of people with high incomes involved some 4,000 individuals, or 1.2% of the sample. The authors justify it by claiming that such people are outliers. But what if it turned out those high income earners had “bad” teachers? Including them in the study would have completely changed the results. Excluding a large number of the best performers from a study about the effect of teaching seems strange.

But that’s not all.  When the authors examined the incomes of 30 year olds they found no statistically significant result.   Why? In the study the authors explain this by the small number of 30 year olds in their sample.  And in their interviews with the media and in public presentations  the authors do not mention this result at all. Yet the number of 30 year olds in their sample is 61,639, and these are all
students who went to school in the same city.  Is this really a small sample? To gain an appreciation for the size of the sample consider the fact that in order to estimate the unemployment rate that it publishes every month, the Bureau of Labor Statistics relies on a national survey of 60,000 households with an average of 1.95 adults in each. Surely if 120,000 people are a good size sample to study a labor force of 150 million people spread all over the country, a sample of 61,639 is a good size sample to study a population of fewer than 5 million elementary school students who all come from the same school system. By any measure the sample size is not only adequate, it is fantastically huge, and the result is not statistically significant.

The statistically insignificant results for 30 year olds may have been inconvenient for the authors for another reason. An increase of $128 a year is small by any standard, so the authors resorted to estimating a lifetime increase in earnings due to this increase. To do this they assumed that the percentage increase in income, 0.9 of one percent, which they estimated for age 28, holds for each year of a person’s working life. And perhaps this is why the authors chose to ignore the results for the 30 year olds. What their findings actually permit them to claim truthfully is that an excellent teacher increases average annual income by $128 at age 28, and that this effect disappears at age 30. But then there would have been nothing to report.

Does teacher quality matter?  Of course it does, and it should, therefore, be evaluated:  by peers, principals, outside experts, students and parents.  But it cannot be measured, and Mayor Emanuel of Chicago knows it.  Why else would the non-union charter schools be exempted from the same measurement?   The evaluation method the mayor wants to implement is nothing more than a union-busting, pro-privatization trick that is based on partisan economics.

Moshe Adler teaches economics at Columbia University and at the Harry Van Arsdale Center for Labor Studies at Empire State College. He is the author of Economics for the Rest of Us: Debunking the Science That Makes Life Dismal (The New Press, 2010),  which is available in paperback and as  an e-book.

 

More articles by:

Moshe Adler teaches economics at Columbia University and at the Harry Van Arsdale Center for Labor Studies at Empire State College. He is the author of Economics for the Rest of Us: Debunking the Science That Makes Life Dismal (The New Press, 2010),  which is available in paperback and as an e-book and in Chinese (2013) and Korean (2015) editions.

CounterPunch Magazine

minimag-edit

bernie-the-sandernistas-cover-344x550

zen economics

June 22, 2017
Ken Levy
Sorry, But It’s Entirely the Right’s Fault
Jason Hirthler
Invisible Empire Beneath the Radar, Above Suspicion
John Laforge
Fukushima’s Radiation Will Poison Food “for Decades,” Study Finds
Ann Garrison
Jeremy Corbyn, the Labour Party, and the UK’s Socialist Surge
Phillip Doe
Big Oil in the Rocky Mountain State: the Overwhelming Tawdriness of Government in Colorado
Howard Lisnoff
The Spiritual Death of Ongoing War
Stephen Cooper
Civilized, Constitution-Loving Californians Will Continue Capital Punishment Fight
Bruno Rodríguez Parrilla
Cuba Will Not Bow to Trump’s Threats
Ramzy Baroud
Israel vs. the United Nations: The Nikki Haley Doctrine
Tyler Wilch
The Political Theology of US Drone Warfare
Colin Todhunter
A Grain of Truth: RCEP and the Corporate Hijack of Indian Agriculture
Robert Koehler
When the Detainee is American…
Jeff Berg
Our No Trump Contract
Faiza Shaheen
London Fire Fuels Movement to Challenge Inequality in UK
Rob Seimetz
Sorry I Am Not Sorry: A Letter From Millennials to Baby Boomers
June 21, 2017
Jim Kavanagh
Resist This: the United States is at War With Syria
James Ridgeway
Good Agent, Bad Agent: Robert Mueller and 9-11
Diana Johnstone
The Single Party French State … as the Majority of Voters Abstain
Ted Rall
Democrats Want to Lose the 2020 Election
Kathy Kelly
“Would You Like a Drink of Water?” Please Ask a Yemeni Child
Russell Mokhiber
Sen. Joe Manchin Says “No” to Single-Payer, While Lindsay Graham Floats Single-Payer for Sick People
Ralph Nader
Closing Democracy’s Doors Until the People Open Them
Binoy Kampmark
Barclays in Hot Water: The Qatar Connection
Jesse Jackson
Trump Ratchets Up the Use of Guns, Bombs, Troops, and Insults
N.D. Jayaprakash
No More Con Games: Abolish Nuclear Weapons Now! (Part Four)
David Busch
The Kingdom of Pence–and His League of Flaming Demons–is Upon Us
Stephen Cooper
How John Steinbeck’s “In Dubious Battle” Helps Us Navigate Social Discord
Madis Senner
The Roots of America’s Identity and Our Political Divide are Buried Deep in the Land
June 20, 2017
Ajamu Baraka
The Body Count Rises in the U.S. War Against Black People
Gary Leupp
Russia’s Calm, But Firm, Response to the US Shooting Down a Syrian Fighter Jet
Maxim Nikolenko
Beating Oliver Stone: the Media’s Spin on the Putin Interviews
Michael J. Sainato
Philando Castile and the Self Righteous Cloak of White Privilege
John W. Whitehead
The Militarized Police State Opens Fire
Peter Crowley
The Groundhog Days of Terrorism
Norman Solomon
Behind the Media Surge Against Bernie Sanders
Pauline Murphy
Friedrich Engels: a Tourist In Ireland
David Swanson
The Unifying Force of War Abolition
Louisa Willcox
Senators Bernie Sanders, Cory Booker, Tom Udall Back Tribes in Grizzly Fight
John Stanton
Mass Incarceration, Prison Labor in the United States
Robert Fisk
Did Trump Denounce Qatar Over Failed Business Deals?
Medea Benjamin
America Will Regret Helping Saudi Arabia Bomb Yemen
Brian Addison
Los Angeles County Data Shows Startling Surge in Youth, Latino Homelessness
Native News Online
Betraying Indian Country: How Grizzly Delisting Exposes Trump and Zinke’s Assault on Tribal Sovereignty and Treaty Rights
Stephen Martin
A Tragic Inferno in London Reflects the Terrorism of the Global Free Market
Debadityo Sinha
Think Like a River
FacebookTwitterGoogle+RedditEmail