Click amount to donate direct to CounterPunch
  • $25
  • $50
  • $100
  • $500
  • $other
  • use PayPal
Please Support CounterPunch’s Annual Fund Drive
We don’t run corporate ads. We don’t shake our readers down for money every month or every quarter like some other sites out there. We only ask you once a year, but when we ask we mean it. So, please, help as much as you can. We provide our site for free to all, but the bandwidth we pay to do so doesn’t come cheap. All contributions are tax-deductible.
FacebookTwitterGoogle+RedditEmail

Why the Future Doesn’t Need Us, Revisited

When the stunning article “Why the Future Doesn’t Need Us” by Bill Joy, chief scientist for Sun Microsystems, made the cover of Wired Magazine in April 2000, it created quite a rumble in high-tech circles. Its argument was that “our most powerful 21st century technologies—robotics, genetic engineering, and nanotech—are threatening to make humans an endangered species.”

Bill Joy was writing about out of control, self-replicating technologies that, once the stuff of science fiction, were now on the way in decades if not years. Tens of thousands of scientists, engineers, mathematicians, and systems analysts are working in countries all over the world churning out theories and specialized applications without much consideration of their overall impacts.

The funding has been coming from various governments’ military budgets, heavily contracted out to industrial corporations and, now increasingly, from the commercial pursuits of global corporations. The rate of knowledge production has been exponential as computers become faster and are programmed to become more self-reliant.

Seventy percent of the volume of stock trading in the U.S. is now driven by computers and their algorithms—a mere glimmer of the future pictured by Mr. Joy.

The worries among sensitive futurists are both the intended and unintended consequences. Autonomous weaponry, for example, may be intended for certain purposes by government militaries, but then emerge as more dreaded unintended consequences where, for example, these weapons decide themselves when and whom to strike.

Last month, astrophysicist Stephen Hawking, Apple co-founder Steve Wozniak and Elon Musk of Tesla Motors were some of many specialists who signed an open letter that called for a ban on autonomous weapons. The letter says, “If any major military power pushes ahead with artificial intelligence weapons, a global arms race is virtually inevitable,” adding that “unlike nuclear weapons, they require no costly or hard-to-obtain raw materials, so they will become ubiquitous and cheap for all significant military powers to mass-produce.”

Artificial intelligence (AI) or “thinking machines” are worrying far more of the serious scientists/technologists than those few who speak out publically.

Last December, in an interview with the BBC, Stephen Hawking, through his computer-generated voice, warned that “the development of full artificial intelligence could spell the end of the human race… It would take off on its own, and re-design itself at an ever increasing rate.” Hawking, a big thinker, noted that “humans, who are limited by slow biological evolution, couldn’t compete, and would be superseded.”

Self-restraint is not a characteristic of the companies developing robotics for businesses that want to replace tens of millions of both white collar and blue collar jobs. Look at the latest factories, refineries and warehouses to illustrate what is coming fast. Even the work of lawyers is being automated.

But the warnings coming from people like Nassim Taleb, author of the runaway best-seller Black Swan and Stuart Russell, a computer scientist at the University of California, Berkeley, co-author of the textbook on artificial intelligence who writes about “risks that could lead to human extinction,” need to reach wider audiences.

Complex systems can be very fragile in ways not foreseen until they happen! That is why Bill Joy saw all three of these technologies—nanotechnology, genetic engineering and artificial intelligence—as interwoven systems expanding over the globe beyond human control.

In a recent interview (July 17, 2015) by Science magazine, Professor Russell was asked “what do you see as a likely path from artificial intelligence (AI) to disaster?” He replied: “the routes could be varied and complex—corporations seeking a super-technological advantage, countries trying to build AI systems before their enemies, or a slow-boiled frog kind of evolution leading to dependence and enfeeblement not unlike E.M. Forster’s The Machine Stops.”

He told Science that he “is not aware of any large movement calling for regulation either inside or outside AI, because we don’t know how to write such regulation.” Such, he noted, is the “bewildering variety of software.”

In the meantime, Congress is oblivious to these grim scenarios. The Republicans in charge have no interest in holding educational public hearings, because the corporations who own them have no such interest. Meanwhile, the myopic Democrats are too busy dialing for commercial campaign dollars to grease their campaigns so as to retake the Congress in 2016.

Some of these Democrats know better. They championed the Office of Technology Assessment (OTA), an arm of Congress established to research and advise members of Congress about such matters. When Congressman Newt Gingrich toppled the Democrats in 1994, one of his first acts was to defund and shut down OTA.

Congress has played ostrich ever since. The American people will surely pay the price unless a tiny few, including leaders of the scientific community, organize and demand that Congress reinstate this technical warning system that OTA provided. With a tiny annual budget of $22 million, OTA saved far more in prevented boondoggles that were circulating on Capitol Hill.

None of this domestic inaction should preclude international efforts to expand the Geneva Conventions against chemical and biological warfare to cover these latest mass destruction weapons against humanity. This initiative would constitute an updated declaration of profound human rights.

More articles by:

Ralph Nader is a consumer advocate, lawyer and author of Only the Super-Rich Can Save Us! 

October 15, 2018
Marvin Kitman
The Kitman Plan for Peace in the Middle East: Two Proposals
Weekend Edition
October 12, 2018
Friday - Sunday
Becky Grant
My History with Alexander Cockburn and The Financial Future of CounterPunch
Paul Street
For Popular Sovereignty, Beyond Absurdity
Nick Pemberton
The Colonial Pantsuit: What We Didn’t Want to Know About Africa
Jeffrey St. Clair
The Summer of No Return
Jeff Halper
Choices Made: From Zionist Settler Colonialism to Decolonization
Gary Leupp
The Khashoggi Incident: Trump’s Special Relationship With the Saudi Monarchy
Andrew Levine
Democrats: Boost, Knock, Enthuse
Barbara Kantz
The Deportation Crisis: Report From Long Island
Doug Johnson
Nate Silver and 538’s Measurable 3.5% Democratic Bias and the 2018 House Race
Gwen Carr
This Stops Today: Seeking Justice for My Son Eric Garner
Robert Hunziker
Peak Carbon Emissions By 2020, or Else!
Arshad Khan
Is There Hope on a World Warming at 1.5 Degrees Celsius?
David Rosen
Packing the Supreme Court in the 21stCentury
Brian Cloughley
Trump’s Threats of Death and Destruction
Joel A. Harrison
The Case for a Non-Profit Single-Payer Healthcare System
Ramzy Baroud
That Single Line of Blood: Nassir al-Mosabeh and Mohammed al-Durrah
Zhivko Illeieff
Addiction and Microtargeting: How “Social” Networks Expose us to Manipulation
ADRIAN KUZMINSKI
What is Truth?
Michael Doliner
Were the Constitution and the Bill of Rights a Mistake?
Victor Grossman
Cassandra Calls
Ralph E. Shaffer
Could Kavanaugh’s Confirmation Hearing Ended Differently?
Vanessa Cid
Our Everyday Family Separations
Walaa Al Ghussein
The Risks of Being a Journalist in Gaza
Ron Jacobs
Betrayal and Treachery—The Extremism of Moderates
James Munson
Identity Politics and the Ruling Class
P. Sainath
The Floods of Kerala: the Bank That Went Under…Almost
Ariel Dorfman
How We Roasted Donald Duck, Disney’s Agent of Imperialism
Joe Emersberger
Ecuadorian President Lenin Moreno’s Assault on Human Rights and Judicial Independence
Ed Meek
White Victimhood: Brett Kavanaugh and the New GOP Brand
Andrew McLean, MD
A Call for “Open Space”
Jim Goodman
Do Republicans Hate All Protesters ?
James Rothenberg
Propaganda’s Long Shadow
Evaggelos Vallianatos
The Menace of Leafblowers: a Careless Technology in Our Own Backyard
Dana E. Abizaid
The Triumph of Words Over Actions
Brett Wilkins
Pope to Declare Slain Salvadoran Archbishop Óscar Romero a Saint
Ralph Nader
Let’s Start a Kavanaugh Watch to Check All Five Corporate Judges
Christopher Brauchli
Air Conditioned Nightmare: Just Another Immigration Story (With Kids)
Jonah Raskin
Dangerous Times Demand Dangerous Books
Wim Laven
Dangerous White Lies
Manuel E. Yepe
Miami Cubans and the Midterm Elections
John Kendall Hawkins
Proof of Life: Self-Abnegation Amongst the Post-Colonial Pirates of Somalia
Charles R. Larson
Lynching Journalists
Binoy Kampmark
Faking It: the Return of Orson Welles
Hans-Armin Ohlmann
On Noah’s Curse
FacebookTwitterGoogle+RedditEmail