ELECTRIC BRAINS

REBECCA MACKINNON

Director, Ranking Digital Rights Project, New America Foundation; cofounder, Global Voices; author, Consent of the Networked

广告:个人专属 VPN,独立 IP,无限流量,多机房切换,还可以屏蔽广告和恶意软件,每月最低仅 5 美元

The Chinese word for computer translates literally as “electric brain.” How do electric brains “think” today? As individual machines, still primitively by human standards. Powerfully enough in the collective. Networked devices and all sorts of things with electric brains embedded in them increasingly communicate with one another, share information, reach mutual “understandings,” and make decisions. It’s already possible for a sequence of data retrieval, analysis, and decision making, distributed across a cloud of machines in various locations, to trigger action by a single machine or set of machines in one physical place, thereby affecting (or in service of) a given human or group of humans.

Perhaps individual machines may never think in a way that resembles individual human consciousness as we understand it. But maybe someday large globally distributed networks of nonhuman things may achieve some sort of pseudo–Jungian collective consciousness. More likely, the collective consciousness of human networks and societies will be enhanced by—and increasingly intertwined with—a different sort of collective consciousness generated by networks of electric brains.

Will this be a good thing or a bad thing?

Both. Neither. Like the Internet we all use today, it depends whether you think human nature is fundamentally good or bad or both. The Internet doesn’t transform or improve human nature. It magnifies, telescopes, enhances, empowers, and concentrates many aspects of human nature—from the altruistic and charitable to the criminal and evil. Get ready to add another dimension to what the Internet already does.

We already have what computer scientists like to call “attribution problems”: identifying who’s truly responsible for something that happens on or through the Internet (say, for example, a cyberattack on a government facility or multinational corporation). Those problems and debates are going to get even tougher very quickly.

We’ll continue to ask many of the questions about human-rights implications of a much smarter and empowered cloud that we’re asking today about the Internet and networked devices. Who gets to shape the technology we increasingly depend on for our economic, social, political, and religious lives? Who’s responsible when somebody’s rights are violated via those technologies, platforms, and networks? Who gets to hold whom accountable for violations including censorship, surveillance, incitement to physical violence, data-driven discrimination, etc.?

New questions: Will rival networks of thinking things, created by and connected closely to (note I don’t say “controlled by”) rival cultures, commercial alliances, religions, or polities, block connections between one another? Might they fight one another? How will artistic creation work? How will politics work? How will war work? Can censorship and surveillance be delegated to nonhuman networks so that humans can avoid taking responsibility for such things? (How convenient for our government and business leaders.) Can thinking networks of things instead be engineered so that direct human involvement or sign-off is required for certain types of actions taken by machines?

Will empowered smart clouds exacerbate global inequalities? Might they exacerbate global ideological and religious conflicts if we don’t act to stop that? If we want to prevent the global digital divide from deepening, what early steps must be taken?

Will these networks be open or closed? Will any innovator from anywhere be able to plug something new into a network and communicate—or shall we say participate—without needing permission? Or will it be a controlled system, with certain companies or governments deciding who and what is allowed to connect at what price? Or will some systems be open and some closed?

Will smarter and more empowered global networks erode the power and legitimacy of nation-states beyond what the Internet has already done? Or might they extend the power of nation-states in new ways? Or enable the nation-state to evolve and ultimately survive in a digitally networked world?

We cannot assume good or humane outcomes just because the people who invent the technology or set the process in motion seem like well-intentioned, freedom-and-democracy-loving people. Such assumptions didn’t work well for the Internet, and they won’t work any better for whatever comes next.