Sunteți pe pagina 1din 16

Policy Analysis

July 23, 2019 | Number 876

Challenging the Social Media


Moral Panic
Preserving Free Expression under Hypertransparency
By Milton Mueller

S
EX EC U T I V E S UMMARY

ocial media are now widely criticized after improved by regulating the intermediaries that facilitate
enjoying a long period of public approbation. unwanted activities.
The kinds of human activities that are coor- This moral panic should give way to calmer reflection.
dinated through social media, good as well There needs to be a clear articulation of the tremendous
as bad, have always existed. However, these value of social media platforms based on their ability to
activities were not visible or accessible to the whole of match seekers and providers of information in huge quan-
society. As conversation, socialization, and commerce tities. We should also recognize that calls for government-
are aggregated into large-scale, public commercial induced content moderation will make these platforms
platforms, they become highly visible to the public and battlegrounds for a perpetual intensifying conflict over
generate storable, searchable records. Social media who gets to silence whom. Finally, we need a renewed af-
make human interactions hypertransparent and displace firmation of Section 230 of the 1996 Telecommunications
the responsibility for societal acts from the perpetrators Act, which shields internet intermediaries from liability for
to the platform that makes them visible. users’ speech. Contrary to Facebook’s call for government-
This hypertransparency is fostering a moral panic supervised content regulation, we need to keep platforms,
around social media. Internet platforms, like earlier new not the state, responsible for finding the optimal balance
media technologies such as TV and radio, now stand between content moderation, freedom of expression, and
accused of a stunning array of evils: addiction, fostering economic value. The alternative of greater government
terrorism and extremism, facilitating ethnic cleansing, regulation would absolve social media companies of mar-
and even the destruction of democracy. The social- ket responsibility for their decisions and would probably
psychological dynamics of hypertransparency lend lead them to exclude and suppress even more legal speech
themselves to the conclusion that social media cause than they do now. It is the moral panic and proposals for
the problems they reveal and that society would be regulation that threaten freedom and democracy.

Milton Mueller is Professor at the Georgia Institute of Technology’s School of Public Policy and director of the Internet Governance Project.
2


INTRODUCTION behavioral advertising brought a slowly sim-
Social media In a few short years, social media platforms mering social media backlash to a boil after
make human have gone from being shiny new paragons the 2016 election. As this reaction enters its
of the internet’s virtue to globally despised third year, it is time to step back and offer some
interactions scourges. Once credited with fostering a glob- critical perspective and an assessment of where
hypertrans­


al civil society and bringing down tyrannical free expression fits into this picture. As hyper-
parent. governments, they are now blamed for an in- transparency brings to public attention disturb-
credible assortment of social ills. In addition ing, and sometimes offensive, content, a moral
to legitimate concerns about data breaches panic has ensued—one that could lead to dam-
and privacy, other ills—hate speech, addiction, aging regulation and government oversight of
mob violence, and the destruction of democ- private judgment and expression. Perhaps pol-
racy itself—are all being laid at the doorstep of icy changes are warranted, but the regulations
social media platforms. being fostered by the current social climate are
Why are social media blamed for these unlikely to serve our deepest public values.
ills? The human activities that are coordinat-
ed through social media, including negative
things such as bullying, gossiping, rioting, MORAL PANIC
and illicit liaisons, have always existed. In the The assault on social media constitutes a
past, these interactions were not as visible textbook case of moral panic. Moral panics
or accessible to society as a whole. As these are defined by sociologists as “the outbreak
activities are aggregated into large-scale, of moral concern over a supposed threat from
public commercial platforms, however, they an agent of corruption that is out of propor-
become highly visible to the public and gen- tion to its actual danger or potential harm.”2
erate storable, searchable records. In other While the problems noted may be real, the
words, social media make human interactions claims “exaggerate the seriousness, extent,
hypertransparent.1 typicality and/or inevitability of harm.” In a
This new hypertransparency of social in- moral panic, sociologist Stanley Cohen says,
teraction has powerful effects on the dialogue “the untypical is made typical.”3 The exagger-
about regulation of communications. It lends ations build upon themselves, amplifying the
itself to the idea that social media causes the fears in a positive feedback loop. Purveyors
problems that it reveals and that society can of the panic distort factual evidence or even
be altered or engineered by meddling with fabricate it to justify (over)reactions to the
the intermediaries who facilitate the targeted perceived threat. One of the most destructive
activities. Hypertransparency generates what aspects of moral panics is that they frequent-
I call the fallacy of displaced control. Society ly direct outrage at a single easily identified
responds to aberrant behavior that is revealed target when the real problems have more
through social media by demanding regulation complex roots. A sober review of the claims
of the intermediaries instead of identifying currently being advanced about social media
and punishing the individuals responsible for finds that they tick off all these boxes.
the bad acts. There is a tendency to go after
the public manifestation of the problem on Fake News!
the internet, rather than punishing the unde- Social media platforms are accused of gen-
sired behavior itself. At its worst, this focus on erating a cacophony of opinions and infor-
the platform rather than the actor promotes mation that is degrading public discourse. A
the dangerous idea that government should quote from a respected media scholar summa-
regulate generic technological capabilities rizes the oft-repeated view that social media
rather than bad behavior. platforms have an intrinsically negative im-
Concerns about foreign interference and pact on our information environment:
3


An always-on, real-time information reason, those nice things are no longer what the
tsunami creates the perfect environ- platform delivers. In human
ment for the spread of falsehoods, con- In the quote below, an academic evokes history,
spiracy theories, rumors, and “leaks.” all the classical themes of media moral pan-
Unsubstantiated claims and narratives ics—addiction, threats to public health, and a
what public
go viral while fact checking efforts strug- lack of confidence in the agency of common medium has
gle to keep up. Members of the public, people—into a single indictment of YouTube not mixed
including researchers and investigative algorithmic recommendations:
fact with


journalists, may not have the expertise,
tools, or time to verify claims. By the Human beings have many natural ten- fiction?
time they do, the falsehoods may have dencies that need to be vigilantly moni-
already embedded themselves in the tored in the context of modern life. For
collective consciousness. Meanwhile, example, our craving for fat, salt and
fresh scandals or outlandish claims are sugar, which served us well when food
continuously raining down on users, was scarce, can lead us astray in an envi-
mixing fact with fiction.4 ronment in which fat, salt and sugar are
all too plentiful and heavily marketed to
In this view, the serpent of social media us. So too our natural curiosity about the
has driven us out of an Eden of rationality and unknown can lead us astray on a website
moderation. In response, one might ask: in that leads us too much in the direction
human history, what public medium has not of lies, hoaxes and misinformation. In
mixed fact with fiction, has not created new effect, YouTube has created a restaurant
opportunities to spread falsehoods, or has not that serves us increasingly sugary, fatty
created new challenges for verification of fact? foods, loading up our plates as soon as
Similar accusations were levelled against the we are finished with the last meal.6
printing press, the daily newspaper, radio, and
television; the claim that social media are de- Another social media critic echoed similar
grading public discourse exaggerates both the claims:
uniqueness and the scope of the threat.
Every pixel on every screen of every In-
Addiction and Extremism ternet app has been tuned to influence
A variant on this theme links the ad-driven users’ behavior. Not every user can be
business model of social media platforms to influenced all the time, but nearly all us-
an inherently pathological distortion of the in- ers can be influenced some of the time.
formation environment: as one pundit wrote, In the most extreme cases, users develop
“YouTube leads viewers down a rabbit hole of behavioral addictions that can lower
extremism, while Google racks up the ad sales.”5 their quality of life and that of family
A facile blend of pop psychology and pop eco- members, co-workers and close friends.7 
nomics equates social media engagement to a
dopamine shot for the user and increasing ad If one investigates the “science” behind
revenue for the platform. The way to prolong these claims, however, one finds little to dif-
and promote such engagement, we are told, is ferentiate social media addiction from earlier
to steer the user to increasingly extreme con- panics about internet addiction, television ad-
tent. Any foray into the land of YouTube videos diction, video game addiction, and the like.
is a one-way ticket to beheadings, Alex Jones, The evidence for the algorithmic slide to-
flat-earthism, school-shooting denial, Pepe the ward media fat, salt, and sugar traces back
Frog, and radical vegans. No more kittens, dog to one man, Jonathan Albright of Columbia
tricks, or baby pictures: for some unspecified University’s Tow Center, and it is very difficult
4


to find any published, peer-reviewed academ- access channels. Nowadays, apparently, the
In the ic research from Albright. All one can find is media system is dangerous because it does
ultramod­ a blog post on Medium, describing “the net- precisely the opposite.
work of YouTube videos users are exposed to But the overstatement of this claim should
erated world after searching for ‘crisis actor’ following the be evident. Major advertisers come down hard
that many Parkland event.”8 In other words, the blog on the social platforms very quickly when their
of the social reports the results of one search and one se- pitches are associated with crazies, haters, and
media critics lected search phrase; there is no description blowhards, leading to algorithmic adjustments
that suppress marginal voices. Users’ ability to
of a methodology nor is there any systematic
seem to be conceptualization or argumentation about “report” offensive content is another impor-
advocating, the causal linkage between YouTube’s busi- tant form of feedback. But this has proven to
important ness model and the elevation of extreme and cut both ways: lots of interesting but racy or
conspiratorial content. Yet Albright’s claims challenging content gets suppressed. Some
minority- echoed through the New York Times and doz- governments have learned how to game orga-
viewpoint ens of other online media outlets. nized content moderation to yank messages
content is The psychological claims also seem to exposing their evil deeds. (See the discussion
as likely to suffer from a moral panic bias. According to of Facebook and Myanmar in the next sec-
tion.) In the ultramoderated world that many
Courtney Seiter, a psychologist cited by some
be targeted of the critics, the oxytocin and dopamine of the social media critics seem to be advocat-
as terrorist levels generated by social media use gener- ing, important minority-viewpoint content is
propaganda ate a positive “hormonal spike equivalent to as likely to be targeted as terrorist propaganda
[what] some people [get] on their wedding and personal harassment.
and personal day.” She goes on to say that “all the goodwill MURDER, HATE SPEECH, AND ETHNIC
harass­


that comes with oxytocin—lowered stress lev- CLEANSING. Another key exhibit in the case
ment. els, feelings of love, trust, empathy, generos- against social media pins the responsibility
ity—comes with social media, too . . . between for ethnic cleansing in Myanmar, and similar
dopamine and oxytocin, social networking incitement tragedies in the developing world,
not only comes with a lot of great feelings, on Facebook. In this case, as in most of the
it’s also really hard to stop wanting more of other concerns, there is substance to the
it.”9 The methodological rigor and experi- claim but its use and framing in the public
mental evidence behind these claims seems discourse seems both biased and exaggerated.
to be thin, but even so, wasn’t social media In Myanmar, the Facebook platform seems
supposed to be a tinderbox for hate speech? to have been systematically utilized as part
Somehow, citations of Seiter in attacks on so- of a state-sponsored campaign to target the
cial media seem to have left the trust, empa- Rohingya Muslim minority.10 The government
thy, and generosity out of the picture. and its allies incited hatred against them,
The panic about elevating conspiratorial while censoring activists and journalists
and marginalized content is especially fasci- documenting state violence, by reporting their
nating. We are told in terms reminiscent of work as offensive content or in violation of
the censorship rationalizations of authoritar- community standards. At the same time, the
ian governments that social media empowers government-sponsored misinformation and
the fringes and so threatens social stability. propaganda against the Rohingya managed to
Yet for decades, mass media have been ac- avoid the scrutiny applied to the expression
cused of appealing to the mainstream taste of human-rights activists. Social media critics
and of marginalizing anything outside of it. also charged that the Facebook News Feed’s
Indeed, in the 1970s, progressives tried to tendency to promote already popular content
force media outlets to include marginalized allowed posts inciting violence against the
voices in their channel lineup through public minority to go viral. As a result, Facebook is
5


blamed for the tragedies in Myanmar. I have as an external platform not under the control
encountered people in the legal profession of the local government was the only thing Pro-
who would like to bring a human-rights that made it possible to intervene at all. Inter- democracy
lawsuit against Facebook.11 If any criticism can estingly, the New York Times article that broke
be leveled at Facebook’s handling of genocidal this story notes that pro-democracy officials in
officials in
propaganda in Myanmar, it is that Facebook’s Myanmar say Facebook was essential for the Myanmar
moderation process is too deferential to democratic transition that brought them into say Facebook
office in 2015.12 This claim is as important (and
governments. This, however, militates against
was essential
greater state regulation. as unverified and possibly untestable) as the
But these claims show just how displaced claim that it is responsible for ethnic cleans- for the
the moral panic is. Why is so much attention ing. But it hasn’t gotten any play lately. democratic
being focused on Facebook and not on the REVIVING THE RUSSIAN MENACE. Russia- transition that
crimes of a state actor? Yes, Myanmar mili- sponsored social media use during the 2016
tary officers used Facebook (and other media) election provides yet another example of
brought them
into office in


as part of an anti-Rohingya propaganda cam- the moral panic around social media and the
paign. If the Burmese generals used telephones avalanche of bitter exaggeration that goes 2015.
or text messages to spread their poison, are with it. Indeed, the 2016 election marks the
they going to blame those service providers or undisputed turning point in public attitudes
technologies? How about roads, which were toward social media. For many Americans,
undoubtedly used by the military to oppress the election of Donald Trump came as a
Rohingya? In fact, violent conflict between shocking and unpleasant surprise. In searching
Rohingya Muslims and Myanmar’s majority for an explanation of what initially seemed
population goes back to 1948, when the coun- inexplicable, however, the nexus between the
try achieved independence from the British election results, Russian influence operations,
and the new government denied citizenship and social media has become massively
to the Rohingya. A nationalist military coup inflated. It has become too convenient to
in 1962 targeted them as a threat to the new overlook Trump’s complete capture of the
government’s concept of national identity; the Republican Party and his ability to capitalize
army closed Rohingya social and political orga- on nationalistic and hateful themes that
nizations, expropriated Rohingya businesses, conservative Republicans had been cultivating
and detained dissenters. It went on to regularly for decades. The focus on social media
kill, torture, and rape Rohingya people. continues to divert our attention from the well-
Facebook disabled the accounts of the understood negatives of Hillary Clinton as well
military propagandists once it understood as the documented impact of James Comey’s
the consequences of their misuse, although decision to reopen the FBI investigation of
this happened much more slowly than critics Clinton’s emails at a critical period in the
would have liked. What’s remarkable about presidential campaign. It overlooks, too, the
the discussion of Facebook, however, is the strength of the Bernie Sanders challenge and
way attention and responsibility for the op- the way the Clinton-controlled Democratic
pression has been diverted away from a mili- National Committee alienated his supporters.
tary dictatorship engaged in a state-sponsored It also tends to downplay the linkages that
campaign of ethnic cleansing, propaganda, existed between Trump’s campaign staff,
and terror to a private foreign social media advisers, and Russia that had nothing to do with
platform. In some cases, the discussion seems social media influence.
to imply that the absence of Facebook from How much more comforting it was to focus
Myanmar would solve, or even improve, the on a foreign power and its use of social media
conflict that has been going on for 70 years. It than to face up to the realities of a politically
is worth remembering that Facebook’s status polarized America and the way politicians
6


and their crews peddle influence to a variety on social media platforms is taken as proof
These of foreign states and interests.13 As this dis- that the entire country is being controlled
messages are placement of blame developed, references to by them. These messages are attributed
Russian information operations uniformly be- enormous power, as if they are the only
attributed came references to Russian interference in the ones anyone sees; as if foreign governments
enormous elections.14 Interference is a strong word—it don’t routinely buy newspaper ads, hire
power, as makes it seem as if leaks of real emails and a Washington lobbyists, or fund nonprofits and
if they are disinformation campaign of Twitter bots and university programs. Worse still, those of this
Facebook accounts were the equivalent of mindset equate messages with weapons in
the only stuffing ballot boxes, erasing votes, hacking ceaseless “information warfare.” It is claimed
ones anyone election machines, or forcibly blocking people that social media are being, or have been,


sees. from the polls. As references to foreign elec- “weaponized”—a transitive verb that was
tion interference became deeply embedded in popularized after being applied to the 9/11
the public discourse, the threat could be fur- attackers’ use of civilian aircraft to murder
ther inflated to one of national security. And thousands of people.17 Users of this term show
so suddenly, the regulation of political speech not the slightest embarrassment at a possible
got on the agenda of Congress, and millions of overstatement implicit in the comparison.
liberals and progressives became born-again Cybersecurity writer Thomas Rid made
Cold Warriors, all too willing to embrace na- the astounding assertion that the most “open
tionalistic controls on information flows. and liberal social media platform” (Twitter)
In April 2016 hackers employed by the is “a threat to open and liberal democracy”
Russian government compromised several precisely because it is open and liberal, thus
servers belonging to the Democratic National implying that free expression is a national se-
Committee, exfiltrated a trove of internal com- curity threat.18 In a Time Magazine cover story,
munications, and published them via Wikileaks a former Facebook executive complained that
using a “Guccifer 2.0” alias.15 The emails leaked Facebook has “aggravated the flaws in our de-
by the Russians were not made up by the mocracy while leaving citizens ever less capable
Russians; they were real. What if they had been of thinking for themselves.”19 The nature of
leaked by a 21st-century Daniel Ellsberg in- this threat is never scientifically documented
stead of the Russians? Would that also be con- in terms of its actual effect on voting patterns
sidered election interference? Disclosures of or political institutions. The only evidence of-
compromising information (e.g., Trump’s Access fered is simple counts of the number of Russian
Hollywood tape) have a long history in American trolls and bots and their impressions—numbers
politics. Is that election interference? How that look unimpressive compared to the spread
much of the cut-and-thrust of an open society’s of a single Donald Trump tweet. What we don’t
media system, and how many whistleblowers, often hear is that social media is the most im-
are we willing to muzzle in this moral panic? portant source of news for only 14 percent of
THE DEATH OF DEMOCRACY. Some critics the population. Research by two economists
go so far as to claim that democracy itself is concluded that “. . . social media have become
threatened by the existence of open social an important but not dominant source of polit-
media platforms. “[Facebook] has swallowed ical news and information. Television remains
up the free press, become an unstoppable more important by a large margin.” They also
private spying operation and undermined conclude that there is no statistically signifi-
democracy. Is it too late to stop it?” asks the cant correlation between social media use and
subtitle of one typical article.16 This critique is those who draw ideologically aligned conclu-
as common as it is inchoate. In its worst and sions from their exposure to news.20
most simple-minded form, the mere ability The most disturbing element of the
of foreign governments to put messages “threat to democracy” argument is the way it
7


militarizes public discourse. The view of so- emotional reactions . . . what may be defined as
cial media as information warfare seems to a media panic.”22 We need to understand that Moral panics
go hand-in-hand with the contradictory idea we are in the midst of one of these renegotia- should inspire
that imposing more regulation by the nation- tions of the norms of public discourse and that
state will “disarm” information and parry this the process has tipped over into media panic—
caution
threat to democracy. In advancing what they one that demonizes social media generically. because they
think of as sophisticated claims that social We can all agree that literacy is a good produce
media are being weaponized, the joke is on our thing. In the 17th and 18th centuries, how-
policy
putative cybersecurity experts: it is Russian ever, some people considered literacy’s spread
and Chinese doctrine that the free flow of in- subversive or corrupting. The expansion of reactions that
formation across borders is a subversive force literacy from a tiny elite to the general popula- overshoot the


that challenges their national sovereignty. This tion scared a lot of conservatives. It meant not mark.
doctrine, articulated in a code of conduct by only that more people could read the Bible,
the Shanghai Cooperation Organization, was but also that they could read radical liberal
designed to rationalize national blocking and tracts such as Thomas Paine’s Rights of Man.
filtering of internet content.21 By equating the Those who feared wider literacy believed that
influence that occurs via exchanges of ideas, it generated conflict and disruption. In fact,
information, and propaganda with war and it already had. The disintermediation of au-
violence, these pundits pose a more salient thority over the interpretation of the written
danger to democracy and free speech than any word by the printing press and by wider lit-
social media platform. eracy created centrifugal forces. Protestants
Any one of these accusations—the destruc- had split with Catholics, and later, different
tion of public discourse, responsibility for Protestant sects formed around different in-
ethnic cleansing and hate speech, abetting a terpretations of scripture. Later, in the 17th
Russian national security threat, and the de- and 18th centuries, the upper class and the re-
struction of democracy—would be serious ligious also complained about sensationalistic
enough. Their combination in a regularly re- printed broadsheets and printed ballads that
peated catechism constitutes a moral panic. appealed to the “baser instincts” of the public.
Moral panics should inspire caution because Commercial media that responded to what
they produce policy reactions that overshoot the people wanted were not perceived kindly
the mark. A fearful public can be stampeded by those who thought they knew best. Yet are
into legal or regulatory measures that serve a these observations an argument for keeping
hidden agenda. Targeted actors can be scape- people illiterate? If not, then what, exactly,
goated and their rights and interests dis- do these concerns militate for? A controlled,
counted. Freedom-enhancing policies and censored press? A press licensed in “the public
proportionate responses to problems never interest”? Who in those days would have been
emerge from moral panics. made the arbiter of public interest? The Pope?
Absolutist kings?
Media Panics in the Past Radio broadcasting was an important revo-
One antidote to moral panic is historical lution in mass media technology. It seems to
perspective. Media studies professor Kirsten have escaped the intense, concentrated panic
Drotner wrote, “[E]very time a new mass we are seeing around contemporary social
medium has entered the social scene, it has media, but in the United States, where broad-
spurred public debates on social and cultural casting had relatively free and commercial
norms, debates that serve to reflect, nego- origins, those in power felt threatened by its
tiate and possibly revise these very norms . potential to evolve into an independent medi-
. . In some cases, debate of a new medium um. Thomas Hazlett has documented the way
brings about—indeed changes into—heated, the 1927 Federal Radio Act and the regulatory
8


commission it created (later to become the its addictive qualities were constant sources of
The retailers Federal Communications Commission) na- discussion.26 Again the similarity to current
and instigators tionalized the airwaves in order to keep the debates about social media is apparent.
new medium licensed and under the thumb In examining historical cases, it becomes
of media panic of Congress.23 Numerous scholarly accounts apparent that it is the retailers and instigators
generally pose have shown how the public-interest licens- of media panic who generally pose the biggest
the biggest ing regime erected after the federal takeover threat to free expression and democracy. For at
threat to free of the airwaves led to a systematic exclusion their root, attacks on new media, past and pres-
of diverse voices, from socialists to African ent, are expressions of fear: fear of empowering
expression Americans to labor unions.24 diverse and dissonant voices, the elites’ fears
and There is another relevant parallel between over losing hegemony over public discourse,


democracy. radio and social media. Totalitarian dictator- and a lack of confidence in the ability of ordi-
ships, particularly Nazi Germany, employed nary people to control their “baser instincts”
radio broadcasting extensively in the 1930s. or make sense of competing claims. The more
Those uses, some of which sparked the birth of sophisticated variants of these critiques are ra-
modern communications effects research, were tionalizations of paternalism and authoritari-
much scarier than the uses of social media by anism. In the social media panic, we have both
today’s dictatorships and illiberal democracies. conservative and liberal elites recoiling from
But oddly, our current panic tends to promote the prospect of a public sphere over which they
and support precisely the types of regulation have lost control, and both are preparing the
and control favored by those very same mod- way for regulatory mechanisms that can tame
ern dictatorships and illiberal democracies: diversity, homogenize output, and maintain
centralized content moderation and blocking their established place in society.
by the state and holding social media platforms
responsible for the postings of their users. What’s Broken?
Comic books generated a media panic in the A recent exchange on Twitter exposed the
1940s and 50s.25 A critic of American commer- policy vacuity of those leading the social media
cial culture, Frederic Wertham, believed that moral panic. Kara Swisher, a well-known tech
comic books encouraged juvenile delinquency journalist with more than a million followers,
and subverted the morality of children for the tweeted to Jack Dorsey, the CEO of Twitter:
sake of profit. The presence of weirdness, vio-
lence, horror, and sexually tinged images led to Overall here is my mood and I think a lot
charges that the comics were dangerous, addic- of people when it comes to fixing what is
tive, and catered to baser instincts. A comic- broke about social media and tech: Why
book scare ensued, complete with a flood of aren’t you moving faster? Why aren’t
newspaper stories, Congressional hearings, you moving faster? Why aren’t you mov-
and a transformation of the comic book in- ing faster?27
dustry. The comic-book scare seems to have
pioneered the three themes that characterize Swisher’s impatient demand for fast action
so much public discourse around new media seemed to assume that the solutions to social
in the 20th century: anti-commercialism, pro- media’s ills were obvious. I tweeted in reply,
tecting children, and addiction. All are echoed asking what “fix” she wanted to implement so
in the current fight over social media. The quickly. There was no answer.
same themes sounded in policy battles over Here is the diagnosis I would offer. What
television. Television’s status as a cause of vio- is “broken” about social media is exactly the
lence was debated and researched endlessly. Its same thing that makes it useful, attractive, and
pollution of public discourse, the way it “culti- commercially successful: it is incredibly effec-
vated” inaccurate and harmful stereotypes, and tive at facilitating discoveries and exchanges
9


of information among interested parties at behaviors and messages so revealed. The false
unprecedented scale. As a direct result of that, promise is that by pushing the platform pro- The reaction
there are more informational interactions viders to block content, eliminate accounts, against social
than ever before and more mutual exchanges or otherwise attack manifestations of social
between people. This human activity, in all its problems on their platforms, we are solving
media is thus
glory, gore, and squalor, generates storable, or reducing those problems. Combing these based on a
searchable records, and its users leave attrib- misapprehensions, we’ve tried to curb “new” false premise
utable tracks everywhere. As noted before, the problems by hiding them from public view.
and a false


emerging new world of social media is marked The major platforms have contributed
by hypertransparency. to this pathology by taking on ever-more- promise.
From the standpoint of free expression and extensive content-moderation duties. Because
free markets there is nothing inherently bro- of the intense political pressure they are under,
ken about this; on the contrary, most of the the dominant platforms are rapidly accepting
critics are unhappy precisely because the model the idea that they have overarching social re-
is working: it is unleashing all kinds of expres- sponsibilities to shape user morals and shape
sion and exchanges, and making tons of money public discourse in politically acceptable ways.
at it to boot. But two distinct sociopolitical pa- Inevitably, due to the scale of social media in-
thologies are generated by this. The first is that, teractions, this means increasingly automated
by exposing all kinds of deplorable uses and or algorithmic forms of regulation, with all of
users, it tends to funnel outrage at these mani- its rigidities, stupidities, and errors. But it also
festations of social deviance toward the plat- means massive investments in labor-intensive
form providers. A man discovers pedophiles manual forms of moderation.29
commenting on YouTube videos of children The policy debate on this topic is compli-
and is sputtering with rage at . . . YouTube.28 cated by the fact that internet intermediaries
The second pathology is the idea that the ob- cannot really avoid taking on some optional
jectionable behaviors can be engineered out of content regulation responsibilities beyond
existence or that society as a whole can be engi- complying with various laws. Their status as
neered into a state of virtue by encouraging in- multisided markets that match providers and
termediaries to adopt stricter surveillance and seekers of information requires it.30 Recom-
regulation. Instead of trying to stop or control mendations based on machine learning guide
the objectionable behavior, we strive to control users through the vast, otherwise intractable
the communications intermediary that was amount of material available. These filters
used by the bad actor. Instead of eliminating vastly improve the value of a platform to a
the crime, we propose to deputize the inter- user, but they also indirectly shape what peo-
mediary to recognize symbols of the crime and ple see, read, and hear. They can also, as part
erase them from view. It’s as though we assume of their attempts to attract users and enhance
that life is a screen, and if we remove unwanted the platforms’ value to advertisers, discourage
things from our screens by controlling inter- or suppress messages and forms of behavior
net intermediaries, then we have solved life’s that make their platforms unpleasant or harm-
problems. (And even as we do this, we hypo- ful places. This form of content moderation is
critically complain about China and its alleged outside the scope of the First Amendment’s
development of an all-embracing social credit legal protections because it is executed by a
system based on online interactions.) private actor and falls within the scope of edi-
The reaction against social media is thus torial discretion.
based on a false premise and a false promise.
The false premise is that the creators of tools What’s the Fix?
that enable public interaction at scale are Section 230 of the Communications
primarily responsible for the existence of the Decency Act squared this circle by immunizing
10


information service providers who did noth- satisfaction to a few highly motivated actors.32
What stance ing to restrict or censor the communications At best, reformers propose to rationalize
should of the parties using their platforms (the clas- content moderation in ways designed to make
sical “neutral conduit” or common-carrier its standards clearer, make their application
advocates concept), while also immunizing information more consistent, and make an appeals process
of both free service providers who assumed some editorial possible.33 Yet this is unlikely to work unless
expression responsibilities (e.g., to restrict pornography platforms get the backbone to strongly assert
and free and other forms of undesirable content). In- their rights to set the criteria, stick to them,
termediaries who did nothing were (supposed and stop constantly adjusting them based on
markets take to be) immunized in ways that promoted free- the vagaries of daily political pressures. At
with respect dom of expression and diversity online; inter- worst, advocates of more content moderation
to social mediaries who were more active in managing are motivated by a belief that greater content


user-generated content were immunized to control will reflect their own personal val-
media? enhance their ability to delete or otherwise ues and priorities. But since calls for tougher
monitor “bad” content without being classi- or more extensive content moderation come
fied as publishers and thus assuming respon- from all ideological and cultural directions,
sibility for the content they did not restrict.31 this expectation is unrealistic. It will only lead
It is clear that this legal balancing act, which to a distributed form of the heckler’s veto, and
worked so well to make the modern social a complete absence of predictable, relatively
media platform successful, is breaking down. objective standards. It is not uncommon for
Section 230 is a victim of its own success. Plat- outrage at social media to lead in contradic-
forms have become big and successful in part tory directions. A reporter for The Guardian,
because of their Section 230 freedoms, but as for example, is outraged that Facebook has an
a result they are subject to political and nor- ad-targeting category for “vaccine controver-
mative pressures that confer upon them de sies” and flogs the company for allowing anti-
facto responsibility for what their users read, vaccination advocates to form closed groups
see, and do. The threat of government inter- that can reinforce those members’ resistance
vention is either lurking in the background or to mainstream medical care.34 However, there
being realized in certain jurisdictions. Fueled is no way for Facebook to intervene without
by hypertransparency, political and normative profiling their users as part of a specific political
pressures are making the pure, neutral, non- movement deemed to be wrong, and then sup-
discriminatory platform a thing of the past. pressing their communications and their ability
The most common proposals for fixing so- to associate based on that data. So, at the same
cial media platforms all seem to ask the plat- time Facebook is widely attacked for privacy vi-
forms to engage in more content moderation olations, it is also being asked to leverage its pri-
and to ferret out unacceptable forms of ex- vate user data to flag political and social beliefs
pression or behavior. The political demand for that are deemed aberrant and to suppress users’
more-aggressive content moderation comes ability to associate, connect with advertisers, or
primarily from a wide variety of groups seek- communicate among themselves. In this com-
ing to suppress specific kinds of content that bination of surveillance and suppression, what
is objectionable to them. Those who want could possibly go wrong?
less control or more toleration suffer from the What stance should advocates of both free
diffuse costs/concentrated benefit problem expression and free markets take with respect
familiar to us from the economic analysis of to social media?
special interest groups: that is, toleration ben- First, there needs to be a clearer articulation
efits everyone a little and its presence is barely of the tremendous value of platforms based on
noticeable until it is lost; suppression, on the their ability to match seekers and providers of
other hand, offers powerful and immediate information. There also needs to be explicit
11


advocacy for greater tolerance of the jarring promises to be intrinsically better than what
diversity revealed by these processes. True we have now, and most alternatives are likely to The
liberals need to make it clear that social me- be worse. The exaggerations generated by the NetzDG law
dia platforms cannot be expected to bear the moral panic have obscured the simple fact that
main responsibility for sheltering us from ideas, moderating content on a global platform with
immediately
people, messages, and cultures that we consider billions of users is an extraordinarily difficult resulted in
wrong or that offend us. Most of the responsi- and demanding task. Users, not platforms, are suppression of
bility for what we see and what we avoid should the source of messages, videos, and images that
people find objectionable, so calls for regula-
various forms
lie with us. If we are outraged by seeing things
we don’t like in online communities comprised tion ignore the fact that regulations don’t gov- of politically
of billions of people, we need to stop misdirect- ern a single supplier, but must govern millions, controversial
ing that outrage against the platforms that hap- and maybe billions, of users. The task of flag- online


pen to expose us to it. Likewise, if the exposed ging user-generated content, considering it,
behavior is illegal, we need to focus on identify- and deciding what to do about it is difficult and
speech.
ing the perpetrators and holding them account- expensive. And is best left to the platforms.
able. As a corollary of this attitudinal change, However, regulation seems to be coming.
we also need to show that the hypertranspar- Facebook CEO Mark Zuckerberg has pub-
ency fostered by social media can have great so- lished a blog post calling for regulating the
cial value. As a simple example of this, research internet, and the UK government has released
has shown that the much-maligned rise of plat- a white paper, “Online Harms,” that proposes
forms matching female sex workers with clients the imposition of systematic liability for user-
is statistically correlated with a decrease in vio- generated content on all internet intermediar-
lence against women—precisely because it took ies (including hosting companies and internet
sex work off the street and made transactions service providers).36
more visible and controllable.35 At best, a system of content regulation in-
Second, free-expression supporters need fluenced by government is going to look very
to actively challenge those who want content much like what is happening now. Government-
moderation to go further. We need to expose mandated standards for content moderation
the fact that they are using social media as a would inevitably put most of the responsibility
means of reforming and reshaping society, for censorship on the platforms themselves.
wielding it like a hammer against norms and Even in China, with its army of censors, the
values they want to be eradicated from the operationalization of censorship relies heav-
world. These viewpoints are leading us down ily on the platform operators. In the tsunami
an authoritarian blind alley. They may very of content unleashed by social media, prior
well succeed in suppressing and crippling the restraint by the state is not really an option.
freedom of digital media, but they will not, Germany responded in a similar fashion with
and cannot, succeed in improving society. In- the 2017 Netzwerkdurchsetzungsgesetz, or
stead, they will make social media platforms Network Enforcement Act (popularly known
battlegrounds for a perpetual intensifying as NetzDG or the Facebook Act), a law aimed
conflict over who gets to silence whom. This is at combating agitation, hate speech, and fake
already abundantly clear from the cries of dis- news in social networks.
crimination and bias as the platforms ratchet The NetzDG law immediately resulted in
up content moderation: the cries come from suppression of various forms of politically con-
both the left and the right in response to mod- troversial online speech. Joachim Steinhöfel, a
eration that is often experienced as arbitrary. German lawyer concerned by Facebook’s es-
Finally, we need to mount a renewed and sentially jurisprudential role under NetzDG,
reinvigorated defense of Section 230. The created a “wall of shame” containing legal
case for Section 230 is simple: no alternative content suppressed by NetzDG.37 Ironically,
12


German right-wing nationalists who suffered free-market standpoint, it would not. Such a
Governmental takedowns under the new law turned the policy would literally force all social media users
involvement law to their advantage by using it to suppress to be exposed to things they didn’t want to be
critical or demeaning comments about them- exposed to. It would undermine the economic
in content selves. “Germany’s attempt to regulate speech value of platforms by decapitating their ability
regulation online has seemingly amplified the voices it to manage their matching algorithms, shape
would have was trying to diminish,” claims an article in their environment, and optimize the tradeoffs
The Atlantic.38 As a result of one right-wing
to conform of a multisided market. Given the current hue
and cry about all the bad things people are see-
politician’s petition, Facebook must ensure
to the First that individuals in Germany cannot use a VPN ing and doing on social media, a legally driven,
Amend­ to access illegal content. Yet still, a report by permissive First Amendment standard does not


ment. an anti-hate-speech group that supports the seem like it would make anyone happy.
law argues that it has been ineffective. “There Advocates of expressive freedom, therefore,
have been no fines imposed on companies and need to reassert the importance of Section 230.
little change in overall takedown rates.”39 Platforms, not the state, should be responsible
Abandoning intermediary immunities for finding the optimal balance between con-
would make the platforms even more conserva- tent moderation, freedom of expression, and
tive and more prone to disable accounts or take the economic value of platforms. The alterna-
down content than they are now. In terms of tive of greater government regulation would ab-
costs and legal risks, it will make sense for them solve the platforms of market responsibility for
to err on the safe side. When intermediaries are their decisions. It would eliminate competition
given legal responsibility, conflicts about arbi- among platforms for appropriate moderation
trariness and false positives don’t go away, they standards and practices and would probably
intensify. In authoritarian countries, platforms lead them to exclude and suppress even more
will be merely be indirect implementers of na- legal speech than they do now.
tional censorship standards and laws.
On the other hand, U.S. politicians face a
unique and interesting dilemma. If they think CONCLUSION
they can capitalize on social media’s travails Content regulation is only the most promi-
with calls for regulation, they must understand nent of the issues faced by social media plat-
that governmental involvement in content forms today; they are also implicated in privacy
regulation would have to conform to the First and competition-policy controversies. But so-
Amendment. This would mean that all kinds cial media content regulation has been the
of content that many users don’t want to see, exclusive focus of this analysis. Hypertrans-
ranging from hate speech to various levels of parency and the subsequent demand for con-
nudity, could no longer be restricted because tent control it creates are the key drivers of the
they are not strictly illegal. Any government new media moral panic. The panic is feeding
interventions that took down postings or de- upon itself, creating conditions for policy reac-
leted accounts could be litigated based on a tions that overlook or openly challenge values
First Amendment standard. Ironically, then, a regarding free expression and free enterprise.
governmental takeover of content regulation While there is a lot to dislike about Facebook
responsibilities in the United States would and other social media platforms, it’s time
have to be far more liberal than the status quo. we realized that a great deal of that negative
Avoidance of this outcome was precisely why reaction stems from an information society
Section 230 was passed in the first place. contemplating manifestations of itself. It is
From a pure free-expression standpoint, not an exaggeration to say that we are blaming
a First Amendment approach would be a the mirror for what we see in it. Section 230 is
good thing. But from a free-association and still surprisingly relevant to this dilemma. As
13

a policy, Section 230 was not a form of infant for content governance in social media. If we
industry protection that we can dispense with stick with this arrangement, learn more toler-
now, nor was it a product of a utopian inebria- ance, and take more responsibility for what we
tion with the potential of the internet. It was see and do on social media, we can respond to
a very clever way of distributing responsibility the problems while retaining the benefits.

NOTES 13. For a discussion of Michael Flynn’s lobbying campaign for the
1. Milton L. Mueller, “Hyper-transparency and Social Control: So- Turkish government and Paul Manafort’s business in Ukraine
cial Media as Magnets for Regulation,” Telecommunications Policy and Russia, see Rebecca Kheel, “Turkey and Michael Flynn: Five
39, no. 9 (2015): 804–10. Things to Know,” The Hill, December 17, 2018; and Franklin Foer,
“Paul Manafort, American Hustler,” The Atlantic, March 2018.
2. Erich Goode and Nachman Ben-Yehuda, “Grounding and
Defending the Sociology of Moral Panic,” chap. 2 in Moral Pan- 14. See, for example, “Minority Views to the Majority-produced
ic and the Politics of Anxiety, ed. Sean Patrick Hier (Abingdon: ‘Report on Russian Active Measures, March 22, 2018’” of the
Routledge, 2011). Democratic representatives from the United States House Per-
manent Select Committee on Intelligence (USHPSCI), March
3. Stanley Cohen, Folk Devils and Moral Panics (Abingdon: 26, 2018.
Routledge, 2011).
15. Indictment at 11, U.S. v. Viktor Borisovich Netyksho et al., Case
4. Ronald J. Deibert, “The Road to Digital Unfreedom: Three 1:18-cr-00032-DLF (D.D.C. filed Feb. 16, 2018).
Painful Truths about Social Media,” Journal of Democracy 30, no.
1 (2019): 25–39. 16. Matt Taibbi, “Can We Be Saved from Facebook?,” Rolling Stone,
April 3, 2018.
5. Zeynep Tufekci, “YouTube, the Great Radicalizer,” New York
Times, March 10, 2018. 17. Peter W. Singer and Emerson T. Brooking, LikeWar: The Weap-
onization of Social Media (New York: Houghton Mifflin Harcourt,
6. Tufekci, “YouTube, the Great Radicalizer.” 2018).

7. Roger McNamee, “I Mentored Mark Zuckerberg. I Loved 18. Thomas Rid, “Why Twitter Is the Best Social Media Platform
Facebook. But I Can’t Stay Silent about What’s Happening,” Time for Disinformation,” Motherboard, November 1, 2017.
Magazine, January 17, 2019.
19. McNamee, “I Mentored Mark Zuckerberg. I Loved Facebook.
8. Jonathan Albright, “Untrue-Tube: Monetizing Misery and Dis- But I Can’t Stay Silent about What’s Happening.”
information,” Medium, February 25, 2018.
20. Hunt Allcott and Matthew Gentzkow, “Social Media and Fake
9. Courtney Seiter, “The Psychology of Social Media: Why We News in the 2016 Election,” Journal of Economic Perspectives 31, no.
Like, Comment, and Share Online,” Buffer, August 20, 2017. 2 (2017): 211–36.

10. Paul Mozur, “A Genocide Incited on Facebook, With Posts 21. Sarah McKune, “An Analysis of the International Code of Con-
from Myanmar’s Military,” New York Times, October 15, 2018. duct for Information Security,” CitizenLab, September 28, 2015.

11. Ingrid Burrington, “Could Facebook Be Tried for Human- 22. Kirsten Drotner, “Dangerous Media? Panic Discourses and
Rights Abuses?,” The Atlantic, December 20, 2017. Dilemmas of Modernity,” Paedagogica Historica 35, no. 3 (1999):
593–619.
12. Burrington, “Could Facebook Be Tried for Human-Rights
Abuses?” 23. Thomas W. Hazlett, “The Rationality of US Regulation of
14

the Broadcast Spectrum,” Journal of Law and Economics 33, no. 1 Cir. 1997), said Sec. 230 was passed to “remove the disincentives
(1990): 133–75. to self-regulation created by the Stratton Oakmont decision.” In
Stratton Oakmont, Inc. v. Prodigy Services Co., (N.Y. Sup. Ct. 1995),
24. Robert McChesney, Telecommunications, Mass Media and De- a bulletin-board provider was held responsible for defamatory
mocracy: The Battle for Control of U.S. Broadcasting, 1928–1935 (New remarks by one of its customers because it made efforts to edit
York: Oxford, 1995). some of the posted content.

25. Fredric Wertham, Seduction of the Innocent (New York: Rine- 32. Robert D Tollison, “Rent Seeking: A Survey,” Kyklos 35, no. 4
hart, 1954); and David Hajdu, The Ten-cent Plague: The Great Comic- (1982): 575–602.
book Scare and How It Changed America (New York: Picador, 2009),
https://us.macmillan.com/books/9780312428235. 33. See, for example, the “Santa Clara Principles on Transparency
and Accountability in Content Moderation,” May 8, 2018, https://
26. “Like drug dealers on the corner, [TV broadcasters] control santaclaraprinciples.org/.
the life of the neighborhood, the home and, increasingly, the lives
of children in their custody,” claimed a former FCC commission- 34. Julia Carrie Wong, “Revealed: Facebook Enables Ads to Target
er. Minow & LeMay, 1995. http://www.washingtonpost.com/wp- Users Interested in ‘Vaccine Controversies’,” The Guardian (Lon-
srv/style/longterm/books/chap1/abandonedinthewasteland.htm. don), February 15, 2019.
Newton N. Minow & Craig L. LaMay, Abandoned in the Wasteland
(New York: Hill and Wang, 1996). 35. See Scott Cunningham, Gregory DeAngelo, and John Tripp,
“Craigslist’s Effect on Violence against Women,” http://scunning.
27. Kara Swisher (@karaswisher), “Overall here is my mood and I com/craigslist110.pdf (2017). See also Emily Witt, “After the Clo-
think a lot of people when it comes to fixing what is broke about sure of Backpage, Increasingly Vulnerable Sex Workers Are De-
social media and tech: Why aren’t you moving faster? Why aren’t manding Their Rights,” New Yorker, June 8, 2018.
you moving faster? Why aren’t you moving faster?” Twitter post,
February 12, 2019, 2:03 p.m., https://twitter.com/karaswisher/ 36. Mark Zuckerberg, “Four Ideas to Regulate the Internet,”
status/1095443416148787202. March 30, 2019; and UK Home Office, Department for Digital,
Culture, Media & Sport, Online Harms White Paper, The Rt Hon.
28. Matt Watson, “Youtube Is Facilitating the Sexual Exploitation Sajid Javid MP, The Rt Hon. Jeremy Wright MP, April 8, 2019.
of Children, and It’s Being Monetized,” YouTube video, 20:47,
“MattsWhatItIs,” February 27, 2019, https://www.youtube.com/ 37. Joachim Nikolaus Steinhöfel, “Blocks & Hate Speech--Insane
watch?v=O13G5A5w5P0. Censorship & Arbitrariness from FB,” Facebook Block - Wall of
Shame, https://facebook-sperre.steinhoefel.de/.
29. Casey Newton, “The Trauma Floor: The Secret Lives of Face-
book Moderators in America,” The Verge, February 25, 2019. 38. Linda Kinstler, “Germany’s Attempt to Fix Facebook Is Back-
firing,” The Atlantic, May 18, 2018.
30. Geoff Parker, Marshall van Alstyne, and Sangeet Choudhary,
Platform Revolution (New York: W. W. Norton, 2016). 39. William Echikson and Olivia Knodt, “Germany’s NetzDG: A
Key Test for Combatting Online Hate,” CEPS Research Report
31. The Court in Zeran v. America Online, Inc., 129 F.3d 327 (4th no. 2018/09, November 2018.
RELATED PUBLICATIONS
FROM THE CATO INSTITUTE

Why the Government Should Not Regulate Content Moderation of Social Media
by John Samples, Cato Institute Policy Analysis no. 865 (April 9, 2019)

What to Do about the Emerging Threat of Censorship Creep on the Internet by


Danielle Keats Citron, Cato Institute Policy Analysis no. 828 (November 28, 2017)

Commercial Speech and the Values of Free Expression by Martin H. Redish, Cato
Institute Policy Analysis no. 813 (June 19, 2017)

Surveillance Takes Wing: Privacy in the Age of Police Drones by Matthew Feeney,
Cato Institute Policy Analysis no. 807 (December 13, 2016)

Hate Speech Laws: Ratifying the Assassin’s Veto by Robert Corn-Revere, Cato
Institute Policy Analysis no. 791 (May 24, 2016)

Leashing the Surveillance State: How to Reform Patriot Act Surveillance


Authorities by Julian Sanchez, Cato Institute Policy Analysis no. 675 (May 16, 2011)

Fairness 2.0: Media Content Regulation in the 21st Century by Robert Corn-Revere,
Cato Institute Policy Analysis no. 651 (November 10, 2009)

Broadcast Localism and the Lessons of the Fairness Doctrine by John Samples,
Cato Institute Policy Analysis no. 639 (May 27, 2009)

Caught in the Seamless Web: Does the Internet’s Global Reach Justify Less
Freedom of Speech? by Robert Corn-Revere, Cato Institute Briefing Paper no. 71
(July 24, 2002)
RECENT STUDIES IN THE
CATO INSTITUTE POLICY ANALYSIS SERIES

875. The Community Reinvestment Act in the Age of Fintech and Bank
Competition by Diego Zuluaga (July 10, 2019)

874. Closing Pandora’s Box: The Growing Abuse of the National Security
Rationale for Restricting Trade by Simon Lester and Huan Zhu (June 25, 2019)

873. Immigration Wait Times from Quotas Have Doubled: Green Card
Backlogs Are Long, Growing, and Inequitable by David J. Bier (June 18, 2019)

872. Is This Time Different? Schumpeter, the Tech Giants, and Monopoly
Fatalism by Ryan Bourne (June 17, 2019)

871. Unplugging the Third Rail: Choices for Affordable Medicare by John F. Early
(June 6, 2019)

870. Principles for the 2020 Surface Transportation Reauthorization by Randal


O’Toole (June 4, 2019)

869. A Reform Agenda for the Next Indian Government by Swaminathan S.


Anklesaria Aiyar (May 21, 2019)

868. Restoring Responsible Government by Cutting Federal Aid to the States by


Chris Edwards (May 20, 2019)

867. Making Sense of the Minimum Wage: A Roadmap for Navigating Recent
Research by Jeffrey Clemens (May 14, 2019)

866. Terrorists by Immigration Status and Nationality: A Risk Analysis, 1975–


2017 by Alex Nowrasteh (May 7, 2019)

865. Why the Government Should Not Regulate Content Moderation of Social
Media by John Samples (April 9, 2019)

864. Overdosing on Regulation: How Government Caused the Opioid Epidemic


by Jeffrey Miron, Greg Sollenberger, and Laura Nicolae (February 14, 2019)

863. How “Market Failure” Arguments Lead to Misguided Policy by Ryan Bourne
(January 22, 2019)

The views expressed in this paper are those of the author(s) and should not be attributed to the Cato Institute, its
trustees, its Sponsors, or any other person or organization. Nothing in this paper should be construed as an attempt to
aid or hinder the passage of any bill before Congress. Copyright © 2019 Cato Institute. This work by Cato Institute is
licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

S-ar putea să vă placă și