Toward a Complex, Realistic, And Moral Tech Criticism - Alexis C. Madrigal - The Atlantic

7/28/2019 Toward a Complex, Realistic, And Moral Tech Criticism - Alexis C. Madrigal - The Atlantic

1/11

7/04/13 3:59 PMToward a Complex, Realistic, and Moral Tech Criticism - Alexis C. Madrigal - The Atlantic

Page 4 of 26http://www.theatlantic.com/technology/archive/2013/03/toward-a-complex-realistic-and-moral-tech-criticism/273996/

Evgeny Morozov delivering a lecture sponsored by Stanford's Program on Liberation Technology (AlexisMadrigal) in January, 2013.

What critics of literature do not both love and hate the subject of their scholarship? The very strength of acritic's love is what inspires such dogged meaning- and fault-finding in the reality of any work.

This is also true for writer and thinker Evgeny Morozov, though it is not literature but technology that must bearthe privilege of his evisceration. His books read like letters from a jilted lover, full of accusations of unmetpromises, lost potential, and occasionally, a glimmer of that initial spark of attraction.

And he is a truly great critic. Morozov's work reveals new things about how technology works in our society atthis particular moment in time. His analysis may be cutting, but he doesn't hate technology. On the contrary,Morozov's ultimate goal is to destroy the ideology of technology, so that particular technologies can be used inspecific situations without the baggage of other people's nonsense.

Morozov's second book, To Save Everything, Click Here: The Folly of Technological Solutionism, is the most

wide-ranging and generative critique of digital technology I've ever read. There's so much substance to argueabout between its covers. At the center of it all, there's a brilliant, idiosyncratic mind at work.

Describing and destroying two concepts -- "Internet-centrism" and "solutionism" -- form the core of his book,and both are fascinating frames for the discourse surrounding our network technologies.

Internet-centrism is the idea that our society, and particularly its public intellectuals, have become fascinated bythe notion that the Internet is a stable and coherent force in our lives. He rails against the idea that this forceshapes things autonomously, or that it has any inherent qualities, or that we have to listen to what "the Internet"wants on a topic like openness, for example. Morozov's goal is to force everyone to write the Internet withquotes -- like this: "the Internet." This, he feels, better implies the complexities of the Internet's social creation

and casts doubt on its power as an independent force with its own ahistorical rules.

His analysis here is a full-frontal attack on the shorthand thinking that's come to dominate many discussions


2/11



about the role of digital technologies in the world. It's a valuable contribution in many ways; he demands thatwe think seriously about the Internet, I mean, "the Internet." I do think that Morozov has succeeded in doing alot of damage to the idea that "'the Internet' is a useful analytical category." And to perform a deconstruction inpublic and for a general reader is a feat of magic that borders on necromancy. Who knew people still wanted toread books like this?

Morozov's "solutionism" is something else altogether. In it, he's identified a key strain of modern political and

social thought, synthesizing a wide variety of domains, technologies, and types of arguments into something wecan ponder and argue about. I find myself coming back to this idea time and again while listening to advocatesand opponents of particular technologies. I would not be surprised if describing the contours, origins, andfailings of this way of thought are what Morozov is remembered for. I think it will become the concept thatgenerates its own set of literature. He writes:

Recasting all complex social situations either as neat problems with definite, computable solutionsor as transparent and self-evident processes that can be easily optimized--if only the rightalgorithms are in place!--this quest is likely to have unexpected consequences that could eventuallycause more damage than the problems they seek to address. I call the ideology that legitimizes andsanctions such aspirations "solutionism." I borrow this unabashedly pejorative term from the world

of architecture and urban planning, where it has come to refer to an unhealthy preoccupation withsexy, monumental, and narrow-minded solutions--the kind of stuff that wows audiences at TEDConferences--to problems that are extremely complex, fluid, and contentious. These are the kindsof problems that, on careful examination, do not have to be defined in the singular and all-encompassing ways that "solutionists" have defined them; what's contentious, then, is not theirproposed solution but their very definition of the problem itself. Design theorist Michael Dobbinshas it right: solutionism presumes rather than investigates the problems that it is trying to solve,reaching "for the answer before the questions have been fully asked." How problems are composedmatters every bit as much as how problems are.

This analysis, which runs throughout the entire book, is really, really interesting. I'm going to get into the details

soon, but my main worry is that solutionism, even accepting Morozov's framing, contains some elements worthpreserving. Indeed, there is a reading of this book (an unkind one, for sure) that finds it deeply anti-progressiveand almost frighteningly supportive of the status quo in politics and elsewhere.

All of which makes the book a delight: It's a high-wire performance, a feat of intellectual daring. He goes to warwith almost everybody else who thinks about the Internet's people, institutions, and technologies in the publiceye: Nicholas Carr, Clay Shirky, David Weinberger, Tim Wu, Kevin Kelly, Farhad Manjoo, Steven Johnson,Gary Wolf, among others. Sometimes, he wins easily. Sometimes, he tangles himself into knots trying to defeatevery possible enemy and defend against every possible counterargument. In all cases, he is worth reading, evenif you vehemently disagree.

The only comparable experience I've ever had was reading Vaclav Smil on energy: Frustrating, enlightening,and counterintuitive in the best meaning of the word. Of course, if you're interested in the Internet, you shouldread it. And I think historians in 2030 or 2050 will use this book to highlight the anxieties and debates of ourtime, pretty much all of which it attempts to tackle at once.

On the other hand, I'm not sure that they'll read it as a fair or grounded representation of the state of technology.Morozov's mode, while learned and theoretically grounded, is not as deeply authoritative as it appears. There islittle actual evidence that many of the phenomena he highlights are actually occurring in the way he says theyare. Granted, that's not his focus. I recognize fully that Morozov's project is in the realm of ideas, ideology, andthe sociology of knowledge.

But there's often not even an attempt to line up reality with his anecdotes and projections. He relies time andagain on scenarios, little flights of fancy, that are neither thought experiment nor forecast, but something moreopaque. Even within the logic of the book itself, it's difficult to compare his scenarios to one another. There's


3/11



little consistency among them in terms of plausibility or time-scale. If you look closely, you're left wondering:is this something that is already happening, might happen in a year, could happen in 10 years, or is a logicalpossibility in a century? Quite-close-to-real scenarios are delivered with the same rhetorical weight as truly wildMorozovian nightmares.

Let me give just a few examples.

Here's one section from Morozov's chapter on predictive policing in which he introduces a real product,ShotSpotter, a microphone sensor system that lets police (in Oakland, say) identify where gunshots are fired.Watch how he slides from there to a much stranger idea without blinking:

These systems are not cheap--ShotSpotter reportedly charges $40,000 to $60,000 a year per squaremile--but they are hardly the latest word in crime detection. Why bother with expensivemicrophones if smartphones can do the job just fine? It all boils down to designing an appealingand nonintrusive app and creating the right incentives--perhaps by appealing to the moralconscience of citizens or by turning crime reports into a game--so that citizens can take on some ofthe tasks of faulty sensors and easily distracted human.

From an actual, deployed system to a nightmarish sousveillance scenario in one sentence. Could such a systemwork? Would this be appealing to institutional players or people? Why even bother, if you're the cops? Isanyone even thinking about doing this in one, five, or even 20 years? What gives him the idea this mighthappen? I don't know. There's certainly nothing in the quite extensive (and welcome) footnotes to explain thisleap.

When police talk about predictive policing, they're talking about putting cops in the areas most likely toexperience a crime. That's actually a far cry from "preventing" crime. In practice, the Los Angeles PoliceDepartment, which Morozov uses as his example, only has officers to patrol a tiny percentage of the city, evenin the zones where a model might say crime is most likely to occur. The institutional reality of the LAPD is thatthey could never prevent a substantial percentage of all crimes, even if they knew precisely, notprobabilistically, where such activity might occur. The same is true for every police department. So how likelyis it that we'd prevent all crime, as Morozov impishly suggests throughout the chapter? It's not that I expect himto deal in the probabilities, but to couch his criticisms within a realistic framework.

Or how likely is it that tweeting about yogurt will bring police to your door? Is it more or less likely than theother scenarios Morozov discusses?

As companies like ECM Universe accumulate extensive archives of tweets and Facebook updatessent by actual criminals, they will also be able to predict the kinds of nonthreatening verbal cuesthat tend to precede criminal acts. Thus, even tweeting that you don't like your yogurt might bringpolice to your door, especially if someone who tweeted the same thing three years before ended upshooting someone in the face later in the day.

Or that acts of civil disobedience will become impossible, as in this remarkable bit of short fiction?

Now, imagine that [Rosa] Parks is riding one of the smart buses of the near future. Equipped withsensors that know how many passengers are waiting at the nearest stop, the bus can calculate theexact number of African Americans it can transport without triggering conflict; those passengerswho won't be able to board or find a seat are sent polite text messages informing them of futurepickups. A smart facial-recognition scheme--powered by video cameras at bus stops--keeps countof how many people of each race are waiting to board and divides the bus into two white and blacksections accordingly. The bus driver--if there still is one--can tap into a big-data computer portalthat, much like predictive software for police, produces historical estimates of how many black

people are likely to be riding that day and calculates the odds of racial tension based on theweather, what's in the news, and the social-networking profiles of specific people at the bus stop.


4/11



These are fascinating

speculations, informed by

all the intellectual

weapons of western

civilization. But he's

going on intuition.

Those passengers most likely to cause tension on board are simply denied entry. Will this newtransportation system be convenient? Sure. Will it give us a Rosa Parks? Probably not, because shewould never have gotten to the front of the bus to begin with. The odds are that a perfectly efficientseat-distribution system--abetted by ubiquitous technology, sensors, and facial recognition--wouldhave robbed us of one of the proudest moments in American history.

How are we to compare this to the tweeting-about-yogurt-brings-the-cops scenario, or the-general-elimination-

of-all-crime, to the citizen-phone-surveillance scenario? Are they all equally likely? What evidence do we haveto evaluate whether these are real thought experiments, predictions, or rhetorical devices? What are the odds,anyway, of any of these stories, even in concept, actually occurring?

Morozov also gives a weak-tea history of Parks herself:

This courageous act was possible because the bus and the sociotechnological system in which itoperated were terribly inefficient. The bus driver asked Parks to move only because he couldn'tanticipate how many people would need to be seated in the white-only section at the front; as thebus got full, the driver had to adjust the sections in real time, and Parks happened to be sitting in anarea that suddenly became "white-only."

Parks did not just happen to be riding the bus in the spot where she was. Rather, she wasa committed civil-rights activist with more than 10 years of activism under her belt and a planfor how to disrupt what was alreadya system designed to minimize disturbances. Parks' training, agency, and forethought are significant becausethey complicate the freaky scenario Morozov conjures in which no one could possibly find a way to protest a"smart" but unjust system powered by sensors and big data. The Parks incident was a calculated and principledact of defiance that was designed to strike exactly at a weak spot in the segregation system. It makes you think:Wouldn't other activists find their way around even Morozov's most implausibly nightmarish scenario? Not tomention that her act, while important, was one tiny piece of a movement that involved hundreds of thousands ofpeople. Are we really supposed to believe that smart buses would have stopped the civil rights movement?

Of course, he might (and does) argue that these systems make itharder for dissidents, that they decrease the probability of peopleseeing civil disobedience, that the possibility of finding a way aroundthe system is no reason to allow the creation of the system. I agree!And think he is making a good and important warning rooted indeep, serious moral thought. That's precisely why I find myselfwishing he had better, more anchored what-ifs.

The point is: These scenarios, and there are dozens and dozens ofthem, operate on a specific worldview and contain a likely set ofactors and outcomes. Each one is an argument, in short, for whichMorozov provides only the scantest evidence. These are fascinating

speculations, informed by all the intellectual weapons of western civilization. But he's going on intuition.

I like his intuition. I value it. But I don't want to have to take his word for it.

Despite these narrative flaws, much of Morozov's chapter on predictive policing and situational crimeprevention is brilliant. As an attack on the ideology of these concepts, it is devastating, especially through afascinating application of the legal theorist Roger Brownsword's hard-hitting framework on the registers (moral,prudential, practicability) on which regulation can work. You could very well enter this chapter thinking yousupport predictive policing and come out the other end with a changed mind. It is that persuasive. But the meansof raising the emotional stakes, even to this great end, strike me as dangerous. They end up looking like themirror image of promoters' pamphlets. Like them, Morozov struggles to keep his own imaginings in properperspective.


5/11



To Morozov, quantifying

the self is a crime against

the self. It forecloses

possibilities, narrows

one's vision.

Now, I want to turn to one particular example: his drubbing of self-tracking. By focusing on this single case, wecan go beyond the general pronouncements about his work to see the brilliant and frustrating individual movesthat Morozov uses to make his arguments.

* * *

Morozov likes to build an argument from some anecdotes downward, starting with a seemingly preposterousidea drawn from our current reality, locating its intellectual foundations in a contemporary thinker's work andthen drilling down relentlessly from there, looping back to the original target as he goes. In his chapter on self-tracking and the quantified self movement, it is Gary Wolf whom he goes after, and, to a lesser extent, KevinKelly. No matter what you think about the critiques themselves, Wolf and Kelly are well-chosen targets as theyhave been thinking about and promoting the generation of data about oneself for years.

Morozov argues forcefully against first self-quantification, then quantification, then the "numeric imagination,"then measurement itself, and, finally, the objective fixity of facts. Do you see what happened there? We wentfrom a debate about whether or not to wear a pedometer to a debate about whether numbers can adequatelyrepresent anything in the world. This movement happens with terrifying speed in Morozov's work.

I want to walk through this movement from the base upwards because I think it's his foundational criticisms thattend to be the best, and the arguments get less persuasive the further he gets from the philosophical bases of hisobjections.

Down at the bottom, Morozov displays a deep, well-founded distrust of the way humans construct models of theworld with numbers. Despite considerable controversy, this type of thinking is prevalent and well-supposed bya substantial literature in science and technology studies. "Bruno Latour distinguishes between 'matters of facts,'the old unrealistic way of presenting all knowledge claims as stable, natural, and apolitical," Morozov writes,"and 'matters of concern,' a more realistic mode that recognizes that knowledge claims are usually partial andreflect a particular set of problems, interests, and agendas."

This is a direct attack on whatever claims people might make that they have authority based on the neutral

collection of data about "reality." He asks of these modes of investigation: "When do they suppress conflictinginterpretations of reality? What do they conceal and make invisible, and is this something we can afford to losesight of? How might they be invoked in the name of seemingly unrelated political projects?" And how mightthe answers to those questions change how we understand "the facts," such as they are presented.

These are important questions and they relate directly to his next target: measurement. He quotes a historianwho has written about measurement to say, "we . . . need to keep reminding ourselves of the human purposesthat led us to create [the measurement] in the first place--and where, if at all, it interferes with any of thesepurposes." Because our tools will always capture the world in imperfect ways.

Again, this is a vital and important chunk of foundational knowledge

that is common in science and technology studies, but absolutelyabsent from most of the popular rhetoric about data, open orotherwise. Any human survey will have the mark of human handsupon it, and laundering that reality through numbers does not changethe underlying nature of these knowledge creation projects.

Moreover, Morozov argues, using these numbers limits the powersof moral and social imagination that we might otherwise employ."We can further contrast 'narrative imagination' with the somewhatoxymoronic 'numeric imagination,' which can be defined as the

predisposition to seek out quantitative and linear casual explanations that have little respect for the complexity

of the actual human world." We need to tell ourselves stories about the world (Martha Nussbaum's "narrativeimagination") because, as Nussbaum writes, "citizens cannot relate well to the complex world around them by


6/11



factual knowledge."

OK, but what's so wrong with using numbers anyway? So they are imperfect, but they're better than nothing,one might argue, and at best they are a complement to the narrative imagination, providing a valuable check onthe biases of storytelling. (In fact, I will argue this shortly.) Morozov counters that not only do numbers notprovide an adequate representation of the world, but they displace all other possible representations. "It's thisimperialistic streak of quantification--its propensity to displace other meaningful and possibly intangible ways

of talking about a phenomenon--that is so troubling," he writes. This, in turn, leads to a "narrowing of vision."Numeric imagination crowds out narrative imagination.

Soon we reach his main attack on quantification, which contains some of the best sections in the entire book.Here, he commands a flurry of arguments and thinkers to take on quantification as a practice. "Nietzscheunderstood that quantifiable information might be nothing but low-hanging fruit that is easy to pick but oftenthwarts more ambitious, more sustained efforts at understanding," he begins the assault. It is hard to measurethe things that matter, Morozov asserts, and what you can measure is almost always a simplification of theworld. The political and moral assumptions and implications that should have traveled with the quantificationget stripped out, letting all those things move unchallenged into discourse. He accuses quantification oflaundering politics, essentially, and I think he's damn right a lot of the time.

He makes a smaller, but no less powerful critique of quantification as an enabler of what I calloveroptimization. Citing technology critic Steven Talbott, he cites the danger of positive feedback loops drivingforward only those aspects of society that can be easily modeled and computed.

We need an ethics of quantification, Morozov cries, and I cry with him. When is it good? When is it bad? Howcan it be used to further our ends, as opposed to being celebrated as its own end?

And finally, we get to his objections at the very top of this huge pile of philosophy, history, and political theory.You can imagine, if this was your understanding of the world, as rooted in your scholarship, why it might getyour hackles up when Gary Wolf says, "Many of our problems come from simply lacking the instruments tounderstand who we are. ... We lack both the physical and the mental apparatus to take stock of ourselves. Weneed help from machines."

Wolf, in this account, takes the hit for the entire enterprise of data collection. But he also endures a witheringassault for his conception of self. "Members of the Quantified Self movement may not always state thisexplicitly, but one hidden hope behind self-tracking is that numbers might eventually reveal some deeper innertruth about who we really are, what we really want, and where we really ought to be," Morozov writes. "Themovement's fundamental assumption is that the numbers can reveal a core and stable self--if only we get thetechnology right."

To Morozov, quantifying the self is a crime against the self. It forecloses possibilities, narrows one's vision.And worse, it does it for others, not just you. Privacy, he argues persuasively, can only be understood in socialcontext: What I choose to disclose impacts your future disclosure options.

"Your choice to quantify yourself (for personal preference or profit) thus has deep implications if it necessitatesmy 'choice' to quantify myself under the pressure of unraveling," he quotes legal scholar Scott Peppet. "What ifI just wasn't the sort of person who wanted to know all of this real-time data about myself, but we evolve aneconomy that requires such measurement? What if quantification is anathema to my aesthetic or psychologicalmakeup; what if it conflicts with the internal architecture around which I have constructed my identity and wayof knowing?"

There you have it: measurement, quantification, facts, the possibility of understanding the self through numbers.All are dispatched in one throbbing mass of interconnected passages.

Then Morozov attempts to think through the ethics of quantification in a short section on education and a larger


7/11



dive into nutrition, calorie-counting, and fitness apps.

And it's here where I think the flaws in Morozov's approach become clear. Despite the rigorous philosophicalunderpinnings, the sheer thoroughness of the thoughts in this chapter, there's something missing: people. And Idon't mean that in a loosey goosey way. His clever use of anecdotes makes it appear as if he's discussing theway that human beings interact with self-tracking devices, but they are not a serious account of practice.

Morozov's book is an innovation- and product-centered account of the deployment of technology. It focuses onmarketing rhetoric, on the stories Silicon Valley tells about itself. And it refutes these stories with all thewithering contempt that a brilliant person can muster over the course of a few years of dedicated reading andwriting. But it does not devote any time to the stories the bulk of technology users tell themselves. It relies onwild anecdotes from newspaper accounts as if they were an adequate representation of the user base of thesetechnologies. In fact, the sample is obviously biased by reporters writing about the people who sound the mostout there.

"Celebrating quantification in the abstract, away from the context of its use, is a pointless exercise," Morozovwrites, and yet he ends up doing excoriating quantification in the abstract. When he does apply his thinking tothe specific case of nutrition aids, it is with some serious handwaving. Calories are not an adequate measure ofoverall nutrition content, he writes, and thinking narrowly about nutritional content is a boon for foodcompanies, and maybe calories aren't even really the problem. All fine and valid ideas, but knowing how manycalories you eat is a good starting point for good health, no? This has been well-established by the medical andpublic-health literature. And, in any case, tracking one's caloric intake is not a search for a "core and stableself." And if your calorie counter doesn't share your data, it could be a private practice. What if you write it in abook as has been done for decades, or in the iPhone's notes, rather than an official app? Is that OK? What aboutnon-tweeting scales, are those anathema as well? Should the ethical concerns Morozov presents really preventactual human beings from trying to understand the basics of their food intake?

Or take the use of pedometers, gussied up into packages like the Nike Fuel Band, Jawbone Up, or Fitbit. Thereare literally hundreds of thousands of pedometers and other activity monitors out there in America, but

Morozov does not try to investigate how such devices are used. Are the people buying FitBits and Nike FuelBands trying to reveal deep inner truths about themselves? Are they sharing every bit and bite with friends? Orare they trying to lose a few pounds in private?

Look at what Amazon can tell you about the market for these devices:people who bought FitBits recently alsobought diet books, scales, and multivitamins. While Morozov locates self-tracking "against the modernnarcissistic quest for uniqueness and exceptionalism," it strikes me that I've yet to meet someone wearing afitness tracker who wasn't engaged in that least unique American activity: weight management.

There are structural reasons for this. Americans are trying to deal with an "obesogenic" environment. Whereand how we live is making us fat, relative to Americans of the past and many other countries. Tens of millionsof people have low-activity jobs or don't work and access to lots of relatively inexpensive food. We movearound in a built environment that militates against actually moving one's body. Of course, there are other non-technological solutions to this problem: reform the Farm Bill, regulate unhealthy foods, change distributionsystems in low-income neighborhoods, redesign food consumption experiences under public control, and createdenser, more walkable neighborhoods that encourage walking or biking as transportation. And, yes, activists ofmany different stripes are working on precisely these sorts of proposals.

Journalists like Michael Pollan have spent years explicating these hard, hard problems, and what policies mightalleviate them. But reform remains elusive, and not for the reason that Morozov states. "One potential problemwith quantification is that it encourages the government not to bother with painful structural changes and simplyto delegate all problem solving to citizens," Morozov argues. "Why bother with regulating highly processedfoods or improving access to farmers markets and prohibiting fast-food chains from advertising to youngsters?After all, we can simply empower individual citizens to monitor how many calories they consume and notbother with any of these initiatives, pretending that obesity is just the result of weak-willed individuals ignorant


8/11



of what they are eating."

But the problem is: This is already the default posture that companies exploit to fight agriculture and food-system reform. It is not self-tracking that has created this perception of individuals, nor is it self-trackingcorporate dollars that sustain their political fight. The real political action is elsewhere. It is simply not true thatwearing a pedometer or other activity monitor is actually hurting activism by giving policymakers atechnological, non-collective loophole. Or if it is, those effects are somewhere down there below the top 25

reasons that changing our farms and development practices are difficult political propositions. You'll find itwedged in between the sugar beet and bat guano lobbies, far below where the actual game is.

This is what I mean when I say that Morozov sometimes loses sight of the relative significance of his critiques.Despite all the important foundational work he's done, Morozov falls prey to his own intellectual creation,technology-centrism.

Without a functioning account of how people actually use self-tracking technologies, it is difficult to know howwell their behaviors match up with Morozov's accounts of their supposed ideology. While he argues that thenumeric and narrative imaginations cannot co-exist, most people are less dogmatic about how data could beused. People are pretty good, I think, at integrating what data they get from the outside world with their owntheories of life and experience. We know the number on an odometer is not the only way to judge the conditionof a car, and remain susceptible to the stories of a good used car salesperson.

Morozov only supplies a single anecdote of a normal user of self-tracking technology. This account, drawnfrom Forbes reporter Kashmir Hill's experience, demonstrates precisely that self-tracking will always beembedded within other types of thought, even though Morozov does not recognize it as such.

[Hill] expresses a sense of befuddlement over what to do with the results of one such self-trackingexperiment. Thanks to some clever software, she finds out, "I'm happiest when drinking at bars(duh); least happy on planes and at work (ahem); Sunday is my happiest day of the week followedby Wednesday; I'm just as happy alone as with other people, and I'm happier interacting with my exthan with my current boyfriend." What to do now, though, Hill doesn't know. "I'm at a slight lossfor what to do with these results. Does this mean I should spend more time in bars and less time atwork to optimize my happiness? And should I rethink my relationship?"

The problem is that, as firm, scientific data, these results have no standing. As moral prompts toaction or conclusions drawn from months of self-reflection, they hold no standing either, for clearlyHill did not deliberate much about her drinking or working habits in the process of using thesoftware.

Well, first, there's no real reason to think Hill did not deliberate much about her "drinking or working habits."That's just an assumption. Maybe she obsesses about them. Second, she's in the process of using her narrativeimagination to connect the data to her life. Isn't this the very way that Morozov wishes people used self-tracking, to gain self-knowledge?

Relative to the caricatures of people using self-tracking devices in the book, I'm guessing most people are a lotmore like Hill or me. I like knowing how many steps I've taken as a decent proxy for physical activity. It helpskeep me honest about how much exercise I'm getting because otherwise I'm apt to lie to myself: "Well, I didn'tgo running yesterday, but I walked a lot." I like having a check against my own unreliable narration. Is thissome sort of crime against the concept of a subjective self? Why? Is it super important that I only know if Ibullshit myself by introspection and no other means?

Or, if I count my steps but I also do yoga, for which I receive no steps, am I somehow unable to reconcile thesetwo things in my own mind? Why wouldn't I see a graph of steps going up, then down, and say to myself, "Oh,

those are the days I did yoga." We don't assume the tools are perfect. Who would? We've all used a cell phone.Humans are not idiots.


9/11



As for the social privacy concerns Morozov raised, they are well-taken. But again, the way people use thesetechnologies complicates his picture. From what I've seen in health tracking, our social norms are provingremarkably resilient to oversharing. For every weirdo tweeting his weight, there are the other 9,999 peoplekeeping it to themselves. There is no revolution afoot in the way that people deal with health or fitness relatedinformation. Most tracking is done in private and held closely. On the service I use, the Jawbone's UP, there isno way to share information to Facebook, and that's by design.

Morozov argues that sharing health data is going to become as widespread as sharing on Facebook (never mindthe number of profiles now locked down from prying eyes). But why would this be? He provides no evidencefor the value or applicability of the analogy. That's just buying the marketing talk hook, line, and sinker.Morozov is willing to do so because it aids in the argument that self-tracking poses a grave danger to non-trackers; he argues that people who refuse to track will be punished socially and in the health-care marketplace.

But to believe that we'd have to believe: A) fitness and health tracking will be ubiquitous or at least widespread;B) the data captured will be shared in a similarly widespread way; C) this sharing will occur with such ubiquityand force that it will constitute a form of social coercion; D) that non-tracking deviants will be punished fortheir refusals; E) the shared data will prove predictive and valuable to insurance, health care, and otherinterested companies.

So far, A is the only proposition here that seems to have any basis out there in the world. B, C, D, and E are allhypothetical propositions that have very little basis, as far as I can tell or have seen. Morozov's intimations thatthis could change are not evidence that it has actually happened, nor that it is happening, nor that it is likely tohappen. There is decent evidence that people are *not* going to become obsessive tracker-sharers. After all,measures we know are correlated with health -- blood pressure, cholesterol, weight, BMI, etc. -- are alreadywidely available with no fancy technology, and you don't see most people sharing these things very willinglyoutside their doctors' offices. The minority that do share have not reshaped the medical system.

Is Morozov's critique a valuable check on the fantasies of a world transformed by self-tracking devices? Yes,definitely. But given the crushing toll that obesity-related problems are having in America and given the

intractability of the political problems creating the obesogenic environment, is it possible that individual-scalesolutions could be a partial and temporary aid in people's efforts to lose weight? I think so. To be clear: If agiven self-tracking device helps you forestall getting diabetes and losing your limbs, who cares if youincidentally provide support for the thesis of Gary Wolf's book?

On the other hand, Morozov's argument about self-tracking through smart energy and water meters works well.In that case, smart meters really do provide rhetorical cover for corporate and government actors to ignoremaking larger scale changes in the energy system. And worse, numerous studies have shown that individual-scale efficiency interventions are small potatoes on a percentage basis. Only a few percent of people activelymanage their energy usage and, of those, only a few bring it down considerably.

You need a city, state, national, and global solutions to energy, yet politicians want to believe that smart meterdeployments that lead to smarter individual energy use can stave off climate change. At best they are goodanswer not up to the scale of the problem, and at worst, they are legitimate distraction and detriment to climateaction. And I say this as someone who has Nest thermostats installed in his home. They're great appliances, butI think my toaster is about as likely to change the planet's fate as they are.

* * *

Morozov has always been a remarkable intellectual hit man. He can bulldoze anybody's ideas about anything.But when the subject has turned to what we should do, rather than what we shouldn't, he is less precise. It's a lotto ask of a critic to both demolish the existing ideology of technology and replace it with something better, butMorozov has never had small ambitions. Yet his advice, distilled from all the theory and scholarship available,consists of rather hoary exhortations:


10/11



It is in using things that

users discover and

transform what those

things are. Examining

ideology is important. But

so is understanding

practice.

"The trick here is to resist the simplifying temptations of techno-optimism and techno-pessimism and toassess each case of technological intervention on its own merits.""We'd be far better off examining individual technologies on their own terms, liberated from themacroscopic fetishes of Silicon Valley.""We must not fixate on what this new arsenal of digital technologies allows us to do without firstinquiring what is worth doing.""But we should not lose sight of the benefits that subjectivity plays in art; much good art is meant to

shock and provoke.""This doesn't mean that we should encourage our politicians to lie, just that we should remember that liescan often serve enabling functions, and while in many cases they will be enabling corruption and laziness,in others they will enable compromise and hope.""Once we leave the confines of the grandiose debates about 'Technology' and 'the Internet,' another wayof talking and thinking becomes possible, one that is technologically literate, attentive to details, mindfulof legal and economic circumstances, and historically informed. It doesn't reject technological solutionsper se; it just wants to question their appropriateness in each and every situation and perhaps to design away for the community to continue debating such appropriateness even once a seemingly tiny andinconsequential technology engenders a giant sociotechnological system to support itself."

And it's worth asking: Who is the "we" in all of this? It's the we of the op-ed idiom, of course. But Morozovdevotes such attention to actors and institutions, individual CEOs and thinkers. He requires such specificityfrom others. Yet in his public policy calls, suddenly, the actors recede and the putative societal we emerges.

He does have a few excellent suggestions in his positive program. One sparkling idea is an audit board foralgorithms, allowing companies to maintain secrecy while ensuring that anti-social or discriminatory practiceshave not been encoded within them. Another is a brief sketch of a "post-Internet" model for thinking aboutdigital technologies. These things are good.

In his final chapter, Morozov attempts to describe a method ofgadget making that meets his ethical criteria. The products he points

to in his final chapter are, to put it frankly, broken. He's taken designfictions that are meant to encourage "user-unfriendliness" and putthem at the center of what technology should be. Appliances that acterratically when your energy usage rises. A radio set that changesstations when energy usage rises. An extension cord that twists inpain when devices in standby mode are left plugged into it. A lampthat dims unless you keep touching it.

I think he's made these technologies into the means; broken thingsmake you focus on their brokenness, not whatever the brokenness issupposed to point to. Would a car that randomly runs out of gas

make you consider the pipeline infrastructure and ecologicaldestruction that our oil economy requires? Or would you just go get a new car? His advice is not the sort ofthing technologists can follow.

Morozov acknowledges that, "without a thorough theoretical scaffolding, all these 'erratic appliances' and'technological troublemakers' can be easily dismissed as quirks of fancy postmodern designers," but the truth is:No matter what theoretical scaffolding you give them, no one wants a radio that gets fuzzy when it's nearelectrical fields. Almost no one will use these things.

That's important because it is in using things that users discover and transform what those things are. Examiningideology is important. But so is understanding practice. What will make Morozov's account so generative is

precisely how much has been left out about how people use things. People like David Edgerton at ImperialCollege London have argued that scholars who study "technology" need to break away from thinking about it asan advancing wave of new things and focus on what people are actually using, day-by-day.


11/11



I remember sitting with Morozov at Stanford in March of last year, when he told me that his goal for the workwas to destroy the concept of "the Internet" in the way that historians of science had destroyed the concept of"science." But try asking a scientist if that's happened. The Berkeley anthropologist of science, Paul Rabinow,put it well. "A major gap has developed today between scientists' self-representation and the representations ofscientists by those who study them," he wrote in a 1996 book. "While this discrepancy is of little consequencefor practicing scientists (most will have never heard of its existence), it provides much of the subject matter andthe authority for the social studies of science."

And while many scientists haven't noticed they've lost some authority in the rest of the academy or among thepublic at large, others cannot escape this fact. I think the worst consequence of destabilizing scientists' authorityin the public sphere has been to give fertilizer and sunshine to climate change skeptics. The skeptics'publications on climate institutions and personalities are like weaponized science and technology studies papers.And we may all end up paying the price of inaction as a result of their incredibly effective lobbying.

If it is worth pointing out that there are costs to any technological solution, as Morozov does, it is also worthnoting that ideas can have costs, too. We don't know how Morozov's arguments will be deployed in the future,but I wouldn't doubt it will sometimes be by people who want to support the continuance of unjust political andsocial arrangements.

Imagine how words like these might be applied by someone other than Morozov:

That so much of our cultural life is inefficient or that our politicians are hypocrites or thatbipartisanship slows down the political process or that crime rates are not yet zero--all of theseissues might be problematic in some limited sense, but they do not necessarily add up to a problemworth solving.

16Jump to comments

Tweet

reddit

EmailPrint

Presented by

Alexis C. Madrigal

Alexis Madrigal is a senior editor at The Atlantic, where he oversees the Technology channel. He's the author ofPowering the Dream: The History and Promise of Green Technology. More

The New York Observer calls Madrigal "for all intents and purposes, the perfect modern reporter." He co-foundedLongshotmagazine, a high-speed media experiment that garnered attention fromThe New York Times,
https://twitter.com/intent/tweet?original_referer=http%3A%2F%2Fwww.theatlantic.com%2Ftechnology%2Farchive%2F2013%2F03%2Ftoward-a-complex-realistic-and-moral-tech-criticism%2F273996%2F&text=Toward%20a%20Complex%2C%20Realistic%2C%20and%20Moral%20Tech%20Criticism%20-%20Alexis%20C.%20Madrigal%20-%20The%20Atlantic&tw_p=tweetbutton&url=http%3A%2F%2Fwww.theatlantic.com%2Ftechnology%2Farchive%2F2013%2F03%2Ftoward-a-complex-realistic-and-moral-tech-criticism%2F273996%2F

Toward a Complex, Realistic, And Moral Tech Criticism - Alexis C. Madrigal - The Atlantic

Documents

Transcript of Toward a Complex, Realistic, And Moral Tech Criticism - Alexis C. Madrigal - The Atlantic