ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer...

37
ICWSM Workshop on Critical Data Science 11 June 2019, Munich, Germany Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) Claudia Müller-Birn (Freie Universität Berlin)

Transcript of ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer...

Page 1: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

ICWSM Workshop on Critical Data Science 11 June 2019, Munich, Germany

Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) Claudia Müller-Birn (Freie Universität Berlin)

Page 2: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

We seek to bring together data scientists and scholars from computer science and the social sciences to engage one another around frameworks for responsibly carrying out data science on social phenomena. By combining cultures of critique with those of practice, we seek to create critical and sustainable ways of interdisciplinary collaboration.

https://pad.fs.tum.de/p/Critical_Data_Science_ICWSM19

ICWSM Workshop on Critical Data Science

Page 3: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Data is power

Page 4: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

“What science becomes in any historical era depends on what we make of it”

– Sandra Harding

Page 5: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and
Page 6: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and
Page 7: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Pick 2 cards! (To use now, and as souvenirs)

Page 8: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

20 different cards, across multiple themes

Page 9: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

“Toward a Critical Technical Practice” (1997)

Toward a Critical Technical Practice: Lessons Learned Trying to Reform AI

Philip E. Agre University of California, San Diego

Every teclmology fits, in its own unique way, into a far-flung network of different sites of social practice. Some technologies are employed in a specific site, and in those cases we often feel that we can warrant clear cause-and-effect stories about the transformations that have accompanied them, either in that site or others. Other teclmologies, such as electric lighting and the telephone, are so ubiquitous-found contributing to the evolution of the activities and relations of so many distinct sites of prac-tice-that it requires considerable effort to understand their effects on society, assuming that such a global notion of "effects" even makes sense (Hughes, 1983; Latour, 1987).

Computers fall in this latter category of ubiquitous technologies. In from an analytical standpoint, computers are worse than that. Com-

puters are representational artifacts, and the people who design them often start by constructing representations of the activities found in the sites where they will be used. This is the purpose of systems analysis, for example, and of the systematic mapping of conceptual entities and rela-tions in the early stages of database design. A computer, does not

have an instrumental use in a site of practice; the computer is frequently about that site in its very design. In this sense and others, computing has been constituted as a kind of imperialism; it aims to reinvent virtually every other site of practice in its own image.

As a result, the institutional relations between the computer world and the rest of the world can be tremendously complicated-much more

131

Page 10: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

“even though I was convinced that [AI] was misguided and stuck, it took tremendous effort and good fortune to understand how and why.”

“to move intellectually from AI to the social sciences — that is, to stop thinking the way that AI people think, and to start thinking the way that social scientists think…

Social science to guide and unstick

Page 11: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

“I literally could not read the literatures of nontechnical fields at anything beyond a popular level. The problem was not exactly that I could not understand the vocabulary, but that I insisted on trying to read everything as a narration of the workings of a mechanism.”

Reading everything technically

Page 12: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

“I still remember the vertigo I felt during this period; I was speaking these strange disciplinary languages, in a wobbly fashion at first, without knowing what they meant — without knowing what sort of meaning they had…”

Vertigo

Page 13: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

• Name

•  Institution(s)

• Discipline(s)

• What brings you here?

Introduce yourselves!

Page 14: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Politics: -  Who are the insiders, and who are the outsiders for

effecting change?

Practice: -  How can we collaborate, with whom, for what tasks?

Action: -  What actions can we take?

https://pad.fs.tum.de/p/Critical_Data_Science_ICWSM19

Page 15: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Cards

Page 16: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and
Page 17: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Unattributed (original comic by Sandserif, https://twitter.com/sandseriftweets/status/1010142230776954880).

Page 18: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

J. D. Biersdorfer, “Tech Tip: Organizing Your Unwieldy Photo Collection Is Easier Than You Think,” The New York Times (April 10, 2019).

Page 19: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Isis Anchalee, “You May Have Seen My Face on BART,” August 1, 2015. https://medium.com/the-coffeelicious/you-may-have-seen-my-face-on-bart-8b9561003e0f

Page 20: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Eugene Wolters, “Is Gender REAL? – 8-Bit Philosophy”, June 27, 2015. https://youtu.be/gkilQ87UUj8.

Page 21: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Data Science For Social GoodSummer Fellowship

Michael Chui | San Francisco

Martin Harryson | Silicon Valley

James Manyika | San Francisco

Roger Roberts | Silicon Valley

Rita Chung | Silicon Valley

Ashley van Heteren | Amsterdam

Pieter Nel | New York

DISCUSSION PAPERDECEMBER 2018

NOTES FROM THE AI FRONTIER APPLYING AI FOR SOCIAL GOOD

Page 22: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Nicholas Gurewitch, “Way Too Much (Apologies to Bill Keane)”, Perry Bible Fellowship (2004). via https://www.reddit.com/r/ProgrammerHumor/comments/9yz2qc/the_essence_of_machine_learning

Page 23: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Interrupt: New

sletter of Computer People for Peace, Issue 15, M

ay 1971. https://eli.naeher.name/

computer-people-for-peace/

Page 24: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and
Page 25: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and
Page 26: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Diana E. Forsythe, Studying Those Who Study Us: An Anthropologist in the World of Artificial Intelligence (Stanford University Press, 2001). Photo by Auggy (@mmmpork), Feb 7, 2019. https://twitter.com/mmmpork/status/1093411715805368324.

Page 27: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Joy Buolamwini, “The Coded Gaze: Unmasking Algorithmic Bias”, November 6, 2016. https://youtu.be/162VzSzzoPs

Page 28: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and
Page 29: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Phot

o by

Sim

on L

indg

ren

(@ s

imon

lindg

ren)

, Jan

uary

10

, 20

18. h

ttps

://tw

itter

.com

/sim

onlin

dgre

n/st

atus

/951

090

3794

2373

580

9

Page 30: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Pratap Chatterjee and Khalil, Verax: The True History of Whistleblowers, Drone Warfare, and Mass Surveillance, A Graphic Novel (Metropolitan Books, 2017).

Page 31: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

“SKYNET: Courier Detection via Machine Learning”, The Intercept, May 8, 2015. https://theintercept.com/document/2015/05/08/skynet-courier/

Page 32: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

20th Century Fox, Point Break, 2001.

Page 33: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and
Page 34: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Bill Watterson, Calvin and Hobbes

Page 35: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

Zach Weinersmith, “The Village and the Tower”, Saturday Morning Breafast Cereal (SMBC), July 11, 2015. https://www.smbc-comics.com/comic/the-village-and-the-tower.

Page 36: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and
Page 37: ICWSM Workshop on Critical Data Science · Momin M. Malik (Harvard University) Katja Mayer (University of Vienna) Hemank Lamba (Carnegie Mellon University) ... Pratap Chatterjee and

“Without the idea that ideologies and social structures can be reproduced through a myriad of unconscious mechanisms such as linguistic forms and bodily habits, all critical analysis may seem like accusations of conscious malfeasance.”

“Even sociological descriptions that seem perfectly neutral to their authors can seem like personal insults to their subjects if they presuppose forms of social order that exist below the level of conscious strategy and choice."

Aside: Description can seem like accusation