Post on 16-Aug-2020
19 January 2012 Copyright 2011 Haym Hirsh 1
Social Computing and
Collective Intelligence
Lecture 2 19 January 2012
19 January 2012 Copyright 2011 Haym Hirsh 2
19 January 2012 Copyright 2011 Haym Hirsh 3
19 January 2012 Copyright 2011 Haym Hirsh 4
19 January 2012 Copyright 2011 Haym Hirsh 5
19 January 2012 Copyright 2011 Haym Hirsh 6
19 January 2012 Copyright 2011 Haym Hirsh 7
19 January 2012 Copyright 2011 Haym Hirsh 8
19 January 2012 Copyright 2011 Haym Hirsh 9
19 January 2012 Copyright 2011 Haym Hirsh 10
19 January 2012 Copyright 2011 Haym Hirsh 11
19 January 2012 Copyright 2011 Haym Hirsh 12
19 January 2012 Copyright 2011 Haym Hirsh 13
19 January 2012 Copyright 2011 Haym Hirsh 14
19 January 2012 Copyright 2011 Haym Hirsh 15
19 January 2012 Copyright 2011 Haym Hirsh 16
19 January 2012 Copyright 2011 Haym Hirsh 17
19 January 2012 Copyright 2011 Haym Hirsh 18
19 January 2012 Copyright 2011 Haym Hirsh 20
19 January 2012 Copyright 2011 Haym Hirsh 21
19 January 2012 Copyright 2011 Haym Hirsh 22
19 January 2012 Copyright 2011 Haym Hirsh 23
19 January 2012 Copyright 2011 Haym Hirsh 24
19 January 2012 Copyright 2011 Haym Hirsh 26
• Introduction: Broad overview of collective intelligence, a framework for understanding it, and its various connections to machine learning – Animals to humans images/videos
– CI mosaic (icons, then list of keywords)
– CI, crowdsourcing, human computation
– Overt vs covert • Collaborative creation
• Collaborative decision making
• Smartest in the crowd / contests
• HC and micro-labor markets
• Crowd mining
– Roles of Machine Learning 19 January 2012 Copyright 2011 Haym Hirsh 27
Collective Intelligence Crowdsourcing
Human Computation Social Computing
19 January 2012 Copyright 2011 Haym Hirsh 28
Collective Intelligence
• “groups of individuals doing things collectively that seem intelligent”
“The Collective Intelligence Genome”, Malone, Laubacher, and Dellarocas, MIT Management Review, April 1, 2010
• “How can people and computers be connected so that—collectively—they act more intelligently than any individuals, groups, or computers have ever done before?”
http://cci.mit.edu
19 January 2012 Copyright 2011 Haym Hirsh 29
Collective Intelligence
• “Collective intelligence is a shared or group intelligence that emerges from the collaboration and competition of many individuals and appears in consensus decision making in bacteria, animals, humans and computer networks”
Wikipedia, “Collective Intelligence”
19 January 2012 Copyright 2011 Haym Hirsh 30
Crowdsourcing
• “Crowdsourcing is the act of taking a job traditionally performed by a designated agent (usually an employee) and outsourcing it to an undefined, generally large group of people in the form of an open call.”
“The Rise of Crowdsourcing,” Jeff Howe, Wired, Jun 2006
19 January 2012 Copyright 2011 Haym Hirsh 31
Crowdsourcing
• “We say that a system is a [crowdsourcing] system if it enlists a crowd of humans to help solve a problem defined by the system owners, and if in doing so, it addresses the following four fundamental challenges: – How to recruit and retain users? – What contributions can users make? – How to combine user contributions to solve the target
problem? – How to evaluate users and their contributions?”
“Crowdsourcing systems on the World-Wide Web,” Anhai Doan, Raghu Ramakrishnan, Alon Y. Halevy. Communications of the ACM,
Vol. 54 No. 4, Pages 86-96, April 2011 19 January 2012 Copyright 2011 Haym Hirsh 32
• “The idea behind digital computers may be explained by saying that these machines are intended to carry out any operations which could be done by a human computer.”
“Computing Machinery and Intelligence.” A.M. Turing, Mind,
59:236, (1950), 433-460.
Human Computation
19 January 2012 Copyright 2011 Haym Hirsh 33
Human Computation
• Human computation is “a paradigm for utilizing human processing power to solve problems that computers cannot yet solve.”
Human Computation, Luis van Ahn. Doctoral Dissertation, Department
of Computer Science, Carnegie Mellon University (2005).
19 January 2012 Copyright 2011 Haym Hirsh 34
Human Computation
• “[H]uman computation systems can be defined as intelligent systems that organize humans to carry out the process of computation.”
Human Computation, Law and van Ahn 2011
19 January 2012 Copyright 2011 Haym Hirsh 35
19 January 2012 Copyright 2011 Haym Hirsh 36
19 January 2012 Copyright 2011 Haym Hirsh 37
19 January 2012 Copyright 2011 Haym Hirsh 38
Human Computation
• Human computation:
– The problems fit the general paradigm of computation, and as such might someday be solvable by computers.
– The human participation is directed by the computational system or process
Quinn and Bederson CHI 2011
19 January 2012 Copyright 2011 Haym Hirsh 39
Social Computing
• “applications and services that facilitate collective action and social interaction online with rich exchange of multimedia information and evolution of aggregate knowledge”
Parameswaran, M. & Whinston, A.B. Social Computing: An
Overview. CAIS 19:37, (2007), 762-780
19 January 2012 Copyright 2011 Haym Hirsh 41
Social Computing
• In the weaker sense of the term, social computing has to do with supporting any sort of social behavior in or through computational systems.
• In the stronger sense of the term, social computing has to do with supporting “computations” that are carried out by groups of people
Wikipedia, “Social Computing”
19 January 2012 Copyright 2011 Haym Hirsh 42
Types of Collective Intelligence
• “Overt” vs “Covert”: Are human participants explicitly participating to achieve the collective outcomes, or is some form of mining of human activity achieving the collective outcomes
– Overt: Amazon reviews, Wikipedia
– Covert (“Crowd Mining”): Google, Amazon recommendations
19 January 2012 Copyright 2011 Haym Hirsh 47
Types of Collective Intelligence
• “Overt” vs “Covert”: Are human participants explicitly participating to achieve the collective outcomes, or is some form of mining of human activity achieving the collective outcomes
– Overt: Amazon reviews, Wikipedia
– Covert (“Crowd Mining”): Google, Amazon recommendations
19 January 2012 Copyright 2011 Haym Hirsh 48
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 49
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 50
19 January 2012 Copyright 2011 Haym Hirsh 51
19 January 2012 Copyright 2011 Haym Hirsh 52
19 January 2012 Copyright 2011 Haym Hirsh 53
19 January 2012 Copyright 2011 Haym Hirsh 54
19 January 2012 Copyright 2011 Haym Hirsh 55
19 January 2012 Copyright 2011 Haym Hirsh 56
19 January 2012 Copyright 2011 Haym Hirsh 57
19 January 2012 Copyright 2011 Haym Hirsh 58
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 59
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 60
19 January 2012 Copyright 2011 Haym Hirsh 61
19 January 2012 Copyright 2011 Haym Hirsh 62
19 January 2012 Copyright 2011 Haym Hirsh 63
19 January 2012 Copyright 2011 Haym Hirsh 64
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 65
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 66
19 January 2012 Copyright 2011 Haym Hirsh 67
19 January 2012 Copyright 2011 Haym Hirsh 68
19 January 2012 Copyright 2011 Haym Hirsh 69
19 January 2012 Copyright 2011 Haym Hirsh 70
19 January 2012 Copyright 2011 Haym Hirsh 71
19 January 2012 Copyright 2011 Haym Hirsh 72
19 January 2012 Copyright 2011 Haym Hirsh 73
19 January 2012 Copyright 2011 Haym Hirsh 74
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 75
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 76
19 January 2012 Copyright 2011 Haym Hirsh 77
19 January 2012 Copyright 2011 Haym Hirsh 78
19 January 2012 Copyright 2011 Haym Hirsh 79
“Prediction Markets”
19 January 2012 Copyright 2011 Haym Hirsh 80
19 January 2012 Copyright 2011 Haym Hirsh 81
19 January 2012 Copyright 2011 Haym Hirsh 82
19 January 2012 Copyright 2011 Haym Hirsh 83
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 84
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 85
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing • Individuals perform numerous small tasks that are hard
for computers and that collectively solve larger, more difficult problems
19 January 2012 Copyright 2011 Haym Hirsh 86
19 January 2012 Copyright 2011 Haym Hirsh 87
88 19 January 2012 Copyright 2011 Haym Hirsh
19 January 2012 Copyright 2011 Haym Hirsh 89
19 January 2012 Copyright 2011 Haym Hirsh 90
19 January 2012 Copyright 2011 Haym Hirsh 91
“Games with a Purpose”
19 January 2012 Copyright 2011 Haym Hirsh 92
19 January 2012 Copyright 2011 Haym Hirsh 93
• Introduction: Broad overview of collective intelligence, a framework for understanding it, and its various connections to machine learning – Animals to humans images/videos
– CI mosaic (icons, then list of keywords)
– CI, crowdsourcing, human computation
– Overt vs covert • Collaborative creation
• Collaborative decision making
• Smartest in the crowd / contests
• HC and micro-labor markets
• Crowd mining
– Roles of Machine Learning 19 January 2012 Copyright 2011 Haym Hirsh 96
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 114
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 115
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Achieve desired outcomes by mining the observed
behaviors of people
19 January 2012 Copyright 2011 Haym Hirsh 116
19 January 2012 Copyright 2011 Haym Hirsh 117
19 January 2012 Copyright 2011 Haym Hirsh 118
19 January 2012 Copyright 2011 Haym Hirsh 120
19 January 2012 Copyright 2011 Haym Hirsh 121
19 January 2012 Copyright 2011 Haym Hirsh 122
19 January 2012 Copyright 2011 Haym Hirsh 123
19 January 2012 Copyright 2011 Haym Hirsh 125
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 126
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 127
19 January 2012 Copyright 2011 Haym Hirsh 128
19 January 2012 Copyright 2011 Haym Hirsh 129
19 January 2012 Copyright 2011 Haym Hirsh 130
19 January 2012 Copyright 2011 Haym Hirsh 131
19 January 2012 Copyright 2011 Haym Hirsh 132
19 January 2012 Copyright 2011 Haym Hirsh 133
19 January 2012 Copyright 2011 Haym Hirsh 134
19 January 2012 Copyright 2011 Haym Hirsh 135
19 January 2012 Copyright 2011 Haym Hirsh 136
Types of Collective Intelligence
• Overt – Collecting
– Collaborative Creation
– Smartest in the Crowd
– Collaborative Decisions
– Human Computation and Micro-Crowdsourcing
• Covert / Crowd Mining – Search logs
– Social media
19 January 2012 Copyright 2011 Haym Hirsh 137
19 January 2012 Copyright 2011 Haym Hirsh 138
19 January 2012 Copyright 2011 Haym Hirsh 139