Crowds & CreativityMike KriegerStanford HCI GroupAdobe Plerk Workshop

How can we tap into the creative potential of online crowds?

Big Picture

Outline

1. Current projects

2. When do crowds make sense for a project?

3. How can we design for better collaboration & creativity?

(4 principles)

How can we tap into the creative potential of online crowds?

Big Picture

Wisdom of the crowd...

...or tyranny of the masses?

diversity of background, expertise, thoughts, ideaspower in numbers“collective intelligence”validation & feedback

Positive traits

Successful Projects

Evaluating Scenarios

6

Evaluating Scenarios

6

Evaluating Scenarios

6

7

7

7

“Personally I prefer the idea of storyboard one. This is because the user freely walks around the museum as they would traditionally, yet automatically receive info about exhibits - a virtual guide without user input. Much more impressive.”

Reactions “Personally I think the

idea from storyboard

one is more compelling.

The reason for this is that I would be interested in finding out

interesting information

about a piece of artwork

or a particular artist that

I couldn't just get at the

museum. The map of

the museum is something that I can get

at the museum on a piece of paper that doesn't require me to be

pulling out my phone and wasting the battery

to get to an exhibit.”

!"#$%&!'()*+,-*#+.'(&/.!

01223'4556718'49'9:1'8;<15=45>19

(;<15'=45>19

*>43?'2@A'=4>1'4'89@53'@B'

3@;5'@A2C'D471'B;2E

-6FF'68'A4F>62G'H@A2'4'I;83'895119?'F621H'A69:'8:@<8?'51894;54298'42H'9:1'F6>1C

D68'B5612H'%:6F'68'62'9:1'J@K11'8:@<'514H62G'9:1'21A8<4<15C

-6FFL8'<:@21'4F1598':6='9:49':68'B5612H'68'2145I3':4762G'4'J@K11C

Phil’s in

the

Coffee

Shop!

-6FF'H1J6H18'9@'H5@<'62'42H':471'4'J@K11'A69:'%:6FC

Hi Phil!

#8':1'129158'9:1'8:@<?':68'<:@21'4F1598':6='9@'9:1'H43L8'8<1J64F'@K158C

! Price Latte

fun activitieshidden ambitionssmall, parallelized tasksencouraging experimentation & iterationright representation

Why sucessful?

Not-so-successful ones

lack of conceptual integritylack of constructive behaviorasking too much, or in the wrong way

Why not sucessful?

9 guidelines1. When diversity

matters2. Small chunks/

delegate-able actions

3. Easy verification 4. Fun activity, or

hidden ambition5. Better than

computers at performing a task

6. Learn from hacks, mods, re-use from crowd

7. Enable novel knowledge discovery

8. Maintain vision & design consistency

9. Not just about lowering costs

Designing for crowd creativityto let them run wild, you need careful design & constraints

Project:Crowd Brainstorming

In brainstorming, constructive ideation is critical

“yes, and...”

Current systems look like Digg...

Current systems look like Digg...

So folks act like they’re on Digg

(no constructive ideation)

Our project:

Ideas2Ideas

Our project:

Ideas2Ideas

Our project:

Ideas2Ideas

Ideas2Ideas Dell IdeaStorm Clone

Non-building ideas 35 52

Constructive ideas 43 25

!2 test of independence = 10.8776, p < 0.001

1. the value of designing for constructive ideation2. reducing staleness by visualizing “long tail” of crowd contributions

2 design principles

Not just building o! ideas, but others’ work as well

Project 2

Not just building o! ideas, but others’ work as well

Project 2

WikiTasks

How does the Wikipedia crowd of editors organize their actions (to-dos), on a personal and site-wide level?

Question

1. Bottom-up structure2. Existing system doesn’t encourage “next action” thinking3. Lack of triage

Insights

4. Disconnect between individual & site-wide goals

5. Lack of support for contextual discovery

WikiTasksPrototype

WikiTasksPrototype

Lowers barriers to participationEncourages collaborative task-making70% of completed actions originated from someone else

Findings

1. Contextual display of task and work information alongside crowd’s work

design principles

2. Sliding scale of participation and bottom-up creation

1. strong potential for creative crowds2. but need to consider right applications for crowds3. and keep design principles in mind when building “crowd-powered” sites

wrapping it up

Scott Klemmer & Joel Brandt for guidance and feedback

Collaborators & Wikipedia participants

Everyone here for participating

thanks!

mkrieger@hci.stanford.edu