Crowding Effects - Matthias...
Transcript of Crowding Effects - Matthias...
![Page 1: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/1.jpg)
Crowding Effects:How Money Influences Open Source Projects and its Contributors
LinuxTag 2007 Berlin, Track „Building and Management of Communities“June 1st 2007, Matthias Stuermer, ETH Zürich & /ch/open, [email protected]
![Page 2: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/2.jpg)
2June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Content
1. Different Perspectives on Community Building
2. About Economics, Motivation and Crowding-Out
3. Incentive Systems in Open Source Communities
4. Debian/dunc-tank and Google Summer of Code
5. Conclusions
![Page 3: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/3.jpg)
3June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Content
1. Different Perspectives on Community Building
2. About Economics, Motivation and Crowding-Out
3. Incentive Systems in Open Source Communities
4. Debian/dunc-tank and Google Summer of Code
5. Conclusions
![Page 4: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/4.jpg)
4June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Macro Best practices of successful OSS projects
Some hints based on anecdotal evidence
Micro Interaction between actors: social behavior Human behavior: Crowding-out of intrinsic motivation
Macro and Micro Perspective on Communities
![Page 5: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/5.jpg)
5June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Best Practices of Successful OSS Projects
Modular structure of the code
Documentation for different stakeholders
Controlled release management
Efficient collaboration platform
Regular physical meetings
Real-world organization such as a foundation
![Page 6: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/6.jpg)
6June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Some hints based on anecdotal evidence
Structure follows problems re-act, not pro-act→
Openness for newcomers, new ideas, new leaders
Do provide incentives for writing documentation
→ More about OSS leadership and preconditions for new OSS
projects: Stuermer, 2005
![Page 7: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/7.jpg)
7June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Content
1. Different Perspectives on Community Building
2. About Economics, Motivation and Crowding-Out
3. Incentive Systems in Open Source Communities
4. Debian/dunc-tank and Google Summer of Code
5. Conclusions
![Page 8: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/8.jpg)
8June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Standard Economic Model
Source: Frey & Jegen 2001 Extrinsic Incentive
Wor
kin
g Ef
fort
⊕
⊕
supply curve
![Page 9: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/9.jpg)
9June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Intrinsic vs. Extrinsic Motivation
Intrinsic Motivation (from within the person) Enjoyment-based
Obligation-based
Extrinsic Motivation (underlying preferences) Non-monetary: reputation, career options...
Monetary: employment, rewards, sponsoring...
![Page 10: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/10.jpg)
10June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Importance of Intrinsic Motivation
Basis for uncompensated voluntary work foundation of OSS contributions→
When results cannot be observed and attributed(complex tasks)
Necessary in all knowledge-intensive tasks
Relevant for team work
Source: Weibel et al. 2007
![Page 11: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/11.jpg)
11June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Crowding-out effect:Experiment 1 of Gneezy & Rusticini (2000)
Voluntary collection: 180 pupils divided in 3 groups 1: Motivation speech and no reward 2: Motivation speech and 1% of collected sum 3: Motivation speech and 10% of collected sum
Who collected the most money? Group 1: Highest intrinsic motivation
Who collected the least money? Groups 2: Crowding-out of intrinsic motivation
Conclusion: “Pay Enough or Don't Pay at all“
![Page 12: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/12.jpg)
12June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Crowding-Out with a Negative Net Effect
Source: Frey & Jegen 2001 Extrinsic Incentive
Wor
kin
g Ef
fort
⊕
⊕
supply curve
crowding-out effect shifts supply curve, e.g. because of introduction of money
new supply curve
![Page 13: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/13.jpg)
13June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Experiment 2 of Gneezy & Rusticini (2000)
Parents come late to pick up their child from day-care
Deterrence theory: Penalty reduces bad behavior
Results from introducing fine for coming late:
Parents arrive even later!
After withdrawing fine, parents still come later
Conclusions from experiment:
Incomplete contracts become preciser with fine
New perception of the situation: “A fine is a price”
Outcome of intervention depends on initial perception
![Page 14: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/14.jpg)
14June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Crowding-in and -out of Intrinsic Motivation
External intervention has two opposite effects: Price effect
Crowding-out effect
Big question: Which effect is stronger? Determines if net effect of intervention is →
positive or negative
![Page 15: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/15.jpg)
15June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Effort
Incentiveproportion of intrinsic motivation
nonobservable price effect nonobservable crowdingout effect observable behaviour (total effect)
standard economic model fails to predict correctly
standard economic model predicts correctly
standard economic model fails to predict correctly
standard economic model predicts correctly
Combining Standard Economic Model and Crowding-Out Effect of Intrinsic Motivation
Source: Weibel et al. 2007
![Page 16: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/16.jpg)
16June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Effects of Motivational Incentives on Effort
Decision Making
Work Effort
Self-Determination(Perceived Internal Control)
Self-Esteem(Appreciation of Involvement)
Performance-Contingent Rewards
Intrinsic Motivation
⊖
⊕
⊕
Source: Weibel et al. 2007; Frey and Jegen, 2000
Goal Setting
Constructive Feedback
⊕
⊕
Extrinsic Motivation ⊕ ⊕
motivational crowding-out⊖
![Page 17: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/17.jpg)
17June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Content
1. Different Perspectives on Community Building
2. About Economics, Motivation and Crowding-Out
3. Incentive Systems in Open Source Communities
4. Debian/dunc-tank and Google Summer of Code
5. Conclusions
![Page 18: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/18.jpg)
18June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
The Motivation Mix of OSS Contributors
Intrinsic motivation Fun, curiosity Ideology („Software must be free.“) Responsibility, commitment (maintainer's fate)
Extrinsic motivation Reputation Career options (learning effect, student projects) Employment, contracts, own business
→ How much are we really intrinsically motivated?
![Page 19: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/19.jpg)
19June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Unattractive Tasks in Open Source Projects
What gets done? Itches of developers→ Unattractive tasks 1: Usability
High quality documentation for different target groups GUI design End user features
Unattractive tasks 2: Quality Code review Bug fixing
→ Tasks of „The Last Mile“ are often neglected.
![Page 20: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/20.jpg)
20June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Why introducing incentive system?
1. Gaps of contributions: Solve unattractive tasks
2. Motivate new people getting into the community
3. 'Weed-out' old, inactive people
→ Who should be attracted with incentive system? Long-term vs. short-term contributors
![Page 21: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/21.jpg)
21June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Examples of Extrinsic Incentives in OSS
Monetary Employment of contributors Bounty system Sponsoring of projects Awards, competitions
Near-Monetary Flight and hotel for conference
Non-Monetary Acknowledgments Credit point system Activity ranking
How does it affect self-determination?(performance-contingent or fixed)
![Page 22: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/22.jpg)
22June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Controlling Effect of Extrinsic Incentives
„Extrinsicy“
Perc
eive
d ex
tern
al c
ontr
ol P
erfo
rman
ce-c
onti
nge
ncy
→ ⊕
⊕
Fixed-Salary Employment
Contingent-RewardEmployment Bounty system
Flight and hotelfor conference
Awards
Sponsoring
Credit point system
Acknowledgments
Activityranking
Theory predicts crowding-out
![Page 23: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/23.jpg)
23June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Content
1. Different Perspectives on Community Building
2. About Economics, Motivation and Crowding-Out
3. Incentive Systems in Open Source Communities
4. Debian/dunc-tank and Google Summer of Code
5. Conclusions
![Page 24: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/24.jpg)
24June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Unhappy example: Debian/dunc-tank
Disclaimer: Highly controversial topic in Debian communityGoogle “Debian dunc tank”: ≈ 10'100 entries... (and much more 'private')
About Debian/dunc-tank Paying 2 release managers to get out Debian 4.0 on time (Dec 4th) Started Sept 2006, goal of Dec 4th not reached because of...?
Preliminary conclusions Impossible to measure crowding-out of intrinsic motivation Envy because of selection process Why not silently employed?→ Payment from Debian itself vs. from external entity Don't experiment with money – or at least don't declare it as this! Employment issues depend on community characteristics
![Page 25: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/25.jpg)
25June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Successful example: Google Summer of Code
About GSoC 2007: Accepted 905 students for 136 OSS projects Projects sign up, students apply for tasks, mentor supervises Student receive 4500$ on completion, mentoring orgs 500$
Preliminary conclusions Highly successful: Everybody seems happy, just little chaotic... Positive because of funding new community entrants Participating in GSoC becomes level of 'certification' Focus only on code, documentation is secondary Implementation of new code in projects?
![Page 26: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/26.jpg)
26June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Other Influences on Success of Extrinsic Incentive Systems in OSS communities
Group effects Crowding-out occurs only on individual level Envy between contributors fair/unfair intervention→ Literature on group dynamics no data in OSS so far→
Community characteristics Target group of software Project age and activity level Software complexity, programming language, OS Working situation of contributors (paid vs. voluntary) Dominant ideology (Free Software vs. OSS)
![Page 27: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/27.jpg)
27June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Content
1. Different Perspectives on Community Building
2. About Economics, Motivation and Crowding-Out
3. Incentive Systems in Open Source Communities
4. Debian/dunc-tank and Google Summer of Code
5. Conclusions
![Page 28: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/28.jpg)
28June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Conclusions
What intervention is definitively positive? Moral call→ „Make them feel the pain“ (Kasper Skårhøj, TYPO3) Increase identification to elevate importance of certain tasks No penalties
New insights and future research Differentiation between personal motivation (=not knowing
what others do or receive) and social behavior (fair/unfair) Extrinsic incentives in OSS sometimes positive, sometimes
negative perception of participants is relevant→ Economists often oversimplify, empirical tests are necessary No empirical studies in OSS environments so far
![Page 29: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/29.jpg)
29June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
Discussion, Acknowledgments
What are your experiences in this area?
To OSS project leads: Interested in collaboration on research about crowding-out?
Thanks to Kasper Skårhøj /ch/open - www.ch-open.ch LinuxTag
Matthias Stuermer, [email protected]
![Page 30: Crowding Effects - Matthias Stürmerstuermer.ch/blog/documents/ethz_LinuxTag2007_CrowdingEffects.pdf · Crowding-Out Effect of Intrinsic Motivation Source: Weibel et al. 2007. June](https://reader035.fdocuments.us/reader035/viewer/2022081523/5fdc2aa0cc423e0f8d446697/html5/thumbnails/30.jpg)
30June 1st 2007 Crowding Effects: How Money Influences Open Source Projects and its Contributors
References
Frey, B. S. & Jegen, R. (2001). 'Motivation Crowding Theory', Journal of Economic Surveys, 15, 589-611.
Gneezy, U. & Rustichini, A. (2000a). 'Pay Enough Or Don't Pay At All', The Quarterly Journal of Economics, 115, 791-810.
Gneezy, U. & Rustichini, A. (2000b) 'A fine is a price', Journal of Legal Studies, 29, 1-18.
Stuermer, M. (2005). 'Open Source Community Building', master thesis, University of Bern, http://opensource.mit.edu/papers/sturmer.pdf
von Krogh, G.; Spaeth, S. & Lakhani, K. R. (2003). 'Community, Joining, And Specialization In Open Source Software Innovation: A Case Study', Research Policy, 32, 1217-1241.
Weibel, A., Rost, K. & Osterloh, M. (2007). 'Crowding-Out Of Intrinsic Motivation – Opening The Black Box', Working Paper, University of Zurich.