Open Source Community Metrics: LinuxCon Barcelona
-
Upload
dawn-foster -
Category
Technology
-
view
1.166 -
download
2
description
Transcript of Open Source Community Metrics: LinuxCon Barcelona
![Page 1: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/1.jpg)
Open Source Community MetricsTips and Techniques for Measuring Participation
LinuxCon BarcelonaNovember 2012
Dawn M. FosterCommunity Manager at Puppet Labs
@geekygirldawn
[email protected] puppetlabs.com
Presentation Available Here: fastwonderblog.com
![Page 2: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/2.jpg)
2
Stuff I'll Talk About
● What, why and example metrics● Coming up with the right metrics● Tips and techniques for collecting metrics● Sharing metrics and highlighting community members
Photo: http://www.flickr.com/photos/falcifer/3136673599
![Page 3: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/3.jpg)
3
Community Definition
● Community includes all of the people who work on the project● Product contributors: developers, release managers, quality
assurance, localization, etc.
● Other developers: writing applications, modules, extensions, etc.
● Users: people who run your software and provide feedback
● Vendors: companies with products / services based on your project
● Other contributors: promotion, moderation, documentation and more
Some people contribute as part of their employment at companies, while others contribute free time. The community includes all of the
people who are working on your project.
![Page 4: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/4.jpg)
4
Metrics are Useful for Open Source Projects
● Measure progress in your community over time● Who contributes● Where are people contributing● Spot trends● Gauge interest● Learn more about key contributors● Recognize contributions
![Page 5: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/5.jpg)
5
Example: Components of an Open Source Community
http://www.flickr.com/photos/korou/2586472234
![Page 6: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/6.jpg)
6
Example: Puppet Metrics October 2012
Summary4864 members & 1249 messages in Puppet-Users
899 members and 157 messages in Puppet-Dev
916 nicks on #puppet IRC channel
1731 Puppet Forge users & 577 modules
3526 Redmine accounts
399 forks / 1014 watchers of Puppet
Six Month Comparison (May 2012)3907 Members & 843 messages in Puppet-Users
751 Members and 242 Messages in Puppet-Dev
739 Nicks on #puppet IRC Channel
1012 Forge Users & 310 Forge Modules
2783 Redmine Accounts
298 Forks / 696 Watchers of Puppet
http://PuppetLabs.com/community/metrics
![Page 7: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/7.jpg)
7
Example: June 2011 MeeGo Community Metrics Summary
• 439,963 unique people visited this month (430,070 last month).– 1,796,288 pageviews (1,857,907 last month); 599,573 total visits (597,658 last month)
• 25,801 people are members of MeeGo.com (was 24,019 last month)– Dev ML subscribers = 4772; Community = 3736; iL10N = 2607; SDK = 3197
• Mailing Lists: 5890 posts this month; 200 people posted 2+ msgs
• Forums: 2255 posts. 242 people posted 2+ messages
• New Bugs Created: 1938; Bugs Resolved: 2871
• Downloads: 52,627 1.2 Netbook, 626 1.2 IVI, 1505 1.1 N900, 3072 Tablet
• Active Users: Estimated at 800 – 1000 people.– Mailing Lists: 302 people with unique email addresses posted (308 last month)
– Forums: 412 people posted at least one item (262 last month)
– Bugzilla: 773 people performed some action (624 last month)
– Wiki: 276 edited the wiki (205 last month)
– IRC: 410-520 people logged into #meego simultaneously most days
http://wiki.meego.com/Metrics
![Page 8: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/8.jpg)
8
What are the Right Metrics for YOUR Project
● Goals● What are your overall goals for the project?● How can you measure progress toward those goals?● What is important to you and your progress?
● Trends● What should you measure to recognize trends?● How do you recognize when something is going wrong?● Do you notice big improvements?
Note: I measure way too muchhttp://www.flickr.com/photos/bandfan/5548675317/
![Page 9: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/9.jpg)
9
Mailing Lists: mlstats
Mailing List Stats is a command line tool used to analyze mailing list archives. It downloads the archives, places
them in a directory and stores all the information contained in each mailing list post into a database
http://libresoft.es/tools/mlstats
![Page 10: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/10.jpg)
10
Mailing Lists: mlstats for LibreOffice Developer List
● Grab data from your mailing & store in db (repeat per ML)– mlstats --db-user=root --db-password=
http://lists.freedesktop.org/archives/libreoffice/ ● Top Content Query: All or By Month
– select subject, count(*) as c from messages group by subject order by c;
– select subject,monthname(first_date) as m, year(first_date) as y, count(*) as c from messages group by subject, month(first_date) order by y, m, c;
● Top Poster Query– select p.email_address,count(*) as c from messages as
m,messages_people as p where m.message_id=p.message_ID group by p.email_address order by c;
![Page 11: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/11.jpg)
11
Mailing Lists: LibreOffice Top Content Result (graphed)
What are people talking about?
[Libreoffice] [Bug 35673] LibreOffice 3.4 most annoying bugs
[Bug 37361] LibreOffice 3.5 most annoying bugs
[Libreoffice] [Bug 37361] LibreOffice 3.5 most annoying bugs
[Bug 44446] LibreOffice 3.6 most annoying bugs
minutes of ESC call ...
[Libreoffice] [Bug 31865] [Task]: LibreOffice 3.3 release blockers\n\t/ stoppers
No subject
License statement
[Libreoffice] minutes of tech steering call ...
[Libreoffice] minutes of tech. steering call ...
Static src analysis of LibreOffice
[Libreoffice] (no subject)
[Bug 35673] LibreOffice 3.4 most annoying bugs
[ANN] Please use Gerrit from now on for Patch Review
[Libreoffice] Assertions and Logging
[Libreoffice] LibreOffice WikiHelp
0 100 200 300 400 500 600 700
Bugzilla Auto-posts
![Page 12: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/12.jpg)
12
Mailing Lists: LibreOffice Top Posters Result
Who contributes to ML discussions?
[email protected] 2222
[email protected] 1929
[email protected] 1521
[email protected] 1434
[email protected] 1224
[email protected] 1076
![Page 13: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/13.jpg)
13
Google Groups Mailing Lists
● Sigh ...● No API, no clean way to download data.● Stats page wipes stats for top monthly contributors to zero
1st of month.
● Working on a custom project in Ruby that● wgets the stats html page on the last day of every month.● regex & lots of custom code to find the data I care about.● output yaml files for number of posts per month & top
monthly / all time users.
● Code● https://github.com/geekygirldawn/metrics_cron
![Page 14: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/14.jpg)
14
Google Groups Mailing Lists: Puppet-Users for October
![Page 15: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/15.jpg)
15
Google Groups Mailing Lists
● Next Steps● Fix some bugs
– inconsistent yaml output format● Convert sequential command line arguments to options
– -d datadir, -c configfilepath, etc.● Add option to email results
– as a command line argument / option -e emailaddress
![Page 16: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/16.jpg)
16
IRC: Multiple Analysis Tools Depending on Log Format
Generates IRC stats for active people, by hour of the day, by day, most used words, quotes and more.
http://royale.zerezo.com/irssistats/
http://pisg.sourceforge.net/
http://code.google.com/p/superseriousstats/
![Page 17: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/17.jpg)
17
IRC
![Page 18: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/18.jpg)
18
IRC
![Page 19: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/19.jpg)
19
IRC
![Page 20: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/20.jpg)
20
Code Contributions: gitdm
http://go.linuxfoundation.org/who-writes-linux-2012April 2012 Data
![Page 21: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/21.jpg)
21
Code Contributions: Ohloh
http://www.ohloh.net/p/puppet
![Page 22: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/22.jpg)
22
New Contributors: Ohloh
http://www.ohloh.net/p/puppet
![Page 23: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/23.jpg)
23
Recent Commits with Filter: Ohloh
http://www.ohloh.net/puppet
![Page 24: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/24.jpg)
24
Bugs
● New bugs vs. resolved bugs● Can't just look at monthly trends● Need to take release cycle into account● Before release: more resolved bugs● After release: more new bugs
● Participants● People who file new bugs● Participate in bugs (comment, etc.)● Careful with people who resolve bugs (usually QA)
Image: http://www.thegeekstuff.com/2010/05/install-bugzilla-on-linux/
![Page 25: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/25.jpg)
25
Media Wiki
![Page 26: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/26.jpg)
26
Media Wiki
● Get Statistics● http://wiki.meego.com/Special:Statistics● http://wiki.meego.com/api.php?
action=query&meta=siteinfo&siprop=statistics&format=yamlfm
![Page 27: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/27.jpg)
27
Website: Google Analytics
Source: Google Analytics(excludes wiki prior to Dec 21)
Nokia Announcement
Roadmaps Mobile World Congress
![Page 28: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/28.jpg)
28
Automate: Scripts & Business Intelligence
● A less than elegant method (figure out what you want)● Giant bash script● Uses wget, awk, mysql queries, etc.● Dumps a bunch of csv files on my hard drive
● A better dashboard approach (WIP)● Open source metrics dashboard (business intelligence)● Uses Pentaho for reporting, runs regularly and produces a
dashboard anyone can view at any time● http://www.webdetails.pt/
![Page 29: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/29.jpg)
29
Automate: Custom Code + Graphite
● What we have now at Puppet● Lots of custom Ruby code● 2 Projects:
● Gather: Gathers data from various sources
● Metrics: Calls Gather and displays output using Graphite
● Generates one image file per graph plus a yaml file with min / max metadata
● Uses Graphite Render URL API to display data● http://graphite.readthedocs.org/en/0.9.10/render_api.html
● I manually add arrows to explain bumps in graphs
![Page 30: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/30.jpg)
30
Example: Custom Code + Graphite
![Page 31: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/31.jpg)
31
Now What?
● Report Regularly● Monthly – may be too often● Quarterly? Yearly?
● Share the reports with the community
● http://puppetlabs.com/community/metrics
● http://wiki.meego.com/Metrics
● https://www.tizen.org/community/community-metrics
● Recognize● Recognize your top contributors
http://www.flickr.com/photos/play4smee/2439494411/
![Page 32: Open Source Community Metrics: LinuxCon Barcelona](https://reader034.fdocuments.us/reader034/viewer/2022052505/55514543b4c905f2288b4c63/html5/thumbnails/32.jpg)
Dawn FosterCommunity Manager at Puppet Labs
@geekygirldawn
http://www.flickr.com/photos/tlk/5630885373/