Data Mashups -Data Science Summit
14
Data Mashups Turning Data Exhaust into Insights May 12, 2011 Data Scientist Summit Pete Skomoroch LinkedIn @peteskomoroch
-
Upload
peter-skomoroch -
Category
Technology
-
view
3.062 -
download
0
description
As large datasets come together exciting and unexpected things can happen. Human behavior is high dimensional, so combining many diverse datasets is critical to revealing actionable insights.
Transcript of Data Mashups -Data Science Summit
Data Mashups
Turning Data Exhaust into Insights
May 12, 2011Data Scientist SummitPete SkomorochLinkedIn@peteskomoroch
We have an explosion of data
•DataWrangling
• InfoChimps
•Data.gov
• Factual
• SimpleGeo
And the tools to make sense of it
•Hadoop
•NoSQL
•R
•Python
•Mechanical Turk
Diverse datasets = better signal
Find a meaningful problem
http://www.flickr.com/photos/aloshbennett/
• Identify pain points
•Work on stuff that matters
• Focus on underutilized data
Trendingtopics.org @hourlytrends
LinkedIn Skills
The best mashups are actionable
•Reveal patterns
•Enable predictions
•Recommendations
Mashup: Skills & Cities
Yuba City, California: 21.3% Unemployment
Ames, Iowa: 4.7% Unemployment
Make data mashups work for you
•Open Data = powerful mashups
•Mashup > sum of its parts
• Focus on meaningful problems
•Actionable mashups are better
