Post on 01-Jan-2016
1
SmartGrid and Spotfire Cloud Computing - Similarities in Innovation
Dr. Brand NiemannDirector and Senior Enterprise Architect – Data Scientist
Semantic Communityhttp://semanticommunity.info/
AOL Government Bloggerhttp://gov.aol.com/bloggers/brand-niemann/
February 9, 2012
2
Overview
• The SmartGrid• Cloud Computing• Open Energy Information Marathon Mashup
and Smart Grid Data Sets• My Data Science Process
3
The SmartGrid
http://www.smartgrid.gov/the_smart_grid#smart_grid
4
Cloud Computing• Characteristics: on-demand, scalable, elastic, and provisioned IT services from
computers and software on the Internet.• Report to the President and Congress on "Designing a Digital Future" that talks
about the importance of federal agencies having "interoperability interfaces" like the Smart Grid: – “The means by which components of the smart grid can talk to each other, for
example, or by which electronic health records can be shared and added to by many parties – are an important stimulus to technology innovation and adoption. Optimally, these interfaces would be open: anyone may create products that use the interfaces without paying fees; and a public, transparent process is used to establish and revise the standards that define the interfaces."• See Cross-Cutting Themes in the Designing a Digital Future Report.
• In my editorials for Federal Computer Week, I described a cloud computing interoperability interface for data sets as:– "Everything within Three Mouse Clicks: See the Data, Search the Data, and Download
the Data."
5
Data.gov Mashathon 2010:An Energy Mashup
http://en.openei.org/apps/mashathon2010/
Click on Washington, DC
See Below on Next Page
6
Data.gov Mashathon 2010:An Energy Mashup
http://en.openei.org/apps/mashathon2010/
Data Sources: See Next Slide
Digitize These Three Graphics
7
Data.gov Mashathon 2010:An Energy Mashup
http://www.eia.gov/cneaf/electricity/esr/table5.html
8
OpenEI Smart Grid
http://en.openei.org/wiki/Gateway:Smart_Grid
Click on Location and Get Only Name
9
Open EI Smart Grid Projects
http://en.openei.org/wiki/Category:Smart_Grid_Projects
Download CSV, But Only Get Part of the Data
Google Map
10
Individual Open EI Smart Grid Project
http://en.openei.org/wiki/ALLETE_Inc.,_d/b/a_Minnesota_Power_Smart_Grid_Project
11
Smart Grid Project UpdateNovember 2011 in PDF
http://energy.gov/sites/prod/files/SGIG%20Awards%20by%20Category%202011%2011%2015.pdf
Same as the Web!
12
Open EI Data Sets
http://en.openei.org/datasets/
A Search for Smart Grid Yields No Data Sets!
13
My Data Science Process
• 1. Get the metadata (data about the data)• 2. Get the data (usually in a spreadsheet)• 3. Combine 1 and 2 (usually by adding web
addresses to 1 in 2)• 4. Import spreadsheet to Spotfire and create
the visualizations• 5. Write the story referencing all the previous
14
1. Get the metadata (data about the data)
http://semanticommunity.info/AOL_Government/Open_Energy_Information_(OpenEI)_Innovations
15
2. Get the data (usually in a spreadsheet)
http://semanticommunity.info/@api/deki/files/17146/=OpenEI02062012.xlsx
3. Combine 1 and2 (usually by addingweb addresses to 1 in 2)
Note: I did not build a Data Warehouse or do major ETL!
16
Map data ©2012 Europa Technologies, INEGI, MapLink, Tele Atlas - Terms of Use
Google MapReconstructed Google Map TilesInto One Map for Import to Spotfire
17
4. Import spreadsheet to Spotfire and create the visualizations
Web Player
Click on Location and See Data!
18
4. Import spreadsheet to Spotfire and create the visualizations
Web Player
19
4. Import spreadsheet to Spotfire and create the visualizations
Web Player
20
5. Write the story referencing all the previous
http://semanticommunity.info/AOL_Government/Open_Energy_Information_(OpenEI)_Innovations
Spotfire provides and interoperability interfacelike the Smart Grid - multiple visualizations“talk to one another.”