Spatial orientations of visual word pairs to improve Bag ...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)
-
Upload
micah-altman -
Category
Technology
-
view
250 -
download
0
description
Transcript of WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)
![Page 1: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/1.jpg)
A Spatial Platform to Support Research and Collaboration
http://worldmap.harvard.edu
Ben Lewis [email protected]
MITCambridge, September 2014
![Page 2: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/2.jpg)
Outline
• Why lat/long is valuable and what research support operations should do about it
• WorldMap as straw man– Overview of current system– New projects
• Global services registry (OGP integration?)• Dataverse integration• HarvardX integration• Neatline integration
• Discussion
![Page 3: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/3.jpg)
Lat/long (location) as organizing facet
(http://www.architectmagazine.com/technology/meet-the-geodesigner.aspx
![Page 4: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/4.jpg)
Spatial search
• Improve access to both spatial and non spatial materials with a “spatial visualization facet”– Books, documents– Paper maps– Local spatial data– Remote spatial data – Local map display and processing services– Remote map display and processing services– Wikipedia– Social media – tweets, etc– The web
![Page 5: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/5.jpg)
Build platforms that lower barriers to:
• Finding spatial materials which reside inside or outside the academy
• Visualizing this data• Using this data• Sharing this data and views of it• Mashing up private and public data• Spatializing materials that are not yet spatial
![Page 6: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/6.jpg)
Support spatial and spatio-temporal visualization
• Make it easy to visualize datasets on a map(A great way to see temporal patterns is on a map http://worldmap.harvard.edu/tweetmap )
• Make it easy to mashup private and public data• Make it easy to share spatial data and views of data• Make it easy to crowd curate data
![Page 7: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/7.jpg)
Support the research life cycle
* Research Lifecycle:• Scoping• Data gathering / exploration• Synthesis / analysis• Writing / communication• Publishing / delivery
Archiving?
![Page 8: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/8.jpg)
WorldMap In a Nutshell
• Designed to lower barriers for researchers who wish to use spatial technology
• Web-based, cloud hosted• Open source software• Service oriented architecture
![Page 9: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/9.jpg)
Allows researchers to…
• Organize: their own (large) mapping datasets and share them
• Visualize: maps with data-driven symbology• Publish: data to the world or to just a few
collaborators• Mashup / Combine: one’s own data with data
provided by others• Analysis: basic but can be easily extended• Collaborate: by letting several people edit the same
map
![Page 10: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/10.jpg)
12,000 Registered Users14,000 Data Layers3,500 Map Collections800,000 Visits
Statistics
![Page 11: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/11.jpg)
Traffic By City
![Page 12: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/12.jpg)
Built on Open Source Software
![Page 13: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/13.jpg)
Loosely Coupled Approach for Adding Major Capabilities
MapWarper Neatline
DataverseEdX
New
WMS WMS
http
Service Registry
CSW
![Page 14: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/14.jpg)
Contributing Organizations(WorldMap and GeoNode)
• Boston Area Research Initiative - BostonMap• UNICEF – Education Access in Cameroon• Cornell University – Global Health Map• UN University – Wildlife Enforcement Monitoring• Virtue Foundation – Women in the World• Amazon - Hardware• Others…
• World Bank – GFDRR, Dominode, Risiko• U.S. State Dept. – ROGUE, HIU, Syria Damage Assessment• NOAA - GeoCloud• UN World Food Program – WFP Geonode• Australian Govt. - AIFDR, TsuDAT• MapStory Foundation – MapStory App• Others…
GeoNode
WorldMap
![Page 15: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/15.jpg)
Niche between desktop and web
Analysis
Ease
of U
se
Collaboration WorldMap
web apps
desktop apps
![Page 16: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/16.jpg)
Openness is key
• Open registration• Open access to data• Open service protocols (WMS, WFS, ESRI Rest)• Open data formats (Shape, GeoTIFF, GeoRSS,
KML, Json, CSV)• Open source code (GPL on github)• Runs on open source operating systems
(Linux) and could run on Windows
![Page 17: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/17.jpg)
Data Connectors to…
• Google maps, Open Street Maps, Bing, MapQuest, ESRI• Geo-tweets• Google Street View• Google Earth• Flickr, GeoRSS• Geonames, Google Places, Yahoo Places• Social Explorer, Yelp• WMS, WFS, ESRI REST• More to come…
![Page 18: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/18.jpg)
Examples…
• Map applications people and organizations have created using WorldMap…
![Page 19: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/19.jpg)
![Page 20: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/20.jpg)
Reischauer InstituteJapan Earthquake Archive
![Page 21: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/21.jpg)
![Page 22: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/22.jpg)
Boston Area Research InitiativeBoston Data
![Page 23: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/23.jpg)
University of BarcelonaHistoric Planning Data
![Page 24: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/24.jpg)
Professor Colin GordonMapping Decline, St. Louis
![Page 25: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/25.jpg)
![Page 26: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/26.jpg)
Virtue FoundationWomen-run NGOs
![Page 27: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/27.jpg)
![Page 28: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/28.jpg)
![Page 29: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/29.jpg)
![Page 30: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/30.jpg)
![Page 31: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/31.jpg)
![Page 32: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/32.jpg)
![Page 33: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/33.jpg)
![Page 34: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/34.jpg)
What’s Coming in WorldMap
• Services Registry• HarvardX Integration• Dataverse Integration• Neatline Integration• Geo-tweet Archive
![Page 35: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/35.jpg)
WorldMap and the Services Registry
• WorldMap is a web-based, open source, collaborative mapping platform developed at Harvard CGA since 2012
• The National Endowment for the Humanities Implementation Grant. – Key objective: create a comprehensive and
sustainable map service registry which researchers and the public can use to discover, create and share any work that can be represented spatially.
![Page 36: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/36.jpg)
Lower the Barrier to Geodata Access, Across Disciplines
Internet
Commercial Systems
local data
Government Systems
Other Institutions
Esri REST, WMS, WFS, RSS etc.
dow
nloa
d
download
download
uplo
ad service view
servi
ce vi
ew
WorldMap Data and Service
Registry
![Page 37: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/37.jpg)
Key Goals• Support discovery of the millions of web maps
that are exposed but not easy to find (the “dark” geoweb)
• To allow anyone to mashup content from any source from within any mapping application
• Enable non-IT professionals to create their own map services without IT support
• Crowd-source map data curation in a metadata-weak environment
![Page 38: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/38.jpg)
Creating a Global Service Registry
-- A basic piece of geo-infrastructure that doesn’t exist
• Build registry of web map services (millions of map layers)• Make API available so any system can use it• Provide a fast, faceted search interface• Allow anyone to add new services to the registry• Maintain uptime statistics on each service• Use WorldMap usage statistics to improve search
(eventually bring in stats from systems outside WorldMap which use API)
![Page 39: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/39.jpg)
How Many Services Are Out There?
• We estimate millions, each containing many map layers totaling petabytes of data which is currently VERY hard for the average researcher to find and use.
• Try this to estimate number of Esri REST servers (15million)– allinurl: http "arcgis rest services" mapserver -test -kml -kmz -
sitemap -query
• Try this to estimate number of WMS servers (47 thousand)– allinurl: http "?request getcapabilities" -test
![Page 40: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/40.jpg)
Service Registry Challenges
• Metadata - tagging and usage statistics• Projections - cascading• Persistence - caching• Discovery - central index, usage statistics• Performance - caching
![Page 41: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/41.jpg)
Open API to Registry
• Public, RESTful API• Access all (public) map layers within WorldMap• Access all service layers outside WorldMap• Access all Maps (collections of layers) within
WorldMap• Search on information:
– Metadata– Usage statistics– Attribute info (for local layers)
![Page 42: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/42.jpg)
Distributed Map
Services
Services
API
ServiceRegistry
Distributed Users
WorldMap
OpenLayers,Leaflet
Esriclients
Any map client
Find and bindto layers
Crowd curation, user submitted services
WorldMap
Service caching,
reprojection
WorldMapLocal
Services
UptimeChecker
WorldMapCore
ServiceCrawler
*Common Crawl
*Start with hadoop search of Common Crawl dataset http://commoncrawl.org/
![Page 43: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/43.jpg)
Faceted Services Search UI Mockup (draft)
![Page 44: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/44.jpg)
More information…
WorldMap http://worldmap.harvard.edu
Center for Geographic Analysis http://gis.harvard.edu
![Page 45: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/45.jpg)
![Page 46: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/46.jpg)
HarvardX Integration
![Page 47: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/47.jpg)
Dataverse Integration (Social Science Archive)
![Page 48: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/48.jpg)
Neatline Integration map-based story telling platform
![Page 49: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/49.jpg)
TweetMap Archive
![Page 50: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/50.jpg)
Demo of Service Registry Test Server
• http://107.22.231.227/– Show services– Add service– Find service layers as layers– Metadata for services– Layer page for services– Statistics for services– Saving map with service layers
![Page 51: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/51.jpg)
Service Registry Architecture
![Page 52: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/52.jpg)
End
![Page 53: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/53.jpg)
Information Exists Within Spectrum of Publicness and Curatedness
• PublicnessPrivate - Group – University – Consortium - Public
• CuratednessData created – Reviewed by expert – Reviewed by crowd
![Page 54: WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BAG TALK)](https://reader033.fdocuments.us/reader033/viewer/2022061218/54b67c424a79592d298b463a/html5/thumbnails/54.jpg)
Our job
• Create platforms (of people and software and objects) to lower barriers to data access:– Data hosting– Data formatting– Metadata creation– Data and view sharing– Search tools – local and remote resources– Connecting systems where relevant– Analytical services– Publishing