Open Data Sources for Disaster Management

Open DataOpen Data Sources

Application Cases

Open Data Sources for Disaster ManagementInternational Training Course on Application of Disaster Data Sharing

and Service Platform

Michal Bodnar

Regional Center for Space Science and Technology Education in Asia and Pacific(RCSSTEAP), Beihang university

October 28, 2015

Michal Bodnar Open Data Sources for Disaster Management


Application Cases

Table of Contents

1 Open DataOpen Data for Disaster Management

2 Open Data SourcesGIS dataSatellite ImageryNon-spatial disaster data

3 Application Cases



Application Cases

Motivation

To take advantage of the new information environment, aidagencies need to adapt in three ways. They need to find ways

to work with new data sources, to collaborate with a widerrange of partners, and to understand that information initself is a life-saving need for people in crisis. It is as

important as water, food and shelter.

OCHA Policy and Study series, Humanitarian in the Network Age



Application CasesOpen Data for Disaster Management

Table of Contents



3 Application Cases




What is Open Data




Open Data

Today, everything becomes OPEN ...




Open World Encyclopedia

www.wikipedia.org


www.wikipedia.org



Open Government

http://ocw.mit.edu/, www.edx.org


http://ocw.mit.edu/www.edx.org



Open Map of the World

www.openstreetmap.org


www.openstreetmap.org



Open Education

http://ocw.mit.edu/, www.edx.org, www.khanacademy.org


http://ocw.mit.edu/www.edx.orgwww.khanacademy.org



Open Disaster Management

Open Humanitarian Crises Initiative?




Open Humanitarianism

www.openhumanitarianism.infoMichal Bodnar Open Data Sources for Disaster Management

www.openhumanitarianism.info




initiative organized by United Nations Office For the Coordination ofHumanitarian Affairs (UN-OCHA)a

inspired by the idea of Open Governmentto make the data produced by humanitarian organizations open andlet affected communities make informed decisions about their livesbased on 4 main principles

awww.unocha.org


www.unocha.org




Principle no.1: Participationengaging affected-disaster individuals in the decision-making is thekeylocal knowledge + communication = better responseface-to-face meetings, mass media or social networks interactionUN-OCHA published Guidance for Establishing Affected PersonInformation Centera

ahttp://openhumanitarianism.info/wp-content/uploads/2015/01/Guidance_for_Establishing_Affected_Persons_Information_Center_Sept-2014.pdf

Taken from http://openhumanitarianism.info/wp-content/uploads/2015/01/Guidance_for_Establishing_Affected_Persons_Information_Center_Sept-2014.pdf


http://openhumanitarianism.info/wp-content/uploads/2015/01/Guidance_for_Establishing_Affected_Persons_Information_Center_Sept-2014.pdfhttp://openhumanitarianism.info/wp-content/uploads/2015/01/Guidance_for_Establishing_Affected_Persons_Information_Center_Sept-2014.pdfhttp://openhumanitarianism.info/wp-content/uploads/2015/01/Guidance_for_Establishing_Affected_Persons_Information_Center_Sept-2014.pdfhttp://openhumanitarianism.info/wp-content/uploads/2015/01/Guidance_for_Establishing_Affected_Persons_Information_Center_Sept-2014.pdf




Principle no.2: Accountabilityto verify that the organizations that are intended to servedisaster-affected community according doing that according to thestandardsHumanitarian Accountability Partnershipa

developed The 2010 HAP standards in Accountability and QualityManagementb

accountability is the means through which power is usedresponsibly

ahttp://hapinternational.org/bhttp://openhumanitarianism.info/wp-content/uploads/2014/10/

2010-hap-standard-in-accountability.pdf


http://hapinternational.org/http://openhumanitarianism.info/wp-content/uploads/2014/10/2010-hap-standard-in-accountability.pdfhttp://openhumanitarianism.info/wp-content/uploads/2014/10/2010-hap-standard-in-accountability.pdf




Principle no.3: Transparencythere is a need to accurate and transparent information in times ofcrisisPublic-Private Partnership and information sharing OpenHumanitarian Initiativea

Publish What You Fund - The Global Campaign for AidTransparencyb

aohi.nethope.orgbwww.publishwhatyoufund.org


ohi.nethope.orgwww.publishwhatyoufund.org




Principle no.4: Collaborationtechnological innovations and increased access to the Internetopened a new horizon in terms of the response to the disasterpeople from all over the world get connected through differentcommunication channels and platforms, such as Facebook, Twitter,Skype, Weibo, QQ, Wechat and otherswe call such groupings Volunteered and Technical Communities(V&TCs)





Digital Humanitarian Networkserves as an umbrella for all basically all V&TCsit is basically network-of-networksacts as a bridge between formal, professional humanitarianorganizations (such as UN-OCHA) and informal yet skilled-and-agilevolunteer & technical networks

digitalhumanitarians.com




Members of DHN




DHN Activation



Application Cases

GIS dataSatellite ImageryNon-spatial disaster data

Table of Contents



3 Application Cases



Application Cases


Open Data Sources

Who produces Open Data?1 Private Institutions2 International Organizations3 National Organizations4 V&TCs

taken from http://files.isanet.org/Media/TitleMaps/2013TitleMap-IO.png


http://files.isanet.org/Media/TitleMaps/2013TitleMap-IO.png


Application Cases


Open Data Sources

What types of data is Open?1 GIS data

physical (land cover, weather and climate, elevation data, hydrology,ecology)human (administrative boundaries, population, land use,transportation, buildings, roads, points of interest)disaster (damage assessment (landslide, buildings, roads, ...), IDPcamps, ...)

2 Satellite imagery3 Non-spatial disaster data

situation reports3W (Who, Where, What) reports



Application Cases


Physical GIS Open Data Sources



Application Cases


Physical GIS Open Data Sources

Category Source Format Type ResolutionGeneral Natural Earth Data1 SHP, SQLite, grid vector/raster various

Diva-GIS2 SHP, GeoTIFF vector/rasterISCGM Global Map3 SHP, TIFF raster/vector various

Climate WorldClim4 ESRI grid, grid raster 1 km and worseClimate Data Library5 various raster various

Elevation GDEM6 TIFF, PNG raster 30 mSRTM7 GeoTIFF raster 90

Land Cover USGS Land Cover Institute8 various raster variousGLOBCOVER9 GeoTIFF raster 300 mMODIS Global Land Cover10 TIFF, JPEG raster 1 km / 4 km

1www.naturalearthdata.com2www.diva-gis.org3 International Steering Committee for Global Mapping, www.iscgm.org4www.worldclim.com5iridl.ldeo.columbia.edu/6Global Digital Elevation Map, asterweb.jpl.nasa.gov/gdem.asp7Shuttle Radar Topographic Mission, srtm.csi.cgiar.org/8landcover.usgs.gov/landcoverdata.php9due.esrin.esa.int/page_globcover.php

10Moderate Resolution Imaging Spectroradiometer visibleearth.nasa.gov/view.php?id=61004Michal Bodnar Open Data Sources for Disaster Management

www.naturalearthdata.comwww.diva-gis.orgwww.iscgm.orgwww.worldclim.comiridl.ldeo.columbia.edu/asterweb.jpl.nasa.gov/gdem.aspsrtm.csi.cgiar.org/landcover.usgs.gov/landcoverdata.phpdue.esrin.esa.int/page_globcover.phpvisibleearth.nasa.gov/view.php?id=61004


Application Cases


Human GIS Open Data Sources



Application Cases



Category Source Format Type ResolutionGeneral UNEP Geodata11 various vector/raster various

World Bank Data12 various textFAO GeoNetwork13 various vector/raster variousArcGIS Open Data14 SHP, JSON vector

Land Use Global Land Use15 ASCII, NetCDF raster variousBuldings

RoadsPOI

OpenStreetMap16 OSM, SHP, DBF vector

Transport Open Flights17 CSV textWorld Port Index18 SHP, PDF, MS Access vector/text

Gazetteers Geonames19 TXT text

11geodata.grid.unep.ch/12data.worldbank.org/13www.fao.org/geonetwork/14opendata.arcgis.com/15nelson.wisc.edu/sage/data-and-models/global-land-use/grid.php16www.openstreetmap.org/17openflights.org/data.html18http://msi.nga.mil/NGAPortal/MSI.portal?_nfpb=true&_pageLabel=msi_portal_page_62&pubCode=001519http://download.geonames.org/


geodata.grid.unep.ch/data.worldbank.org/www.fao.org/geonetwork/opendata.arcgis.com/nelson.wisc.edu/sage/data-and-models/global-land-use/grid.phpwww.openstreetmap.org/openflights.org/data.htmlhttp://msi.nga.mil/NGAPortal/MSI.portal?_nfpb=true&_pageLabel=msi_portal_page_62&pubCode=0015http://download.geonames.org/


Application Cases



UNEP (United Nations Environment Programme) Geodatadifferent types of data, such as freshwater, population, forests,emissions, climate, health and GPStogether more than 500 different variables being mappedboth spatial and non-spatialsearch can be done on national, subregional and regional level

taken from https://undg.org/wp-content/uploads/2015/01/logo_UNEP.png


https://undg.org/wp-content/uploads/2015/01/logo_UNEP.png


Application Cases



World Banktwo goals of World Bank:

1 end extreme poverty2 boost shared prosperity

World Bank often cooperates with humanitarian organizationsduring disastersdata include economic, health, climate, development, environmentand other sectorsa possibility to search data by country

taken from https://upload.wikimedia.org/wikipedia/en/1/11/World_Bank_Group_logo.png


https://upload.wikimedia.org/wikipedia/en/1/11/World_Bank_Group_logo.png


Application Cases



FAO GeoNetworkFood and Agriculture Organization of the United Nationsfree spatial data management systemprovides full range of GIS data (human and physical)also interactive maps monitoring situation in a concrete fieldpossibility to search for the data by country

taken from http://www.vectorsland.com/imgd/l29383-fao-logo-81263.png


http://www.vectorsland.com/imgd/l29383-fao-logo-81263.png


Application Cases



ArcGIS Open Datarun by ESRI, the leader in GIS innovations and software in theprivate sectoranyone can add his/her own datasets into the central repositorydownloadable in Shapefile (SHP) formatcurrently more than 32,000 datasets from almost 2,500 organizations

taken from http://files.isanet.org/Media/TitleMaps/2013TitleMap-IO.png


http://files.isanet.org/Media/TitleMaps/2013TitleMap-IO.png


Application Cases



OpenStreetMapthe most complete free, editable map of the worldvery high level of detailmobile, desktop and web-based version for volunteers to contributedata can be either digitized from underlying satellite images, orinput from GPS devices



Application Cases



How to download OSM data?OSM has 4 different data background layers: Standard, Cycle,Transport and Humanitariandownload in different ways:

servers storing huge amount of data to download via Planet.osmaextract a specific region directly from OpenStreetMap and thendownload to your GIS softwaremore information can be found of Wiki website of OSMb

ahttp://wiki.openstreetmap.org/wiki/Planet.osm#Country_and_area_extracts

bhttp://wiki.openstreetmap.org


http://wiki.openstreetmap.org/wiki/Planet.osm#Country_and_area_extractshttp://wiki.openstreetmap.org/wiki/Planet.osm#Country_and_area_extractshttp://wiki.openstreetmap.org


Application Cases


How much are the volunteerscontributing at this very moment?

Lets see.

http://osmlab.github.io/show-me-the-way/


http://osmlab.github.io/show-me-the-way/


Application Cases


Disaster GIS Open Data Sources

Category Source Format Type ResolutionGeneral HDX20 various vector/raster/text various

Humanitarian Response various vector/raster variousSEDAC Disaster Hotspots21 WMS, PDF vector/raster variousGlobal Seismic Hazard Map22 grid rasterNatural Disaster Hazards23 ASCII, DBF raster/textMapAction24 PDF mapHOT25 SHP, DBF, OSM vectorUNOSAT26 SHP, PDF vectorCopernicus27 GeoRSS, PDF, ... various

Earthquake USGS Earthquake28 various vector/raster variousHurricanes IBTrACS29 various vector/raster/text variousTsunami NOAA/WDC Tsunami30 CSV text20data.hdx.rwlabs.org21Socioeconomic Data and Applications Center sedac.ciesin.columbia.edu/data/collection/ndh22www.seismo.ethz.ch/static/GSHAP/23www.ldeo.columbia.edu/chrr/research/hotspots/coredata.html24http://www.mapaction.org/25hotosm.org26www.unitar.org/unosat27www.copernicus.eu28http://earthquake.usgs.gov/29 International Best Track Archive for Climate Stewardship /www.ncdc.noaa.gov/ibtracs/30National Oceanic and Atmospheric Association, http://www.ngdc.noaa.gov/hazard/tsu_db.shtmlMichal Bodnar Open Data Sources for Disaster Management

sedac.ciesin.columbia.edu/data/collection/ndhwww.seismo.ethz.ch/static/GSHAP/www.ldeo.columbia.edu/chrr/research/hotspots/coredata.htmlhttp://www.mapaction.org/hotosm.orgwww.unitar.org/unosatwww.copernicus.euhttp://earthquake.usgs.gov//www.ncdc.noaa.gov/ibtracs/http://www.ngdc.noaa.gov/hazard/tsu_db.shtml


Application Cases



HDX (Humanitarian Data Exchange)project by UN-OCHAthe most complete open humanitarian data repository in the worldin case of a disaster, this is the place to go to search for the data2700+ datasets, 244 locations, 570+ sources



Application Cases


Introduction to HDX

Source: https://www.youtube.com/watch?v=P8XDNmcQI0o


hdx.mpgMedia File (video/mpeg)

https://www.youtube.com/watch?v=P8XDNmcQI0o


Application Cases



Humanitarian OSM (HOT)applies the principles of open source and open data sharing forhumanitarian response and economic development.create free, up-to-date maps during a disaster (damage assessment,IDP camps monitoring...)in case of disaster, OSM Tasking Managers will publish the mappingtasks there will be need to work onvolunteers work both remotely and locally



Application Cases



UNOSATUNITARs Operational Satellite Applications Programmedelivering imagery analysis and satellite solutions to relief anddevelopment organizations within outside the UN systemGIS data, PDF maps, various reportsany organization can request for their help

taken from http://geospatialworld.net//Admincms/Filemanager/connectors/ashx/images/UNOSAT_UNITAR_Logo.jpg


http://geospatialworld.net//Admincms/Filemanager/connectors/ashx/images/UNOSAT_UNITAR_Logo.jpg


Application Cases



CopernicusEuropean system for monitoring the Earthproject coordinated by European Commissionsix thematics areas of focus, one of them is emergency managementsolutions to the policymakers by analyzing satellite data fromSentinel satellites and in-situ data from ground stationstwo main services: Mapping, Early Warning System

taken from http://www.magellium.com/wp-content/uploads/2015/08/Copernicus.png


http://www.magellium.com/wp-content/uploads/2015/08/Copernicus.png


Application Cases


Satellite Imagery Open Data Sources



Application Cases



UN-SPIDERUnited Nations Platform for Space-based Information for DisasterManagement and Emergency Responsecreated by UNOOSA (United Nations Office for Outer Space Affairs)mission: Ensure that all countries and international and regionalorganizations have access to and develop the capacity to use alltypes of space-based information to support the full disastermanagement cycle.serving as a bridge to connect the disaster management, riskmanagement and space communities

taken from http://www.unoosa.org/images/spider/UN-Spider.jpg


http://www.unoosa.org/images/spider/UN-Spider.jpg


Application Cases



gateway to space information for disaster management supportunifies all the resources (GIS, non-spatial, but mainly satellite data)into one place for easy use in disaster managementvarious filters when searching for data:

data typedisaster cycle phaseresolution (temporal, spatial)data accessibilityfile typesatellite/sensor and others ...



Application Cases





Application Cases



Organization Imagery Resolution Data typeCNES31 SPOT 1 m TIFF, XMLNASA32 EO-1 10 m GeoTIFF, HDF

ASTER 15 - 90 mTERRA, Aqua (MODIS) 250 m GeoTIFF, JPEGLandsat 1-8 15 - 120 m GeoTIFF, KML, WMS

ESA33 Sentinel-1 5 - 40 m TIFF, XML

31Centre national dEtudes Spatiales cnes.fr/en32National Aeronautics and Space Administration www.nasa.gov33European Space Agency www.esa.int


cnes.fr/enwww.nasa.govwww.esa.int


Application Cases



USGS Earth Explorera joint initiative by USGS (U.S. Geological Survey) and NASAopen digital imagery database systemprovides data from different NASA satellites (AVHRR, Landsat,ASTER, MODIS)elevation, land survey, vegetation monitoring ...not all the data is free



Application Cases


Non-spatial Disaster Open Data Sources

Category Source Type of DataInternational

organization GDACS34 reports, disaster alerts, social media

ReliefWeb35 situation reports, media monitoring, disaster monitoringHumanitarian Response36 3W/4W, assessments, needs reports, response plans

Volunteercommunities Humanity Road

37 social media monitoring

SBTF38 media monitoring, mapping, reportsinfo4disasters39 social media, response activations, ...

34http://portal.gdacs.org/35www.reliefweb.int36www.humanitarianresponse.info37humanitarianroad.org38http://blog.standbytaskforce.com/39info4disasters.org


http://portal.gdacs.org/www.reliefweb.intwww.humanitarianresponse.infohumanitarian road.orghttp://blog.standbytaskforce.com/info4disasters.org


Application Cases



GDACS (Global Disaster Alert and Coordination System)a joint initiative by United Nations and European Commission (EC)the goal is to fill the coordination and information gap in the firstphase after major disastersprovides alerts and impact estimations after major disasters througha multi-hazard disaster impact assessment service managed byEC-JRC (EC Joint Research Centre)discussion forum between disaster managers to exchange importantinformation through Virtual OSOCC account

taken from http://www.bt.cdc.gov/situationawareness/naturalhazards/Images/GDACS.jpg


http://www.bt.cdc.gov/situationawareness/naturalhazards/Images/GDACS.jpg


Application Cases



GDACS Satellite Mapping Coordination Systemallows experts to see which events are occured where and whichentity is working on which type of analysishorizonal coordination and reduction of duplication efforts

screenshot taken from https://gdacs-smcs.unosat.org/Michal Bodnar Open Data Sources for Disaster Management

https://gdacs-smcs.unosat.org/


Application Cases



Reliew Webproject by UN-OCHAthe leading source for reliable and timely humanitarian informationon global crises and disaster since 1996three types of information:

1 reports (analysis, appeals, assessment, situation reports)2 PDF maps (original maps, situation snapshots, infographics)3 data (assessment and financial data)

search available by country or by disaster



Application Cases



Humanitarian Responseproject by UN-OCHAcentral website for Information Management tools and services,enabling information exchange among operational responders duringeither a protracted or sudden onset emergency.complimented by country specific emergency sites which can be alsoaccessed from the same websiteit has a similar mission with ReliewWeb and UN-OCHA is workingon its merging in the future

taken from http://washcluster.net/wp-content/uploads/sites/5/2014/05/HR_Logo_April_2014_500px.pngMichal Bodnar Open Data Sources for Disaster Management

http://washcluster.net/wp-content/uploads/sites/5/2014/05/HR_Logo_April_2014_500px.png


Application Cases


Introduction to Humanitarian Response

Source: https://www.youtube.com/watch?v=OAzNjYtabuM


hr.mpgMedia File (video/mpeg)

https://www.youtube.com/watch?v=OAzNjYtabuM


Application Cases


Open Data Sources for Disaster Management

Type of Data Private institution International organization National organization Volunteer community

Climate Data LibraryGDEM

Physical GIS Diva-GIS ISCGM Global Map SRTM Natural EarthWorldClim USGS Land Cover

MODIS Global Land CoverGLOBCOVER

UNEP Geodata Global Land Use OpenStreetMapHuman GIS ArcGIS Open Data World Bank Data World Port Index Open Flights

FAO GeoNetwork GeoNamesSEDAC Disaster Hotspots

Humanitarian Response Natural Disaster HazardsDisaster GIS Global Seismic Hazard Map Copernicus HOT

UNOSAT USGS Earthquake MapActionHDX IBTrACS

NOAA/WCD TsunamiUSGS/NASA Earth Explorer

Satellite Imagery Digital Globe UN-SPIDER ESACNES

GDACS Humanity RoadNon-spatial Disaster GIS Relief Web SBTF

Humanitarian Response info4disasters



Application Cases

Table of Contents



3 Application Cases



Application Cases

Disaster Risk Preparedness



Application Cases

Disaster Monitoring



Application Cases

Disaster Response - Damage Assessment



Application Cases

Disaster Response - Help from the Crowd



Application Cases

Haiti Earthquake - Ushahidi initiative



Application Cases

Haiti Earthquake - OpenStreetMap

Source: https://www.youtube.com/watch?v=BwMM_vsA3aY


osm.mpgMedia File (video/mpeg)

https://www.youtube.com/watch?v=BwMM_vsA3aY


Application Cases

Nepal Earthquake - Tomnod



Application Cases

Nepal Earthquake - HOT



Application Cases

Conclusion

Data is everywhere.

We just need to learn how to use them effectively.



Application Cases

Thank You for Your attention!


Open DataOpen Data for Disaster Management

Open Data SourcesGIS dataSatellite ImageryNon-spatial disaster data

Application Cases

Open Data Sources for Disaster Management

Data & Analytics

Transcript of Open Data Sources for Disaster Management