Open Data and Open Source Software

Open Data and Open Source Software

@Finnish Meteorological Institute

Finnish Meteorological

Institute opened its data

12/2/2016 2

FMI Open Source Software

https://en.ilmatieteenlaitos.fi/open-data

FMI starts to open it’s

software

2013 2016

Open Source Software @ Finnish Meteorological

Institute | Roope Tervo, Mikko Visa


Finnish Meteorological Institute opened its data in 2013.

Basically everything that FMI has property rights was opened.

Data is provided in freely in machine readable format.

12/2/2016 3

FMI Open Data





Data set Description Time

Interval

Estimated

publish date

Weather

Observations

Temperature, Wind,

Humidity, Ground

Temperature…

10 min Open,

older data to be

added

Weather forecast

model HIRLAM RCR

Point forecasts and grid

dataLatest

model run

(4 times a

day) 0…54

h

Open

Aviation Observations METAR 30 min open

Weather Radars Precipitation Rate,

Precipitation Amount…5 min Open,

older data to be

added

Lightning Thunder Strikes in

Finland5 min Open

Some Example Data Sets

12/2/2016 4Open Source Software @ Finnish Meteorological


FMI Open Data Portal follows INSPIRE requirements.

FMI Open Data Portal

Meta dataServices

The very same data portal works as Open Data and

INSPIRE portal.

12/2/2016 5

ISO19115 WFS WMS

CSW

Grid SeriesObservations

Time SeriesObservations

Data Models O&M

SimpleFeature

GRIBNetCDF GeoTiff



Registration

o Registration is required to use View and Download Services

o Working email address is the only mandatory information

o After registration the user gets an API key which have to be added into all requests

o GET parameter fmi-apikey=…&

o Header fmi-apikey; …

o Part of url http://wms.fmi.fi/fmi-apikey/…/wms?

o One can create several API keys with one email



Usage Limits

With one API key it’s allowed to

o do at most 20 000 requests per day to Download Service

o do at most 10 000 requests per day to View Service

o do at most 600 requests per 5 minutes to both services

o If all observations from one time step is calculated to as one, little over 17 000 new data sets are published daily

o So, with one API key it’s allowed load everything once

o View service can be used for testing but can not be used as a back end for popular clients



Finnish Meteorological

Institute opened its data

12/2/2016 8

FMI Open Source Software


FMI starts to open it’s

software

2013 2016




12/2/2016Open Source Software @ Finnish Meteorological

Institute | Roope Tervo, Mikko Visa9

FMI Open Data

Portal & FMI

INSPIRE Data

Services

Backend for

clients’ web

services

Integration to

clients’

systemsBackend for

mobile

applications

Backend for

FMI Client

Services

Backend for

FMI public

pages

• Basis of FMI product generation

SmartMet Server

Why Open Source Software

• Increase appropriability of weather and climate data

• Boost product development of the software

• Streamline collaboration with partners

• Support research activities

• Support companies



What

• SmartMet Server in 2016

• About 30 different software under review

• Open source is the baseline…

• … but every software is considered

separately

• How easy the software is to isolate from

production system?

• Is the project vital? Is the software still

developed and maintained?

• Does the software potentially benefit

someone?



License

• MIT license is recommended for all FMI

OSS…

• …but every license is considered

separately.• For example, other members of the project

and/or used third party projects may require some specific license.

Commercial Use

Distribution

Modification

Private Use

License and Copyright Notice required



Potential Users

• Other National Meteorological Services and international

agencies (ECMWF, EUMETSAT…)

• Other environmental agencies

• Environmental companies

• Private developers



Policies and Guidelines

• Source code and documentation in

GitHub: https://github.com/fmidev

• Small contributions with pull requests

• In larger contributions, implementation

plan is recommended (in GitHub wiki)

• CLA (Contributor Licence Agreement) will

be required

• Documentation in GitHub



https://github.com/fmidev

Hands-on?

Follow:


https://facebook.com/fmibeta

New releases will be updated here





Hands-on?

Open Right Now

https://github.com/fmidev/metolib

JavaScript library to request and use FMI open data

https://github.com/fmidev/openlayers-animation

OpenLayers extension to create WMS animations

https://github.com/fmidev/metoclient-ui

Example UI based on MetOLib and OpenLayers Animation



https://github.com/fmidev/metolib

https://github.com/fmidev/openlayers-animation

https://github.com/fmidev/metoclient-ui

www.fmi.fi

http://ilmatieteenlaitos.fi/avoin-lahdekoodi




http://roopetervo.com

http://www.slideshare.net/tervo





http://roopetervo.com

http://www.slideshare.net/tervo/

Open Data and Open Source Software

Documents

Transcript of Open Data and Open Source Software