Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and...

19
Introducton to GEM and Overview of OpenQuake soſtware Paul Henshaw, GEM Foundaton

Transcript of Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and...

Page 1: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

Introducton to GEM and Overview of OpenQuake software

● Paul Henshaw, GEM Foundaton

Page 2: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

Date of great quake

Earthquakes from Bilham (Science, 2006)Population from Landscan (Oak Ridge Nat. Lab., 2004)

A millennium of great earthquakes

Page 3: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

2011 LandscanPopulationdensity

1900-2009 ISC-GEMEarthquake Catalog

Bogota

Page 4: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

Global Earthquake Model● Public - Private partnership to provide:

– global models of earthquakes and their consequences– tools and data to advance the science of seismic risk

assessment● Internatonal projects with leading experts

● Regional collaboraton with local experts

● Open Source software development

Page 5: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Components and Status● OpenQuake platform

– Web-based access to data, models and tools

– Work in progress, v1.0 release end 2014● OpenQuake engine

– Calculate seismic hazard and physical risk

– v1.0 released in June 2013

– Development contnues● OpenQuake desktop tools

– Prepare input models for OpenQuake engine

– Early stages of development, v1.0 release end 2014

Page 6: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Component Interacton

Page 7: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Community Interacton

Page 8: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

● Web based, built on GeoNode, PostGIS, Django, TileStream

● Find, explore and visualize existng data and models

● Download data, models, and tools

● Filter, combine and share Maps

● Contribute using online capture tools

● Share results with community

● REST APIs for integraton with desktop tools and engine

● Local platforms installatons also possible

OpenQuake Platform Overview

Page 9: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

Populaton and Dwelling Fractons

Page 10: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Platform: Custom Map

Page 11: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Platform: Contribute Data

Page 12: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Engine Overview● Seismic Hazard and Physical Risk calculatons

– Classical PSHA, event-based, disaggregaton, scenario

– Model epistemic uncertainty via logic trees● Contnental and global scale calculatons (SHARE, GEAR)

● Ubuntu Linux 12.04 on laptop, VM, server, cluster

– Red Hat / CentOS coming soon

– 'Engine-lite' for (single machine) Windows & Mac planned● REST API and Platform Web interface in progress

– Integraton with platform and desktop tools

Page 13: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Engine Infrastructure

● Engine and library code written in Python (plus C extensions)

● Using Celery, RabbitMQ to distribute tasks across CPUs/nodes

● Rewrote hazard library to reduce RAM consumpton

● Inputs and results stored in PostgreSQL + PostGIS

Page 14: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

Web UI for Calculatons (WIP)

Page 15: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Desktop Tools Overview

● Python libraries for scientfic developers

– oq-eqcatalogue-tool can be used as independent library● Graphical User interface (QGIS Plugin / QT applicaton)

– Connect to platform to download / upload data

– Load (local) event catalogue, visualize events

– Exposure import/export, visualize exposure data

– Vulnerability and Fragility: curve display, match to exposure

– Connect to engine to run jobs and view results

– Social Economic Vulnerability and Integrated Risk

Page 16: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Prototype Desktop Tools

Page 17: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Development Philosophy● OpenSource is not just a license

– All contributons visible on github.com and reviewed by at least one other developer

● Collaboraton with Scientfic Staf

– Key for requirements gathering, QA testng and code review● Test-driven

– Unit tests (nose+mock), QA tests, performance monitoring

– Contnuous integraton (Jenkins)● Agile

– Daily Scrum developer meetngs, 4-6 week Sprints

Page 18: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

OpenQuake Licensing● Open Source Software license: AGPL v3.0

– Transparency a key issue for public and private sector sponsors

– Facilitates collaboraton, defect identficaton

● Creatve-Commons Data license: CC BY-SA-NC v3.0

– Data re-released without 'NC' clause after 18 months

– Data licensing subject of much discussion (confusion?)

– Key issue for data contributors, users and sponsors

– Many community members not familiar with implicatons

Page 19: Introducton to GEM and Overview of OpenQuake software · 2018. 11. 15. · Introducton to GEM and Overview of OpenQuake software ... – Daily Scrum developer meetngs, 4-6 week Sprints.

More Informaton

http://www.globalquakemodel.org