Climate Data Lake: Empowering Citizen Scientists in Acadia National Park

1© Copyright 2013 Pivotal. All rights reserved. 1© Copyright 2013 Pivotal. All rights reserved.

Climate Data Lake: Empowering Citizen Scientists in Acadia National Park

Srivatsan RamanujamPrincipal Data Scientist, Pivotal

@being_bayesian

John CardenteDistinguished Engineer/Lead Data Scientist, EMC

@johncardente

19-Feb-2015


Climate Change is happening

Source: NASA

3© Copyright 2013 Pivotal. All rights reserved.Source: National Geographic

At the Ice Caps…

From Chasing Ice

by James Balog

4© Copyright 2013 Pivotal. All rights reserved.

And in the

Oceans…


Weather is Nature’s clock


And the clock is shifting

Source: EPA


English Oak Winter Moth Pied Flycatcher

Both et al. 2006 Nature

EARLIER SAME TIME

EACH YEAR

Disrupting species interactions


…the study of the timing of recurring plant and animal life-

cycle stages, or phenophases, and their relationship to

environmental conditions.

Phenology

Source: USA National Phenology Network


Acadia National Park

Source: Wikipedia

A key phenology

observation point


Citizen Science, the “Hadoop” of Phenology


Challenges impeding scientific progress

A multitude of disparate data sources

Different approaches to data conditioning

Different analysis platforms and scripts

Inconsistent data treatment distracts the

scientific debate from the findings!


Challenges to encouraging citizen science

Different infrastructures for data collection

Unable to see how contributions help science

Inability to analyze the data and collaborate with scientists

Missing a feedback loop to encourage and

engage citizen scientists


EMC Federation teams up with Earthwatch


Objectives

• Authoritative, curated data repository

• Shared analysis platform and software libraries

• Web portals to

– Show citizen scientists how contributions benefit science

– Present data visualization and exploration tools

– Provide access to data sets for volunteer analysis

– Offer common data collection APIs and interfaces

– Host forums to interact with leading scientists


Climate Data Lake

PL/X

Hadoop++

Data

Data Lake Foundation

Explore

CloudFoundry

Collect

Isilon ECS


The kick-off expedition at Acadia


Post kick-off activities

• Established partnerships with data providers

• Stood up initial Data Lake platform

• Active collaboration across all participants on data

conditioning, analysis, feature selection, and visualization

• Launching an initial web presence in March


What’s next

• Pursuing the “full vision” using Federation Technologies

• Talking with other potential corporate sponsors

• Exploring ways to expand support to other climate and

academic projects


Learn More

• White House Press Release:

Harnessing Climate Data to Boost

Ecosystem & Water Resilience

• Pivotal Blog: Pivotal Data Science

Looks at Climate Change @ Acadia

NP

• EMC Reflections Blog: Big Data vs.

Climate Change

BlogsEMC TV video

http://youtu.be/VBeZl7fdoYQ

http://youtu.be/VBeZl7fdoYQ

http://www.whitehouse.gov/sites/default/files/microsites/ostp/cdi-ecosystems-12-9.pdf

http://blog.pivotal.io/data-science-pivotal/case-studies-2/from-sea-to-trees-pivotal-data-science-looks-at-climate-change-in-acadia-national-park-day-4-final-day-field-report

http://reflectionsblog.emc.com/2014/12/big-data-vs-climate-change/


The Team

@alyssacaddle1

@stevendozen

@johncardente

@lilewite

@being_bayesian

@maryanngarwood

@emctv

@TheMatthewNolan

@johnnysuire

@sriauggie31

@earthwatch_org

@schoodicinst

@hwschoodic

+ many more (not on twitter ) !

Climate Data Lake: Empowering Citizen Scientists in Acadia National Park

Data & Analytics

Transcript of Climate Data Lake: Empowering Citizen Scientists in Acadia National Park