PIs: Antonietta Capotondi , University of Colorado/NOAA Mike Alexander , NOAA
Jeff de La Beaujardière, PhD NOAA Data Management Architect
description
Transcript of Jeff de La Beaujardière, PhD NOAA Data Management Architect
Social, Political & Financial Issues Connecting Geodata in and
between Government AgenciesRemarks at GeoData panel, 2014-06-17
Jeff de La Beaujardière, PhDNOAA Data Management Architect
Chair, Environmental Data Management Committee
[email protected] +1 301-713-7175
Social Issues• "Not-invented-here" mentality when starting new projects• Poorly established methods of getting credit for datasets
vs published papers• Fear of having others get interesting research from your
data before you do• Fear of having research proven wrong• Laziness?• Standards are complicated, too general, or too specific to
a different purpose• Good DM practices often not part of employee job
descriptions or recognition methods2014-
06-
17
2
Political Issues• Government propensity for large commercial
contracts to solve IT problems• Too much focus on the initial customer• Failure to plan & budget in advance for data
management• Lack of consequences for poor planning• Tendency to form groups or start projects to address
entire data management life-cycle, rather than focusing on improvements to cross-cutting domains (e.g., discovery, metadata, access, preservation, etc.) and defining interfaces between them.
2014-
06-
17
3
Financial Issues• Tendency to spend all the money on the observing
hardware and too little on data management, analysis, & reusability
• Lack of resources to improve or retrofit existing systems
• Not taking an agency-wide view of all data production and management
2014-
06-
17
4
Recommendations• US:– Continue inter-agency coordination groups• and clarify their overlapping scopes
• Agency:– Make Programs & Program Managers responsible for proper
management of data they produce• Require that DM plans be written and followed
– Give credit to employees for good DM practices• Both via employee reviews and data citation metrics
• Technical:– Automate data management at the worker level– Give interoperable software stacks IT security pre-approval– Make use of Cloud Computing where relevant
2014-
06-
17
5
Conceptual Model of NOAA Big Data Partnership
2014-
06-
17
6
EarthObservations
EarthObservations
ModelOutputs
Agency Service Tier
Access ServicesCatalog
Metadata Formatting
agency security boundary
Customer 1 Customer 2 Customer 3
integration functions
analysis functions
mastercopy of data
agency-providedservices
network serviceprovider
commercial cloudprovider
working copy of data
application &product providers
$
customers
$
CustomProduct/App #1
CustomProduct/App #2
CustomProduct/App #3
$
maxim
um standardization
maxim
um diversity