Jeff de La Beaujardière, PhD NOAA Data Management Architect

7
Social, Political & Financial Issues Connecting Geodata in and between Government Agencies Remarks at GeoData panel, 2014-06-17 Jeff de La Beaujardière, PhD NOAA Data Management Architect Chair, Environmental Data Management Committee [email protected] +1 301-713-7175

description

Social, Political & Financial Issues Connecting Geodata in and between Government Agencies Remarks at GeoData panel, 2014-06-17. Jeff de La Beaujardière, PhD NOAA Data Management Architect Chair, Environmental Data Management Committee [email protected] +1 301-713-7175. - PowerPoint PPT Presentation

Transcript of Jeff de La Beaujardière, PhD NOAA Data Management Architect

Page 1: Jeff de La Beaujardière, PhD NOAA Data Management Architect

Social, Political & Financial Issues Connecting Geodata in and

between Government AgenciesRemarks at GeoData panel, 2014-06-17

Jeff de La Beaujardière, PhDNOAA Data Management Architect

Chair, Environmental Data Management Committee

[email protected] +1 301-713-7175

Page 2: Jeff de La Beaujardière, PhD NOAA Data Management Architect

Social Issues• "Not-invented-here" mentality when starting new projects• Poorly established methods of getting credit for datasets

vs published papers• Fear of having others get interesting research from your

data before you do• Fear of having research proven wrong• Laziness?• Standards are complicated, too general, or too specific to

a different purpose• Good DM practices often not part of employee job

descriptions or recognition methods2014-

06-

17

[email protected]

2

Page 3: Jeff de La Beaujardière, PhD NOAA Data Management Architect

Political Issues• Government propensity for large commercial

contracts to solve IT problems• Too much focus on the initial customer• Failure to plan & budget in advance for data

management• Lack of consequences for poor planning• Tendency to form groups or start projects to address

entire data management life-cycle, rather than focusing on improvements to cross-cutting domains (e.g., discovery, metadata, access, preservation, etc.) and defining interfaces between them.

2014-

06-

17

[email protected]

3

Page 4: Jeff de La Beaujardière, PhD NOAA Data Management Architect

Financial Issues• Tendency to spend all the money on the observing

hardware and too little on data management, analysis, & reusability

• Lack of resources to improve or retrofit existing systems

• Not taking an agency-wide view of all data production and management

2014-

06-

17

[email protected]

4

Page 5: Jeff de La Beaujardière, PhD NOAA Data Management Architect

Recommendations• US:– Continue inter-agency coordination groups• and clarify their overlapping scopes

• Agency:– Make Programs & Program Managers responsible for proper

management of data they produce• Require that DM plans be written and followed

– Give credit to employees for good DM practices• Both via employee reviews and data citation metrics

• Technical:– Automate data management at the worker level– Give interoperable software stacks IT security pre-approval– Make use of Cloud Computing where relevant

2014-

06-

17

[email protected]

5

Page 6: Jeff de La Beaujardière, PhD NOAA Data Management Architect

Conceptual Model of NOAA Big Data Partnership

2014-

06-

17

[email protected]

6

EarthObservations

EarthObservations

ModelOutputs

Agency Service Tier

Access ServicesCatalog

Metadata Formatting

agency security boundary

Customer 1 Customer 2 Customer 3

integration functions

analysis functions

mastercopy of data

agency-providedservices

network serviceprovider

commercial cloudprovider

working copy of data

application &product providers

$

customers

$

CustomProduct/App #1

CustomProduct/App #2

CustomProduct/App #3

$

maxim

um standardization

maxim

um diversity

Page 7: Jeff de La Beaujardière, PhD NOAA Data Management Architect

backup slides

2014-

06-

17

[email protected]

7