Metadata Creation and Validation Tools of the Trade.

28
Metadata Creation and Validation Tools of the Trade

Transcript of Metadata Creation and Validation Tools of the Trade.

Page 1: Metadata Creation and Validation Tools of the Trade.

Metadata Creation

and Validation

Tools of the Trade

Page 2: Metadata Creation and Validation Tools of the Trade.

Metadata ToolsSome available tools for metadata

creation, validation, and publication.

• CNS and MP“Chew ‘n spit,” checks and corrects structural errors, and “Metadata Parser”, which checks for errors in element compliance.

• Template tools CSC’s metaScribe create large numbers of similar records.

• ArcView Tools Extension for ArcView 3.x

ArcCatalog for ArcGIS 8.x

• TKMEText editor used for metadata entry.

Page 3: Metadata Creation and Validation Tools of the Trade.

TKME, CNS and MP are

FREE downloads!

http://geology.usgs.gov/tools/metadata

Page 4: Metadata Creation and Validation Tools of the Trade.

Tools of the TradeTKME - An editor for formal metadata, TKME is

intended to simplify the process of creating metadata that conform to the Standard.

- Hierarchical structure - Proper arrangement

Maintains:

of elements

Page 5: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade - How Tkme works

• “Add” element names from dropdown menu

When right side turns white, you know to input info (import, cut & paste, etc.)

Page 6: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade - How Tkme works

Help Menu:

- Version (how to use, helpful hints

- Element (definition of element)

- Output (final output look)

- Fonts (choose different fonts

Help Menu

Page 7: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade CNS

CNS (“Chew ‘n Spit”) - Pre-parser for formal metadata designed to help you convert records that cannot be parsed by mp, into records that can

Page 8: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade

Assumptions by CNS:

• The input_file has metadata elements identified by name which is the first alphabetic string of characters on the line. • CNS does NOT assume that you use underscores in the standard element names (i.e. Indentification_Information).

• You may use non-standard names (aliases) for standard elements and/or spaces (i.e. Spatial_Domain as Geographic Extent).

• NO indentation required

Page 9: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade - How CNS works

• Builds a “parse tree” based on your input_file

• Establishes parent/child relationships

• Creates leftovers and info_files

Page 10: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade – How CNS works

Options:

-v

-c config_file

-i info_file

-a aliases

-e leftovers

-o output_file

Usage

C:>\cns [options] input_file

Page 11: Metadata Creation and Validation Tools of the Trade.

Now it’s your turn. . . USER REVISION!!

You must compare the output files generated by CNS to your original input files, to determine if CNS properly transferred your

information.

Tools of the Trade - CNS

CNS should only be used where metadata are not properly indented or if the element tags happen to include numbers on them!

Page 12: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade - MP

MP (Metadata Parser) - A compiler to parse formal metadata, checking the syntax against the FGDC Content Standard for Digital Geospatial Metadata and generating output suitable for viewing with a web browser or text editor.

Options:-c config-file-l language-code-e error-file -t text-file-h html-file-f faq-file-s sgml-file-x xml-file-d dif-file-fixdoc

UsageC:>\mp [options] input_file

Page 13: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade – How MP works• C:>\mp [options] input_file (Note- input_file for MP = .out file from CNS)

• MP generates error_file and the output format you specify (.txt, .html, .xml, etc.)

Page 14: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade – How MP works

Correcting Errors Generated with MP

• All errors must be fixed in the original metadata record (warnings don’t count)

• Errors output in numbered list – how to locate these in your record?

• Open DOS window and edit the file

• View the CNS output file, “Find” in WordPad

• Use a text editor (Ultra Edit, Crimson Editor) open .err file and input file

• ESRI software

• Fix errors, run through MP again

Page 15: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade - MP

• Text -t tfile

• HTML -h hfile

• FAQ/HTML -f ffile

• SGML -s sfile

• XML -x xfile

• DIF -d dfile

Output Command

Page 16: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade - MP

Examples of commands for MP:

1. mp charts.met –e charts.err

• A report of errors is written to the file charts.err

2. mp charts.met –e charts.err –h charts.html

• In addition to the error file charts.err, an outline style HTML page is created called charts.html

Page 17: Metadata Creation and Validation Tools of the Trade.

Example of HTML style page created by MP

Page 18: Metadata Creation and Validation Tools of the Trade.

Example of FAQ-style HTML page created by mp Remember “Metadata in Plain Language”. . . ?

Page 19: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade

Diagram of MP’s function

- Peter Schweitzer, USGS

Page 20: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade

NOAA’s CSC: ArcView® Metadata Collector v2.0 Extension

Page 21: Metadata Creation and Validation Tools of the Trade.

Tool Time

The ArcView® Metadata Collection Tool was developed by CSC in ArcView

using Avenue® scripting language. This tool collects and compiles FGDC-

compliant metadata for ARC/INFO coverage's, shapefiles, grids and

supported image formats.

NOAA CSC ArcView ® Metadata Collector

http://www.csc.noaa.gov/metadata/text/download.html

Page 22: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade

ESRI’s

ArcGIS 8.x:

ArcCatalog

Page 23: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade

• Intergraph’s MP Batch

Check multiple records at one time for CNS and MP compliance

http://imgs.intergraph.com/smms/default.asp

• SMMS Metadata Software

Variety of metadata tools (but it cost)

http://www.intergraph.com/gis/support/ > Free Utilities/Tools

Page 24: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade

http://www.nature.nps.gov/im/units/mwr/gis/metadata/metadata_tools.htm

• NPS Metadata Tools/Extensions - ArcGIS

• ESRI Metadata Customizations

http://imgssupport.intergraph.com/Tools.asp

- ArcCatalog extension; 5 new buttons (Mp, editor, organizational, input/export capabilities)

- Spell checker: understands element names, underscores

- Advanced synchronization: turn on/off different sections so it’s not “automatically updated” (Entity & Attributes)

Page 25: Metadata Creation and Validation Tools of the Trade.

Tool Time NOAA CSC’s MetaScribe

• A template driven tool created to reduce the labor required to produce FGDC compliant metadata

• Used for large data sets that have similar content and very few fields changing from one record to the next

http://www.csc.noaa.gov/metadata/metascribe/

Page 26: Metadata Creation and Validation Tools of the Trade.

Tool Time Creating this template using MetaScribe,

would produce this data page.

Page 27: Metadata Creation and Validation Tools of the Trade.

Tools of the Trade

http://www.fgdc.gov/standards/status/textstatus.html

• NBII Biological Data Profile

• Remote Sensing Extension

FGDC Profiles and Extensions to the CSDGM

• Shoreline Data Profilehttp://www.csc.noaa.gov/metadata/shoreline_profile.html

http://www.fgdc.gov/standards/status/sub5_2.html

http://www.fgdc.gov/standards/status/csdgm_rs_ex.html

http://www.fgdc.gov/standards/status/sub5_6.html

http://www.nbii.gov/datainfo/metadata/standards/index.html

Page 28: Metadata Creation and Validation Tools of the Trade.

Kim OwensNOAA National Ocean Service

[email protected]

www.csc.noaa.gov/metadata/