EGRIS-1 E-infrastructure shared between Europe and Latin America Luciano Diaz ICN UNAM Mexico City,...
-
Upload
eduardo-longacre -
Category
Documents
-
view
222 -
download
5
Transcript of EGRIS-1 E-infrastructure shared between Europe and Latin America Luciano Diaz ICN UNAM Mexico City,...
EGRIS-1
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
Luciano Diaz
ICN UNAM
Mexico City, 24 October 2007
Hands on session: the AMGA Metadata Catalogue
E-infrastructure shared between Europe and Latin America
Configuration file
Create the configuration file for AMGA:$HOME/.mdclient.config
# Connection optionsHost = amga.ct.infn.itPort = 8822# User settingsPermissionMask = rwxGroupMask = r-xHome = /#Name=# Security optionsUseSSL = require # Values: require, try, no. If off, all options below are ignoredAuthenticateWithCertificate = 1 # Use certificate to authenticate# Certificates used for authentication: ... either normal certs#CertFile=/home/koblitz/.globus/usercert.pem#KeyFile=/home/koblitz/.globus/userkey.pem# ... or a grid proxy certificateUseGridProxy = 1# Use password instead of certificate to authenticate# Password = secret#VerifyServerCert = 1# If server certificates are verified, CA certificates need to be loaded:TrustedCertDir = /etc/grid-security/certificates# RequireDataEncryption = 0Login = NULL
EGRIS-1
E-infrastructure shared between Europe and Latin America
Access the Metadata Catalog
• Or copy a template of config file for the MDC and customize it:
$ cp $GLITE_LOCATION/etc/mdclient.config \
• Start up the Metadata Catalog Client with
$ mdclient
• Once logged in, you can list the available commands, typing help. Connected to amga.ct.infn.it:8822ARDA Metadata Server 1.2.0Query> help>> >help [topic]<>> >Displays help on a command or a topic.<>> >Valid topics are: help metadata metadata-optional directory entry
group acl index schema sequence user view ticket commands<
• Commands are grouped by topic. You can get the list of valid commands for each topic, typing: help [topic]
EGRIS-1
E-infrastructure shared between Europe and Latin America
AMGA: List of topics (HELP)
• Valid topics:– help – metadata – metadata-optional – directory – replication – entry – group – acl – index – schema – sequence – user – view – ticket – commands
EGRIS-1
E-infrastructure shared between Europe and Latin America
mdclient: Generic Commands
• Example: help entry>> createdir <path> [options] Make a new folder. It can inherit the schema assosciated to the upper level folder>> rm pattern Remove items corresponding to the given pattern>> link <file> Make a link to another file or to a external URL>> dir <directory> List the content of a directory>> listentries <directory> List the items (not the collections) of a directory>> stat <filepattern> Show the statistic information about a directory>> chown <file> <owner> Changhe the ownership of a file or a directory>> chmod <file> <rights> Change the access rights to a file or a directory>> rmdir <directory> Remove a directory>> dump <directory> Make a recursive dump startung from a given directory, (the default is: ‘/’)
EGRIS-1
E-infrastructure shared between Europe and Latin America
MDC directory related commands
• Browse the contents of a directory– dir [path] / ls [path]Returns the name of all subdirectories and files in the given path or in the current
directory if not specified
• Print the current working directory– pwd
• Change the current working directory– cd directoryExample: cd /gilda/
• Directory creation– createdir /parentdir/dirCreates the directory dir if it does not yet exist but parentdir already doesExample: createdir /gilda/tutorial/eelaMX/mexicoXX (XX=01…40)
• Directory removal– rmdir pathRemoves the directory given by path
EGRIS-1
E-infrastructure shared between Europe and Latin America
MDC: Handling attributes• Schema population
– addattr dir attr typeAdds a new attribute to the schema of a directory. Type is the name
of an SQL datatype which will translated (if necessary) into a data type understood by the back end DB.
Examples of valid datatypes are int, float, varchar(n), timestamp, text, numeric(p,s)
Examples:
• Attribute listing– listattr pathReturns a list of all attributes of the given file/direcory
• Attribute Removal– removeattr dir attributeRemoves an attribute from a directory if it is not used by any entry in
the directory
Query> addattr /gilda/tutorial/eelaMX/mexicoXX id intQuery> addattr /gilda/tutorial/eelaMX/mexicoXX name varchar(20)Query> addattr /gilda/tutorial/eelaMX/mexicoXX number float
EGRIS-1
E-infrastructure shared between Europe and Latin America
MDC: managing entries
• Entry creation– addentry entry (attribute value)Add a new entry and initializes some attributesExample:
• Setting attribute values– setattr entry (attribute value)Sets one or more attributes of an entry to given valuesExample:
cd /gilda/tutorial/eelaMX/mexicoXXaddentry file1 id 1 name 'Juan Perez' number 30.1addentry file2 id 2 name 'Miguel Benitez' number 20.11addentry file3 id 3 name 'Tomas Cruz' number 330.11addentry file10 id 10 name 'Bartolomeo Simpson' number 320.11addentries file20 file30
setattr /gilda/tutorial/eelaMX/mexico32/file20 id 20 name 'Julia Roberta' number 10.11setattr file30 id 300 name 'Beatriz Sanches' number 300.11setattr /gilda/tutorial/eelaMX/mexicoXX/file30 id 30 name 'Beatriz Sanchez'
EGRIS-1
E-infrastructure shared between Europe and Latin AmericaMDC: managing entries• Getting attribute values
– getattr pattern (attribute)Returns the entries and all the attributes for every file matching patternExample:
• Entry deletion– rm patternRemoves all entries matching patternExample:
getattr /gilda/tutorial/eelaMX/mexicoXX/file*0 name
addentries file40 file50rm file40rm file50
EGRIS-1
E-infrastructure shared between Europe and Latin America
Metadata Queries
– find pattern ‘query_condition’Returns all entries matching pattern for which query_condition
is trueExamples: Query> getattr * name>> file1>> Juan Perez>> file2>> Miguel Benitez>> file3>> Tomas Cruz>> file10>> Bartolomeo Simpson>> file20>> Julia Roberta>> file30>> Beatriz SanchezQuery> find ./file* 'like(name,"%a%")' >> file1>> file3>> file10>> file20>> file30Query> find ./file? 'like(name,"%a%")' >> file1>> file3
EGRIS-1
E-infrastructure shared between Europe and Latin AmericaMetadata Queries
selectattr attr... conditionReturns the values of given attributes for all files matching conditionExample:
Query> pwd>> /gilda/tutorial/eelaMX/mexicoXX/Query> selectattr .:name .:number 'id>10'>> Julia Roberta>> 10.11>> Beatriz Sanchez>> 30000.11
EGRIS-1
E-infrastructure shared between Europe and Latin America
Hands-on Session
Exercise:• Log into the Metadata Catalog• Create a directory with your surname into the
/grid/tutorial/eelaMX/mexicoXX directory• Add some attributes (id int, name varchar(32), remark
varchar(128)) to the directory just created• Add some entries, you may use any name or the LFNs you
uploaded and registered into the File Catalog during the DMS hands-on session
• Fill the attribute fields for the inserted entries• Look for the entries having ‘id’ > 50
EGRIS-1
E-infrastructure shared between Europe and Latin America
GILDA wiki pages
• Introduction to AMGA https://grid.ct.infn.it/twiki/bin/view/GILDA/AMGAHandsOn
• AMGA Advanced usage https://grid.ct.infn.it/twiki/bin/view/GILDA/AMGAAdv