Introduction environment, scripts, visualization, …

11
Introduction environment, scripts, visualization, …

Transcript of Introduction environment, scripts, visualization, …

Page 1: Introduction environment, scripts, visualization, …

Introduction

environment, scripts, visualization, …

Page 2: Introduction environment, scripts, visualization, …

Overview

• computer characteristics

• scripts and environment

• how to submit a job

• visualization

– frodo, edf, chagal, viewer

Page 3: Introduction environment, scripts, visualization, …

regatta IBM p690

system AIX 5.1

scheduler Loadleveler 3.1

compiler xlf

# of nodes 1

# of CPUs 32

processor 1.3 GHz power4

memory 2GB/CPU

Computer characteristics

Page 4: Introduction environment, scripts, visualization, …

host regatta

username wshop{xx}, {xx}=01,02,…,10

passwd wshop{xx}

HOME (29GB) /users/wshop{xx}

WORKDIR (700GB) /users/workdir/wshop{xx} ~/workdir

model compilationpack/

check ODB contentsOdbViewer/

TOVS_full/

bias correction calculationTOVS/

varpackVarpack/

calculate B-matrixJb/

scripts to run 3dvar3dvar/

~/workdir/ ~/workdir/Doc/

Page 5: Introduction environment, scripts, visualization, …

Submit a jobLoadleveler

• commands: – llsubmit: submit a job– llq, (upr): check running jobs– llcancel: cancel a job

• classes: big(8), medium(4), mono(1)• submit syntax: value=val llsubmit script• job header: #@ ll_command = value

Page 6: Introduction environment, scripts, visualization, …

#!/bin/ksh

#@ job_name = test#@ job_type = parallel#@ environment = COPY_ALL#@ output = out.$(job_name).$(jobid)#@ error = err.$(job_name).$(jobid)#@ notification = never#@ total_tasks = 4#@ class = medium#@ arguments = ${ARG}#@ queue

set –xecho ARG=${ARG}sleep 20exit 0

test.sh

Page 7: Introduction environment, scripts, visualization, …

submit the job:

$ ARG=3 llsubmit test.shllsubmit: The job “regatta.met.hu.79174” has been submitted.

$ llqId Owner Submitted ST PRI Class Running On--------------- ------- ---------- -- --- ------ -----------regatta.79174.0 wshop01 6/1 07:32 R 50 medium regattaregatta.79166.0 szepszo 6/1 06:36 R 50 big regatta

check running jobs:

$ llcancel 79174llcancel: Cancel command has been sent to the central manager.

cancel a job:

Page 8: Introduction environment, scripts, visualization, …

Visualization and related tools

• frodo: view file header and list of fields

• edf: dump a selected field to ascii

• chagal: visualize a field

• Viewer: check ODB content

Page 9: Introduction environment, scripts, visualization, …

frodo fafile INFO.fafile

edf namelist fafile ASCII.fafile

&NAML INFO=.T., LDAT=.T., VIEW=‘I’, TABCH(1)=‘S037TEMPERATURE’,/

Page 10: Introduction environment, scripts, visualization, …

***************************** INFO ***************************** (NOTE THAT X AND Y COORDINATES ARE RELATIVES AT TOTAL DOMAIN, FROM 1 TO NDLON, AND FROM 1 TO NDGL. TO HAVE THE REAL INDEX IN THE DATA ARRAY USE : INDEX = (Y-1)*NDLON+X .)

ARRAY SIZE ON X : 229ARRAY SIZE ON Y : 205 LON LAT X Y S037TEMPERATURESW : 2.18 34.00 1 1 289.6446491NE : 39.08 55.62 229 205 283.0028346MAXIMUM VALUES ON ARRAY : 303.1829368AT LON-LAT COORDINATES PT : 5.89 34.50AT X AND Y COORDINATES PT : 30 1MINIMUM VALUES ON ARRAY : 267.8150697AT LON-LAT COORDINATES PT : 7.84 45.99AT X AND Y COORDINATES PT : 57 104**************************************************************** LON LAT S037TEMPERATURE

2.1783 33.9958 289.6446491 2.3054 34.0157 290.4234711 2.4325 34.0353 291.3951976 2.5597 34.0548 291.5606389

Page 11: Introduction environment, scripts, visualization, …

chagal namelist gmeta

ctr fig.psidt

e.g.: ~/workdir/Visualize/namchagal.T

ODB viewer:

~/workdir/OdbViewer/

alex.par :

test.sql : sql query

Viewer –p alex.par odb_res.txt

parameter file (full path to ODB, name of sql file)