LBA-DIS Working Group Report

17th LBA Science Steering Committee Meeting

Belém, PA

June 2 - 4, 2005

Laurindo Campos, Luiz Horta, Merilyn Gentry & Peter Griffith

LBA DIS WG Topics

• DIS Activities 2004-2005

• Data Registration / Archive Status

• Data Registration status for EU and BR teams

• System Updates

Activities 2004-2005

Activities Strengthening LBA offices H/S infrastructure

Beija-flor and Metadata Editor Training classes , Rio Branco-AC, Ji-Paraná-RO (Nov/2004) and Belém-PA (May/2005) – Next Manaus-AM (August/2005)

Converted all programs accessing MS SQL Server from .asp to .php move towards migration to non-proprietary Operating System such as Linux.

LBA Web Page – Redesign and Mirror Sites

Activities Integration of Reference Manage (LBAECO) with

INPA’s Library System

Plan is on the way to install “The Scheduler” at LBA Central Office

LBA-DIS and SIPAM, setup meetings to plan Metadata Integration.

Data Registration (Status)

LBA Data Registration Status

LBA Overall Status:Metadata Registered in Beija-flor

260

40

0

62

8

118

63

133

83

152

80

231

92

325

100

379

207

413

211

418

211

469

215

538

217

633

217

0

100

200

300

400

500

600

700

06/99 01/00 06/00 10/00 02/01 05/01 11/01 05/02 11/02 05/03 11/03 05/04 11/04 06/05

# of data sets registered

# of posters registered

N=850

17.7%Increase

in metadata data sets

LBA Overall Status:Data Volume Archived at LBA-DIS / CPTEC

4.00.50.614.88.71.1

69.0

8.91.2

89.1

18.71.5

120.5

20.11.5

210.6

22.1

1.7

322.1

22.3

1.5

0

50

100

150

200

250

300

350

Gig

abyt

es

11/01 11/02 05/03 11/03 05/04 11/04 06/05

Unrestricted Data

Restricted Data

Posters

52.9 %increase

in data sets

LBA Component Status

124

45

23

25

38

10

4

2

507

22

21

29

0 100 200 300 400 500 600 700 800

BR-US

BR-EU

BR

Pre-LBA / Other

Data Sets with data available 507 22 21 29

Data Sets w/o data 38 10 4 2

Posters 124 45 23 25

BR-US BR-EU BR Pre-LBA / Other

Con

N=48

N=77

N=669

N=56

Data Registration Details

1- Substantial increase in data archived at the LBA-DIS server was mainly due to: * 44.9 Giga bytes : Landsat Orthorectified ETM+ data for the time period ca. 2000 * 3.2 Gbytes : Hyperion data * 2.63 Bbyes : PC-02 data

2- The emphasis has been on registering data sets over registering posters, per se. We are encouraging data providers to archive their posters and add them as supporting information to the metadata for the actual data to which they are related, rather than registering the posters as independent Beija-flor entries. This will result in a relatively small increase in the number of "Posters registered", compared to the volume of the storage under the /lba/posters

Data Registration/Archive Performance of EU and BR teams

• DIS group has fixed broken links of several metadata records.

• Contacted each of the non-contributing Brazilian and European/BR teams to acquire data; several teams already complied! Last email requesting data sent on May 06, 2005.

• Plan for next 6 months:

• Continue analysis of data in archive but not registered -- theory is that much of the “missing” EU/BR & BR data is archived but not registered

Data Archived but Not Registered

Huge task in progress!!

1. Develop a method to cross-reference [hundreds of] data directories in archive with entries in Beija-flor

2. Record these findings in a “data tracking system”

• Link the B-f registered data sets with corresponding archive directories

3. Identify the archive directories that aren’t represented in Beija-flor – who? what? when? where? …

4. Register the “found” data

System Updates• Disk space added to LBA server in July 2004; as of

May 30, 2005 there are ZERO bytes available for new data. – In 2004 the LBA-DIS group @ CPTEC submitted the

2005 budget which included additional disk space for the LBA Server.

– 1 Terabyte of disk space was requested in January 2005 AFTER an extensive study of new technologies that could be used (DAS, EVA, NAS, SATA, etc). Several vendor called to CPTEC to check the LBA server and advise on disk storage hardware.

– DVD with about 4.2 Gbytes received from LC-02 on May 18 will be put on-line when more storage becomes available. Also LC-02 data that was in the process of being submitted via FTP had to be stopped until more disk space becomes available.

1- Email received by DIS on May 30, 2005 about new data coming to the LBA server via FTP

2- Email sent on May 30, 2005

3- Email from DIS asking the PI tostop sending data via FTP untilmore disk space becomes available(almost 4 Giga bytes received).

System Updates (cont)

• IAI has implemented a Beija-flor like system which is 100% compatible with LBA, thus allowing us to share data. LBA has a development site with IAI as a data sources.

• Renata, the LBA Data Coordinator person, resigned on May 6 because of a better job offer. Rosely Aparecida da Silva was hired on May 11 to replace Renata (5 candidates were interviewed).

System Updates (cont)

• CEOP updates: several LBA files have been posted in the CEOP site. BUT we are still behind sending the full set of CEOP3/4 data files.

Thanks to

Amy Morrell – Nasa GoddardChris Lindsay - ORNL Larry Voor - ORNLLisa Wilcox – Nasa Goddard Luciano Ferreira – INPAMarcelo Augusto – CPTEC Rubens Pinto – INPATim Rhyne - ORNL