GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )
-
Upload
clarence-page -
Category
Documents
-
view
221 -
download
0
Transcript of GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )
![Page 1: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/1.jpg)
GAME-T Data Management Report
AGATA, Yasushi Univ. of Tokyo, Japan
( )
![Page 2: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/2.jpg)
Significance of Data Management
• Collecting and Sharing data is crucial for hyd romet research
• Information on all dataset should be located in the same place
• DB with ‘User-friendly’ interface helps researchers
![Page 3: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/3.jpg)
Then, where is GAME-T Dataset?
• Published by using WWW technology.
• In Japan (Univ. of Tokyo):http://hydro.iis.u-tokyo.ac.jp/GAME-T/
• In Thailand (NRCT): NEW!http://game-t.nrct.go.th/GAME-T/
• They are always ‘mirrored’
![Page 4: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/4.jpg)
GAME-T Dataset Contents• Routine Observations
– Weather / River discharge etc.– By various countries in SE Asia
• Field Observations– Flux / Radiation / Rainfall etc.
• Upper Air Observations– Sonde / Lidar / Wind Profiler / GPS etc.
• Quicklook images and maps• Documents
![Page 5: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/5.jpg)
How Datasets are being collected? [1] Routine Obs.
• ‘3 tier’ system
Original (Raw) FilesVarious Format
GovernmentalAgencies on Weather/River Observation
DB Manager
‘Gateway’ Persons of GAME-T
Adding Info./Format Conv.
DB
![Page 6: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/6.jpg)
How Datasets are being collected? [2] Intensive (GAME-T) Obs.
• Researchers send files to DB manager
Original (Raw) FilesVarious Format
Each Researcher
DB Manager
Adding Info.(No Format Conv.)
DB
![Page 7: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/7.jpg)
GAME-T Dataset
![Page 8: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/8.jpg)
Characteristics
• Richness in not only intensive measurements by researchers
but also routine (operational) observation by official agencies from various countries
![Page 9: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/9.jpg)
Routine Obs. Stations
![Page 10: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/10.jpg)
Original (Raw) Files• Media
– More than 100 FD, CD-R, ZIP, MO, DVD-R, DLT...– On-line publication– E-mail attached
•GAME-T Member can view contents of each disk (Password Needed)
![Page 11: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/11.jpg)
Recent Achievement [1]• CD-ROM published
– Complete ‘Snapshot’ of GAME-T database at June 2002.
– Contains more than 8000 files (620MB)
– Please take one!
![Page 12: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/12.jpg)
Recent Achievement [2]• New DB Server
was installed in NRCT, Thailand– Maintained by N
RCT’s staff– Contents are the
same as that of Univ. of Tokyo’s Server (rsync)
http://game-t.nrct.go.th/GAME-T/
![Page 13: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/13.jpg)
New Contents (after CD-ROM)• ORIGINAL DATA FILES :
GAME-T members can now view their contents originally provided by researchers and/or agencies– Total size is now more than 4GB
• 0.1 deg DEM of ChaoPhraya River– Also 0.1deg river direction data is now being pre
pared– For 0.1deg LSM study (tomorrow’s presentation)
![Page 14: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/14.jpg)
0.1deg DEM of ChaoPhraya River,
Thailand
![Page 15: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/15.jpg)
Size of Files• 3.4GB out of 4.1GB is original files
– Original files sometimes contain huge data files
Original Files 3.4GB
Field Obs 0.3GB Routine Obs 0.25GB
Total : 4.1GB
![Page 16: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/16.jpg)
• NUMBER: 7464 out of 12790 are routine files.– DB manager divided all files so that
each file contains one-year one-station data in the same format
Number of Files
Routine Files 7464
Original Files 2056Remote Sensing 1679
Total : 12790
![Page 17: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/17.jpg)
Access Count• Total Pageview to date=92909
GAME-T Datacenter (Tokyo) Access Count
0
2000
4000
6000
8000
10000
12000
14000
16000
18000
2000
/06
2000
/08
2000
/10
2000
/12
2001
/02
2001
/04
2001
/06
2001
/08
2001
/10
2001
/12
2002
/02
2002
/04
2002
/06
2002
/08
Month
To
tal P
ag
ev
iew
0
100
200
300
400
500
600
700
800
900
Un
iqu
e IP
Total Pageview
Unique IP
Pageview
Unique IP
Max. at 2002Aug.Pageview=16309UniqIP=704
![Page 18: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/18.jpg)
GAME-T Datacenter (Tokyo) Access Count
024
68
101214
161820
2000
/06
2000
/08
2000
/10
2000
/12
2001
/02
2001
/04
2001
/06
2001
/08
2001
/10
2001
/12
2002
/02
2002
/04
2002
/06
2002
/08
Month
Un
iqu
e I
P f
rom
Th
ail
an
d
0
100
200
300
400
500
600
700
800
900
Un
iqu
e IP
Access from Thailand
From Thai
Unique IP
Max at 2002Aug.UniqIP=704From Thai=18
![Page 19: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/19.jpg)
Conclusion• GAME-T(1)’s achievement :
– ‘Human network’ for data collection– Data publication and sharing system.
• Data collection / publication activities continue also in GAME-T(2)
• CD-ROM and distributed DB server offers easier access to GAME-T data files.
• New data files were/will be created– For new generation study
![Page 20: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/20.jpg)
Need latest info?• GAME-T ML (see hyperlink in the DB)
– Monsoon-ML(English/Thai) : BY Prof. Hashizume, Chulalongkorn Univ.
– GAME-ML(Japanese)By Univ. of Tokyo
• DB Manager : [email protected]• We welcome your comment and data r
equests!
![Page 21: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/21.jpg)
Acknowledgement
• GAME-T DB has been helped by – all who provided us their precious data, i
ncluding both official agencies in SE Asia countries and GAME-T researchers
– All who used the DB and gave comments
• New DB server in Thailand was installed with NRCT’s support. The server is now maintained by NRCT.
![Page 22: GAME-T Data Management Report AGATA, Yasushi Univ. of Tokyo, Japan ( )](https://reader035.fdocuments.us/reader035/viewer/2022062518/5697bf8e1a28abf838c8c9fb/html5/thumbnails/22.jpg)
THANK YOU!