KMA System Upgrade

Korean Meteorological Administration

KMA System UpgradeKMA System Upgrade

2005. 9. 14 Korea Meteorological Administration

Dong-il Lee ([email protected])Korean Meteorological

Administration

CAS2k5


List of contents

1. History OF NWP Model and System at

KMA

2. Plan of NWP Model Development

3. 1st supercomputer system

4. 2nd supercomputer system

5. Issues and Plan

6. Other Activities


(year) 1988 1994 2000 2001 2002 2003 2004 2005

10000

1000

100

10

1

(Gflps)

NEC SX5

2000. 6

224Gflops

Fujitsu VPX 220

1995. 6

1.25Gflops

CRAY X1E

2005. 11

18.5Tflops

NEC SX5

2001.5

80Gflops

PC Cluster 128

2001.12

435.2Gflops

IBM P690

2002.1

665.6Gflops

IBM P690+

2003.7

3.7Tflops

TeraCluster

2004.1

2.9Tflops

NEC SX6

2003.6

160Gflops

CRAY T3E

1997.6

115Gflops

CRAY C90

1993.11

16Gflops

Cyber932

1988.

Cray-2S1988

2Gflops

F-LAM (77X63) 80km 15L

K-LAM (59X59) 40km 15L

KTM (109X109) 50km 8L

RDPS MM5 30km 10km, 5km 33L

GDPS T106 30L

GDPS T426 40L

GDPS T213 30L

ENSE T213 30L (32members)

ENSE T106 30L(17member)

1.History of NWP model & System at KMA

KISTI : Korea Institute of Science and Technology Information


Model Analysis ResolutionLead time

(Days)Remark

3dVarT213 (55km, 30

levels)10

Global Spectral Model

3dVarT106 (110km, 30

levels)10 17 Ensemble

(GDAPS) 3dOIT106 (110km, 21

levels)90 Ensemble

Regional Model

(RDAPS)3dOI/ 3dVar

30/ 10/ 5km (33 levels)

2 Triple Mesh

Typhoon Model (DBAR)

Bogus 20km (barotropic) 3 Typhoon Track

Wave Model 0.25° 2 Asian

1°× 1° 10 Global

Statistical Model

- 2 Temp, PoP

Models on operation at KMA


2.Plan of NWP Model Development2.Plan of NWP Model Development

Global Data AssimilationGlobal ModelEnsemble Prediction SystemWave and Ocean ModelRegional Data AssimilationRegional ModelTyphoon Model


Year Plan

2005

Consideration of Error of the day in 3dVar

Test operation of unified 3dVar (NCAR)

Incorporation of AMSU-A (AQUA)

Test operation of rain assl. Module

2006

Operation of unified 3dVar (NCAR)

Assl. of GPS (NCAR)

AIRS, AMSU-B, AMSR-E

2007 EnKF or 4dVar

Global Data Assimilation


Year Plan

2005Tuning of physics (convection, PBL, etc.)

Model comparison ( T426L40 & YOURS )

2006Operation of new global model (T426L40 or

YOURS)Tuning of physics

2007 L70

Global Model


Year Plan

2005

Global EPS with more than 32 members

L40

Regional EPS(TEST)

2006Ensemble Transform Kalman filter for regional

scale (10km)

2007 Test of ensemble Kalman filter with global model

Ensemble Prediction System


Year Plan

2004WW3 for global and regional domain

Test operation of SWAN (1/120 deg)

2005

Tuning of SWAN

Assimilation of ARGO

Development of ocean model (METRI)

2006 Test operation of ocean model (METRI)

2007 Tuning

Wave and ocean models


Year Plan

2005Tuning of assl. Modules for Quikscat, AWS, windprofiler, GOES TBB, ATOVS 1dVar

Test operation of rain assl module

2006 Operation of rain assl. module

2007 4dVar or EnKF

Regional Data Assimilation


Year Plan

2005

Test operation of WRF (10km L40) with unified 3dVar

Tuning of physics

Parallel run of MM5 and WRF

2006Operation of WRF (5km L40) and unified 3dVar

Tuning of physics

2007 Test of 1km L70 version

Regional Model


Year Plan

2005

Test operation of moving nest MM5

Tuning of bogus with 3dVar

Intensity forecast with global model (T426 or more)

2006 72 hr intensity forecast with global model

2007

Typhoon Model


NAS storage

Backup server

Pre-post server

GigabitSwitch2

GigabitSwitch1

SX-5/16ASX-5/16A

SX-5/12ASX-5/12A

Firewall

KREONET

KORENKMA Backbone 3F

3. 1st supercomputer system

IXS


RefRef NEC SX-5/16ANEC SX-5/16A NEC SX-5/12ANEC SX-5/12A

InstallationInstallation 1999.6.1999.6. 2000.10.2000.10.

CPUCPU 1616 1212

Peak performancePeak performance 128Gflops128Gflops 96Gflops96Gflops

Main Main

MemoryMemory128GB128GB 96GB96GB

CapacityCapacity of Raid diskof Raid disk

2.16 TByte2.16 TByte 1.62 TByte1.62 TByte

FunctionsFunctions- For NWP- For NWP OperationOperation

- Research & - Research & DevelopmentDevelopment

The specification of KMA 1st supercomputer system

StorageTek 14TB

SX-5


1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39

1 1

2 2

3 3

4 4

5 5

6 6

7 7

8 8

9 9

10 10

11 11

12 12

13 13

14 14

15 15

16 16

17 17

18 18

19 19

20 20

21 21

22 22

23 23

24 24

25 25

26 26

27 27

28 28

29 29

30 30

31 31

32 32

33 33

34 34

35 35

36 36

37 37

38 38

39 39

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39

HQ Floor LayoutHQ Floor Layout

Cooling공조실

항온항습

실

Enterprise5500

8400 백업장치

AlpaServer 8400

LC2 NR2 LC1

통신 Rack

Netappliance F820C

전후처리서버 APPRO

기둥

기둥기둥

HP Superdome

Disk Array

배전반

SUN Ultra 60

FEPIOX

IOX1

IOX consol

StorageTek

ACSLS

SX-5/12A

SX-5/16A

SX-4/2A

통신 RackDisk Array(SX-4) IXS

분전반

분전

반

커 텐

복 도

DISK Array (SX-5)

NCOMIS 용모니터링

수치예보용모니터링

Primepower450EMC disk

GR7000F

Raid Disk

NT Server LXr800

0

AlphaServer GS160

Q9.140Tape 장치

ML750

EMCDisk

GS160

커 텐

커 텐

커 텐

60×60 cm

기후자료지원

후지쯔TX600TX200

EMC disk

SUNFire V880

Digital WX System

Valcretec

정보통신센터슈퍼컴센터

정보화담당관실수치예보과 (

김정훈 )원격탐사과디지털예보기술개발단예보연구실 기후예측과

후지쯔 Alteon 184

후지쯔 primepower 400


Regional H.Q.

WX Stations

WX Obs.

Super Computer

GigabitBack borne

COMIS & GTSServer

Station WXServerD/B Server Numerical Weather

ServerSatelliteServer

Relation agenciesServer WAFS

EarthquakeAnalysisServer

ThunderstormAnalysisServer

RadarAnalysisServer

firewallSuper Highway

(2Mbps~45Mbps)

MeteorologicalRadio Transmission

Station

BroadcastServer

Internet

InternetServer

firewall

PublicWeatherServer

IntranetServer

Government Network

100Mbps

Earthquakes(107)

FAX.Voice(94)

Thunderstorm(20)

AWS(607)

Telephone(94)

RADAR(9

Videoconferencing(9)

Buoy(5)

CCTV(12)

KMA Systems firewallKOREN,

KREONET

GTS(Beijing, Tokyo)

Worldwide

Each

1 Gbps

45Mbps

DWDM4Gbps

IDC 2nd Supercomputer


4. 2nd supercomputer system (Initial)


2nd Supercomputer System(Final)

baram

Shinbaram


RefRef CRAY X1ECRAY X1E

InstallationInstallation 2005. 112005. 11

CPUCPU 1024 MSP 1024 MSP

Peak performancePeak performance 18.5 TF18.5 TF

Main MemoryMain Memory 4 TB4 TB

Capacity of DAS DiskCapacity of DAS Disk 67 TB67 TB

Capacity of SAN DiskCapacity of SAN Disk 21 TB21 TB

Capacity of Tape driveCapacity of Tape drive 1 PB1 PB

FunctionsFunctionsFor NWP Operation For NWP Operation Research & DevelopmentResearch & Development

The specification of KMA 2nd supercomputer system

CRAY X1E

ADIC Scalar 10K 1PB


Internet Data Center


2005.9.10


5.Issues and Plan5.Issues and Plan

Needs more space, cooling and power -> New building for next system(2009)Job Scheduling and failover including DR -> SMS, developing the best way and KISTIData Management -> 2005 Pilot Project initiated -> 2006 System replacement for distributed

Data Integration (storage pool) 2007 extra budget for reinforcement


KMAHQ

KMAKIDC

HONGHONGKONGKONG

SEATTLESEATTLESEOULSEOUL

DAEJEONDAEJEON

TEIN 155Mbps

Japan 2.2Gbps

(USA 1.2Gbps)

China 310Mbps

KOREN

GLORIAD

10Gbps

GLORIAD

10Gbps

4Gbps

6.Other Activities - High Performance network


http://dfsweb.kma.go.kr

1. Generate 5km grid from NWP output

3. Distribute digital forecast contents from DB system

2. Get 5km digital forecast grids

DFSDB

TE

XT

IMAGE G

RAPHIC

TIME-SERIES

TABULAR

VOICEGEM

MOS/PPM

GR

ID-P

OIN

T

KMA Digital Weather Forecast Service


Supporting Research Community (VPN &GRID)

VPN

APCC PC

ROKAF PC

Internet

intranet

DMZ

other PC

UNICORE Gateway

UNICORE & PBS

V

P

N

DWD

APCC : Asia Pacific Climate CenterROKAF : Republic of Korean Air Force


Grid, e-Science and user supportsGrid, e-Science and user supports

National Grid ProjectE-Science projectHigh Performance Network (BcN project)Application Programmers and system

analysis expert supported by CrayKMA-Cray ESRC ( ex. Workshop on

performance 32-/64bit precision operational models )


Thank you Thank you

2005. 9


KMA System Upgrade

Documents

Transcript of KMA System Upgrade