Extensions to the ETICS Build System Client Allowing Porting to Multiple Platforms at Local Sites

15
EGEE-II INFSO-RI- 031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Extensions to the ETICS Build System Client Allowing Porting to Multiple Platforms at Local Sites Presenter: Eamonn Kenny Institution: Trinity College Dublin Location: CGW, Krakow

description

Extensions to the ETICS Build System Client Allowing Porting to Multiple Platforms at Local Sites. Presenter:Eamonn Kenny Institution:Trinity College Dublin Location:CGW, Krakow. Current Status & Enhancements. WN. UI. UI. WN. prod. prod. prod. prod. cert. cert. cert. cert. - PowerPoint PPT Presentation

Transcript of Extensions to the ETICS Build System Client Allowing Porting to Multiple Platforms at Local Sites

Page 1: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

EGEE-II INFSO-RI-031688

Enabling Grids for E-sciencE

www.eu-egee.org

EGEE and gLite are registered trademarks

Extensions to the ETICS Build System Client Allowing

Porting to Multiple Platformsat Local Sites

Presenter: Eamonn Kenny

Institution: Trinity College Dublin

Location: CGW, Krakow

Page 2: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 2

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Current Status & Enhancements

Description ETICS Support Current TCD Support

Patching System No Yes

Environment variables (platform specific)

Supported Dynamic Support

Differing dependencies and naming conventions

Supported Dynamic Support

Reporting Automatic Automatic grouping

per platform

Secure Building Remote building

(no proxy support)

Local Building with proxy

Support

HEAD, Production, Certification builds

HEAD only HEAD and Production

Page 3: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 3

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 1: Rollback Builds

prod

WN

cert prod

UI

cert

SA3 Deployment Lists

JRA1 Middleware

CVS Repository

Nightly Build on HEAD

ETICS Build Rules

Artifact Repository

Yum Repositories

prod

WN

cert prod

UI

cert

SA3 Deployment Lists

JRA1 Middleware

CVS Repository

ETICS Build

Build Rules

Artifact Repository

Yum Repositories

Meta Package Building (to come in ETICS)

Build Production, Certification & HEAD WN

Local

Builds

1

2

3

1

2

3

Page 4: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 4

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 2: Firewalls & Proxies

cvs, wget, ZSI

Web Server

Repository

cern.chgLite repository

AIX, Mac. em64tBuild Machines

rsync(cron)

CentOS 4.5, CentOS 5.0, SL 3.0.8, SuSE 9.3VM Build Machine

yum/apt/tarballs

rsync (cron)

*

1

ssh

ssh

Worker NodesVM Test WNs

3

TestGrid Subnet

computer scienceFirewall

http/httpscvs proxies

1

web-pages, xml reports,RPMs, tarballs

cern.chETICS interface

XML reportsRPMs, tarballs

Page 5: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 5

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Multiple Platform: XML Schema

Page 6: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 6

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Multiple Platform: XML Schema

Page 7: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 7

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 3: Differing Modules

Page 8: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 8

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 4: Patching System

Page 9: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 9

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 4: Patching System (bash)

Page 10: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 10

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 4: Patching System (sed)

Page 11: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 11

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 4: Patching System (patch)

Page 12: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 12

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 5: Platform Specific Variables

Page 13: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 13

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 6: Automatic Result Grouping

Page 14: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 14

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Issue 6: Automatic Result Grouping

Page 15: Extensions to the ETICS Build System Client Allowing  Porting to Multiple Platforms at Local Sites

ETICS in TCD 15

Enabling Grids for E-sciencE

EGEE-II INFSO-RI-031688

Current & Future Work

• Inclusion of VDT globus source code in ETICS• Complete a 10 step guide to porting:

https://twiki.cern.ch/twiki/bin/view/EGEE/EGEEPortingGuide

• Helping other partners with Debian x86/x86_64 ports• Help ETICS developers with development of an etics-

patch command• Work starting on SuSE 9.3 (x86_64), CentOS 4.5/5.0

(x86_64), Mac OS X 10.4 (PowerPC)