European Southern Observatory: Implementing Day CQ5 at ESO

@ ESO

Part II Implementing Day CQ5 at ESO

Rein Warmels Cristina Garcia de Juan

Warmels, Gracia de Juan | Day Ignite 3 – 4 November . 2010 | 2

@ ESO

ESO Overview

•  Headquarters in Garching/Munich. Observatories in Chile: Paranal, La Silla, Chajnantor and …?

•  Budget 160 M Euro per year. •  Personnel ~720 Staff (International and Local) •  Foremost intergovernmental astronomy organization in

Europe and the world’s most productive astronomical observatory.

•  Supported by Austria, Belgium, the Czech Republic, Denmark, Finland, France, Germany, Italy, the Netherlands, Portugal, Spain, Sweden, Switzerland and the United Kingdom.

ESO, the European Southern Observatory, builds and operates a suite of the world's most advanced ground-based astronomical telescopes


@ ESO

Sites and Locations


@ ESO


@ ESO

Core Activities

Operations – Development – Science

•  3 + 4++ Telescopes •  3 + 12++ Instruments •  Data Calibration •  Quality Control

•  Instrument Monitoring •  Maintenance •  Development and Upgrades

Service Observing Telescopes and Instruments

•  In Garching and at the Observatories

•  1,800 Proposals per year •  1,000 Observing Runs p/y

•  Currently 65 TBytes •  Growth rate 15 Tbytes p/y •  After 2013 150 TBytes

per year •  10,000 data requests per year

Observing User Support

Archive Operations – Virtual Observatory


@ ESO

ESO Web Operations

Statistics (www.eso.org only):

•  1 Gbps incoming, 300 Mbps outgoing; Backbone 10 Gbps •  30+ servers, mostly Dell Blades (Linux), VMware virtual

servers •  50+ Web sites •  ~ 80 IP addresses for Web related servers •  Pages

•  > 100,000 HTML pages •  > 10,000 pdf files

•  Visits: •  ~ 50,000,000 hits/month •  ~ 5,000,000 page views/month

•  Transfer > ~ 1 Pbytes/year (excl. Science Archive)


@ ESO

CQ Project Goals

Replace the old authoring and publishing procedures and systems. Migrate the content from the old system to CQ

Explore and Install CQ functionalities to substantially ease authoring.

System, User and Content Management overheads

Easy to Use (non-technical staff)

Enforce standards

Support Efforts

Reduce

ESO Common Look and Feel Central Control

Content Structure Syndication and Synergies Bind Scripts and Applications

Reorganize and streamline


@ ESO

Initial Conditions •  Large fraction of content

operations critical •  Maintenance intense •  High Support needs •  Competing development

activities in the Organization

Operations and Maintenance

•  Static and dynamic •  HTML, PHP •  Perl, Java, Shell, Javascript, …

•  Small (and rather) CMS Solutions

•  Propriety and home-build applications

•  Different formats and layouts

•  Images, images, images, images, … videos, pdfs, …

Content and Assets

•  No CQ Knowledge •  Limited manpower •  Many delays in the past:

Loss of credit and authors confidence

WoMen Power and Knowledge


@ ESO

Constraints Budget limitations = Hw/Sw Limitations

Without DAM License

Without Clustering

2 Instances


@ ESO

Boundary Conditions Limited Budget – Limited Staffing

No interruption of critical operations and services (Observing!)

Continue operations, maintenance and support of old system

Moderate changes of content structure

TIME


@ ESO

Approaches & Methods

•  Basic Project/Implementation Plan •  No large documentation efforts: TWiki-based •  Rapid Prototyping – Continuous testing on users •  Split the migration in packages

Be Pragmatic

•  Short communication lines •  Regular meetings

(Project Team, Steering Committee, Users) •  Make future authors/users part of the project

Communications

Philosophy


@ ESO

Project Organisation

Project Steering Committee •  Chairperson •  Stakeholders

WoManPower

User/Authors •  Testers •  Validation

Project Team (4) •  Architecture •  Design •  Development •  Migration •  Testing •  Administration •  Training •  Support •  Management


@ ESO

Project Stages

Phase I

Getting Started

•  Project Organization •  Stakeholders Meetings

(Project Board) •  Basic Project Plan •  Basic Risk Analysis •  Authors Demonstration

Phase II

Analysis

•  Architecture Analysis •  CQ Architectural Design •  Layout and Content

Analysis •  Review Authors

Requirements


@ ESO

ESO Agile Approach

Architecture Vision

Architecture Agreement

PHP App. and CQ5 Live together

CQ5 PHP PHP PHP PHP


@ ESO

Internet Users Intranet Users

Load Balancer

Publish Side

PHP

COLD/StandBy


@ ESO

Project Stages

Phase III

Proto-typing

•  Hardware and Software Configuration (Production / Testing)

•  Development Component and Templates

•  Prototype Look and Feel

•  Demonstrations and Feedback

Phase IV

Migration I – N

•  Clearly defined content •  Well defined in

time and efforts •  Tailored migration script

and development efforts •  User Interaction!


@ ESO

Migration


@ ESO

Migration Process

Content Analysis

Migration Validation

Deployment

Development

Old System

Training

Users


@ ESO

Migration Iterative Cycle - 3 Months •  Content Analysis and Migration Package Definition •  Migration Package Tuning •  Creation of mirrors (curl commands) •  Automated Migration: Parsing HTML

and mapping site structures •  Agreement: migration in 95% of the site

content to Rich Text Edit Component •  Risk: Performance on client side

•  Quality Check •  Training and additional Support •  Configuration and Performance Check •  Deployment •  Migration Package Going Live


@ ESO

Technical Challenges

Handling with Links, Navigation and Sitemap •  Dispatcher and Load Balancer Configuration

(URL Mapping) •  Rewrite & Redirect Rules •  Vanity URLs •  "Blank" Pages on CQ side

Import of Digital Assets

Activation Queues after Migration

Performance issues

Disable certain DAM Workflow instantiations

Process improvement and planning

Migration to CRX 2.1, Performance Packages


@ ESO

•  CQ Installed, Hardware and Software configured Fully operational and living in harmony with old system

•  Implementation L&F and Styles completed •  Three Migration Packages released •  Demonstrations and Trainings provided, Support in place

Achievements and Status – Nine months

•  Migration of small packages •  The Observatories (Chile) •  Inclusion of data bases (SQL) •  SSO and LDAP server implementation

Outlook

Conclusions


@ ESO

European Southern Observatory: Implementing Day CQ5 at ESO

Technology

Transcript of European Southern Observatory: Implementing Day CQ5 at ESO