Information Grid Services in the Polish Optical Internet PIONIER Cezary Mazurek, Maciej Stroiński,...

Information Grid Services in the Information Grid Services in the Polish Optical Internet PIONIERPolish Optical Internet PIONIER

Cezary Mazurek, Maciej Stroiński, Jan Węglarz

Presentation PlanPresentation Plan

• PIONIER and Information Grids

• Digital Library Services

• Streaming Media Services

• Other Services

• Architecture for Information Grid

• Application examples

PIONIER and Information GridsPIONIER and Information Grids

• Grid initiatives in Poland and around the world succeeded in developing and deploying different grid components

• The driving force for the development of such a next generation computing infrastructure are scientific applications

• Emergent information (i.e. digital content) environments must take an advantage of grid services and tools to enable efficient information management and access

PIONIER and Information GridsPIONIER and Information Grids

• Within the PIONIER Programme there has been realized several systems in the area of information and digital content – Digital Library Framework– Audio Streaming System– Data Management System– Interactive TV

Digital Library Services in PIONIERDigital Library Services in PIONIER


• Digital Libraries are based on dLibra DL Framework

• dLibra is the PIONIER Digital Library Framework• Developed in PSNC since 1999• Now deployed in

– Wielkopolska Digital Library (10.2002)

– Wroclaw University of Technology Digital Library (11.2004)

– Four other installations in different Polish universities


• Multitier, distributed and portable DL platform• Support for multiple content types• Hierarchic collections• Resources versioning• Advanced support for resources’ metadata

(DublinCore, MARC, RDF)• Multiple searching mechanism• Extended access management (LDAP, Single

Sign-On)


• Each service can be deployed on different host• Services does not need to know their locations• Services can send and receive events• Services implementations can be easily replaced• Services can access each other (if authorized)• External services can access DL system (if

authorized)– Via dLibra interfaces with Java RMI

– Via OAI-PMH

Streaming Media ServicesStreaming Media Services

• Audio Steaming– 12 servers– 10 locations– 14 stations– 40 streams


• Streaming server: Icecast2 with streams relaying

• Brokered services– User redirection to best server, based on:

• availability streams on server

• current load on server

• distance to user

– Topology network gathering – from BGP


• Radio stations: 12

• Events: 2– Football Match – weekly

– National Youth Christian Meeting – Lednica 2005


About 700-900 average listeners.

Maximum so far – above 1200 simultaneous listeners


• TOK FM – news station

Other servicesOther services

• Data Management Services (PROGRESS)

• Content Distribution Services (iTVP)

iTVP ServicesiTVP Services

• content distribution and delivery– live, VOD, nVOD

– content replication, migration and removal

• request routing– allows to direct users to best proxy/cache servers

– supports load balancing

– authentication and authorisation

• monitoring– system load and status

– critical events identification and logging

– parameters: CPU load, free memory, network interfaces load, discs load and free space,

– active distribution and delivery transactions

• reporting– active and passive data gathering

– provides reports on system usage and errors

• system management

PIONIER Information GridPIONIER Information Grid

• Services provided by the mentioned systems enabled within the Information Grid architecture allow to construct more advanced information applications and its access from specialized portals


• Services are grouped within service provider layer• Content management services are independent of

computational resources management services• Every system provides brokerage service which

manages its resources (e.g. information management or content delivery)

• Service provider communicates with many brokers and provides abstractive descriptors for objects (also complex processes) managed by high-level services


• Broker’s tasks– Access interface to Information Grid Services– Enables the task handling in an efficient way

also by management services for distributed resources

– Communicates with other brokers to pass them the specifications of tasks which should/might be performed in different subsystem

PIONIER Information Grid ArchitecturePIONIER Information Grid Architecture

Computing

Grid

Grid Data

Management

System

Distributed

Digital

Library

Content

Delivery

System

Grid

Resource

Broker

Data

Broker

Library

Broker

Delivery

Broker

Grid Service

Provider

Telemedicine

Service

Provider

Digital Library

Service

Provider

iTVP Service

Provider

Computing Portal iTVP PortalDigital Library

Portal

Telemedicine

Portal

PIONIER Information Grid ArchitecturePIONIER Information Grid Architecture

Examples of Information Grid ApplicationsExamples of Information Grid Applications

• Bioinformatics computational applications

• Telemedicine applications

• Education and Learning

• Hosting services for SMEs

• Virtual Laboratory

• ....

Grid DataManagement

System

DistributedDigitalLibrary

ContentDeliverySystem

TelemedicineServiceProvider

DataBroker

LibraryBroker

DeliveryBroker

TelemedicinePortal

Access to applications in PIONIER Information Access to applications in PIONIER Information Grid Grid

Data Management System

Grid ServiceProvider




Portlet Framework Portlet FrameworkPortlet Framework Portlet Framework

Portlets PortletsPortlets Portlets PortletsPortletsPortlets PortletsPortlets Portlets PortletsPortlets

Specializedportal

Educationportal

Computingportal

Specializedportal

Educationportal

Computingportal

Specializedportal

Educationportal

Computingportal

Specializedportal

Educationportal

Computingportal

Shared Grid InfrastructureShared Grid Infrastructure

Data BrokerData Broker Data BrokerData Broker

Campus 1 Campus 2Campus 1 Campus 2

ConclusionConclusion

• Services for content management and delivery must be integrated and managed in the grid-like structure because it allows:– grid constructors, the grid specialization in information

access and management– application developers, to use general services in

content management and delivery– portal constructors, to use an integrated service and

content environments for an efficient access to distributed information

– operators, to build more complex application scenarios based on PIONIER Information Grid Services

Thank you!Thank you!

Cezary Mazurek

[email protected]

Information Grid Services in the Polish Optical Internet PIONIER Cezary Mazurek, Maciej Stroiński,...

Documents

Transcript of Information Grid Services in the Polish Optical Internet PIONIER Cezary Mazurek, Maciej Stroiński,...